00:00:00.001 Started by upstream project "autotest-nightly-lts" build number 2009 00:00:00.001 originally caused by: 00:00:00.001 Started by upstream project "nightly-trigger" build number 3270 00:00:00.001 originally caused by: 00:00:00.001 Started by timer 00:00:00.079 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.080 The recommended git tool is: git 00:00:00.080 using credential 00000000-0000-0000-0000-000000000002 00:00:00.082 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.109 Fetching changes from the remote Git repository 00:00:00.113 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.150 Using shallow fetch with depth 1 00:00:00.150 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.150 > git --version # timeout=10 00:00:00.202 > git --version # 'git version 2.39.2' 00:00:00.202 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.243 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.243 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:05.309 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:05.322 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:05.333 Checking out Revision 9bf0dabeadcf84e29a3d5dbec2430e38aceadf8d (FETCH_HEAD) 00:00:05.333 > git config core.sparsecheckout # timeout=10 00:00:05.344 > git read-tree -mu HEAD # timeout=10 00:00:05.360 > git checkout -f 9bf0dabeadcf84e29a3d5dbec2430e38aceadf8d # timeout=5 00:00:05.382 Commit message: "inventory: add WCP3 to free inventory" 00:00:05.382 > git rev-list --no-walk 9bf0dabeadcf84e29a3d5dbec2430e38aceadf8d # timeout=10 00:00:05.455 [Pipeline] Start of Pipeline 00:00:05.466 [Pipeline] library 00:00:05.467 Loading library shm_lib@master 00:00:05.467 Library shm_lib@master is cached. Copying from home. 00:00:05.484 [Pipeline] node 00:00:05.496 Running on GP11 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:05.497 [Pipeline] { 00:00:05.508 [Pipeline] catchError 00:00:05.509 [Pipeline] { 00:00:05.522 [Pipeline] wrap 00:00:05.530 [Pipeline] { 00:00:05.536 [Pipeline] stage 00:00:05.537 [Pipeline] { (Prologue) 00:00:05.746 [Pipeline] sh 00:00:06.024 + logger -p user.info -t JENKINS-CI 00:00:06.046 [Pipeline] echo 00:00:06.048 Node: GP11 00:00:06.054 [Pipeline] sh 00:00:06.352 [Pipeline] setCustomBuildProperty 00:00:06.361 [Pipeline] echo 00:00:06.363 Cleanup processes 00:00:06.370 [Pipeline] sh 00:00:06.653 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:06.653 1303391 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:06.664 [Pipeline] sh 00:00:06.942 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:06.942 ++ grep -v 'sudo pgrep' 00:00:06.942 ++ awk '{print $1}' 00:00:06.942 + sudo kill -9 00:00:06.942 + true 00:00:06.953 [Pipeline] cleanWs 00:00:06.961 [WS-CLEANUP] Deleting project workspace... 00:00:06.961 [WS-CLEANUP] Deferred wipeout is used... 00:00:06.967 [WS-CLEANUP] done 00:00:06.970 [Pipeline] setCustomBuildProperty 00:00:06.981 [Pipeline] sh 00:00:07.258 + sudo git config --global --replace-all safe.directory '*' 00:00:07.322 [Pipeline] httpRequest 00:00:07.353 [Pipeline] echo 00:00:07.354 Sorcerer 10.211.164.101 is alive 00:00:07.360 [Pipeline] httpRequest 00:00:07.364 HttpMethod: GET 00:00:07.364 URL: http://10.211.164.101/packages/jbp_9bf0dabeadcf84e29a3d5dbec2430e38aceadf8d.tar.gz 00:00:07.365 Sending request to url: http://10.211.164.101/packages/jbp_9bf0dabeadcf84e29a3d5dbec2430e38aceadf8d.tar.gz 00:00:07.381 Response Code: HTTP/1.1 200 OK 00:00:07.382 Success: Status code 200 is in the accepted range: 200,404 00:00:07.382 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_9bf0dabeadcf84e29a3d5dbec2430e38aceadf8d.tar.gz 00:00:29.331 [Pipeline] sh 00:00:29.618 + tar --no-same-owner -xf jbp_9bf0dabeadcf84e29a3d5dbec2430e38aceadf8d.tar.gz 00:00:29.635 [Pipeline] httpRequest 00:00:29.660 [Pipeline] echo 00:00:29.662 Sorcerer 10.211.164.101 is alive 00:00:29.670 [Pipeline] httpRequest 00:00:29.674 HttpMethod: GET 00:00:29.675 URL: http://10.211.164.101/packages/spdk_4b94202c659be49093c32ec1d2d75efdacf00691.tar.gz 00:00:29.675 Sending request to url: http://10.211.164.101/packages/spdk_4b94202c659be49093c32ec1d2d75efdacf00691.tar.gz 00:00:29.691 Response Code: HTTP/1.1 200 OK 00:00:29.691 Success: Status code 200 is in the accepted range: 200,404 00:00:29.692 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_4b94202c659be49093c32ec1d2d75efdacf00691.tar.gz 00:01:15.972 [Pipeline] sh 00:01:16.265 + tar --no-same-owner -xf spdk_4b94202c659be49093c32ec1d2d75efdacf00691.tar.gz 00:01:18.806 [Pipeline] sh 00:01:19.090 + git -C spdk log --oneline -n5 00:01:19.090 4b94202c6 lib/event: Bug fix for framework_set_scheduler 00:01:19.090 507e9ba07 nvme: add lock_depth for ctrlr_lock 00:01:19.090 62fda7b5f nvme: check pthread_mutex_destroy() return value 00:01:19.090 e03c164a1 nvme: add nvme_ctrlr_lock 00:01:19.090 d61f89a86 nvme/cuse: Add ctrlr_lock for cuse register and unregister 00:01:19.102 [Pipeline] } 00:01:19.122 [Pipeline] // stage 00:01:19.132 [Pipeline] stage 00:01:19.134 [Pipeline] { (Prepare) 00:01:19.156 [Pipeline] writeFile 00:01:19.172 [Pipeline] sh 00:01:19.456 + logger -p user.info -t JENKINS-CI 00:01:19.468 [Pipeline] sh 00:01:19.752 + logger -p user.info -t JENKINS-CI 00:01:19.764 [Pipeline] sh 00:01:20.049 + cat autorun-spdk.conf 00:01:20.049 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:20.049 SPDK_TEST_NVMF=1 00:01:20.049 SPDK_TEST_NVME_CLI=1 00:01:20.049 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:20.049 SPDK_TEST_NVMF_NICS=e810 00:01:20.049 SPDK_RUN_UBSAN=1 00:01:20.049 NET_TYPE=phy 00:01:20.056 RUN_NIGHTLY=1 00:01:20.063 [Pipeline] readFile 00:01:20.098 [Pipeline] withEnv 00:01:20.100 [Pipeline] { 00:01:20.116 [Pipeline] sh 00:01:20.402 + set -ex 00:01:20.402 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:01:20.402 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:20.402 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:20.402 ++ SPDK_TEST_NVMF=1 00:01:20.402 ++ SPDK_TEST_NVME_CLI=1 00:01:20.402 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:20.402 ++ SPDK_TEST_NVMF_NICS=e810 00:01:20.402 ++ SPDK_RUN_UBSAN=1 00:01:20.402 ++ NET_TYPE=phy 00:01:20.402 ++ RUN_NIGHTLY=1 00:01:20.402 + case $SPDK_TEST_NVMF_NICS in 00:01:20.402 + DRIVERS=ice 00:01:20.402 + [[ tcp == \r\d\m\a ]] 00:01:20.402 + [[ -n ice ]] 00:01:20.402 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:01:20.402 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:01:20.402 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:01:20.402 rmmod: ERROR: Module irdma is not currently loaded 00:01:20.402 rmmod: ERROR: Module i40iw is not currently loaded 00:01:20.402 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:01:20.402 + true 00:01:20.402 + for D in $DRIVERS 00:01:20.402 + sudo modprobe ice 00:01:20.402 + exit 0 00:01:20.413 [Pipeline] } 00:01:20.433 [Pipeline] // withEnv 00:01:20.437 [Pipeline] } 00:01:20.448 [Pipeline] // stage 00:01:20.454 [Pipeline] catchError 00:01:20.455 [Pipeline] { 00:01:20.467 [Pipeline] timeout 00:01:20.467 Timeout set to expire in 50 min 00:01:20.469 [Pipeline] { 00:01:20.481 [Pipeline] stage 00:01:20.482 [Pipeline] { (Tests) 00:01:20.495 [Pipeline] sh 00:01:20.781 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:20.781 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:20.781 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:20.781 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:01:20.781 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:20.781 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:20.781 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:01:20.781 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:20.781 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:20.781 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:20.781 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:01:20.781 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:20.781 + source /etc/os-release 00:01:20.781 ++ NAME='Fedora Linux' 00:01:20.781 ++ VERSION='38 (Cloud Edition)' 00:01:20.781 ++ ID=fedora 00:01:20.781 ++ VERSION_ID=38 00:01:20.781 ++ VERSION_CODENAME= 00:01:20.781 ++ PLATFORM_ID=platform:f38 00:01:20.781 ++ PRETTY_NAME='Fedora Linux 38 (Cloud Edition)' 00:01:20.781 ++ ANSI_COLOR='0;38;2;60;110;180' 00:01:20.781 ++ LOGO=fedora-logo-icon 00:01:20.781 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:38 00:01:20.781 ++ HOME_URL=https://fedoraproject.org/ 00:01:20.781 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f38/system-administrators-guide/ 00:01:20.781 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:01:20.781 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:01:20.781 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:01:20.781 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=38 00:01:20.781 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:01:20.781 ++ REDHAT_SUPPORT_PRODUCT_VERSION=38 00:01:20.781 ++ SUPPORT_END=2024-05-14 00:01:20.781 ++ VARIANT='Cloud Edition' 00:01:20.781 ++ VARIANT_ID=cloud 00:01:20.781 + uname -a 00:01:20.781 Linux spdk-gp-11 6.7.0-68.fc38.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jan 15 00:59:40 UTC 2024 x86_64 GNU/Linux 00:01:20.781 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:01:21.723 Hugepages 00:01:21.723 node hugesize free / total 00:01:21.723 node0 1048576kB 0 / 0 00:01:21.723 node0 2048kB 0 / 0 00:01:21.723 node1 1048576kB 0 / 0 00:01:21.723 node1 2048kB 0 / 0 00:01:21.723 00:01:21.723 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:21.723 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:01:21.723 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:01:21.723 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:01:21.723 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:01:21.723 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:01:21.723 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:01:21.723 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:01:21.723 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:01:21.723 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:01:21.723 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:01:21.723 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:01:21.723 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:01:21.723 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:01:21.723 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:01:21.723 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:01:21.723 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:01:21.723 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:01:21.723 + rm -f /tmp/spdk-ld-path 00:01:21.723 + source autorun-spdk.conf 00:01:21.723 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:21.723 ++ SPDK_TEST_NVMF=1 00:01:21.723 ++ SPDK_TEST_NVME_CLI=1 00:01:21.723 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:21.723 ++ SPDK_TEST_NVMF_NICS=e810 00:01:21.723 ++ SPDK_RUN_UBSAN=1 00:01:21.723 ++ NET_TYPE=phy 00:01:21.723 ++ RUN_NIGHTLY=1 00:01:21.723 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:21.723 + [[ -n '' ]] 00:01:21.723 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:21.723 + for M in /var/spdk/build-*-manifest.txt 00:01:21.723 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:21.723 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:21.723 + for M in /var/spdk/build-*-manifest.txt 00:01:21.723 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:21.723 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:21.723 ++ uname 00:01:21.723 + [[ Linux == \L\i\n\u\x ]] 00:01:21.723 + sudo dmesg -T 00:01:21.723 + sudo dmesg --clear 00:01:21.723 + dmesg_pid=1304690 00:01:21.723 + [[ Fedora Linux == FreeBSD ]] 00:01:21.723 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:21.723 + sudo dmesg -Tw 00:01:21.723 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:21.723 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:21.724 + [[ -x /usr/src/fio-static/fio ]] 00:01:21.724 + export FIO_BIN=/usr/src/fio-static/fio 00:01:21.724 + FIO_BIN=/usr/src/fio-static/fio 00:01:21.724 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:21.724 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:21.724 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:21.724 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:21.724 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:21.724 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:21.724 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:21.724 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:21.724 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:21.724 Test configuration: 00:01:21.724 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:21.724 SPDK_TEST_NVMF=1 00:01:21.724 SPDK_TEST_NVME_CLI=1 00:01:21.724 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:21.724 SPDK_TEST_NVMF_NICS=e810 00:01:21.724 SPDK_RUN_UBSAN=1 00:01:21.724 NET_TYPE=phy 00:01:21.724 RUN_NIGHTLY=1 08:40:10 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:21.724 08:40:10 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:21.724 08:40:10 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:21.724 08:40:10 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:21.724 08:40:10 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:21.724 08:40:10 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:21.724 08:40:10 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:21.724 08:40:10 -- paths/export.sh@5 -- $ export PATH 00:01:21.724 08:40:10 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:21.724 08:40:10 -- common/autobuild_common.sh@434 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:21.724 08:40:10 -- common/autobuild_common.sh@435 -- $ date +%s 00:01:21.724 08:40:10 -- common/autobuild_common.sh@435 -- $ mktemp -dt spdk_1721025610.XXXXXX 00:01:21.724 08:40:10 -- common/autobuild_common.sh@435 -- $ SPDK_WORKSPACE=/tmp/spdk_1721025610.5rPZsb 00:01:21.724 08:40:10 -- common/autobuild_common.sh@437 -- $ [[ -n '' ]] 00:01:21.724 08:40:10 -- common/autobuild_common.sh@441 -- $ '[' -n '' ']' 00:01:21.724 08:40:10 -- common/autobuild_common.sh@444 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:01:21.724 08:40:10 -- common/autobuild_common.sh@448 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:01:21.724 08:40:10 -- common/autobuild_common.sh@450 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:01:21.724 08:40:10 -- common/autobuild_common.sh@451 -- $ get_config_params 00:01:21.724 08:40:10 -- common/autotest_common.sh@387 -- $ xtrace_disable 00:01:21.724 08:40:10 -- common/autotest_common.sh@10 -- $ set +x 00:01:21.724 08:40:10 -- common/autobuild_common.sh@451 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:01:21.724 08:40:10 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:21.724 08:40:10 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:21.724 08:40:10 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:21.724 08:40:10 -- spdk/autobuild.sh@16 -- $ date -u 00:01:21.724 Mon Jul 15 06:40:10 AM UTC 2024 00:01:21.724 08:40:10 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:21.724 LTS-59-g4b94202c6 00:01:21.724 08:40:10 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:21.724 08:40:10 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:21.724 08:40:10 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:21.724 08:40:10 -- common/autotest_common.sh@1077 -- $ '[' 3 -le 1 ']' 00:01:21.724 08:40:10 -- common/autotest_common.sh@1083 -- $ xtrace_disable 00:01:21.724 08:40:10 -- common/autotest_common.sh@10 -- $ set +x 00:01:21.724 ************************************ 00:01:21.724 START TEST ubsan 00:01:21.724 ************************************ 00:01:21.724 08:40:10 -- common/autotest_common.sh@1104 -- $ echo 'using ubsan' 00:01:21.724 using ubsan 00:01:21.724 00:01:21.724 real 0m0.000s 00:01:21.724 user 0m0.000s 00:01:21.724 sys 0m0.000s 00:01:21.724 08:40:10 -- common/autotest_common.sh@1105 -- $ xtrace_disable 00:01:21.724 08:40:10 -- common/autotest_common.sh@10 -- $ set +x 00:01:21.724 ************************************ 00:01:21.724 END TEST ubsan 00:01:21.724 ************************************ 00:01:21.984 08:40:10 -- spdk/autobuild.sh@27 -- $ '[' -n '' ']' 00:01:21.984 08:40:10 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:01:21.984 08:40:10 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:01:21.984 08:40:10 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:01:21.984 08:40:10 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:01:21.984 08:40:10 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:01:21.984 08:40:10 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:01:21.984 08:40:10 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:01:21.984 08:40:10 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-shared 00:01:21.984 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:01:21.984 Using default DPDK in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:22.244 Using 'verbs' RDMA provider 00:01:32.489 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:01:42.461 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:01:42.461 Creating mk/config.mk...done. 00:01:42.461 Creating mk/cc.flags.mk...done. 00:01:42.461 Type 'make' to build. 00:01:42.461 08:40:30 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:01:42.461 08:40:30 -- common/autotest_common.sh@1077 -- $ '[' 3 -le 1 ']' 00:01:42.461 08:40:30 -- common/autotest_common.sh@1083 -- $ xtrace_disable 00:01:42.461 08:40:30 -- common/autotest_common.sh@10 -- $ set +x 00:01:42.461 ************************************ 00:01:42.461 START TEST make 00:01:42.461 ************************************ 00:01:42.461 08:40:30 -- common/autotest_common.sh@1104 -- $ make -j48 00:01:42.752 make[1]: Nothing to be done for 'all'. 00:01:50.894 The Meson build system 00:01:50.894 Version: 1.3.1 00:01:50.894 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk 00:01:50.894 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp 00:01:50.894 Build type: native build 00:01:50.894 Program cat found: YES (/usr/bin/cat) 00:01:50.894 Project name: DPDK 00:01:50.894 Project version: 23.11.0 00:01:50.894 C compiler for the host machine: cc (gcc 13.2.1 "cc (GCC) 13.2.1 20231011 (Red Hat 13.2.1-4)") 00:01:50.894 C linker for the host machine: cc ld.bfd 2.39-16 00:01:50.894 Host machine cpu family: x86_64 00:01:50.894 Host machine cpu: x86_64 00:01:50.894 Message: ## Building in Developer Mode ## 00:01:50.894 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:50.894 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/check-symbols.sh) 00:01:50.894 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/options-ibverbs-static.sh) 00:01:50.894 Program python3 found: YES (/usr/bin/python3) 00:01:50.894 Program cat found: YES (/usr/bin/cat) 00:01:50.894 Compiler for C supports arguments -march=native: YES 00:01:50.894 Checking for size of "void *" : 8 00:01:50.894 Checking for size of "void *" : 8 (cached) 00:01:50.894 Library m found: YES 00:01:50.894 Library numa found: YES 00:01:50.894 Has header "numaif.h" : YES 00:01:50.894 Library fdt found: NO 00:01:50.894 Library execinfo found: NO 00:01:50.894 Has header "execinfo.h" : YES 00:01:50.894 Found pkg-config: YES (/usr/bin/pkg-config) 1.8.0 00:01:50.894 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:50.894 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:50.894 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:50.894 Run-time dependency openssl found: YES 3.0.9 00:01:50.894 Run-time dependency libpcap found: YES 1.10.4 00:01:50.894 Has header "pcap.h" with dependency libpcap: YES 00:01:50.894 Compiler for C supports arguments -Wcast-qual: YES 00:01:50.894 Compiler for C supports arguments -Wdeprecated: YES 00:01:50.894 Compiler for C supports arguments -Wformat: YES 00:01:50.894 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:50.894 Compiler for C supports arguments -Wformat-security: NO 00:01:50.894 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:50.894 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:50.894 Compiler for C supports arguments -Wnested-externs: YES 00:01:50.894 Compiler for C supports arguments -Wold-style-definition: YES 00:01:50.894 Compiler for C supports arguments -Wpointer-arith: YES 00:01:50.894 Compiler for C supports arguments -Wsign-compare: YES 00:01:50.894 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:50.894 Compiler for C supports arguments -Wundef: YES 00:01:50.894 Compiler for C supports arguments -Wwrite-strings: YES 00:01:50.894 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:50.894 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:50.894 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:50.894 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:50.894 Program objdump found: YES (/usr/bin/objdump) 00:01:50.894 Compiler for C supports arguments -mavx512f: YES 00:01:50.894 Checking if "AVX512 checking" compiles: YES 00:01:50.894 Fetching value of define "__SSE4_2__" : 1 00:01:50.894 Fetching value of define "__AES__" : 1 00:01:50.894 Fetching value of define "__AVX__" : 1 00:01:50.895 Fetching value of define "__AVX2__" : (undefined) 00:01:50.895 Fetching value of define "__AVX512BW__" : (undefined) 00:01:50.895 Fetching value of define "__AVX512CD__" : (undefined) 00:01:50.895 Fetching value of define "__AVX512DQ__" : (undefined) 00:01:50.895 Fetching value of define "__AVX512F__" : (undefined) 00:01:50.895 Fetching value of define "__AVX512VL__" : (undefined) 00:01:50.895 Fetching value of define "__PCLMUL__" : 1 00:01:50.895 Fetching value of define "__RDRND__" : 1 00:01:50.895 Fetching value of define "__RDSEED__" : (undefined) 00:01:50.895 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:50.895 Fetching value of define "__znver1__" : (undefined) 00:01:50.895 Fetching value of define "__znver2__" : (undefined) 00:01:50.895 Fetching value of define "__znver3__" : (undefined) 00:01:50.895 Fetching value of define "__znver4__" : (undefined) 00:01:50.895 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:50.895 Message: lib/log: Defining dependency "log" 00:01:50.895 Message: lib/kvargs: Defining dependency "kvargs" 00:01:50.895 Message: lib/telemetry: Defining dependency "telemetry" 00:01:50.895 Checking for function "getentropy" : NO 00:01:50.895 Message: lib/eal: Defining dependency "eal" 00:01:50.895 Message: lib/ring: Defining dependency "ring" 00:01:50.895 Message: lib/rcu: Defining dependency "rcu" 00:01:50.895 Message: lib/mempool: Defining dependency "mempool" 00:01:50.895 Message: lib/mbuf: Defining dependency "mbuf" 00:01:50.895 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:50.895 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:50.895 Compiler for C supports arguments -mpclmul: YES 00:01:50.895 Compiler for C supports arguments -maes: YES 00:01:50.895 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:50.895 Compiler for C supports arguments -mavx512bw: YES 00:01:50.895 Compiler for C supports arguments -mavx512dq: YES 00:01:50.895 Compiler for C supports arguments -mavx512vl: YES 00:01:50.895 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:50.895 Compiler for C supports arguments -mavx2: YES 00:01:50.895 Compiler for C supports arguments -mavx: YES 00:01:50.895 Message: lib/net: Defining dependency "net" 00:01:50.895 Message: lib/meter: Defining dependency "meter" 00:01:50.895 Message: lib/ethdev: Defining dependency "ethdev" 00:01:50.895 Message: lib/pci: Defining dependency "pci" 00:01:50.895 Message: lib/cmdline: Defining dependency "cmdline" 00:01:50.895 Message: lib/hash: Defining dependency "hash" 00:01:50.895 Message: lib/timer: Defining dependency "timer" 00:01:50.895 Message: lib/compressdev: Defining dependency "compressdev" 00:01:50.895 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:50.895 Message: lib/dmadev: Defining dependency "dmadev" 00:01:50.895 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:50.895 Message: lib/power: Defining dependency "power" 00:01:50.895 Message: lib/reorder: Defining dependency "reorder" 00:01:50.895 Message: lib/security: Defining dependency "security" 00:01:50.895 Has header "linux/userfaultfd.h" : YES 00:01:50.895 Has header "linux/vduse.h" : YES 00:01:50.895 Message: lib/vhost: Defining dependency "vhost" 00:01:50.895 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:50.895 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:50.895 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:50.895 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:50.895 Message: Disabling raw/* drivers: missing internal dependency "rawdev" 00:01:50.895 Message: Disabling regex/* drivers: missing internal dependency "regexdev" 00:01:50.895 Message: Disabling ml/* drivers: missing internal dependency "mldev" 00:01:50.895 Message: Disabling event/* drivers: missing internal dependency "eventdev" 00:01:50.895 Message: Disabling baseband/* drivers: missing internal dependency "bbdev" 00:01:50.895 Message: Disabling gpu/* drivers: missing internal dependency "gpudev" 00:01:50.895 Program doxygen found: YES (/usr/bin/doxygen) 00:01:50.895 Configuring doxy-api-html.conf using configuration 00:01:50.895 Configuring doxy-api-man.conf using configuration 00:01:50.895 Program mandb found: YES (/usr/bin/mandb) 00:01:50.895 Program sphinx-build found: NO 00:01:50.895 Configuring rte_build_config.h using configuration 00:01:50.895 Message: 00:01:50.895 ================= 00:01:50.895 Applications Enabled 00:01:50.895 ================= 00:01:50.895 00:01:50.895 apps: 00:01:50.895 00:01:50.895 00:01:50.895 Message: 00:01:50.895 ================= 00:01:50.895 Libraries Enabled 00:01:50.895 ================= 00:01:50.895 00:01:50.895 libs: 00:01:50.895 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:01:50.895 net, meter, ethdev, pci, cmdline, hash, timer, compressdev, 00:01:50.895 cryptodev, dmadev, power, reorder, security, vhost, 00:01:50.895 00:01:50.895 Message: 00:01:50.895 =============== 00:01:50.895 Drivers Enabled 00:01:50.895 =============== 00:01:50.895 00:01:50.895 common: 00:01:50.895 00:01:50.895 bus: 00:01:50.895 pci, vdev, 00:01:50.895 mempool: 00:01:50.895 ring, 00:01:50.895 dma: 00:01:50.895 00:01:50.895 net: 00:01:50.895 00:01:50.895 crypto: 00:01:50.895 00:01:50.895 compress: 00:01:50.895 00:01:50.895 vdpa: 00:01:50.895 00:01:50.895 00:01:50.895 Message: 00:01:50.895 ================= 00:01:50.895 Content Skipped 00:01:50.895 ================= 00:01:50.895 00:01:50.895 apps: 00:01:50.895 dumpcap: explicitly disabled via build config 00:01:50.895 graph: explicitly disabled via build config 00:01:50.895 pdump: explicitly disabled via build config 00:01:50.895 proc-info: explicitly disabled via build config 00:01:50.895 test-acl: explicitly disabled via build config 00:01:50.895 test-bbdev: explicitly disabled via build config 00:01:50.895 test-cmdline: explicitly disabled via build config 00:01:50.895 test-compress-perf: explicitly disabled via build config 00:01:50.895 test-crypto-perf: explicitly disabled via build config 00:01:50.895 test-dma-perf: explicitly disabled via build config 00:01:50.895 test-eventdev: explicitly disabled via build config 00:01:50.895 test-fib: explicitly disabled via build config 00:01:50.895 test-flow-perf: explicitly disabled via build config 00:01:50.895 test-gpudev: explicitly disabled via build config 00:01:50.895 test-mldev: explicitly disabled via build config 00:01:50.895 test-pipeline: explicitly disabled via build config 00:01:50.895 test-pmd: explicitly disabled via build config 00:01:50.895 test-regex: explicitly disabled via build config 00:01:50.895 test-sad: explicitly disabled via build config 00:01:50.895 test-security-perf: explicitly disabled via build config 00:01:50.895 00:01:50.895 libs: 00:01:50.895 metrics: explicitly disabled via build config 00:01:50.895 acl: explicitly disabled via build config 00:01:50.895 bbdev: explicitly disabled via build config 00:01:50.895 bitratestats: explicitly disabled via build config 00:01:50.895 bpf: explicitly disabled via build config 00:01:50.895 cfgfile: explicitly disabled via build config 00:01:50.895 distributor: explicitly disabled via build config 00:01:50.895 efd: explicitly disabled via build config 00:01:50.895 eventdev: explicitly disabled via build config 00:01:50.895 dispatcher: explicitly disabled via build config 00:01:50.895 gpudev: explicitly disabled via build config 00:01:50.895 gro: explicitly disabled via build config 00:01:50.895 gso: explicitly disabled via build config 00:01:50.895 ip_frag: explicitly disabled via build config 00:01:50.895 jobstats: explicitly disabled via build config 00:01:50.895 latencystats: explicitly disabled via build config 00:01:50.895 lpm: explicitly disabled via build config 00:01:50.895 member: explicitly disabled via build config 00:01:50.895 pcapng: explicitly disabled via build config 00:01:50.895 rawdev: explicitly disabled via build config 00:01:50.895 regexdev: explicitly disabled via build config 00:01:50.895 mldev: explicitly disabled via build config 00:01:50.895 rib: explicitly disabled via build config 00:01:50.895 sched: explicitly disabled via build config 00:01:50.895 stack: explicitly disabled via build config 00:01:50.895 ipsec: explicitly disabled via build config 00:01:50.895 pdcp: explicitly disabled via build config 00:01:50.895 fib: explicitly disabled via build config 00:01:50.895 port: explicitly disabled via build config 00:01:50.895 pdump: explicitly disabled via build config 00:01:50.895 table: explicitly disabled via build config 00:01:50.895 pipeline: explicitly disabled via build config 00:01:50.895 graph: explicitly disabled via build config 00:01:50.895 node: explicitly disabled via build config 00:01:50.895 00:01:50.895 drivers: 00:01:50.895 common/cpt: not in enabled drivers build config 00:01:50.895 common/dpaax: not in enabled drivers build config 00:01:50.895 common/iavf: not in enabled drivers build config 00:01:50.895 common/idpf: not in enabled drivers build config 00:01:50.895 common/mvep: not in enabled drivers build config 00:01:50.895 common/octeontx: not in enabled drivers build config 00:01:50.895 bus/auxiliary: not in enabled drivers build config 00:01:50.895 bus/cdx: not in enabled drivers build config 00:01:50.895 bus/dpaa: not in enabled drivers build config 00:01:50.895 bus/fslmc: not in enabled drivers build config 00:01:50.895 bus/ifpga: not in enabled drivers build config 00:01:50.895 bus/platform: not in enabled drivers build config 00:01:50.895 bus/vmbus: not in enabled drivers build config 00:01:50.895 common/cnxk: not in enabled drivers build config 00:01:50.895 common/mlx5: not in enabled drivers build config 00:01:50.895 common/nfp: not in enabled drivers build config 00:01:50.895 common/qat: not in enabled drivers build config 00:01:50.895 common/sfc_efx: not in enabled drivers build config 00:01:50.895 mempool/bucket: not in enabled drivers build config 00:01:50.895 mempool/cnxk: not in enabled drivers build config 00:01:50.895 mempool/dpaa: not in enabled drivers build config 00:01:50.895 mempool/dpaa2: not in enabled drivers build config 00:01:50.895 mempool/octeontx: not in enabled drivers build config 00:01:50.895 mempool/stack: not in enabled drivers build config 00:01:50.895 dma/cnxk: not in enabled drivers build config 00:01:50.895 dma/dpaa: not in enabled drivers build config 00:01:50.895 dma/dpaa2: not in enabled drivers build config 00:01:50.895 dma/hisilicon: not in enabled drivers build config 00:01:50.896 dma/idxd: not in enabled drivers build config 00:01:50.896 dma/ioat: not in enabled drivers build config 00:01:50.896 dma/skeleton: not in enabled drivers build config 00:01:50.896 net/af_packet: not in enabled drivers build config 00:01:50.896 net/af_xdp: not in enabled drivers build config 00:01:50.896 net/ark: not in enabled drivers build config 00:01:50.896 net/atlantic: not in enabled drivers build config 00:01:50.896 net/avp: not in enabled drivers build config 00:01:50.896 net/axgbe: not in enabled drivers build config 00:01:50.896 net/bnx2x: not in enabled drivers build config 00:01:50.896 net/bnxt: not in enabled drivers build config 00:01:50.896 net/bonding: not in enabled drivers build config 00:01:50.896 net/cnxk: not in enabled drivers build config 00:01:50.896 net/cpfl: not in enabled drivers build config 00:01:50.896 net/cxgbe: not in enabled drivers build config 00:01:50.896 net/dpaa: not in enabled drivers build config 00:01:50.896 net/dpaa2: not in enabled drivers build config 00:01:50.896 net/e1000: not in enabled drivers build config 00:01:50.896 net/ena: not in enabled drivers build config 00:01:50.896 net/enetc: not in enabled drivers build config 00:01:50.896 net/enetfec: not in enabled drivers build config 00:01:50.896 net/enic: not in enabled drivers build config 00:01:50.896 net/failsafe: not in enabled drivers build config 00:01:50.896 net/fm10k: not in enabled drivers build config 00:01:50.896 net/gve: not in enabled drivers build config 00:01:50.896 net/hinic: not in enabled drivers build config 00:01:50.896 net/hns3: not in enabled drivers build config 00:01:50.896 net/i40e: not in enabled drivers build config 00:01:50.896 net/iavf: not in enabled drivers build config 00:01:50.896 net/ice: not in enabled drivers build config 00:01:50.896 net/idpf: not in enabled drivers build config 00:01:50.896 net/igc: not in enabled drivers build config 00:01:50.896 net/ionic: not in enabled drivers build config 00:01:50.896 net/ipn3ke: not in enabled drivers build config 00:01:50.896 net/ixgbe: not in enabled drivers build config 00:01:50.896 net/mana: not in enabled drivers build config 00:01:50.896 net/memif: not in enabled drivers build config 00:01:50.896 net/mlx4: not in enabled drivers build config 00:01:50.896 net/mlx5: not in enabled drivers build config 00:01:50.896 net/mvneta: not in enabled drivers build config 00:01:50.896 net/mvpp2: not in enabled drivers build config 00:01:50.896 net/netvsc: not in enabled drivers build config 00:01:50.896 net/nfb: not in enabled drivers build config 00:01:50.896 net/nfp: not in enabled drivers build config 00:01:50.896 net/ngbe: not in enabled drivers build config 00:01:50.896 net/null: not in enabled drivers build config 00:01:50.896 net/octeontx: not in enabled drivers build config 00:01:50.896 net/octeon_ep: not in enabled drivers build config 00:01:50.896 net/pcap: not in enabled drivers build config 00:01:50.896 net/pfe: not in enabled drivers build config 00:01:50.896 net/qede: not in enabled drivers build config 00:01:50.896 net/ring: not in enabled drivers build config 00:01:50.896 net/sfc: not in enabled drivers build config 00:01:50.896 net/softnic: not in enabled drivers build config 00:01:50.896 net/tap: not in enabled drivers build config 00:01:50.896 net/thunderx: not in enabled drivers build config 00:01:50.896 net/txgbe: not in enabled drivers build config 00:01:50.896 net/vdev_netvsc: not in enabled drivers build config 00:01:50.896 net/vhost: not in enabled drivers build config 00:01:50.896 net/virtio: not in enabled drivers build config 00:01:50.896 net/vmxnet3: not in enabled drivers build config 00:01:50.896 raw/*: missing internal dependency, "rawdev" 00:01:50.896 crypto/armv8: not in enabled drivers build config 00:01:50.896 crypto/bcmfs: not in enabled drivers build config 00:01:50.896 crypto/caam_jr: not in enabled drivers build config 00:01:50.896 crypto/ccp: not in enabled drivers build config 00:01:50.896 crypto/cnxk: not in enabled drivers build config 00:01:50.896 crypto/dpaa_sec: not in enabled drivers build config 00:01:50.896 crypto/dpaa2_sec: not in enabled drivers build config 00:01:50.896 crypto/ipsec_mb: not in enabled drivers build config 00:01:50.896 crypto/mlx5: not in enabled drivers build config 00:01:50.896 crypto/mvsam: not in enabled drivers build config 00:01:50.896 crypto/nitrox: not in enabled drivers build config 00:01:50.896 crypto/null: not in enabled drivers build config 00:01:50.896 crypto/octeontx: not in enabled drivers build config 00:01:50.896 crypto/openssl: not in enabled drivers build config 00:01:50.896 crypto/scheduler: not in enabled drivers build config 00:01:50.896 crypto/uadk: not in enabled drivers build config 00:01:50.896 crypto/virtio: not in enabled drivers build config 00:01:50.896 compress/isal: not in enabled drivers build config 00:01:50.896 compress/mlx5: not in enabled drivers build config 00:01:50.896 compress/octeontx: not in enabled drivers build config 00:01:50.896 compress/zlib: not in enabled drivers build config 00:01:50.896 regex/*: missing internal dependency, "regexdev" 00:01:50.896 ml/*: missing internal dependency, "mldev" 00:01:50.896 vdpa/ifc: not in enabled drivers build config 00:01:50.896 vdpa/mlx5: not in enabled drivers build config 00:01:50.896 vdpa/nfp: not in enabled drivers build config 00:01:50.896 vdpa/sfc: not in enabled drivers build config 00:01:50.896 event/*: missing internal dependency, "eventdev" 00:01:50.896 baseband/*: missing internal dependency, "bbdev" 00:01:50.896 gpu/*: missing internal dependency, "gpudev" 00:01:50.896 00:01:50.896 00:01:51.155 Build targets in project: 85 00:01:51.155 00:01:51.155 DPDK 23.11.0 00:01:51.155 00:01:51.155 User defined options 00:01:51.155 buildtype : debug 00:01:51.155 default_library : shared 00:01:51.155 libdir : lib 00:01:51.155 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:51.155 c_args : -fPIC -Werror -Wno-stringop-overflow -fcommon -Wno-stringop-overread -Wno-array-bounds 00:01:51.155 c_link_args : 00:01:51.155 cpu_instruction_set: native 00:01:51.155 disable_apps : test-fib,test-sad,test,test-regex,test-security-perf,test-bbdev,dumpcap,test-crypto-perf,test-flow-perf,test-gpudev,test-cmdline,test-dma-perf,test-eventdev,test-pipeline,test-acl,proc-info,test-compress-perf,graph,test-pmd,test-mldev,pdump 00:01:51.155 disable_libs : bbdev,latencystats,member,gpudev,mldev,pipeline,lpm,efd,regexdev,sched,node,dispatcher,table,bpf,port,gro,fib,cfgfile,ip_frag,gso,rawdev,ipsec,pdcp,rib,acl,metrics,graph,pcapng,jobstats,eventdev,stack,bitratestats,distributor,pdump 00:01:51.155 enable_docs : false 00:01:51.155 enable_drivers : bus,bus/pci,bus/vdev,mempool/ring 00:01:51.155 enable_kmods : false 00:01:51.155 tests : false 00:01:51.155 00:01:51.155 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:51.727 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp' 00:01:51.727 [1/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:51.727 [2/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:51.727 [3/265] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:01:51.727 [4/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:51.727 [5/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:51.727 [6/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:51.727 [7/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:51.727 [8/265] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:51.727 [9/265] Linking static target lib/librte_kvargs.a 00:01:51.727 [10/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:51.727 [11/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:51.727 [12/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:51.727 [13/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:51.727 [14/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:51.727 [15/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:51.727 [16/265] Compiling C object lib/librte_log.a.p/log_log.c.o 00:01:51.727 [17/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:51.989 [18/265] Linking static target lib/librte_log.a 00:01:51.989 [19/265] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:51.989 [20/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:51.989 [21/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:52.563 [22/265] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:52.563 [23/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:52.563 [24/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:52.563 [25/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:52.563 [26/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:52.563 [27/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:52.563 [28/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:52.563 [29/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:52.563 [30/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:52.563 [31/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:52.563 [32/265] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:52.563 [33/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:52.563 [34/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:52.563 [35/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:52.563 [36/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:52.563 [37/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:52.563 [38/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:52.563 [39/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:52.563 [40/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:52.563 [41/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:52.563 [42/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:52.563 [43/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:52.563 [44/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:52.563 [45/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:52.563 [46/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:52.563 [47/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:52.824 [48/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:52.824 [49/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:52.824 [50/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:52.824 [51/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:52.824 [52/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:52.824 [53/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:52.824 [54/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:52.824 [55/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:52.824 [56/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:52.824 [57/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:52.824 [58/265] Linking static target lib/librte_telemetry.a 00:01:52.824 [59/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:52.824 [60/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:52.824 [61/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:52.825 [62/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:52.825 [63/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:52.825 [64/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:52.825 [65/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:52.825 [66/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:52.825 [67/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:52.825 [68/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:53.090 [69/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:53.090 [70/265] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:53.090 [71/265] Linking static target lib/librte_pci.a 00:01:53.090 [72/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:53.090 [73/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:53.090 [74/265] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:01:53.090 [75/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:53.090 [76/265] Linking target lib/librte_log.so.24.0 00:01:53.090 [77/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:53.090 [78/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:53.090 [79/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:53.090 [80/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:53.351 [81/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:53.351 [82/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:53.351 [83/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:53.351 [84/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:53.351 [85/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:53.351 [86/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:53.351 [87/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:53.351 [88/265] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:53.351 [89/265] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:53.351 [90/265] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:53.614 [91/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:53.614 [92/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:53.614 [93/265] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:01:53.614 [94/265] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:53.614 [95/265] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:53.614 [96/265] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:53.614 [97/265] Linking target lib/librte_kvargs.so.24.0 00:01:53.614 [98/265] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:53.614 [99/265] Linking static target lib/librte_ring.a 00:01:53.614 [100/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:53.614 [101/265] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:53.614 [102/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:53.614 [103/265] Linking static target lib/librte_meter.a 00:01:53.614 [104/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:53.614 [105/265] Linking target lib/librte_telemetry.so.24.0 00:01:53.614 [106/265] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:53.614 [107/265] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:53.614 [108/265] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:53.614 [109/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:53.877 [110/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:53.877 [111/265] Linking static target lib/librte_eal.a 00:01:53.877 [112/265] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:53.877 [113/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:53.877 [114/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:53.877 [115/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:53.877 [116/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:53.877 [117/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:53.877 [118/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:53.877 [119/265] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:53.877 [120/265] Linking static target lib/librte_mempool.a 00:01:53.877 [121/265] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:53.877 [122/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:53.877 [123/265] Linking static target lib/librte_rcu.a 00:01:53.877 [124/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:53.877 [125/265] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:01:53.877 [126/265] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:53.877 [127/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:53.877 [128/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:53.877 [129/265] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:01:53.877 [130/265] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:54.135 [131/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:54.135 [132/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:01:54.135 [133/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:54.135 [134/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:54.135 [135/265] Linking static target lib/librte_cmdline.a 00:01:54.135 [136/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:54.135 [137/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:54.135 [138/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:54.135 [139/265] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:54.135 [140/265] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:54.394 [141/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:54.394 [142/265] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:54.394 [143/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:54.394 [144/265] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:54.394 [145/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:54.394 [146/265] Linking static target lib/librte_timer.a 00:01:54.394 [147/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:54.394 [148/265] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:54.394 [149/265] Linking static target lib/librte_net.a 00:01:54.394 [150/265] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:54.394 [151/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:54.394 [152/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:01:54.652 [153/265] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:54.652 [154/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:54.652 [155/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:54.652 [156/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:54.652 [157/265] Linking static target lib/librte_dmadev.a 00:01:54.652 [158/265] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:54.652 [159/265] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:54.652 [160/265] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:01:54.910 [161/265] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:54.910 [162/265] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:54.910 [163/265] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:54.910 [164/265] Linking static target lib/librte_hash.a 00:01:54.910 [165/265] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:54.910 [166/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:54.910 [167/265] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:54.910 [168/265] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:54.910 [169/265] Linking static target lib/librte_compressdev.a 00:01:54.910 [170/265] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:01:54.910 [171/265] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:54.910 [172/265] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:54.910 [173/265] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:01:54.910 [174/265] Linking static target lib/librte_power.a 00:01:54.910 [175/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:54.910 [176/265] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:54.910 [177/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:55.167 [178/265] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:01:55.167 [179/265] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:55.167 [180/265] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:55.167 [181/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:01:55.167 [182/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:55.167 [183/265] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:55.167 [184/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:55.167 [185/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:55.167 [186/265] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:55.167 [187/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:55.167 [188/265] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:55.167 [189/265] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:55.167 [190/265] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:55.424 [191/265] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:55.424 [192/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:55.424 [193/265] Linking static target lib/librte_mbuf.a 00:01:55.424 [194/265] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:55.424 [195/265] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:55.424 [196/265] Linking static target lib/librte_reorder.a 00:01:55.425 [197/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:55.425 [198/265] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:55.425 [199/265] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:55.425 [200/265] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:55.425 [201/265] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:55.425 [202/265] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:55.425 [203/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:55.425 [204/265] Linking static target drivers/librte_bus_pci.a 00:01:55.425 [205/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:55.425 [206/265] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:55.425 [207/265] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:55.425 [208/265] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:55.425 [209/265] Linking static target drivers/librte_bus_vdev.a 00:01:55.425 [210/265] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:55.425 [211/265] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:55.425 [212/265] Linking static target drivers/librte_mempool_ring.a 00:01:55.425 [213/265] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:55.425 [214/265] Linking static target lib/librte_security.a 00:01:55.682 [215/265] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:55.682 [216/265] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:55.682 [217/265] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:55.682 [218/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:55.980 [219/265] Linking static target lib/librte_cryptodev.a 00:01:55.980 [220/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:55.980 [221/265] Linking static target lib/librte_ethdev.a 00:01:55.980 [222/265] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:55.980 [223/265] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:56.910 [224/265] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.281 [225/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:02:00.181 [226/265] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:00.181 [227/265] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:02:00.181 [228/265] Linking target lib/librte_eal.so.24.0 00:02:00.181 [229/265] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:02:00.181 [230/265] Linking target lib/librte_ring.so.24.0 00:02:00.181 [231/265] Linking target lib/librte_timer.so.24.0 00:02:00.181 [232/265] Linking target lib/librte_meter.so.24.0 00:02:00.181 [233/265] Linking target lib/librte_pci.so.24.0 00:02:00.181 [234/265] Linking target drivers/librte_bus_vdev.so.24.0 00:02:00.181 [235/265] Linking target lib/librte_dmadev.so.24.0 00:02:00.439 [236/265] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:02:00.439 [237/265] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:02:00.439 [238/265] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:02:00.439 [239/265] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:02:00.439 [240/265] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:02:00.439 [241/265] Linking target lib/librte_mempool.so.24.0 00:02:00.439 [242/265] Linking target lib/librte_rcu.so.24.0 00:02:00.439 [243/265] Linking target drivers/librte_bus_pci.so.24.0 00:02:00.439 [244/265] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:02:00.439 [245/265] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:02:00.439 [246/265] Linking target drivers/librte_mempool_ring.so.24.0 00:02:00.439 [247/265] Linking target lib/librte_mbuf.so.24.0 00:02:00.697 [248/265] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:02:00.697 [249/265] Linking target lib/librte_compressdev.so.24.0 00:02:00.697 [250/265] Linking target lib/librte_reorder.so.24.0 00:02:00.697 [251/265] Linking target lib/librte_net.so.24.0 00:02:00.697 [252/265] Linking target lib/librte_cryptodev.so.24.0 00:02:00.697 [253/265] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:02:00.697 [254/265] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:02:00.955 [255/265] Linking target lib/librte_cmdline.so.24.0 00:02:00.955 [256/265] Linking target lib/librte_hash.so.24.0 00:02:00.955 [257/265] Linking target lib/librte_security.so.24.0 00:02:00.955 [258/265] Linking target lib/librte_ethdev.so.24.0 00:02:00.955 [259/265] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:02:00.955 [260/265] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:02:00.955 [261/265] Linking target lib/librte_power.so.24.0 00:02:03.487 [262/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:02:03.487 [263/265] Linking static target lib/librte_vhost.a 00:02:04.422 [264/265] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:02:04.422 [265/265] Linking target lib/librte_vhost.so.24.0 00:02:04.422 INFO: autodetecting backend as ninja 00:02:04.422 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp -j 48 00:02:05.392 CC lib/ut_mock/mock.o 00:02:05.392 CC lib/ut/ut.o 00:02:05.392 CC lib/log/log.o 00:02:05.392 CC lib/log/log_flags.o 00:02:05.392 CC lib/log/log_deprecated.o 00:02:05.392 LIB libspdk_ut_mock.a 00:02:05.392 LIB libspdk_log.a 00:02:05.392 SO libspdk_ut_mock.so.5.0 00:02:05.392 LIB libspdk_ut.a 00:02:05.392 SO libspdk_ut.so.1.0 00:02:05.392 SO libspdk_log.so.6.1 00:02:05.392 SYMLINK libspdk_ut_mock.so 00:02:05.392 SYMLINK libspdk_ut.so 00:02:05.392 SYMLINK libspdk_log.so 00:02:05.650 CC lib/dma/dma.o 00:02:05.650 CXX lib/trace_parser/trace.o 00:02:05.650 CC lib/ioat/ioat.o 00:02:05.650 CC lib/util/base64.o 00:02:05.650 CC lib/util/bit_array.o 00:02:05.650 CC lib/util/cpuset.o 00:02:05.650 CC lib/util/crc16.o 00:02:05.650 CC lib/util/crc32.o 00:02:05.650 CC lib/util/crc32c.o 00:02:05.650 CC lib/util/crc32_ieee.o 00:02:05.650 CC lib/util/crc64.o 00:02:05.650 CC lib/util/dif.o 00:02:05.650 CC lib/util/fd.o 00:02:05.650 CC lib/util/file.o 00:02:05.650 CC lib/util/hexlify.o 00:02:05.650 CC lib/util/iov.o 00:02:05.650 CC lib/util/math.o 00:02:05.650 CC lib/util/pipe.o 00:02:05.650 CC lib/util/strerror_tls.o 00:02:05.650 CC lib/util/string.o 00:02:05.650 CC lib/util/uuid.o 00:02:05.650 CC lib/util/fd_group.o 00:02:05.650 CC lib/util/xor.o 00:02:05.650 CC lib/util/zipf.o 00:02:05.650 CC lib/vfio_user/host/vfio_user_pci.o 00:02:05.650 CC lib/vfio_user/host/vfio_user.o 00:02:05.908 LIB libspdk_dma.a 00:02:05.908 SO libspdk_dma.so.3.0 00:02:05.908 SYMLINK libspdk_dma.so 00:02:05.908 LIB libspdk_ioat.a 00:02:05.908 SO libspdk_ioat.so.6.0 00:02:05.908 SYMLINK libspdk_ioat.so 00:02:05.908 LIB libspdk_vfio_user.a 00:02:05.908 SO libspdk_vfio_user.so.4.0 00:02:05.908 SYMLINK libspdk_vfio_user.so 00:02:06.165 LIB libspdk_util.a 00:02:06.165 SO libspdk_util.so.8.0 00:02:06.423 SYMLINK libspdk_util.so 00:02:06.423 CC lib/conf/conf.o 00:02:06.423 CC lib/vmd/vmd.o 00:02:06.423 CC lib/json/json_parse.o 00:02:06.423 CC lib/env_dpdk/env.o 00:02:06.423 CC lib/json/json_util.o 00:02:06.423 CC lib/vmd/led.o 00:02:06.423 CC lib/env_dpdk/memory.o 00:02:06.423 CC lib/json/json_write.o 00:02:06.423 CC lib/env_dpdk/pci.o 00:02:06.423 CC lib/env_dpdk/init.o 00:02:06.423 CC lib/env_dpdk/threads.o 00:02:06.423 CC lib/rdma/common.o 00:02:06.423 CC lib/idxd/idxd.o 00:02:06.423 CC lib/env_dpdk/pci_ioat.o 00:02:06.423 CC lib/rdma/rdma_verbs.o 00:02:06.423 CC lib/idxd/idxd_user.o 00:02:06.423 CC lib/env_dpdk/pci_virtio.o 00:02:06.423 CC lib/idxd/idxd_kernel.o 00:02:06.423 CC lib/env_dpdk/pci_vmd.o 00:02:06.423 CC lib/env_dpdk/pci_idxd.o 00:02:06.423 CC lib/env_dpdk/pci_event.o 00:02:06.423 CC lib/env_dpdk/sigbus_handler.o 00:02:06.423 CC lib/env_dpdk/pci_dpdk.o 00:02:06.423 CC lib/env_dpdk/pci_dpdk_2211.o 00:02:06.423 CC lib/env_dpdk/pci_dpdk_2207.o 00:02:06.423 LIB libspdk_trace_parser.a 00:02:06.423 SO libspdk_trace_parser.so.4.0 00:02:06.681 SYMLINK libspdk_trace_parser.so 00:02:06.681 LIB libspdk_conf.a 00:02:06.681 SO libspdk_conf.so.5.0 00:02:06.681 LIB libspdk_rdma.a 00:02:06.681 SYMLINK libspdk_conf.so 00:02:06.681 LIB libspdk_json.a 00:02:06.681 SO libspdk_rdma.so.5.0 00:02:06.681 SO libspdk_json.so.5.1 00:02:06.939 SYMLINK libspdk_rdma.so 00:02:06.939 SYMLINK libspdk_json.so 00:02:06.939 CC lib/jsonrpc/jsonrpc_server.o 00:02:06.939 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:02:06.939 CC lib/jsonrpc/jsonrpc_client.o 00:02:06.939 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:02:06.939 LIB libspdk_idxd.a 00:02:06.939 SO libspdk_idxd.so.11.0 00:02:07.197 SYMLINK libspdk_idxd.so 00:02:07.197 LIB libspdk_vmd.a 00:02:07.197 SO libspdk_vmd.so.5.0 00:02:07.197 SYMLINK libspdk_vmd.so 00:02:07.197 LIB libspdk_jsonrpc.a 00:02:07.197 SO libspdk_jsonrpc.so.5.1 00:02:07.197 SYMLINK libspdk_jsonrpc.so 00:02:07.456 CC lib/rpc/rpc.o 00:02:07.715 LIB libspdk_rpc.a 00:02:07.715 SO libspdk_rpc.so.5.0 00:02:07.715 SYMLINK libspdk_rpc.so 00:02:07.715 CC lib/trace/trace.o 00:02:07.715 CC lib/trace/trace_flags.o 00:02:07.715 CC lib/trace/trace_rpc.o 00:02:07.715 CC lib/notify/notify.o 00:02:07.715 CC lib/sock/sock.o 00:02:07.715 CC lib/sock/sock_rpc.o 00:02:07.715 CC lib/notify/notify_rpc.o 00:02:07.973 LIB libspdk_notify.a 00:02:07.973 SO libspdk_notify.so.5.0 00:02:07.973 LIB libspdk_trace.a 00:02:07.973 SYMLINK libspdk_notify.so 00:02:07.973 SO libspdk_trace.so.9.0 00:02:07.973 SYMLINK libspdk_trace.so 00:02:08.231 LIB libspdk_sock.a 00:02:08.231 CC lib/thread/thread.o 00:02:08.231 CC lib/thread/iobuf.o 00:02:08.231 SO libspdk_sock.so.8.0 00:02:08.231 SYMLINK libspdk_sock.so 00:02:08.231 CC lib/nvme/nvme_ctrlr_cmd.o 00:02:08.231 CC lib/nvme/nvme_ctrlr.o 00:02:08.231 CC lib/nvme/nvme_fabric.o 00:02:08.231 CC lib/nvme/nvme_ns_cmd.o 00:02:08.231 CC lib/nvme/nvme_ns.o 00:02:08.231 CC lib/nvme/nvme_pcie_common.o 00:02:08.231 CC lib/nvme/nvme_pcie.o 00:02:08.231 CC lib/nvme/nvme_qpair.o 00:02:08.231 CC lib/nvme/nvme.o 00:02:08.231 CC lib/nvme/nvme_quirks.o 00:02:08.231 CC lib/nvme/nvme_transport.o 00:02:08.231 CC lib/nvme/nvme_discovery.o 00:02:08.231 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:02:08.231 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:02:08.231 CC lib/nvme/nvme_tcp.o 00:02:08.231 CC lib/nvme/nvme_opal.o 00:02:08.231 CC lib/nvme/nvme_io_msg.o 00:02:08.490 CC lib/nvme/nvme_poll_group.o 00:02:08.490 CC lib/nvme/nvme_zns.o 00:02:08.490 CC lib/nvme/nvme_cuse.o 00:02:08.490 CC lib/nvme/nvme_vfio_user.o 00:02:08.490 CC lib/nvme/nvme_rdma.o 00:02:08.490 LIB libspdk_env_dpdk.a 00:02:08.490 SO libspdk_env_dpdk.so.13.0 00:02:08.748 SYMLINK libspdk_env_dpdk.so 00:02:09.683 LIB libspdk_thread.a 00:02:09.683 SO libspdk_thread.so.9.0 00:02:09.942 SYMLINK libspdk_thread.so 00:02:09.942 CC lib/init/json_config.o 00:02:09.942 CC lib/virtio/virtio.o 00:02:09.942 CC lib/blob/blobstore.o 00:02:09.942 CC lib/init/subsystem.o 00:02:09.942 CC lib/accel/accel.o 00:02:09.942 CC lib/virtio/virtio_vhost_user.o 00:02:09.942 CC lib/blob/request.o 00:02:09.942 CC lib/accel/accel_rpc.o 00:02:09.942 CC lib/init/subsystem_rpc.o 00:02:09.943 CC lib/blob/zeroes.o 00:02:09.943 CC lib/accel/accel_sw.o 00:02:09.943 CC lib/virtio/virtio_vfio_user.o 00:02:09.943 CC lib/init/rpc.o 00:02:09.943 CC lib/blob/blob_bs_dev.o 00:02:09.943 CC lib/virtio/virtio_pci.o 00:02:10.201 LIB libspdk_init.a 00:02:10.201 SO libspdk_init.so.4.0 00:02:10.201 LIB libspdk_virtio.a 00:02:10.201 SYMLINK libspdk_init.so 00:02:10.201 SO libspdk_virtio.so.6.0 00:02:10.459 SYMLINK libspdk_virtio.so 00:02:10.459 CC lib/event/app.o 00:02:10.459 CC lib/event/reactor.o 00:02:10.459 CC lib/event/log_rpc.o 00:02:10.459 CC lib/event/app_rpc.o 00:02:10.460 CC lib/event/scheduler_static.o 00:02:10.718 LIB libspdk_nvme.a 00:02:10.718 SO libspdk_nvme.so.12.0 00:02:10.718 LIB libspdk_event.a 00:02:10.718 SO libspdk_event.so.12.0 00:02:10.977 SYMLINK libspdk_event.so 00:02:10.977 LIB libspdk_accel.a 00:02:10.977 SYMLINK libspdk_nvme.so 00:02:10.977 SO libspdk_accel.so.14.0 00:02:10.977 SYMLINK libspdk_accel.so 00:02:11.235 CC lib/bdev/bdev.o 00:02:11.235 CC lib/bdev/bdev_rpc.o 00:02:11.235 CC lib/bdev/bdev_zone.o 00:02:11.235 CC lib/bdev/part.o 00:02:11.235 CC lib/bdev/scsi_nvme.o 00:02:12.613 LIB libspdk_blob.a 00:02:12.871 SO libspdk_blob.so.10.1 00:02:12.871 SYMLINK libspdk_blob.so 00:02:12.871 CC lib/blobfs/blobfs.o 00:02:12.871 CC lib/blobfs/tree.o 00:02:12.871 CC lib/lvol/lvol.o 00:02:13.813 LIB libspdk_bdev.a 00:02:13.813 SO libspdk_bdev.so.14.0 00:02:13.813 LIB libspdk_blobfs.a 00:02:13.813 SO libspdk_blobfs.so.9.0 00:02:13.813 SYMLINK libspdk_bdev.so 00:02:13.813 LIB libspdk_lvol.a 00:02:13.813 SYMLINK libspdk_blobfs.so 00:02:13.813 SO libspdk_lvol.so.9.1 00:02:13.813 CC lib/nbd/nbd.o 00:02:13.813 CC lib/ublk/ublk.o 00:02:13.813 CC lib/scsi/dev.o 00:02:13.813 CC lib/nvmf/ctrlr.o 00:02:13.813 CC lib/nbd/nbd_rpc.o 00:02:13.813 CC lib/ublk/ublk_rpc.o 00:02:13.813 CC lib/scsi/lun.o 00:02:13.813 CC lib/ftl/ftl_core.o 00:02:13.813 CC lib/nvmf/ctrlr_discovery.o 00:02:13.813 CC lib/ftl/ftl_init.o 00:02:13.813 CC lib/nvmf/ctrlr_bdev.o 00:02:13.813 CC lib/scsi/port.o 00:02:13.813 CC lib/scsi/scsi.o 00:02:13.813 CC lib/ftl/ftl_layout.o 00:02:13.813 CC lib/nvmf/subsystem.o 00:02:13.813 CC lib/ftl/ftl_debug.o 00:02:13.813 CC lib/nvmf/nvmf.o 00:02:13.813 CC lib/scsi/scsi_bdev.o 00:02:13.813 CC lib/scsi/scsi_pr.o 00:02:13.813 CC lib/nvmf/nvmf_rpc.o 00:02:13.813 CC lib/ftl/ftl_io.o 00:02:13.813 CC lib/nvmf/tcp.o 00:02:13.813 CC lib/ftl/ftl_sb.o 00:02:13.813 CC lib/nvmf/transport.o 00:02:13.813 CC lib/scsi/scsi_rpc.o 00:02:13.813 CC lib/nvmf/rdma.o 00:02:13.813 CC lib/scsi/task.o 00:02:13.813 CC lib/ftl/ftl_l2p.o 00:02:13.813 CC lib/ftl/ftl_l2p_flat.o 00:02:13.813 CC lib/ftl/ftl_nv_cache.o 00:02:13.813 CC lib/ftl/ftl_band.o 00:02:13.813 CC lib/ftl/ftl_band_ops.o 00:02:13.813 CC lib/ftl/ftl_writer.o 00:02:13.813 SYMLINK libspdk_lvol.so 00:02:13.813 CC lib/ftl/ftl_rq.o 00:02:13.813 CC lib/ftl/ftl_reloc.o 00:02:13.813 CC lib/ftl/ftl_l2p_cache.o 00:02:13.813 CC lib/ftl/ftl_p2l.o 00:02:13.813 CC lib/ftl/mngt/ftl_mngt.o 00:02:13.813 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:02:13.813 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:02:13.813 CC lib/ftl/mngt/ftl_mngt_startup.o 00:02:13.813 CC lib/ftl/mngt/ftl_mngt_md.o 00:02:13.813 CC lib/ftl/mngt/ftl_mngt_misc.o 00:02:13.813 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:02:13.813 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:02:13.813 CC lib/ftl/mngt/ftl_mngt_band.o 00:02:13.813 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:02:13.813 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:02:14.071 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:02:14.071 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:02:14.071 CC lib/ftl/utils/ftl_conf.o 00:02:14.329 CC lib/ftl/utils/ftl_md.o 00:02:14.329 CC lib/ftl/utils/ftl_mempool.o 00:02:14.329 CC lib/ftl/utils/ftl_bitmap.o 00:02:14.329 CC lib/ftl/utils/ftl_property.o 00:02:14.329 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:02:14.329 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:02:14.329 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:02:14.329 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:02:14.329 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:02:14.329 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:02:14.329 CC lib/ftl/upgrade/ftl_sb_v3.o 00:02:14.329 CC lib/ftl/upgrade/ftl_sb_v5.o 00:02:14.329 CC lib/ftl/nvc/ftl_nvc_dev.o 00:02:14.329 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:02:14.329 CC lib/ftl/base/ftl_base_dev.o 00:02:14.329 CC lib/ftl/base/ftl_base_bdev.o 00:02:14.329 CC lib/ftl/ftl_trace.o 00:02:14.587 LIB libspdk_nbd.a 00:02:14.587 SO libspdk_nbd.so.6.0 00:02:14.587 SYMLINK libspdk_nbd.so 00:02:14.587 LIB libspdk_scsi.a 00:02:14.845 SO libspdk_scsi.so.8.0 00:02:14.845 LIB libspdk_ublk.a 00:02:14.845 SYMLINK libspdk_scsi.so 00:02:14.845 SO libspdk_ublk.so.2.0 00:02:14.845 SYMLINK libspdk_ublk.so 00:02:14.845 CC lib/vhost/vhost.o 00:02:14.845 CC lib/iscsi/conn.o 00:02:14.845 CC lib/iscsi/init_grp.o 00:02:14.845 CC lib/vhost/vhost_rpc.o 00:02:14.845 CC lib/iscsi/iscsi.o 00:02:14.845 CC lib/vhost/vhost_scsi.o 00:02:14.845 CC lib/iscsi/md5.o 00:02:14.845 CC lib/vhost/vhost_blk.o 00:02:14.845 CC lib/iscsi/param.o 00:02:14.845 CC lib/vhost/rte_vhost_user.o 00:02:14.845 CC lib/iscsi/portal_grp.o 00:02:14.845 CC lib/iscsi/tgt_node.o 00:02:14.845 CC lib/iscsi/iscsi_subsystem.o 00:02:14.845 CC lib/iscsi/iscsi_rpc.o 00:02:14.845 CC lib/iscsi/task.o 00:02:15.102 LIB libspdk_ftl.a 00:02:15.102 SO libspdk_ftl.so.8.0 00:02:15.668 SYMLINK libspdk_ftl.so 00:02:16.233 LIB libspdk_vhost.a 00:02:16.233 SO libspdk_vhost.so.7.1 00:02:16.233 SYMLINK libspdk_vhost.so 00:02:16.233 LIB libspdk_nvmf.a 00:02:16.233 SO libspdk_nvmf.so.17.0 00:02:16.233 LIB libspdk_iscsi.a 00:02:16.491 SO libspdk_iscsi.so.7.0 00:02:16.491 SYMLINK libspdk_nvmf.so 00:02:16.491 SYMLINK libspdk_iscsi.so 00:02:16.748 CC module/env_dpdk/env_dpdk_rpc.o 00:02:16.748 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:02:16.748 CC module/blob/bdev/blob_bdev.o 00:02:16.748 CC module/accel/iaa/accel_iaa.o 00:02:16.748 CC module/scheduler/gscheduler/gscheduler.o 00:02:16.748 CC module/accel/ioat/accel_ioat.o 00:02:16.748 CC module/sock/posix/posix.o 00:02:16.748 CC module/accel/ioat/accel_ioat_rpc.o 00:02:16.748 CC module/accel/iaa/accel_iaa_rpc.o 00:02:16.748 CC module/scheduler/dynamic/scheduler_dynamic.o 00:02:16.748 CC module/accel/error/accel_error.o 00:02:16.748 CC module/accel/dsa/accel_dsa.o 00:02:16.748 CC module/accel/error/accel_error_rpc.o 00:02:16.748 CC module/accel/dsa/accel_dsa_rpc.o 00:02:16.748 LIB libspdk_env_dpdk_rpc.a 00:02:17.007 SO libspdk_env_dpdk_rpc.so.5.0 00:02:17.007 LIB libspdk_scheduler_gscheduler.a 00:02:17.007 SYMLINK libspdk_env_dpdk_rpc.so 00:02:17.007 LIB libspdk_scheduler_dpdk_governor.a 00:02:17.007 SO libspdk_scheduler_gscheduler.so.3.0 00:02:17.007 SO libspdk_scheduler_dpdk_governor.so.3.0 00:02:17.007 LIB libspdk_accel_error.a 00:02:17.007 LIB libspdk_accel_ioat.a 00:02:17.007 LIB libspdk_scheduler_dynamic.a 00:02:17.007 LIB libspdk_accel_iaa.a 00:02:17.007 SO libspdk_accel_error.so.1.0 00:02:17.007 SO libspdk_scheduler_dynamic.so.3.0 00:02:17.007 SO libspdk_accel_ioat.so.5.0 00:02:17.007 SYMLINK libspdk_scheduler_gscheduler.so 00:02:17.007 SYMLINK libspdk_scheduler_dpdk_governor.so 00:02:17.007 SO libspdk_accel_iaa.so.2.0 00:02:17.007 LIB libspdk_accel_dsa.a 00:02:17.007 SYMLINK libspdk_accel_error.so 00:02:17.007 SYMLINK libspdk_scheduler_dynamic.so 00:02:17.007 SO libspdk_accel_dsa.so.4.0 00:02:17.007 LIB libspdk_blob_bdev.a 00:02:17.007 SYMLINK libspdk_accel_ioat.so 00:02:17.007 SYMLINK libspdk_accel_iaa.so 00:02:17.007 SO libspdk_blob_bdev.so.10.1 00:02:17.007 SYMLINK libspdk_accel_dsa.so 00:02:17.266 SYMLINK libspdk_blob_bdev.so 00:02:17.266 CC module/bdev/null/bdev_null.o 00:02:17.266 CC module/bdev/gpt/gpt.o 00:02:17.266 CC module/bdev/aio/bdev_aio.o 00:02:17.266 CC module/bdev/error/vbdev_error.o 00:02:17.266 CC module/bdev/delay/vbdev_delay.o 00:02:17.266 CC module/bdev/null/bdev_null_rpc.o 00:02:17.266 CC module/bdev/passthru/vbdev_passthru.o 00:02:17.266 CC module/bdev/delay/vbdev_delay_rpc.o 00:02:17.266 CC module/bdev/malloc/bdev_malloc.o 00:02:17.266 CC module/bdev/gpt/vbdev_gpt.o 00:02:17.266 CC module/bdev/split/vbdev_split.o 00:02:17.266 CC module/bdev/error/vbdev_error_rpc.o 00:02:17.266 CC module/bdev/aio/bdev_aio_rpc.o 00:02:17.266 CC module/blobfs/bdev/blobfs_bdev.o 00:02:17.266 CC module/bdev/nvme/bdev_nvme.o 00:02:17.266 CC module/bdev/malloc/bdev_malloc_rpc.o 00:02:17.266 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:02:17.266 CC module/bdev/split/vbdev_split_rpc.o 00:02:17.266 CC module/bdev/nvme/bdev_nvme_rpc.o 00:02:17.266 CC module/bdev/virtio/bdev_virtio_scsi.o 00:02:17.266 CC module/bdev/zone_block/vbdev_zone_block.o 00:02:17.266 CC module/bdev/iscsi/bdev_iscsi.o 00:02:17.266 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:02:17.266 CC module/bdev/virtio/bdev_virtio_blk.o 00:02:17.266 CC module/bdev/nvme/nvme_rpc.o 00:02:17.266 CC module/bdev/raid/bdev_raid.o 00:02:17.266 CC module/bdev/lvol/vbdev_lvol.o 00:02:17.266 CC module/bdev/virtio/bdev_virtio_rpc.o 00:02:17.266 CC module/bdev/raid/bdev_raid_rpc.o 00:02:17.266 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:02:17.266 CC module/bdev/ftl/bdev_ftl.o 00:02:17.266 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:02:17.266 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:02:17.266 CC module/bdev/nvme/bdev_mdns_client.o 00:02:17.266 CC module/bdev/ftl/bdev_ftl_rpc.o 00:02:17.266 CC module/bdev/raid/bdev_raid_sb.o 00:02:17.266 CC module/bdev/nvme/vbdev_opal.o 00:02:17.266 CC module/bdev/raid/raid0.o 00:02:17.266 CC module/bdev/raid/raid1.o 00:02:17.266 CC module/bdev/nvme/vbdev_opal_rpc.o 00:02:17.266 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:02:17.266 CC module/bdev/raid/concat.o 00:02:17.833 LIB libspdk_bdev_error.a 00:02:17.834 LIB libspdk_blobfs_bdev.a 00:02:17.834 SO libspdk_bdev_error.so.5.0 00:02:17.834 SO libspdk_blobfs_bdev.so.5.0 00:02:17.834 LIB libspdk_sock_posix.a 00:02:17.834 LIB libspdk_bdev_split.a 00:02:17.834 LIB libspdk_bdev_null.a 00:02:17.834 SO libspdk_sock_posix.so.5.0 00:02:17.834 SO libspdk_bdev_split.so.5.0 00:02:17.834 SYMLINK libspdk_bdev_error.so 00:02:17.834 SO libspdk_bdev_null.so.5.0 00:02:17.834 SYMLINK libspdk_blobfs_bdev.so 00:02:17.834 LIB libspdk_bdev_gpt.a 00:02:17.834 LIB libspdk_bdev_ftl.a 00:02:17.834 SYMLINK libspdk_bdev_split.so 00:02:17.834 SYMLINK libspdk_sock_posix.so 00:02:17.834 SYMLINK libspdk_bdev_null.so 00:02:17.834 SO libspdk_bdev_gpt.so.5.0 00:02:17.834 SO libspdk_bdev_ftl.so.5.0 00:02:17.834 LIB libspdk_bdev_passthru.a 00:02:17.834 LIB libspdk_bdev_iscsi.a 00:02:17.834 LIB libspdk_bdev_delay.a 00:02:17.834 LIB libspdk_bdev_lvol.a 00:02:17.834 LIB libspdk_bdev_aio.a 00:02:17.834 SYMLINK libspdk_bdev_gpt.so 00:02:17.834 SYMLINK libspdk_bdev_ftl.so 00:02:17.834 SO libspdk_bdev_passthru.so.5.0 00:02:17.834 SO libspdk_bdev_delay.so.5.0 00:02:17.834 SO libspdk_bdev_iscsi.so.5.0 00:02:17.834 SO libspdk_bdev_lvol.so.5.0 00:02:17.834 LIB libspdk_bdev_zone_block.a 00:02:17.834 SO libspdk_bdev_aio.so.5.0 00:02:17.834 LIB libspdk_bdev_malloc.a 00:02:17.834 SO libspdk_bdev_zone_block.so.5.0 00:02:17.834 SYMLINK libspdk_bdev_passthru.so 00:02:17.834 SYMLINK libspdk_bdev_iscsi.so 00:02:17.834 SYMLINK libspdk_bdev_delay.so 00:02:17.834 SO libspdk_bdev_malloc.so.5.0 00:02:17.834 SYMLINK libspdk_bdev_lvol.so 00:02:18.092 SYMLINK libspdk_bdev_aio.so 00:02:18.092 SYMLINK libspdk_bdev_zone_block.so 00:02:18.092 SYMLINK libspdk_bdev_malloc.so 00:02:18.092 LIB libspdk_bdev_virtio.a 00:02:18.092 SO libspdk_bdev_virtio.so.5.0 00:02:18.092 SYMLINK libspdk_bdev_virtio.so 00:02:18.349 LIB libspdk_bdev_raid.a 00:02:18.349 SO libspdk_bdev_raid.so.5.0 00:02:18.607 SYMLINK libspdk_bdev_raid.so 00:02:19.594 LIB libspdk_bdev_nvme.a 00:02:19.594 SO libspdk_bdev_nvme.so.6.0 00:02:19.858 SYMLINK libspdk_bdev_nvme.so 00:02:19.858 CC module/event/subsystems/vmd/vmd.o 00:02:19.858 CC module/event/subsystems/iobuf/iobuf.o 00:02:19.858 CC module/event/subsystems/scheduler/scheduler.o 00:02:19.858 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:02:19.858 CC module/event/subsystems/sock/sock.o 00:02:19.858 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:02:19.858 CC module/event/subsystems/vmd/vmd_rpc.o 00:02:20.116 LIB libspdk_event_sock.a 00:02:20.116 LIB libspdk_event_scheduler.a 00:02:20.116 LIB libspdk_event_vhost_blk.a 00:02:20.116 LIB libspdk_event_vmd.a 00:02:20.116 SO libspdk_event_sock.so.4.0 00:02:20.116 SO libspdk_event_scheduler.so.3.0 00:02:20.116 LIB libspdk_event_iobuf.a 00:02:20.116 SO libspdk_event_vhost_blk.so.2.0 00:02:20.116 SO libspdk_event_vmd.so.5.0 00:02:20.116 SO libspdk_event_iobuf.so.2.0 00:02:20.116 SYMLINK libspdk_event_sock.so 00:02:20.116 SYMLINK libspdk_event_scheduler.so 00:02:20.116 SYMLINK libspdk_event_vhost_blk.so 00:02:20.116 SYMLINK libspdk_event_vmd.so 00:02:20.116 SYMLINK libspdk_event_iobuf.so 00:02:20.374 CC module/event/subsystems/accel/accel.o 00:02:20.374 LIB libspdk_event_accel.a 00:02:20.374 SO libspdk_event_accel.so.5.0 00:02:20.632 SYMLINK libspdk_event_accel.so 00:02:20.632 CC module/event/subsystems/bdev/bdev.o 00:02:20.891 LIB libspdk_event_bdev.a 00:02:20.891 SO libspdk_event_bdev.so.5.0 00:02:20.891 SYMLINK libspdk_event_bdev.so 00:02:20.891 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:02:20.891 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:02:20.891 CC module/event/subsystems/scsi/scsi.o 00:02:20.891 CC module/event/subsystems/ublk/ublk.o 00:02:20.891 CC module/event/subsystems/nbd/nbd.o 00:02:21.150 LIB libspdk_event_ublk.a 00:02:21.150 LIB libspdk_event_nbd.a 00:02:21.150 LIB libspdk_event_scsi.a 00:02:21.150 SO libspdk_event_ublk.so.2.0 00:02:21.150 SO libspdk_event_nbd.so.5.0 00:02:21.150 SO libspdk_event_scsi.so.5.0 00:02:21.150 SYMLINK libspdk_event_ublk.so 00:02:21.150 SYMLINK libspdk_event_nbd.so 00:02:21.150 SYMLINK libspdk_event_scsi.so 00:02:21.150 LIB libspdk_event_nvmf.a 00:02:21.150 SO libspdk_event_nvmf.so.5.0 00:02:21.408 SYMLINK libspdk_event_nvmf.so 00:02:21.408 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:02:21.408 CC module/event/subsystems/iscsi/iscsi.o 00:02:21.408 LIB libspdk_event_vhost_scsi.a 00:02:21.408 SO libspdk_event_vhost_scsi.so.2.0 00:02:21.408 LIB libspdk_event_iscsi.a 00:02:21.408 SO libspdk_event_iscsi.so.5.0 00:02:21.674 SYMLINK libspdk_event_vhost_scsi.so 00:02:21.674 SYMLINK libspdk_event_iscsi.so 00:02:21.674 SO libspdk.so.5.0 00:02:21.674 SYMLINK libspdk.so 00:02:21.674 CXX app/trace/trace.o 00:02:21.674 CC test/rpc_client/rpc_client_test.o 00:02:21.674 CC app/spdk_nvme_perf/perf.o 00:02:21.674 CC app/trace_record/trace_record.o 00:02:21.674 CC app/spdk_top/spdk_top.o 00:02:21.674 CC app/spdk_lspci/spdk_lspci.o 00:02:21.674 TEST_HEADER include/spdk/accel.h 00:02:21.674 TEST_HEADER include/spdk/accel_module.h 00:02:21.674 CC app/spdk_nvme_identify/identify.o 00:02:21.674 TEST_HEADER include/spdk/assert.h 00:02:21.941 CC app/spdk_nvme_discover/discovery_aer.o 00:02:21.941 TEST_HEADER include/spdk/barrier.h 00:02:21.941 TEST_HEADER include/spdk/base64.h 00:02:21.941 TEST_HEADER include/spdk/bdev.h 00:02:21.941 TEST_HEADER include/spdk/bdev_module.h 00:02:21.941 TEST_HEADER include/spdk/bdev_zone.h 00:02:21.941 TEST_HEADER include/spdk/bit_array.h 00:02:21.941 TEST_HEADER include/spdk/bit_pool.h 00:02:21.941 TEST_HEADER include/spdk/blob_bdev.h 00:02:21.941 TEST_HEADER include/spdk/blobfs_bdev.h 00:02:21.941 TEST_HEADER include/spdk/blobfs.h 00:02:21.941 TEST_HEADER include/spdk/blob.h 00:02:21.941 TEST_HEADER include/spdk/conf.h 00:02:21.941 TEST_HEADER include/spdk/config.h 00:02:21.941 TEST_HEADER include/spdk/cpuset.h 00:02:21.941 TEST_HEADER include/spdk/crc16.h 00:02:21.941 CC app/nvmf_tgt/nvmf_main.o 00:02:21.941 TEST_HEADER include/spdk/crc32.h 00:02:21.941 CC app/spdk_dd/spdk_dd.o 00:02:21.941 TEST_HEADER include/spdk/crc64.h 00:02:21.941 CC examples/interrupt_tgt/interrupt_tgt.o 00:02:21.941 TEST_HEADER include/spdk/dif.h 00:02:21.941 TEST_HEADER include/spdk/dma.h 00:02:21.941 CC app/iscsi_tgt/iscsi_tgt.o 00:02:21.941 CC app/vhost/vhost.o 00:02:21.941 TEST_HEADER include/spdk/endian.h 00:02:21.941 TEST_HEADER include/spdk/env_dpdk.h 00:02:21.941 TEST_HEADER include/spdk/env.h 00:02:21.941 TEST_HEADER include/spdk/event.h 00:02:21.941 CC examples/util/zipf/zipf.o 00:02:21.941 CC test/event/reactor/reactor.o 00:02:21.941 CC test/event/reactor_perf/reactor_perf.o 00:02:21.941 TEST_HEADER include/spdk/fd_group.h 00:02:21.941 CC test/app/histogram_perf/histogram_perf.o 00:02:21.941 CC test/event/event_perf/event_perf.o 00:02:21.941 CC test/env/memory/memory_ut.o 00:02:21.941 TEST_HEADER include/spdk/fd.h 00:02:21.941 CC test/env/pci/pci_ut.o 00:02:21.941 CC test/thread/poller_perf/poller_perf.o 00:02:21.941 TEST_HEADER include/spdk/file.h 00:02:21.941 CC test/env/vtophys/vtophys.o 00:02:21.941 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:02:21.941 TEST_HEADER include/spdk/ftl.h 00:02:21.941 TEST_HEADER include/spdk/gpt_spec.h 00:02:21.941 CC examples/ioat/perf/perf.o 00:02:21.941 CC examples/sock/hello_world/hello_sock.o 00:02:21.941 TEST_HEADER include/spdk/hexlify.h 00:02:21.941 CC test/nvme/aer/aer.o 00:02:21.941 CC app/fio/nvme/fio_plugin.o 00:02:21.941 CC examples/nvme/hello_world/hello_world.o 00:02:21.941 TEST_HEADER include/spdk/histogram_data.h 00:02:21.941 CC examples/accel/perf/accel_perf.o 00:02:21.941 CC examples/vmd/lsvmd/lsvmd.o 00:02:21.941 TEST_HEADER include/spdk/idxd.h 00:02:21.941 CC test/event/app_repeat/app_repeat.o 00:02:21.941 CC examples/idxd/perf/perf.o 00:02:21.941 TEST_HEADER include/spdk/idxd_spec.h 00:02:21.941 TEST_HEADER include/spdk/init.h 00:02:21.941 TEST_HEADER include/spdk/ioat.h 00:02:21.941 TEST_HEADER include/spdk/ioat_spec.h 00:02:21.941 TEST_HEADER include/spdk/iscsi_spec.h 00:02:21.941 CC app/spdk_tgt/spdk_tgt.o 00:02:21.941 TEST_HEADER include/spdk/json.h 00:02:21.941 TEST_HEADER include/spdk/jsonrpc.h 00:02:21.941 TEST_HEADER include/spdk/likely.h 00:02:21.941 TEST_HEADER include/spdk/log.h 00:02:21.941 TEST_HEADER include/spdk/lvol.h 00:02:21.941 TEST_HEADER include/spdk/memory.h 00:02:21.941 TEST_HEADER include/spdk/mmio.h 00:02:21.941 CC examples/bdev/hello_world/hello_bdev.o 00:02:21.941 TEST_HEADER include/spdk/nbd.h 00:02:21.941 CC test/blobfs/mkfs/mkfs.o 00:02:21.941 CC test/bdev/bdevio/bdevio.o 00:02:21.941 TEST_HEADER include/spdk/notify.h 00:02:21.941 CC test/dma/test_dma/test_dma.o 00:02:21.941 CC examples/bdev/bdevperf/bdevperf.o 00:02:21.941 TEST_HEADER include/spdk/nvme.h 00:02:21.941 CC examples/thread/thread/thread_ex.o 00:02:21.941 CC test/accel/dif/dif.o 00:02:21.941 TEST_HEADER include/spdk/nvme_intel.h 00:02:21.941 CC test/app/bdev_svc/bdev_svc.o 00:02:21.941 CC examples/blob/hello_world/hello_blob.o 00:02:21.941 CC test/event/scheduler/scheduler.o 00:02:21.941 TEST_HEADER include/spdk/nvme_ocssd.h 00:02:21.941 CC test/env/mem_callbacks/mem_callbacks.o 00:02:21.941 CC examples/nvmf/nvmf/nvmf.o 00:02:21.941 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:02:21.941 TEST_HEADER include/spdk/nvme_spec.h 00:02:21.941 TEST_HEADER include/spdk/nvme_zns.h 00:02:21.941 TEST_HEADER include/spdk/nvmf_cmd.h 00:02:21.941 CC test/lvol/esnap/esnap.o 00:02:21.941 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:02:21.941 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:02:21.941 TEST_HEADER include/spdk/nvmf.h 00:02:21.941 TEST_HEADER include/spdk/nvmf_spec.h 00:02:21.941 TEST_HEADER include/spdk/nvmf_transport.h 00:02:21.941 TEST_HEADER include/spdk/opal.h 00:02:21.941 TEST_HEADER include/spdk/opal_spec.h 00:02:21.941 TEST_HEADER include/spdk/pci_ids.h 00:02:21.941 TEST_HEADER include/spdk/pipe.h 00:02:21.941 TEST_HEADER include/spdk/queue.h 00:02:21.941 TEST_HEADER include/spdk/reduce.h 00:02:21.941 TEST_HEADER include/spdk/rpc.h 00:02:21.941 TEST_HEADER include/spdk/scheduler.h 00:02:21.941 TEST_HEADER include/spdk/scsi.h 00:02:21.941 TEST_HEADER include/spdk/scsi_spec.h 00:02:21.941 TEST_HEADER include/spdk/sock.h 00:02:21.941 TEST_HEADER include/spdk/stdinc.h 00:02:21.941 TEST_HEADER include/spdk/string.h 00:02:21.941 TEST_HEADER include/spdk/thread.h 00:02:21.941 TEST_HEADER include/spdk/trace.h 00:02:21.941 TEST_HEADER include/spdk/trace_parser.h 00:02:21.941 TEST_HEADER include/spdk/tree.h 00:02:21.941 TEST_HEADER include/spdk/ublk.h 00:02:22.202 TEST_HEADER include/spdk/util.h 00:02:22.202 LINK spdk_lspci 00:02:22.202 TEST_HEADER include/spdk/uuid.h 00:02:22.202 TEST_HEADER include/spdk/version.h 00:02:22.202 TEST_HEADER include/spdk/vfio_user_pci.h 00:02:22.202 TEST_HEADER include/spdk/vfio_user_spec.h 00:02:22.202 TEST_HEADER include/spdk/vhost.h 00:02:22.202 TEST_HEADER include/spdk/vmd.h 00:02:22.202 TEST_HEADER include/spdk/xor.h 00:02:22.202 TEST_HEADER include/spdk/zipf.h 00:02:22.202 CXX test/cpp_headers/accel.o 00:02:22.202 LINK rpc_client_test 00:02:22.202 LINK histogram_perf 00:02:22.202 LINK reactor 00:02:22.202 LINK reactor_perf 00:02:22.202 LINK event_perf 00:02:22.202 LINK zipf 00:02:22.202 LINK spdk_nvme_discover 00:02:22.202 LINK poller_perf 00:02:22.202 LINK vtophys 00:02:22.202 LINK lsvmd 00:02:22.202 LINK interrupt_tgt 00:02:22.202 LINK app_repeat 00:02:22.202 LINK nvmf_tgt 00:02:22.202 LINK env_dpdk_post_init 00:02:22.202 LINK vhost 00:02:22.202 LINK spdk_trace_record 00:02:22.202 LINK iscsi_tgt 00:02:22.202 LINK bdev_svc 00:02:22.202 LINK ioat_perf 00:02:22.465 LINK spdk_tgt 00:02:22.465 LINK mkfs 00:02:22.465 LINK hello_world 00:02:22.465 LINK hello_sock 00:02:22.465 LINK scheduler 00:02:22.465 LINK hello_bdev 00:02:22.465 LINK hello_blob 00:02:22.465 CXX test/cpp_headers/accel_module.o 00:02:22.465 LINK thread 00:02:22.465 LINK aer 00:02:22.466 CXX test/cpp_headers/assert.o 00:02:22.466 CC app/fio/bdev/fio_plugin.o 00:02:22.466 LINK idxd_perf 00:02:22.466 LINK spdk_dd 00:02:22.466 CXX test/cpp_headers/barrier.o 00:02:22.466 CC test/nvme/reset/reset.o 00:02:22.466 LINK nvmf 00:02:22.466 CC examples/nvme/reconnect/reconnect.o 00:02:22.466 CC test/app/jsoncat/jsoncat.o 00:02:22.729 CC examples/vmd/led/led.o 00:02:22.729 CC examples/nvme/nvme_manage/nvme_manage.o 00:02:22.729 CC examples/ioat/verify/verify.o 00:02:22.729 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:02:22.729 LINK spdk_trace 00:02:22.729 LINK pci_ut 00:02:22.729 CC test/nvme/sgl/sgl.o 00:02:22.729 CC examples/nvme/arbitration/arbitration.o 00:02:22.729 CC test/nvme/e2edp/nvme_dp.o 00:02:22.729 CC examples/blob/cli/blobcli.o 00:02:22.729 LINK bdevio 00:02:22.729 CC test/nvme/overhead/overhead.o 00:02:22.729 LINK dif 00:02:22.729 LINK test_dma 00:02:22.729 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:02:22.729 CC examples/nvme/hotplug/hotplug.o 00:02:22.729 CXX test/cpp_headers/base64.o 00:02:22.729 LINK accel_perf 00:02:22.729 LINK nvme_fuzz 00:02:22.729 CC test/app/stub/stub.o 00:02:22.729 CXX test/cpp_headers/bdev.o 00:02:22.729 CC examples/nvme/cmb_copy/cmb_copy.o 00:02:22.729 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:02:22.729 CC test/nvme/err_injection/err_injection.o 00:02:22.729 CC examples/nvme/abort/abort.o 00:02:22.729 CXX test/cpp_headers/bdev_module.o 00:02:22.729 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:02:22.729 LINK jsoncat 00:02:22.993 CC test/nvme/startup/startup.o 00:02:22.993 CC test/nvme/reserve/reserve.o 00:02:22.993 LINK led 00:02:22.993 CC test/nvme/connect_stress/connect_stress.o 00:02:22.993 CXX test/cpp_headers/bdev_zone.o 00:02:22.993 CC test/nvme/simple_copy/simple_copy.o 00:02:22.993 CC test/nvme/boot_partition/boot_partition.o 00:02:22.993 CC test/nvme/compliance/nvme_compliance.o 00:02:22.993 LINK spdk_nvme 00:02:22.993 CXX test/cpp_headers/bit_array.o 00:02:22.993 LINK verify 00:02:22.993 CC test/nvme/fused_ordering/fused_ordering.o 00:02:22.993 CC test/nvme/doorbell_aers/doorbell_aers.o 00:02:22.993 LINK reset 00:02:22.993 CXX test/cpp_headers/bit_pool.o 00:02:22.993 CC test/nvme/fdp/fdp.o 00:02:22.993 CXX test/cpp_headers/blob_bdev.o 00:02:22.993 CXX test/cpp_headers/blobfs_bdev.o 00:02:22.993 CXX test/cpp_headers/blobfs.o 00:02:22.993 LINK stub 00:02:23.255 CXX test/cpp_headers/blob.o 00:02:23.255 CXX test/cpp_headers/conf.o 00:02:23.255 CXX test/cpp_headers/config.o 00:02:23.255 CXX test/cpp_headers/cpuset.o 00:02:23.255 LINK cmb_copy 00:02:23.255 LINK nvme_dp 00:02:23.255 LINK err_injection 00:02:23.255 LINK mem_callbacks 00:02:23.255 CC test/nvme/cuse/cuse.o 00:02:23.255 CXX test/cpp_headers/crc16.o 00:02:23.255 LINK sgl 00:02:23.255 LINK hotplug 00:02:23.255 CXX test/cpp_headers/crc32.o 00:02:23.255 LINK pmr_persistence 00:02:23.255 LINK startup 00:02:23.255 CXX test/cpp_headers/crc64.o 00:02:23.255 LINK reconnect 00:02:23.255 LINK overhead 00:02:23.255 LINK connect_stress 00:02:23.255 LINK spdk_nvme_perf 00:02:23.255 CXX test/cpp_headers/dif.o 00:02:23.255 LINK boot_partition 00:02:23.255 LINK reserve 00:02:23.255 LINK arbitration 00:02:23.255 CXX test/cpp_headers/dma.o 00:02:23.255 CXX test/cpp_headers/endian.o 00:02:23.255 CXX test/cpp_headers/env_dpdk.o 00:02:23.255 LINK bdevperf 00:02:23.255 LINK simple_copy 00:02:23.255 CXX test/cpp_headers/env.o 00:02:23.517 LINK spdk_nvme_identify 00:02:23.517 LINK spdk_top 00:02:23.517 CXX test/cpp_headers/event.o 00:02:23.517 CXX test/cpp_headers/fd_group.o 00:02:23.517 LINK doorbell_aers 00:02:23.517 LINK fused_ordering 00:02:23.517 LINK spdk_bdev 00:02:23.517 CXX test/cpp_headers/fd.o 00:02:23.517 CXX test/cpp_headers/file.o 00:02:23.517 CXX test/cpp_headers/ftl.o 00:02:23.517 CXX test/cpp_headers/hexlify.o 00:02:23.517 CXX test/cpp_headers/gpt_spec.o 00:02:23.517 CXX test/cpp_headers/histogram_data.o 00:02:23.517 CXX test/cpp_headers/idxd.o 00:02:23.517 CXX test/cpp_headers/idxd_spec.o 00:02:23.517 LINK abort 00:02:23.517 CXX test/cpp_headers/init.o 00:02:23.517 LINK nvme_manage 00:02:23.517 CXX test/cpp_headers/ioat.o 00:02:23.517 CXX test/cpp_headers/ioat_spec.o 00:02:23.517 CXX test/cpp_headers/iscsi_spec.o 00:02:23.517 CXX test/cpp_headers/json.o 00:02:23.517 CXX test/cpp_headers/jsonrpc.o 00:02:23.517 CXX test/cpp_headers/likely.o 00:02:23.517 CXX test/cpp_headers/log.o 00:02:23.517 CXX test/cpp_headers/lvol.o 00:02:23.517 CXX test/cpp_headers/memory.o 00:02:23.517 LINK nvme_compliance 00:02:23.517 CXX test/cpp_headers/mmio.o 00:02:23.517 LINK vhost_fuzz 00:02:23.517 LINK blobcli 00:02:23.517 CXX test/cpp_headers/nbd.o 00:02:23.517 LINK memory_ut 00:02:23.517 CXX test/cpp_headers/notify.o 00:02:23.517 CXX test/cpp_headers/nvme.o 00:02:23.517 CXX test/cpp_headers/nvme_intel.o 00:02:23.517 CXX test/cpp_headers/nvme_ocssd.o 00:02:23.779 CXX test/cpp_headers/nvme_ocssd_spec.o 00:02:23.779 CXX test/cpp_headers/nvme_spec.o 00:02:23.779 CXX test/cpp_headers/nvme_zns.o 00:02:23.779 CXX test/cpp_headers/nvmf_cmd.o 00:02:23.779 CXX test/cpp_headers/nvmf_fc_spec.o 00:02:23.779 CXX test/cpp_headers/nvmf.o 00:02:23.779 CXX test/cpp_headers/nvmf_spec.o 00:02:23.779 LINK fdp 00:02:23.779 CXX test/cpp_headers/nvmf_transport.o 00:02:23.779 CXX test/cpp_headers/opal.o 00:02:23.779 CXX test/cpp_headers/opal_spec.o 00:02:23.779 CXX test/cpp_headers/pci_ids.o 00:02:23.779 CXX test/cpp_headers/pipe.o 00:02:23.779 CXX test/cpp_headers/queue.o 00:02:23.779 CXX test/cpp_headers/reduce.o 00:02:23.779 CXX test/cpp_headers/rpc.o 00:02:23.779 CXX test/cpp_headers/scheduler.o 00:02:23.779 CXX test/cpp_headers/scsi.o 00:02:23.779 CXX test/cpp_headers/scsi_spec.o 00:02:23.779 CXX test/cpp_headers/sock.o 00:02:23.779 CXX test/cpp_headers/stdinc.o 00:02:23.779 CXX test/cpp_headers/string.o 00:02:23.779 CXX test/cpp_headers/thread.o 00:02:23.779 CXX test/cpp_headers/trace.o 00:02:23.779 CXX test/cpp_headers/trace_parser.o 00:02:23.779 CXX test/cpp_headers/tree.o 00:02:24.038 CXX test/cpp_headers/ublk.o 00:02:24.038 CXX test/cpp_headers/util.o 00:02:24.038 CXX test/cpp_headers/uuid.o 00:02:24.038 CXX test/cpp_headers/version.o 00:02:24.038 CXX test/cpp_headers/vfio_user_pci.o 00:02:24.038 CXX test/cpp_headers/vfio_user_spec.o 00:02:24.038 CXX test/cpp_headers/vhost.o 00:02:24.038 CXX test/cpp_headers/vmd.o 00:02:24.038 CXX test/cpp_headers/xor.o 00:02:24.038 CXX test/cpp_headers/zipf.o 00:02:24.603 LINK cuse 00:02:24.861 LINK iscsi_fuzz 00:02:27.419 LINK esnap 00:02:27.677 00:02:27.677 real 0m45.121s 00:02:27.677 user 9m35.798s 00:02:27.677 sys 2m9.090s 00:02:27.677 08:41:15 -- common/autotest_common.sh@1105 -- $ xtrace_disable 00:02:27.677 08:41:15 -- common/autotest_common.sh@10 -- $ set +x 00:02:27.677 ************************************ 00:02:27.677 END TEST make 00:02:27.677 ************************************ 00:02:27.677 08:41:16 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:02:27.677 08:41:16 -- nvmf/common.sh@7 -- # uname -s 00:02:27.677 08:41:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:02:27.677 08:41:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:02:27.677 08:41:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:02:27.677 08:41:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:02:27.677 08:41:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:02:27.677 08:41:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:02:27.677 08:41:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:02:27.677 08:41:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:02:27.677 08:41:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:02:27.677 08:41:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:02:27.677 08:41:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:02:27.677 08:41:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:02:27.677 08:41:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:02:27.677 08:41:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:02:27.677 08:41:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:02:27.677 08:41:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:02:27.677 08:41:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:02:27.677 08:41:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:02:27.677 08:41:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:02:27.677 08:41:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:27.677 08:41:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:27.677 08:41:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:27.677 08:41:16 -- paths/export.sh@5 -- # export PATH 00:02:27.677 08:41:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:27.677 08:41:16 -- nvmf/common.sh@46 -- # : 0 00:02:27.677 08:41:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:02:27.677 08:41:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:02:27.677 08:41:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:02:27.677 08:41:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:02:27.677 08:41:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:02:27.677 08:41:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:02:27.677 08:41:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:02:27.677 08:41:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:02:27.677 08:41:16 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:02:27.677 08:41:16 -- spdk/autotest.sh@32 -- # uname -s 00:02:27.677 08:41:16 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:02:27.677 08:41:16 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:02:27.677 08:41:16 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:27.677 08:41:16 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:02:27.677 08:41:16 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:27.677 08:41:16 -- spdk/autotest.sh@44 -- # modprobe nbd 00:02:27.677 08:41:16 -- spdk/autotest.sh@46 -- # type -P udevadm 00:02:27.677 08:41:16 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:02:27.677 08:41:16 -- spdk/autotest.sh@48 -- # udevadm_pid=1346963 00:02:27.677 08:41:16 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:02:27.677 08:41:16 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:27.677 08:41:16 -- spdk/autotest.sh@54 -- # echo 1346965 00:02:27.677 08:41:16 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:27.677 08:41:16 -- spdk/autotest.sh@56 -- # echo 1346966 00:02:27.677 08:41:16 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:27.677 08:41:16 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:02:27.677 08:41:16 -- spdk/autotest.sh@60 -- # echo 1346967 00:02:27.677 08:41:16 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:02:27.677 08:41:16 -- spdk/autotest.sh@62 -- # echo 1346968 00:02:27.677 08:41:16 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:02:27.677 08:41:16 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:02:27.677 08:41:16 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:02:27.677 08:41:16 -- common/autotest_common.sh@712 -- # xtrace_disable 00:02:27.677 08:41:16 -- common/autotest_common.sh@10 -- # set +x 00:02:27.677 08:41:16 -- spdk/autotest.sh@70 -- # create_test_list 00:02:27.677 08:41:16 -- common/autotest_common.sh@736 -- # xtrace_disable 00:02:27.677 08:41:16 -- common/autotest_common.sh@10 -- # set +x 00:02:27.677 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:02:27.677 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:02:27.677 08:41:16 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:02:27.677 08:41:16 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:27.677 08:41:16 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:27.677 08:41:16 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:02:27.677 08:41:16 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:27.677 08:41:16 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:02:27.677 08:41:16 -- common/autotest_common.sh@1440 -- # uname 00:02:27.677 08:41:16 -- common/autotest_common.sh@1440 -- # '[' Linux = FreeBSD ']' 00:02:27.677 08:41:16 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:02:27.677 08:41:16 -- common/autotest_common.sh@1460 -- # uname 00:02:27.677 08:41:16 -- common/autotest_common.sh@1460 -- # [[ Linux = FreeBSD ]] 00:02:27.677 08:41:16 -- spdk/autotest.sh@82 -- # grep CC_TYPE mk/cc.mk 00:02:27.677 08:41:16 -- spdk/autotest.sh@82 -- # CC_TYPE=CC_TYPE=gcc 00:02:27.677 08:41:16 -- spdk/autotest.sh@83 -- # hash lcov 00:02:27.677 08:41:16 -- spdk/autotest.sh@83 -- # [[ CC_TYPE=gcc == *\c\l\a\n\g* ]] 00:02:27.677 08:41:16 -- spdk/autotest.sh@91 -- # export 'LCOV_OPTS= 00:02:27.677 --rc lcov_branch_coverage=1 00:02:27.677 --rc lcov_function_coverage=1 00:02:27.677 --rc genhtml_branch_coverage=1 00:02:27.677 --rc genhtml_function_coverage=1 00:02:27.677 --rc genhtml_legend=1 00:02:27.677 --rc geninfo_all_blocks=1 00:02:27.677 ' 00:02:27.677 08:41:16 -- spdk/autotest.sh@91 -- # LCOV_OPTS=' 00:02:27.677 --rc lcov_branch_coverage=1 00:02:27.677 --rc lcov_function_coverage=1 00:02:27.678 --rc genhtml_branch_coverage=1 00:02:27.678 --rc genhtml_function_coverage=1 00:02:27.678 --rc genhtml_legend=1 00:02:27.678 --rc geninfo_all_blocks=1 00:02:27.678 ' 00:02:27.678 08:41:16 -- spdk/autotest.sh@92 -- # export 'LCOV=lcov 00:02:27.678 --rc lcov_branch_coverage=1 00:02:27.678 --rc lcov_function_coverage=1 00:02:27.678 --rc genhtml_branch_coverage=1 00:02:27.678 --rc genhtml_function_coverage=1 00:02:27.678 --rc genhtml_legend=1 00:02:27.678 --rc geninfo_all_blocks=1 00:02:27.678 --no-external' 00:02:27.678 08:41:16 -- spdk/autotest.sh@92 -- # LCOV='lcov 00:02:27.678 --rc lcov_branch_coverage=1 00:02:27.678 --rc lcov_function_coverage=1 00:02:27.678 --rc genhtml_branch_coverage=1 00:02:27.678 --rc genhtml_function_coverage=1 00:02:27.678 --rc genhtml_legend=1 00:02:27.678 --rc geninfo_all_blocks=1 00:02:27.678 --no-external' 00:02:27.678 08:41:16 -- spdk/autotest.sh@94 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -v 00:02:27.678 lcov: LCOV version 1.14 00:02:27.678 08:41:16 -- spdk/autotest.sh@96 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -c -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:02:29.587 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel.gcno:no functions found 00:02:29.587 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel.gcno 00:02:29.587 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel_module.gcno:no functions found 00:02:29.587 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel_module.gcno 00:02:29.587 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/assert.gcno:no functions found 00:02:29.587 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/assert.gcno 00:02:29.587 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/barrier.gcno:no functions found 00:02:29.587 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/barrier.gcno 00:02:29.587 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/base64.gcno:no functions found 00:02:29.587 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/base64.gcno 00:02:29.587 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev.gcno:no functions found 00:02:29.587 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev.gcno 00:02:29.587 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_module.gcno:no functions found 00:02:29.587 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_module.gcno 00:02:29.587 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_zone.gcno:no functions found 00:02:29.587 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_zone.gcno 00:02:29.587 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_array.gcno:no functions found 00:02:29.587 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_array.gcno 00:02:29.587 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_pool.gcno:no functions found 00:02:29.587 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_pool.gcno 00:02:29.587 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob_bdev.gcno:no functions found 00:02:29.587 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob_bdev.gcno 00:02:29.587 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs_bdev.gcno:no functions found 00:02:29.587 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs_bdev.gcno 00:02:29.587 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs.gcno:no functions found 00:02:29.587 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs.gcno 00:02:29.587 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob.gcno:no functions found 00:02:29.587 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob.gcno 00:02:29.587 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/conf.gcno:no functions found 00:02:29.587 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/conf.gcno 00:02:29.587 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/config.gcno:no functions found 00:02:29.587 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/config.gcno 00:02:29.587 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/cpuset.gcno:no functions found 00:02:29.587 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/cpuset.gcno 00:02:29.587 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc16.gcno:no functions found 00:02:29.587 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc16.gcno 00:02:29.587 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc32.gcno:no functions found 00:02:29.587 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc32.gcno 00:02:29.587 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc64.gcno:no functions found 00:02:29.587 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc64.gcno 00:02:29.587 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dif.gcno:no functions found 00:02:29.587 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dif.gcno 00:02:29.587 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dma.gcno:no functions found 00:02:29.587 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dma.gcno 00:02:29.587 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/endian.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/endian.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env_dpdk.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env_dpdk.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/event.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/event.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd_group.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd_group.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/file.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/file.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ftl.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ftl.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/hexlify.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/hexlify.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/gpt_spec.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/gpt_spec.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/histogram_data.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/histogram_data.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd_spec.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd_spec.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/init.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/init.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat_spec.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat_spec.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/iscsi_spec.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/iscsi_spec.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/json.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/json.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/jsonrpc.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/jsonrpc.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/likely.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/likely.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/log.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/log.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/lvol.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/lvol.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/memory.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/memory.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/mmio.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/mmio.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nbd.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nbd.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/notify.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/notify.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_intel.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_intel.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd_spec.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd_spec.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_spec.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_spec.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_zns.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_zns.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_cmd.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_cmd.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_fc_spec.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_fc_spec.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_spec.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_spec.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_transport.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_transport.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal_spec.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal_spec.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pci_ids.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pci_ids.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pipe.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pipe.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/queue.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/queue.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/reduce.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/reduce.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/rpc.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/rpc.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scheduler.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scheduler.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi_spec.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi_spec.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/sock.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/sock.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/stdinc.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/stdinc.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/string.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/string.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/thread.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/thread.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace_parser.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace_parser.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/tree.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/tree.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ublk.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ublk.gcno 00:02:29.588 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/util.gcno:no functions found 00:02:29.588 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/util.gcno 00:02:29.589 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/uuid.gcno:no functions found 00:02:29.589 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/uuid.gcno 00:02:29.589 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/version.gcno:no functions found 00:02:29.589 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/version.gcno 00:02:29.589 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_pci.gcno:no functions found 00:02:29.589 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_pci.gcno 00:02:29.589 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_spec.gcno:no functions found 00:02:29.589 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_spec.gcno 00:02:29.589 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vhost.gcno:no functions found 00:02:29.589 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vhost.gcno 00:02:29.589 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vmd.gcno:no functions found 00:02:29.589 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vmd.gcno 00:02:29.589 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/xor.gcno:no functions found 00:02:29.589 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/xor.gcno 00:02:29.589 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/zipf.gcno:no functions found 00:02:29.589 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/zipf.gcno 00:02:44.469 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:02:44.469 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:02:44.469 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:02:44.469 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:02:44.469 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:02:44.469 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:02:59.347 08:41:46 -- spdk/autotest.sh@100 -- # timing_enter pre_cleanup 00:02:59.347 08:41:46 -- common/autotest_common.sh@712 -- # xtrace_disable 00:02:59.347 08:41:46 -- common/autotest_common.sh@10 -- # set +x 00:02:59.347 08:41:46 -- spdk/autotest.sh@102 -- # rm -f 00:02:59.347 08:41:46 -- spdk/autotest.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:59.605 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:02:59.605 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:02:59.605 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:02:59.605 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:02:59.605 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:02:59.605 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:02:59.605 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:02:59.605 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:02:59.605 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:02:59.605 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:02:59.605 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:02:59.605 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:02:59.605 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:02:59.864 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:02:59.864 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:02:59.865 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:02:59.865 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:02:59.865 08:41:48 -- spdk/autotest.sh@107 -- # get_zoned_devs 00:02:59.865 08:41:48 -- common/autotest_common.sh@1654 -- # zoned_devs=() 00:02:59.865 08:41:48 -- common/autotest_common.sh@1654 -- # local -gA zoned_devs 00:02:59.865 08:41:48 -- common/autotest_common.sh@1655 -- # local nvme bdf 00:02:59.865 08:41:48 -- common/autotest_common.sh@1657 -- # for nvme in /sys/block/nvme* 00:02:59.865 08:41:48 -- common/autotest_common.sh@1658 -- # is_block_zoned nvme0n1 00:02:59.865 08:41:48 -- common/autotest_common.sh@1647 -- # local device=nvme0n1 00:02:59.865 08:41:48 -- common/autotest_common.sh@1649 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:02:59.865 08:41:48 -- common/autotest_common.sh@1650 -- # [[ none != none ]] 00:02:59.865 08:41:48 -- spdk/autotest.sh@109 -- # (( 0 > 0 )) 00:02:59.865 08:41:48 -- spdk/autotest.sh@121 -- # ls /dev/nvme0n1 00:02:59.865 08:41:48 -- spdk/autotest.sh@121 -- # grep -v p 00:02:59.865 08:41:48 -- spdk/autotest.sh@121 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:02:59.865 08:41:48 -- spdk/autotest.sh@123 -- # [[ -z '' ]] 00:02:59.865 08:41:48 -- spdk/autotest.sh@124 -- # block_in_use /dev/nvme0n1 00:02:59.865 08:41:48 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:02:59.865 08:41:48 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:02:59.865 No valid GPT data, bailing 00:02:59.865 08:41:48 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:02:59.865 08:41:48 -- scripts/common.sh@393 -- # pt= 00:02:59.865 08:41:48 -- scripts/common.sh@394 -- # return 1 00:02:59.865 08:41:48 -- spdk/autotest.sh@125 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:02:59.865 1+0 records in 00:02:59.865 1+0 records out 00:02:59.865 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00250511 s, 419 MB/s 00:02:59.865 08:41:48 -- spdk/autotest.sh@129 -- # sync 00:02:59.865 08:41:48 -- spdk/autotest.sh@131 -- # xtrace_disable_per_cmd reap_spdk_processes 00:02:59.865 08:41:48 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:02:59.865 08:41:48 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:03:01.769 08:41:50 -- spdk/autotest.sh@135 -- # uname -s 00:03:01.769 08:41:50 -- spdk/autotest.sh@135 -- # '[' Linux = Linux ']' 00:03:01.769 08:41:50 -- spdk/autotest.sh@136 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:03:01.769 08:41:50 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:01.769 08:41:50 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:01.769 08:41:50 -- common/autotest_common.sh@10 -- # set +x 00:03:01.769 ************************************ 00:03:01.769 START TEST setup.sh 00:03:01.769 ************************************ 00:03:01.769 08:41:50 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:03:01.769 * Looking for test storage... 00:03:01.769 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:01.769 08:41:50 -- setup/test-setup.sh@10 -- # uname -s 00:03:01.769 08:41:50 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:03:01.769 08:41:50 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:03:01.770 08:41:50 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:01.770 08:41:50 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:01.770 08:41:50 -- common/autotest_common.sh@10 -- # set +x 00:03:01.770 ************************************ 00:03:01.770 START TEST acl 00:03:01.770 ************************************ 00:03:01.770 08:41:50 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:03:02.030 * Looking for test storage... 00:03:02.030 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:02.030 08:41:50 -- setup/acl.sh@10 -- # get_zoned_devs 00:03:02.030 08:41:50 -- common/autotest_common.sh@1654 -- # zoned_devs=() 00:03:02.030 08:41:50 -- common/autotest_common.sh@1654 -- # local -gA zoned_devs 00:03:02.030 08:41:50 -- common/autotest_common.sh@1655 -- # local nvme bdf 00:03:02.030 08:41:50 -- common/autotest_common.sh@1657 -- # for nvme in /sys/block/nvme* 00:03:02.030 08:41:50 -- common/autotest_common.sh@1658 -- # is_block_zoned nvme0n1 00:03:02.030 08:41:50 -- common/autotest_common.sh@1647 -- # local device=nvme0n1 00:03:02.030 08:41:50 -- common/autotest_common.sh@1649 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:02.030 08:41:50 -- common/autotest_common.sh@1650 -- # [[ none != none ]] 00:03:02.030 08:41:50 -- setup/acl.sh@12 -- # devs=() 00:03:02.030 08:41:50 -- setup/acl.sh@12 -- # declare -a devs 00:03:02.030 08:41:50 -- setup/acl.sh@13 -- # drivers=() 00:03:02.030 08:41:50 -- setup/acl.sh@13 -- # declare -A drivers 00:03:02.030 08:41:50 -- setup/acl.sh@51 -- # setup reset 00:03:02.030 08:41:50 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:02.030 08:41:50 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:03.406 08:41:51 -- setup/acl.sh@52 -- # collect_setup_devs 00:03:03.406 08:41:51 -- setup/acl.sh@16 -- # local dev driver 00:03:03.406 08:41:51 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.406 08:41:51 -- setup/acl.sh@15 -- # setup output status 00:03:03.406 08:41:51 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:03.406 08:41:51 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:04.342 Hugepages 00:03:04.342 node hugesize free / total 00:03:04.342 08:41:52 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:03:04.342 08:41:52 -- setup/acl.sh@19 -- # continue 00:03:04.342 08:41:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:04.342 08:41:52 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:03:04.342 08:41:52 -- setup/acl.sh@19 -- # continue 00:03:04.342 08:41:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:04.342 08:41:52 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:03:04.342 08:41:52 -- setup/acl.sh@19 -- # continue 00:03:04.342 08:41:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:04.342 00:03:04.342 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:04.342 08:41:52 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:03:04.342 08:41:52 -- setup/acl.sh@19 -- # continue 00:03:04.342 08:41:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:04.342 08:41:52 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:03:04.342 08:41:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:04.342 08:41:52 -- setup/acl.sh@20 -- # continue 00:03:04.342 08:41:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:04.342 08:41:52 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:03:04.342 08:41:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:04.342 08:41:52 -- setup/acl.sh@20 -- # continue 00:03:04.342 08:41:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:04.342 08:41:52 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:03:04.342 08:41:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:04.342 08:41:52 -- setup/acl.sh@20 -- # continue 00:03:04.342 08:41:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:04.342 08:41:52 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:03:04.342 08:41:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:04.342 08:41:52 -- setup/acl.sh@20 -- # continue 00:03:04.342 08:41:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:04.342 08:41:52 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:03:04.342 08:41:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:04.342 08:41:52 -- setup/acl.sh@20 -- # continue 00:03:04.342 08:41:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:04.342 08:41:52 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:03:04.342 08:41:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:04.342 08:41:52 -- setup/acl.sh@20 -- # continue 00:03:04.342 08:41:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:04.342 08:41:52 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:03:04.342 08:41:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:04.342 08:41:52 -- setup/acl.sh@20 -- # continue 00:03:04.342 08:41:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:04.342 08:41:52 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:03:04.342 08:41:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:04.342 08:41:52 -- setup/acl.sh@20 -- # continue 00:03:04.342 08:41:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:04.342 08:41:52 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:03:04.342 08:41:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:04.342 08:41:52 -- setup/acl.sh@20 -- # continue 00:03:04.342 08:41:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:04.342 08:41:52 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:03:04.342 08:41:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:04.342 08:41:52 -- setup/acl.sh@20 -- # continue 00:03:04.342 08:41:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:04.342 08:41:52 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:03:04.342 08:41:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:04.342 08:41:52 -- setup/acl.sh@20 -- # continue 00:03:04.342 08:41:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:04.342 08:41:52 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:03:04.342 08:41:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:04.342 08:41:52 -- setup/acl.sh@20 -- # continue 00:03:04.342 08:41:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:04.342 08:41:52 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:03:04.342 08:41:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:04.342 08:41:52 -- setup/acl.sh@20 -- # continue 00:03:04.342 08:41:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:04.342 08:41:52 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:03:04.342 08:41:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:04.342 08:41:52 -- setup/acl.sh@20 -- # continue 00:03:04.342 08:41:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:04.342 08:41:52 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:03:04.342 08:41:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:04.342 08:41:52 -- setup/acl.sh@20 -- # continue 00:03:04.342 08:41:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:04.342 08:41:52 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:03:04.342 08:41:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:04.342 08:41:52 -- setup/acl.sh@20 -- # continue 00:03:04.342 08:41:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:04.342 08:41:52 -- setup/acl.sh@19 -- # [[ 0000:88:00.0 == *:*:*.* ]] 00:03:04.342 08:41:52 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:03:04.342 08:41:52 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:03:04.342 08:41:52 -- setup/acl.sh@22 -- # devs+=("$dev") 00:03:04.342 08:41:52 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:03:04.342 08:41:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:04.342 08:41:52 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:03:04.342 08:41:52 -- setup/acl.sh@54 -- # run_test denied denied 00:03:04.342 08:41:52 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:04.342 08:41:52 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:04.342 08:41:52 -- common/autotest_common.sh@10 -- # set +x 00:03:04.342 ************************************ 00:03:04.342 START TEST denied 00:03:04.342 ************************************ 00:03:04.342 08:41:52 -- common/autotest_common.sh@1104 -- # denied 00:03:04.342 08:41:52 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:88:00.0' 00:03:04.342 08:41:52 -- setup/acl.sh@38 -- # setup output config 00:03:04.342 08:41:52 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:88:00.0' 00:03:04.342 08:41:52 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:04.342 08:41:52 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:05.767 0000:88:00.0 (8086 0a54): Skipping denied controller at 0000:88:00.0 00:03:05.767 08:41:54 -- setup/acl.sh@40 -- # verify 0000:88:00.0 00:03:05.767 08:41:54 -- setup/acl.sh@28 -- # local dev driver 00:03:05.767 08:41:54 -- setup/acl.sh@30 -- # for dev in "$@" 00:03:05.767 08:41:54 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:88:00.0 ]] 00:03:05.767 08:41:54 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:88:00.0/driver 00:03:05.767 08:41:54 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:03:05.767 08:41:54 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:03:05.767 08:41:54 -- setup/acl.sh@41 -- # setup reset 00:03:05.767 08:41:54 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:05.767 08:41:54 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:08.299 00:03:08.299 real 0m3.989s 00:03:08.299 user 0m1.118s 00:03:08.299 sys 0m1.963s 00:03:08.299 08:41:56 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:08.299 08:41:56 -- common/autotest_common.sh@10 -- # set +x 00:03:08.299 ************************************ 00:03:08.299 END TEST denied 00:03:08.299 ************************************ 00:03:08.299 08:41:56 -- setup/acl.sh@55 -- # run_test allowed allowed 00:03:08.299 08:41:56 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:08.299 08:41:56 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:08.299 08:41:56 -- common/autotest_common.sh@10 -- # set +x 00:03:08.299 ************************************ 00:03:08.299 START TEST allowed 00:03:08.299 ************************************ 00:03:08.299 08:41:56 -- common/autotest_common.sh@1104 -- # allowed 00:03:08.299 08:41:56 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:88:00.0 00:03:08.299 08:41:56 -- setup/acl.sh@45 -- # setup output config 00:03:08.299 08:41:56 -- setup/acl.sh@46 -- # grep -E '0000:88:00.0 .*: nvme -> .*' 00:03:08.299 08:41:56 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:08.299 08:41:56 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:10.838 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:10.838 08:41:59 -- setup/acl.sh@47 -- # verify 00:03:10.838 08:41:59 -- setup/acl.sh@28 -- # local dev driver 00:03:10.838 08:41:59 -- setup/acl.sh@48 -- # setup reset 00:03:10.838 08:41:59 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:10.838 08:41:59 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:12.215 00:03:12.215 real 0m3.800s 00:03:12.215 user 0m0.918s 00:03:12.215 sys 0m1.699s 00:03:12.215 08:42:00 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:12.215 08:42:00 -- common/autotest_common.sh@10 -- # set +x 00:03:12.215 ************************************ 00:03:12.215 END TEST allowed 00:03:12.215 ************************************ 00:03:12.215 00:03:12.215 real 0m10.264s 00:03:12.215 user 0m3.011s 00:03:12.215 sys 0m5.242s 00:03:12.215 08:42:00 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:12.215 08:42:00 -- common/autotest_common.sh@10 -- # set +x 00:03:12.215 ************************************ 00:03:12.215 END TEST acl 00:03:12.215 ************************************ 00:03:12.215 08:42:00 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:12.215 08:42:00 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:12.215 08:42:00 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:12.215 08:42:00 -- common/autotest_common.sh@10 -- # set +x 00:03:12.215 ************************************ 00:03:12.215 START TEST hugepages 00:03:12.215 ************************************ 00:03:12.215 08:42:00 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:12.215 * Looking for test storage... 00:03:12.215 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:12.215 08:42:00 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:03:12.215 08:42:00 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:03:12.215 08:42:00 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:03:12.215 08:42:00 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:03:12.215 08:42:00 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:03:12.215 08:42:00 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:03:12.215 08:42:00 -- setup/common.sh@17 -- # local get=Hugepagesize 00:03:12.215 08:42:00 -- setup/common.sh@18 -- # local node= 00:03:12.215 08:42:00 -- setup/common.sh@19 -- # local var val 00:03:12.215 08:42:00 -- setup/common.sh@20 -- # local mem_f mem 00:03:12.215 08:42:00 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:12.215 08:42:00 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:12.215 08:42:00 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:12.215 08:42:00 -- setup/common.sh@28 -- # mapfile -t mem 00:03:12.215 08:42:00 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:12.215 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.215 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.215 08:42:00 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541692 kB' 'MemFree: 43772708 kB' 'MemAvailable: 47274256 kB' 'Buffers: 2704 kB' 'Cached: 10177512 kB' 'SwapCached: 0 kB' 'Active: 7180884 kB' 'Inactive: 3506596 kB' 'Active(anon): 6786292 kB' 'Inactive(anon): 0 kB' 'Active(file): 394592 kB' 'Inactive(file): 3506596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 511224 kB' 'Mapped: 191148 kB' 'Shmem: 6279028 kB' 'KReclaimable: 188400 kB' 'Slab: 554624 kB' 'SReclaimable: 188400 kB' 'SUnreclaim: 366224 kB' 'KernelStack: 13120 kB' 'PageTables: 9452 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36562296 kB' 'Committed_AS: 7907456 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196072 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 1758812 kB' 'DirectMap2M: 13889536 kB' 'DirectMap1G: 53477376 kB' 00:03:12.215 08:42:00 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.215 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.215 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.215 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.215 08:42:00 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.215 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.215 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.215 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.215 08:42:00 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.215 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.215 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.215 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.215 08:42:00 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.215 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.215 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.215 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.215 08:42:00 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.215 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.215 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.215 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.215 08:42:00 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.215 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.215 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.215 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.215 08:42:00 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.215 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.215 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.215 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.215 08:42:00 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.215 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.215 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.215 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.215 08:42:00 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.215 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.215 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.215 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.215 08:42:00 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.215 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.215 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.215 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.215 08:42:00 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.215 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.215 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.215 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.215 08:42:00 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.215 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.215 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.215 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.215 08:42:00 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.215 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.215 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.215 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.215 08:42:00 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.215 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.215 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.215 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.215 08:42:00 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.215 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # continue 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.216 08:42:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.216 08:42:00 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.216 08:42:00 -- setup/common.sh@33 -- # echo 2048 00:03:12.216 08:42:00 -- setup/common.sh@33 -- # return 0 00:03:12.216 08:42:00 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:03:12.216 08:42:00 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:03:12.216 08:42:00 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:03:12.216 08:42:00 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:03:12.216 08:42:00 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:03:12.216 08:42:00 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:03:12.216 08:42:00 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:03:12.216 08:42:00 -- setup/hugepages.sh@207 -- # get_nodes 00:03:12.216 08:42:00 -- setup/hugepages.sh@27 -- # local node 00:03:12.216 08:42:00 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:12.216 08:42:00 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:03:12.216 08:42:00 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:12.216 08:42:00 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:12.216 08:42:00 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:12.216 08:42:00 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:12.216 08:42:00 -- setup/hugepages.sh@208 -- # clear_hp 00:03:12.216 08:42:00 -- setup/hugepages.sh@37 -- # local node hp 00:03:12.216 08:42:00 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:12.217 08:42:00 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:12.217 08:42:00 -- setup/hugepages.sh@41 -- # echo 0 00:03:12.217 08:42:00 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:12.217 08:42:00 -- setup/hugepages.sh@41 -- # echo 0 00:03:12.217 08:42:00 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:12.217 08:42:00 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:12.217 08:42:00 -- setup/hugepages.sh@41 -- # echo 0 00:03:12.217 08:42:00 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:12.217 08:42:00 -- setup/hugepages.sh@41 -- # echo 0 00:03:12.217 08:42:00 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:12.217 08:42:00 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:12.217 08:42:00 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:03:12.217 08:42:00 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:12.217 08:42:00 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:12.217 08:42:00 -- common/autotest_common.sh@10 -- # set +x 00:03:12.217 ************************************ 00:03:12.217 START TEST default_setup 00:03:12.217 ************************************ 00:03:12.217 08:42:00 -- common/autotest_common.sh@1104 -- # default_setup 00:03:12.217 08:42:00 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:03:12.217 08:42:00 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:12.217 08:42:00 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:12.217 08:42:00 -- setup/hugepages.sh@51 -- # shift 00:03:12.217 08:42:00 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:12.217 08:42:00 -- setup/hugepages.sh@52 -- # local node_ids 00:03:12.217 08:42:00 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:12.217 08:42:00 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:12.217 08:42:00 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:12.217 08:42:00 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:12.217 08:42:00 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:12.217 08:42:00 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:12.217 08:42:00 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:12.217 08:42:00 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:12.217 08:42:00 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:12.217 08:42:00 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:12.217 08:42:00 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:12.217 08:42:00 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:12.217 08:42:00 -- setup/hugepages.sh@73 -- # return 0 00:03:12.217 08:42:00 -- setup/hugepages.sh@137 -- # setup output 00:03:12.217 08:42:00 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:12.217 08:42:00 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:13.593 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:13.593 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:13.593 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:13.593 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:13.593 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:13.593 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:13.593 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:13.593 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:13.593 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:13.593 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:13.593 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:13.593 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:13.593 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:13.593 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:13.593 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:13.593 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:14.535 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:14.535 08:42:02 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:03:14.535 08:42:02 -- setup/hugepages.sh@89 -- # local node 00:03:14.535 08:42:02 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:14.535 08:42:02 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:14.535 08:42:02 -- setup/hugepages.sh@92 -- # local surp 00:03:14.535 08:42:02 -- setup/hugepages.sh@93 -- # local resv 00:03:14.535 08:42:02 -- setup/hugepages.sh@94 -- # local anon 00:03:14.535 08:42:02 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:14.535 08:42:02 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:14.535 08:42:02 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:14.535 08:42:02 -- setup/common.sh@18 -- # local node= 00:03:14.535 08:42:02 -- setup/common.sh@19 -- # local var val 00:03:14.535 08:42:02 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.535 08:42:02 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.535 08:42:02 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:14.535 08:42:02 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:14.535 08:42:02 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.535 08:42:02 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.535 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.535 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.535 08:42:02 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541692 kB' 'MemFree: 45872456 kB' 'MemAvailable: 49373956 kB' 'Buffers: 2704 kB' 'Cached: 10177596 kB' 'SwapCached: 0 kB' 'Active: 7196396 kB' 'Inactive: 3506596 kB' 'Active(anon): 6801804 kB' 'Inactive(anon): 0 kB' 'Active(file): 394592 kB' 'Inactive(file): 3506596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 525908 kB' 'Mapped: 191640 kB' 'Shmem: 6279112 kB' 'KReclaimable: 188304 kB' 'Slab: 554188 kB' 'SReclaimable: 188304 kB' 'SUnreclaim: 365884 kB' 'KernelStack: 13056 kB' 'PageTables: 9024 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610872 kB' 'Committed_AS: 7921116 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196116 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1758812 kB' 'DirectMap2M: 13889536 kB' 'DirectMap1G: 53477376 kB' 00:03:14.535 08:42:02 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.535 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.535 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.535 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.535 08:42:02 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.535 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.535 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.535 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.535 08:42:02 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.535 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.535 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.535 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.535 08:42:02 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.535 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.535 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.535 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.535 08:42:02 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.535 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.535 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.535 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.535 08:42:02 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.535 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.535 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.535 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.535 08:42:02 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.535 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.535 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.535 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.535 08:42:02 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.535 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.535 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.535 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.535 08:42:02 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.535 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.535 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.535 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.535 08:42:02 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.535 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.535 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.535 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.535 08:42:02 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.535 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.535 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.535 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.535 08:42:02 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.535 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.535 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.535 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.535 08:42:02 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.535 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.535 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.535 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.535 08:42:02 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.535 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.535 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.535 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.535 08:42:02 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.535 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.535 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.535 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.535 08:42:02 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.535 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.535 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.536 08:42:02 -- setup/common.sh@33 -- # echo 0 00:03:14.536 08:42:02 -- setup/common.sh@33 -- # return 0 00:03:14.536 08:42:02 -- setup/hugepages.sh@97 -- # anon=0 00:03:14.536 08:42:02 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:14.536 08:42:02 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:14.536 08:42:02 -- setup/common.sh@18 -- # local node= 00:03:14.536 08:42:02 -- setup/common.sh@19 -- # local var val 00:03:14.536 08:42:02 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.536 08:42:02 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.536 08:42:02 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:14.536 08:42:02 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:14.536 08:42:02 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.536 08:42:02 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.536 08:42:02 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541692 kB' 'MemFree: 45877024 kB' 'MemAvailable: 49378524 kB' 'Buffers: 2704 kB' 'Cached: 10177600 kB' 'SwapCached: 0 kB' 'Active: 7196300 kB' 'Inactive: 3506596 kB' 'Active(anon): 6801708 kB' 'Inactive(anon): 0 kB' 'Active(file): 394592 kB' 'Inactive(file): 3506596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 525816 kB' 'Mapped: 191712 kB' 'Shmem: 6279116 kB' 'KReclaimable: 188304 kB' 'Slab: 554152 kB' 'SReclaimable: 188304 kB' 'SUnreclaim: 365848 kB' 'KernelStack: 12864 kB' 'PageTables: 8488 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610872 kB' 'Committed_AS: 7922592 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196104 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1758812 kB' 'DirectMap2M: 13889536 kB' 'DirectMap1G: 53477376 kB' 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.536 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.536 08:42:02 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.537 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.537 08:42:02 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.537 08:42:02 -- setup/common.sh@33 -- # echo 0 00:03:14.537 08:42:02 -- setup/common.sh@33 -- # return 0 00:03:14.537 08:42:02 -- setup/hugepages.sh@99 -- # surp=0 00:03:14.537 08:42:02 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:14.537 08:42:02 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:14.537 08:42:02 -- setup/common.sh@18 -- # local node= 00:03:14.537 08:42:02 -- setup/common.sh@19 -- # local var val 00:03:14.537 08:42:02 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.538 08:42:02 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.538 08:42:02 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:14.538 08:42:02 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:14.538 08:42:02 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.538 08:42:02 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.538 08:42:02 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541692 kB' 'MemFree: 45877152 kB' 'MemAvailable: 49378652 kB' 'Buffers: 2704 kB' 'Cached: 10177612 kB' 'SwapCached: 0 kB' 'Active: 7196352 kB' 'Inactive: 3506596 kB' 'Active(anon): 6801760 kB' 'Inactive(anon): 0 kB' 'Active(file): 394592 kB' 'Inactive(file): 3506596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 525820 kB' 'Mapped: 191672 kB' 'Shmem: 6279128 kB' 'KReclaimable: 188304 kB' 'Slab: 554240 kB' 'SReclaimable: 188304 kB' 'SUnreclaim: 365936 kB' 'KernelStack: 12832 kB' 'PageTables: 8364 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610872 kB' 'Committed_AS: 7922608 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196120 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1758812 kB' 'DirectMap2M: 13889536 kB' 'DirectMap1G: 53477376 kB' 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # continue 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.538 08:42:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.538 08:42:02 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.538 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.538 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.538 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.538 08:42:03 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.538 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.538 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.538 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.538 08:42:03 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.538 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.538 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.538 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.538 08:42:03 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.538 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.538 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.538 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.538 08:42:03 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.538 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.538 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.538 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.538 08:42:03 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.538 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.538 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.538 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.538 08:42:03 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.538 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.538 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.538 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.538 08:42:03 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.538 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.538 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.538 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.538 08:42:03 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.538 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.538 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.538 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.538 08:42:03 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.538 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.538 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.538 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.538 08:42:03 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.538 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.538 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.538 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.538 08:42:03 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.538 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.538 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.538 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.538 08:42:03 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.538 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.538 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.538 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.538 08:42:03 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.538 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.538 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.538 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.539 08:42:03 -- setup/common.sh@33 -- # echo 0 00:03:14.539 08:42:03 -- setup/common.sh@33 -- # return 0 00:03:14.539 08:42:03 -- setup/hugepages.sh@100 -- # resv=0 00:03:14.539 08:42:03 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:14.539 nr_hugepages=1024 00:03:14.539 08:42:03 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:14.539 resv_hugepages=0 00:03:14.539 08:42:03 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:14.539 surplus_hugepages=0 00:03:14.539 08:42:03 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:14.539 anon_hugepages=0 00:03:14.539 08:42:03 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:14.539 08:42:03 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:14.539 08:42:03 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:14.539 08:42:03 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:14.539 08:42:03 -- setup/common.sh@18 -- # local node= 00:03:14.539 08:42:03 -- setup/common.sh@19 -- # local var val 00:03:14.539 08:42:03 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.539 08:42:03 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.539 08:42:03 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:14.539 08:42:03 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:14.539 08:42:03 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.539 08:42:03 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.539 08:42:03 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541692 kB' 'MemFree: 45875136 kB' 'MemAvailable: 49376636 kB' 'Buffers: 2704 kB' 'Cached: 10177624 kB' 'SwapCached: 0 kB' 'Active: 7191360 kB' 'Inactive: 3506596 kB' 'Active(anon): 6796768 kB' 'Inactive(anon): 0 kB' 'Active(file): 394592 kB' 'Inactive(file): 3506596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 521312 kB' 'Mapped: 191672 kB' 'Shmem: 6279140 kB' 'KReclaimable: 188304 kB' 'Slab: 554240 kB' 'SReclaimable: 188304 kB' 'SUnreclaim: 365936 kB' 'KernelStack: 12864 kB' 'PageTables: 8472 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610872 kB' 'Committed_AS: 7917860 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196132 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1758812 kB' 'DirectMap2M: 13889536 kB' 'DirectMap1G: 53477376 kB' 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.539 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.539 08:42:03 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.540 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.540 08:42:03 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.540 08:42:03 -- setup/common.sh@33 -- # echo 1024 00:03:14.540 08:42:03 -- setup/common.sh@33 -- # return 0 00:03:14.540 08:42:03 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:14.540 08:42:03 -- setup/hugepages.sh@112 -- # get_nodes 00:03:14.540 08:42:03 -- setup/hugepages.sh@27 -- # local node 00:03:14.540 08:42:03 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:14.540 08:42:03 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:14.540 08:42:03 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:14.540 08:42:03 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:14.540 08:42:03 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:14.541 08:42:03 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:14.541 08:42:03 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:14.541 08:42:03 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:14.541 08:42:03 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:14.541 08:42:03 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:14.541 08:42:03 -- setup/common.sh@18 -- # local node=0 00:03:14.541 08:42:03 -- setup/common.sh@19 -- # local var val 00:03:14.541 08:42:03 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.541 08:42:03 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.541 08:42:03 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:14.541 08:42:03 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:14.541 08:42:03 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.541 08:42:03 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.541 08:42:03 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32876940 kB' 'MemFree: 21554200 kB' 'MemUsed: 11322740 kB' 'SwapCached: 0 kB' 'Active: 4972560 kB' 'Inactive: 3264144 kB' 'Active(anon): 4783988 kB' 'Inactive(anon): 0 kB' 'Active(file): 188572 kB' 'Inactive(file): 3264144 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7952612 kB' 'Mapped: 63868 kB' 'AnonPages: 287624 kB' 'Shmem: 4499896 kB' 'KernelStack: 6872 kB' 'PageTables: 5136 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 112012 kB' 'Slab: 297808 kB' 'SReclaimable: 112012 kB' 'SUnreclaim: 185796 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # continue 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.541 08:42:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.541 08:42:03 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.541 08:42:03 -- setup/common.sh@33 -- # echo 0 00:03:14.542 08:42:03 -- setup/common.sh@33 -- # return 0 00:03:14.542 08:42:03 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:14.542 08:42:03 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:14.542 08:42:03 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:14.542 08:42:03 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:14.542 08:42:03 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:14.542 node0=1024 expecting 1024 00:03:14.542 08:42:03 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:14.542 00:03:14.542 real 0m2.373s 00:03:14.542 user 0m0.623s 00:03:14.542 sys 0m0.853s 00:03:14.542 08:42:03 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:14.542 08:42:03 -- common/autotest_common.sh@10 -- # set +x 00:03:14.542 ************************************ 00:03:14.542 END TEST default_setup 00:03:14.542 ************************************ 00:03:14.799 08:42:03 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:03:14.799 08:42:03 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:14.799 08:42:03 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:14.799 08:42:03 -- common/autotest_common.sh@10 -- # set +x 00:03:14.799 ************************************ 00:03:14.799 START TEST per_node_1G_alloc 00:03:14.799 ************************************ 00:03:14.799 08:42:03 -- common/autotest_common.sh@1104 -- # per_node_1G_alloc 00:03:14.799 08:42:03 -- setup/hugepages.sh@143 -- # local IFS=, 00:03:14.799 08:42:03 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:03:14.799 08:42:03 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:14.799 08:42:03 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:03:14.799 08:42:03 -- setup/hugepages.sh@51 -- # shift 00:03:14.799 08:42:03 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:03:14.799 08:42:03 -- setup/hugepages.sh@52 -- # local node_ids 00:03:14.799 08:42:03 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:14.799 08:42:03 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:14.799 08:42:03 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:03:14.799 08:42:03 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:03:14.799 08:42:03 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:14.799 08:42:03 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:14.799 08:42:03 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:14.799 08:42:03 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:14.799 08:42:03 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:14.799 08:42:03 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:03:14.799 08:42:03 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:14.799 08:42:03 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:14.799 08:42:03 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:14.799 08:42:03 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:14.799 08:42:03 -- setup/hugepages.sh@73 -- # return 0 00:03:14.799 08:42:03 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:03:14.799 08:42:03 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:03:14.799 08:42:03 -- setup/hugepages.sh@146 -- # setup output 00:03:14.799 08:42:03 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:14.799 08:42:03 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:15.731 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:15.731 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:15.731 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:15.731 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:15.731 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:15.731 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:15.731 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:15.731 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:15.731 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:15.731 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:15.731 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:15.731 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:15.731 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:15.731 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:15.732 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:15.732 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:15.732 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:16.000 08:42:04 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:03:16.000 08:42:04 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:03:16.000 08:42:04 -- setup/hugepages.sh@89 -- # local node 00:03:16.000 08:42:04 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:16.000 08:42:04 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:16.000 08:42:04 -- setup/hugepages.sh@92 -- # local surp 00:03:16.000 08:42:04 -- setup/hugepages.sh@93 -- # local resv 00:03:16.000 08:42:04 -- setup/hugepages.sh@94 -- # local anon 00:03:16.000 08:42:04 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:16.000 08:42:04 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:16.000 08:42:04 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:16.000 08:42:04 -- setup/common.sh@18 -- # local node= 00:03:16.000 08:42:04 -- setup/common.sh@19 -- # local var val 00:03:16.000 08:42:04 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.000 08:42:04 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.000 08:42:04 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:16.000 08:42:04 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:16.000 08:42:04 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.000 08:42:04 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.000 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.000 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.000 08:42:04 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541692 kB' 'MemFree: 45855948 kB' 'MemAvailable: 49357448 kB' 'Buffers: 2704 kB' 'Cached: 10177684 kB' 'SwapCached: 0 kB' 'Active: 7191236 kB' 'Inactive: 3506596 kB' 'Active(anon): 6796644 kB' 'Inactive(anon): 0 kB' 'Active(file): 394592 kB' 'Inactive(file): 3506596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 520652 kB' 'Mapped: 191668 kB' 'Shmem: 6279200 kB' 'KReclaimable: 188304 kB' 'Slab: 554248 kB' 'SReclaimable: 188304 kB' 'SUnreclaim: 365944 kB' 'KernelStack: 12864 kB' 'PageTables: 8388 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610872 kB' 'Committed_AS: 7922784 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196132 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1758812 kB' 'DirectMap2M: 13889536 kB' 'DirectMap1G: 53477376 kB' 00:03:16.000 08:42:04 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.000 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.000 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.000 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.000 08:42:04 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.000 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.000 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.000 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.000 08:42:04 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.000 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.000 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.000 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.000 08:42:04 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.000 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.000 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.000 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.000 08:42:04 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.000 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.000 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.000 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.000 08:42:04 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.000 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.000 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.000 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.000 08:42:04 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.000 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.000 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.000 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.000 08:42:04 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.000 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.000 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.000 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.000 08:42:04 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.000 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.000 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.000 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.000 08:42:04 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.000 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.000 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.000 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.000 08:42:04 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.000 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.000 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.000 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.000 08:42:04 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.000 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.000 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.000 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.000 08:42:04 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.000 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.000 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.000 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.000 08:42:04 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.000 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.000 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.000 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.000 08:42:04 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.000 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.000 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.000 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.000 08:42:04 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.000 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.000 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.000 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.000 08:42:04 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.000 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.000 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.000 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.000 08:42:04 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.000 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.000 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.000 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.000 08:42:04 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.000 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.000 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.000 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.000 08:42:04 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.000 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.001 08:42:04 -- setup/common.sh@33 -- # echo 0 00:03:16.001 08:42:04 -- setup/common.sh@33 -- # return 0 00:03:16.001 08:42:04 -- setup/hugepages.sh@97 -- # anon=0 00:03:16.001 08:42:04 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:16.001 08:42:04 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:16.001 08:42:04 -- setup/common.sh@18 -- # local node= 00:03:16.001 08:42:04 -- setup/common.sh@19 -- # local var val 00:03:16.001 08:42:04 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.001 08:42:04 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.001 08:42:04 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:16.001 08:42:04 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:16.001 08:42:04 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.001 08:42:04 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.001 08:42:04 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541692 kB' 'MemFree: 45858520 kB' 'MemAvailable: 49360020 kB' 'Buffers: 2704 kB' 'Cached: 10177684 kB' 'SwapCached: 0 kB' 'Active: 7191092 kB' 'Inactive: 3506596 kB' 'Active(anon): 6796500 kB' 'Inactive(anon): 0 kB' 'Active(file): 394592 kB' 'Inactive(file): 3506596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 520468 kB' 'Mapped: 191676 kB' 'Shmem: 6279200 kB' 'KReclaimable: 188304 kB' 'Slab: 554248 kB' 'SReclaimable: 188304 kB' 'SUnreclaim: 365944 kB' 'KernelStack: 12784 kB' 'PageTables: 8116 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610872 kB' 'Committed_AS: 7916324 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196100 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1758812 kB' 'DirectMap2M: 13889536 kB' 'DirectMap1G: 53477376 kB' 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.001 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.001 08:42:04 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.002 08:42:04 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.002 08:42:04 -- setup/common.sh@33 -- # echo 0 00:03:16.002 08:42:04 -- setup/common.sh@33 -- # return 0 00:03:16.002 08:42:04 -- setup/hugepages.sh@99 -- # surp=0 00:03:16.002 08:42:04 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:16.002 08:42:04 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:16.002 08:42:04 -- setup/common.sh@18 -- # local node= 00:03:16.002 08:42:04 -- setup/common.sh@19 -- # local var val 00:03:16.002 08:42:04 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.002 08:42:04 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.002 08:42:04 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:16.002 08:42:04 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:16.002 08:42:04 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.002 08:42:04 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.002 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.003 08:42:04 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541692 kB' 'MemFree: 45858940 kB' 'MemAvailable: 49360440 kB' 'Buffers: 2704 kB' 'Cached: 10177696 kB' 'SwapCached: 0 kB' 'Active: 7190508 kB' 'Inactive: 3506596 kB' 'Active(anon): 6795916 kB' 'Inactive(anon): 0 kB' 'Active(file): 394592 kB' 'Inactive(file): 3506596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 519860 kB' 'Mapped: 191612 kB' 'Shmem: 6279212 kB' 'KReclaimable: 188304 kB' 'Slab: 554272 kB' 'SReclaimable: 188304 kB' 'SUnreclaim: 365968 kB' 'KernelStack: 12832 kB' 'PageTables: 8212 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610872 kB' 'Committed_AS: 7916336 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196068 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1758812 kB' 'DirectMap2M: 13889536 kB' 'DirectMap1G: 53477376 kB' 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.003 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.003 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.004 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.004 08:42:04 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.004 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.004 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.004 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.004 08:42:04 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.004 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.004 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.004 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.004 08:42:04 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.004 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.004 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.004 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.004 08:42:04 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.004 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.004 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.004 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.004 08:42:04 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.004 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.004 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.004 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.004 08:42:04 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.004 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.004 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.004 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.004 08:42:04 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.004 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.004 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.004 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.004 08:42:04 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.004 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.004 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.004 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.004 08:42:04 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.004 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.004 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.004 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.004 08:42:04 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.004 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.004 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.004 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.004 08:42:04 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.004 08:42:04 -- setup/common.sh@33 -- # echo 0 00:03:16.004 08:42:04 -- setup/common.sh@33 -- # return 0 00:03:16.004 08:42:04 -- setup/hugepages.sh@100 -- # resv=0 00:03:16.004 08:42:04 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:16.004 nr_hugepages=1024 00:03:16.004 08:42:04 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:16.004 resv_hugepages=0 00:03:16.004 08:42:04 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:16.004 surplus_hugepages=0 00:03:16.004 08:42:04 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:16.004 anon_hugepages=0 00:03:16.004 08:42:04 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:16.004 08:42:04 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:16.004 08:42:04 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:16.004 08:42:04 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:16.004 08:42:04 -- setup/common.sh@18 -- # local node= 00:03:16.004 08:42:04 -- setup/common.sh@19 -- # local var val 00:03:16.004 08:42:04 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.004 08:42:04 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.004 08:42:04 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:16.004 08:42:04 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:16.004 08:42:04 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.004 08:42:04 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.004 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.004 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.004 08:42:04 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541692 kB' 'MemFree: 45858940 kB' 'MemAvailable: 49360440 kB' 'Buffers: 2704 kB' 'Cached: 10177716 kB' 'SwapCached: 0 kB' 'Active: 7190504 kB' 'Inactive: 3506596 kB' 'Active(anon): 6795912 kB' 'Inactive(anon): 0 kB' 'Active(file): 394592 kB' 'Inactive(file): 3506596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 519828 kB' 'Mapped: 191612 kB' 'Shmem: 6279232 kB' 'KReclaimable: 188304 kB' 'Slab: 554272 kB' 'SReclaimable: 188304 kB' 'SUnreclaim: 365968 kB' 'KernelStack: 12816 kB' 'PageTables: 8160 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610872 kB' 'Committed_AS: 7916356 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196068 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1758812 kB' 'DirectMap2M: 13889536 kB' 'DirectMap1G: 53477376 kB' 00:03:16.004 08:42:04 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.004 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.004 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.004 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.004 08:42:04 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.004 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.004 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.004 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.004 08:42:04 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.004 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.004 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.004 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.004 08:42:04 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.004 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.004 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.004 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.004 08:42:04 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.004 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.004 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.004 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.004 08:42:04 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.004 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.004 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.004 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.004 08:42:04 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.004 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.004 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.004 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.004 08:42:04 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.004 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.004 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.004 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.004 08:42:04 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.004 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.004 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.004 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.004 08:42:04 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.005 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.005 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.005 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.005 08:42:04 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.005 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.005 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.005 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.005 08:42:04 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.005 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.005 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.005 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.005 08:42:04 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.005 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.005 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.005 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.005 08:42:04 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.005 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.005 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.005 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.005 08:42:04 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.005 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.005 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.005 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.005 08:42:04 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.005 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.005 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.005 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.005 08:42:04 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.005 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.005 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.005 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.005 08:42:04 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.005 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.005 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.005 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.005 08:42:04 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.005 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.005 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.005 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.005 08:42:04 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.005 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.005 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.005 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.005 08:42:04 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.005 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.005 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.005 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.005 08:42:04 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.005 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.005 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.005 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.005 08:42:04 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.005 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.005 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.005 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.005 08:42:04 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.005 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.005 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.005 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.005 08:42:04 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.005 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.005 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.005 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.005 08:42:04 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.005 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.006 08:42:04 -- setup/common.sh@33 -- # echo 1024 00:03:16.006 08:42:04 -- setup/common.sh@33 -- # return 0 00:03:16.006 08:42:04 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:16.006 08:42:04 -- setup/hugepages.sh@112 -- # get_nodes 00:03:16.006 08:42:04 -- setup/hugepages.sh@27 -- # local node 00:03:16.006 08:42:04 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:16.006 08:42:04 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:16.006 08:42:04 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:16.006 08:42:04 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:16.006 08:42:04 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:16.006 08:42:04 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:16.006 08:42:04 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:16.006 08:42:04 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:16.006 08:42:04 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:16.006 08:42:04 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:16.006 08:42:04 -- setup/common.sh@18 -- # local node=0 00:03:16.006 08:42:04 -- setup/common.sh@19 -- # local var val 00:03:16.006 08:42:04 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.006 08:42:04 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.006 08:42:04 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:16.006 08:42:04 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:16.006 08:42:04 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.006 08:42:04 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.006 08:42:04 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32876940 kB' 'MemFree: 22603504 kB' 'MemUsed: 10273436 kB' 'SwapCached: 0 kB' 'Active: 4969204 kB' 'Inactive: 3264144 kB' 'Active(anon): 4780632 kB' 'Inactive(anon): 0 kB' 'Active(file): 188572 kB' 'Inactive(file): 3264144 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7952672 kB' 'Mapped: 63872 kB' 'AnonPages: 283792 kB' 'Shmem: 4499956 kB' 'KernelStack: 6840 kB' 'PageTables: 4968 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 112012 kB' 'Slab: 297768 kB' 'SReclaimable: 112012 kB' 'SUnreclaim: 185756 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.006 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.006 08:42:04 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.007 08:42:04 -- setup/common.sh@33 -- # echo 0 00:03:16.007 08:42:04 -- setup/common.sh@33 -- # return 0 00:03:16.007 08:42:04 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:16.007 08:42:04 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:16.007 08:42:04 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:16.007 08:42:04 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:16.007 08:42:04 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:16.007 08:42:04 -- setup/common.sh@18 -- # local node=1 00:03:16.007 08:42:04 -- setup/common.sh@19 -- # local var val 00:03:16.007 08:42:04 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.007 08:42:04 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.007 08:42:04 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:16.007 08:42:04 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:16.007 08:42:04 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.007 08:42:04 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.007 08:42:04 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27664752 kB' 'MemFree: 23255688 kB' 'MemUsed: 4409064 kB' 'SwapCached: 0 kB' 'Active: 2221352 kB' 'Inactive: 242452 kB' 'Active(anon): 2015332 kB' 'Inactive(anon): 0 kB' 'Active(file): 206020 kB' 'Inactive(file): 242452 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2227764 kB' 'Mapped: 127740 kB' 'AnonPages: 236092 kB' 'Shmem: 1779292 kB' 'KernelStack: 5960 kB' 'PageTables: 3136 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 76292 kB' 'Slab: 256504 kB' 'SReclaimable: 76292 kB' 'SUnreclaim: 180212 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.007 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.007 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # continue 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.008 08:42:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.008 08:42:04 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.008 08:42:04 -- setup/common.sh@33 -- # echo 0 00:03:16.008 08:42:04 -- setup/common.sh@33 -- # return 0 00:03:16.008 08:42:04 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:16.008 08:42:04 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:16.008 08:42:04 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:16.008 08:42:04 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:16.008 08:42:04 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:16.008 node0=512 expecting 512 00:03:16.008 08:42:04 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:16.008 08:42:04 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:16.008 08:42:04 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:16.008 08:42:04 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:16.008 node1=512 expecting 512 00:03:16.008 08:42:04 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:16.008 00:03:16.008 real 0m1.422s 00:03:16.008 user 0m0.591s 00:03:16.008 sys 0m0.795s 00:03:16.008 08:42:04 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:16.008 08:42:04 -- common/autotest_common.sh@10 -- # set +x 00:03:16.008 ************************************ 00:03:16.008 END TEST per_node_1G_alloc 00:03:16.008 ************************************ 00:03:16.008 08:42:04 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:03:16.008 08:42:04 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:16.008 08:42:04 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:16.008 08:42:04 -- common/autotest_common.sh@10 -- # set +x 00:03:16.008 ************************************ 00:03:16.008 START TEST even_2G_alloc 00:03:16.008 ************************************ 00:03:16.008 08:42:04 -- common/autotest_common.sh@1104 -- # even_2G_alloc 00:03:16.008 08:42:04 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:03:16.008 08:42:04 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:16.008 08:42:04 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:16.008 08:42:04 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:16.008 08:42:04 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:16.008 08:42:04 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:16.008 08:42:04 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:16.008 08:42:04 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:16.008 08:42:04 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:16.008 08:42:04 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:16.008 08:42:04 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:16.008 08:42:04 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:16.008 08:42:04 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:16.008 08:42:04 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:16.008 08:42:04 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:16.008 08:42:04 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:16.008 08:42:04 -- setup/hugepages.sh@83 -- # : 512 00:03:16.008 08:42:04 -- setup/hugepages.sh@84 -- # : 1 00:03:16.008 08:42:04 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:16.008 08:42:04 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:16.008 08:42:04 -- setup/hugepages.sh@83 -- # : 0 00:03:16.008 08:42:04 -- setup/hugepages.sh@84 -- # : 0 00:03:16.008 08:42:04 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:16.008 08:42:04 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:03:16.008 08:42:04 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:03:16.008 08:42:04 -- setup/hugepages.sh@153 -- # setup output 00:03:16.008 08:42:04 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:16.008 08:42:04 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:17.407 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:17.407 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:17.407 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:17.407 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:17.407 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:17.407 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:17.407 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:17.407 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:17.407 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:17.407 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:17.407 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:17.407 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:17.407 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:17.407 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:17.407 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:17.407 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:17.407 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:17.407 08:42:05 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:03:17.407 08:42:05 -- setup/hugepages.sh@89 -- # local node 00:03:17.407 08:42:05 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:17.407 08:42:05 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:17.407 08:42:05 -- setup/hugepages.sh@92 -- # local surp 00:03:17.407 08:42:05 -- setup/hugepages.sh@93 -- # local resv 00:03:17.407 08:42:05 -- setup/hugepages.sh@94 -- # local anon 00:03:17.407 08:42:05 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:17.407 08:42:05 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:17.407 08:42:05 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:17.407 08:42:05 -- setup/common.sh@18 -- # local node= 00:03:17.407 08:42:05 -- setup/common.sh@19 -- # local var val 00:03:17.407 08:42:05 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.407 08:42:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.407 08:42:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:17.407 08:42:05 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:17.407 08:42:05 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.407 08:42:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.407 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 08:42:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541692 kB' 'MemFree: 45874772 kB' 'MemAvailable: 49376272 kB' 'Buffers: 2704 kB' 'Cached: 10177776 kB' 'SwapCached: 0 kB' 'Active: 7191228 kB' 'Inactive: 3506596 kB' 'Active(anon): 6796636 kB' 'Inactive(anon): 0 kB' 'Active(file): 394592 kB' 'Inactive(file): 3506596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 520500 kB' 'Mapped: 191668 kB' 'Shmem: 6279292 kB' 'KReclaimable: 188304 kB' 'Slab: 553784 kB' 'SReclaimable: 188304 kB' 'SUnreclaim: 365480 kB' 'KernelStack: 12848 kB' 'PageTables: 8288 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610872 kB' 'Committed_AS: 7916904 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196164 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1758812 kB' 'DirectMap2M: 13889536 kB' 'DirectMap1G: 53477376 kB' 00:03:17.407 08:42:05 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.407 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.407 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 08:42:05 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.407 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.407 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 08:42:05 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.407 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.407 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 08:42:05 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.407 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.407 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 08:42:05 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.407 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.407 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 08:42:05 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.407 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.407 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 08:42:05 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.407 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.407 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 08:42:05 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.407 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.407 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 08:42:05 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.407 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.407 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 08:42:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.407 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.407 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 08:42:05 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.407 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.407 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 08:42:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.407 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.407 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 08:42:05 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.408 08:42:05 -- setup/common.sh@33 -- # echo 0 00:03:17.408 08:42:05 -- setup/common.sh@33 -- # return 0 00:03:17.408 08:42:05 -- setup/hugepages.sh@97 -- # anon=0 00:03:17.408 08:42:05 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:17.408 08:42:05 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:17.408 08:42:05 -- setup/common.sh@18 -- # local node= 00:03:17.408 08:42:05 -- setup/common.sh@19 -- # local var val 00:03:17.408 08:42:05 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.408 08:42:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.408 08:42:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:17.408 08:42:05 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:17.408 08:42:05 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.408 08:42:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 08:42:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541692 kB' 'MemFree: 45878140 kB' 'MemAvailable: 49379640 kB' 'Buffers: 2704 kB' 'Cached: 10177780 kB' 'SwapCached: 0 kB' 'Active: 7191900 kB' 'Inactive: 3506596 kB' 'Active(anon): 6797308 kB' 'Inactive(anon): 0 kB' 'Active(file): 394592 kB' 'Inactive(file): 3506596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 521200 kB' 'Mapped: 191744 kB' 'Shmem: 6279296 kB' 'KReclaimable: 188304 kB' 'Slab: 553840 kB' 'SReclaimable: 188304 kB' 'SUnreclaim: 365536 kB' 'KernelStack: 12896 kB' 'PageTables: 8456 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610872 kB' 'Committed_AS: 7916916 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196132 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1758812 kB' 'DirectMap2M: 13889536 kB' 'DirectMap1G: 53477376 kB' 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 08:42:05 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 08:42:05 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.410 08:42:05 -- setup/common.sh@33 -- # echo 0 00:03:17.410 08:42:05 -- setup/common.sh@33 -- # return 0 00:03:17.410 08:42:05 -- setup/hugepages.sh@99 -- # surp=0 00:03:17.410 08:42:05 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:17.410 08:42:05 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:17.410 08:42:05 -- setup/common.sh@18 -- # local node= 00:03:17.410 08:42:05 -- setup/common.sh@19 -- # local var val 00:03:17.410 08:42:05 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.410 08:42:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.410 08:42:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:17.410 08:42:05 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:17.410 08:42:05 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.410 08:42:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.410 08:42:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541692 kB' 'MemFree: 45878140 kB' 'MemAvailable: 49379640 kB' 'Buffers: 2704 kB' 'Cached: 10177788 kB' 'SwapCached: 0 kB' 'Active: 7191300 kB' 'Inactive: 3506596 kB' 'Active(anon): 6796708 kB' 'Inactive(anon): 0 kB' 'Active(file): 394592 kB' 'Inactive(file): 3506596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 520556 kB' 'Mapped: 191696 kB' 'Shmem: 6279304 kB' 'KReclaimable: 188304 kB' 'Slab: 553820 kB' 'SReclaimable: 188304 kB' 'SUnreclaim: 365516 kB' 'KernelStack: 12864 kB' 'PageTables: 8280 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610872 kB' 'Committed_AS: 7916932 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196132 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1758812 kB' 'DirectMap2M: 13889536 kB' 'DirectMap1G: 53477376 kB' 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.410 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.410 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.411 08:42:05 -- setup/common.sh@33 -- # echo 0 00:03:17.411 08:42:05 -- setup/common.sh@33 -- # return 0 00:03:17.411 08:42:05 -- setup/hugepages.sh@100 -- # resv=0 00:03:17.411 08:42:05 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:17.411 nr_hugepages=1024 00:03:17.411 08:42:05 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:17.411 resv_hugepages=0 00:03:17.411 08:42:05 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:17.411 surplus_hugepages=0 00:03:17.411 08:42:05 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:17.411 anon_hugepages=0 00:03:17.411 08:42:05 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:17.411 08:42:05 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:17.411 08:42:05 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:17.411 08:42:05 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:17.411 08:42:05 -- setup/common.sh@18 -- # local node= 00:03:17.411 08:42:05 -- setup/common.sh@19 -- # local var val 00:03:17.411 08:42:05 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.411 08:42:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.411 08:42:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:17.411 08:42:05 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:17.411 08:42:05 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.411 08:42:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.411 08:42:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541692 kB' 'MemFree: 45878636 kB' 'MemAvailable: 49380136 kB' 'Buffers: 2704 kB' 'Cached: 10177804 kB' 'SwapCached: 0 kB' 'Active: 7191056 kB' 'Inactive: 3506596 kB' 'Active(anon): 6796464 kB' 'Inactive(anon): 0 kB' 'Active(file): 394592 kB' 'Inactive(file): 3506596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 520292 kB' 'Mapped: 191620 kB' 'Shmem: 6279320 kB' 'KReclaimable: 188304 kB' 'Slab: 553824 kB' 'SReclaimable: 188304 kB' 'SUnreclaim: 365520 kB' 'KernelStack: 12848 kB' 'PageTables: 8220 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610872 kB' 'Committed_AS: 7916944 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196132 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1758812 kB' 'DirectMap2M: 13889536 kB' 'DirectMap1G: 53477376 kB' 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.411 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.411 08:42:05 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.412 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.412 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.413 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.413 08:42:05 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.413 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.413 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.413 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.413 08:42:05 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.413 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.413 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.413 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.413 08:42:05 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.413 08:42:05 -- setup/common.sh@33 -- # echo 1024 00:03:17.413 08:42:05 -- setup/common.sh@33 -- # return 0 00:03:17.413 08:42:05 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:17.413 08:42:05 -- setup/hugepages.sh@112 -- # get_nodes 00:03:17.413 08:42:05 -- setup/hugepages.sh@27 -- # local node 00:03:17.413 08:42:05 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:17.413 08:42:05 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:17.413 08:42:05 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:17.413 08:42:05 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:17.413 08:42:05 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:17.413 08:42:05 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:17.413 08:42:05 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:17.413 08:42:05 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:17.413 08:42:05 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:17.413 08:42:05 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:17.413 08:42:05 -- setup/common.sh@18 -- # local node=0 00:03:17.413 08:42:05 -- setup/common.sh@19 -- # local var val 00:03:17.413 08:42:05 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.413 08:42:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.413 08:42:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:17.413 08:42:05 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:17.673 08:42:05 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.673 08:42:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.673 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 08:42:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32876940 kB' 'MemFree: 22612636 kB' 'MemUsed: 10264304 kB' 'SwapCached: 0 kB' 'Active: 4969856 kB' 'Inactive: 3264144 kB' 'Active(anon): 4781284 kB' 'Inactive(anon): 0 kB' 'Active(file): 188572 kB' 'Inactive(file): 3264144 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7952760 kB' 'Mapped: 63876 kB' 'AnonPages: 284424 kB' 'Shmem: 4500044 kB' 'KernelStack: 6920 kB' 'PageTables: 5280 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 112012 kB' 'Slab: 297552 kB' 'SReclaimable: 112012 kB' 'SUnreclaim: 185540 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:17.673 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 08:42:05 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.673 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.673 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 08:42:05 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.673 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.673 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 08:42:05 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.673 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.673 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 08:42:05 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.673 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.673 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 08:42:05 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.673 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.673 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 08:42:05 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.673 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.673 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 08:42:05 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.673 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.673 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 08:42:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.673 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.673 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 08:42:05 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.673 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.673 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 08:42:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.673 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 08:42:05 -- setup/common.sh@33 -- # echo 0 00:03:17.674 08:42:05 -- setup/common.sh@33 -- # return 0 00:03:17.674 08:42:05 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:17.674 08:42:05 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:17.674 08:42:05 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:17.674 08:42:05 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:17.674 08:42:05 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:17.674 08:42:05 -- setup/common.sh@18 -- # local node=1 00:03:17.674 08:42:05 -- setup/common.sh@19 -- # local var val 00:03:17.674 08:42:05 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.674 08:42:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.674 08:42:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:17.674 08:42:05 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:17.674 08:42:05 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.674 08:42:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 08:42:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27664752 kB' 'MemFree: 23266104 kB' 'MemUsed: 4398648 kB' 'SwapCached: 0 kB' 'Active: 2221288 kB' 'Inactive: 242452 kB' 'Active(anon): 2015268 kB' 'Inactive(anon): 0 kB' 'Active(file): 206020 kB' 'Inactive(file): 242452 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2227764 kB' 'Mapped: 127744 kB' 'AnonPages: 235976 kB' 'Shmem: 1779292 kB' 'KernelStack: 5976 kB' 'PageTables: 3096 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 76292 kB' 'Slab: 256272 kB' 'SReclaimable: 76292 kB' 'SUnreclaim: 179980 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 08:42:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # continue 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.675 08:42:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.675 08:42:05 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.675 08:42:05 -- setup/common.sh@33 -- # echo 0 00:03:17.675 08:42:05 -- setup/common.sh@33 -- # return 0 00:03:17.675 08:42:05 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:17.675 08:42:05 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:17.675 08:42:05 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:17.675 08:42:05 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:17.675 08:42:05 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:17.675 node0=512 expecting 512 00:03:17.675 08:42:05 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:17.675 08:42:05 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:17.675 08:42:05 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:17.675 08:42:05 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:17.675 node1=512 expecting 512 00:03:17.675 08:42:05 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:17.675 00:03:17.675 real 0m1.460s 00:03:17.675 user 0m0.623s 00:03:17.675 sys 0m0.802s 00:03:17.675 08:42:05 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:17.675 08:42:05 -- common/autotest_common.sh@10 -- # set +x 00:03:17.675 ************************************ 00:03:17.675 END TEST even_2G_alloc 00:03:17.675 ************************************ 00:03:17.675 08:42:06 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:03:17.675 08:42:06 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:17.675 08:42:06 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:17.675 08:42:06 -- common/autotest_common.sh@10 -- # set +x 00:03:17.675 ************************************ 00:03:17.675 START TEST odd_alloc 00:03:17.675 ************************************ 00:03:17.675 08:42:06 -- common/autotest_common.sh@1104 -- # odd_alloc 00:03:17.675 08:42:06 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:03:17.675 08:42:06 -- setup/hugepages.sh@49 -- # local size=2098176 00:03:17.675 08:42:06 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:17.675 08:42:06 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:17.675 08:42:06 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:03:17.675 08:42:06 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:17.675 08:42:06 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:17.675 08:42:06 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:17.675 08:42:06 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:03:17.675 08:42:06 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:17.675 08:42:06 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:17.675 08:42:06 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:17.675 08:42:06 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:17.675 08:42:06 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:17.675 08:42:06 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:17.675 08:42:06 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:17.675 08:42:06 -- setup/hugepages.sh@83 -- # : 513 00:03:17.675 08:42:06 -- setup/hugepages.sh@84 -- # : 1 00:03:17.675 08:42:06 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:17.675 08:42:06 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:03:17.675 08:42:06 -- setup/hugepages.sh@83 -- # : 0 00:03:17.675 08:42:06 -- setup/hugepages.sh@84 -- # : 0 00:03:17.675 08:42:06 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:17.675 08:42:06 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:03:17.675 08:42:06 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:03:17.675 08:42:06 -- setup/hugepages.sh@160 -- # setup output 00:03:17.675 08:42:06 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:17.675 08:42:06 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:18.613 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:18.613 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:18.613 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:18.613 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:18.613 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:18.613 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:18.613 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:18.613 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:18.613 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:18.613 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:18.613 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:18.613 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:18.613 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:18.613 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:18.613 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:18.613 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:18.613 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:18.875 08:42:07 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:03:18.875 08:42:07 -- setup/hugepages.sh@89 -- # local node 00:03:18.875 08:42:07 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:18.875 08:42:07 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:18.875 08:42:07 -- setup/hugepages.sh@92 -- # local surp 00:03:18.875 08:42:07 -- setup/hugepages.sh@93 -- # local resv 00:03:18.875 08:42:07 -- setup/hugepages.sh@94 -- # local anon 00:03:18.875 08:42:07 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:18.875 08:42:07 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:18.875 08:42:07 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:18.875 08:42:07 -- setup/common.sh@18 -- # local node= 00:03:18.875 08:42:07 -- setup/common.sh@19 -- # local var val 00:03:18.875 08:42:07 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.875 08:42:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.875 08:42:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:18.875 08:42:07 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:18.875 08:42:07 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.875 08:42:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.875 08:42:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541692 kB' 'MemFree: 45885556 kB' 'MemAvailable: 49387056 kB' 'Buffers: 2704 kB' 'Cached: 10177868 kB' 'SwapCached: 0 kB' 'Active: 7187720 kB' 'Inactive: 3506596 kB' 'Active(anon): 6793128 kB' 'Inactive(anon): 0 kB' 'Active(file): 394592 kB' 'Inactive(file): 3506596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 516884 kB' 'Mapped: 190756 kB' 'Shmem: 6279384 kB' 'KReclaimable: 188304 kB' 'Slab: 553708 kB' 'SReclaimable: 188304 kB' 'SUnreclaim: 365404 kB' 'KernelStack: 12832 kB' 'PageTables: 7956 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37609848 kB' 'Committed_AS: 7902304 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196196 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1758812 kB' 'DirectMap2M: 13889536 kB' 'DirectMap1G: 53477376 kB' 00:03:18.875 08:42:07 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.875 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.875 08:42:07 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.875 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.875 08:42:07 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.875 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.875 08:42:07 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.875 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.875 08:42:07 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.875 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.875 08:42:07 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.875 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.875 08:42:07 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.875 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.875 08:42:07 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.875 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.875 08:42:07 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.875 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.875 08:42:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.875 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.875 08:42:07 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.875 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.875 08:42:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.875 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.875 08:42:07 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.875 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.875 08:42:07 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.875 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.875 08:42:07 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.875 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.875 08:42:07 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.875 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.875 08:42:07 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.875 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.875 08:42:07 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.875 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.875 08:42:07 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.875 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.875 08:42:07 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.875 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.875 08:42:07 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.875 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.875 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.876 08:42:07 -- setup/common.sh@33 -- # echo 0 00:03:18.876 08:42:07 -- setup/common.sh@33 -- # return 0 00:03:18.876 08:42:07 -- setup/hugepages.sh@97 -- # anon=0 00:03:18.876 08:42:07 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:18.876 08:42:07 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:18.876 08:42:07 -- setup/common.sh@18 -- # local node= 00:03:18.876 08:42:07 -- setup/common.sh@19 -- # local var val 00:03:18.876 08:42:07 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.876 08:42:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.876 08:42:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:18.876 08:42:07 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:18.876 08:42:07 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.876 08:42:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.876 08:42:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541692 kB' 'MemFree: 45885304 kB' 'MemAvailable: 49386804 kB' 'Buffers: 2704 kB' 'Cached: 10177872 kB' 'SwapCached: 0 kB' 'Active: 7188104 kB' 'Inactive: 3506596 kB' 'Active(anon): 6793512 kB' 'Inactive(anon): 0 kB' 'Active(file): 394592 kB' 'Inactive(file): 3506596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 517308 kB' 'Mapped: 190832 kB' 'Shmem: 6279388 kB' 'KReclaimable: 188304 kB' 'Slab: 553760 kB' 'SReclaimable: 188304 kB' 'SUnreclaim: 365456 kB' 'KernelStack: 12864 kB' 'PageTables: 8020 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37609848 kB' 'Committed_AS: 7902316 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196164 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1758812 kB' 'DirectMap2M: 13889536 kB' 'DirectMap1G: 53477376 kB' 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.876 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.876 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.877 08:42:07 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.877 08:42:07 -- setup/common.sh@33 -- # echo 0 00:03:18.877 08:42:07 -- setup/common.sh@33 -- # return 0 00:03:18.877 08:42:07 -- setup/hugepages.sh@99 -- # surp=0 00:03:18.877 08:42:07 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:18.877 08:42:07 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:18.877 08:42:07 -- setup/common.sh@18 -- # local node= 00:03:18.877 08:42:07 -- setup/common.sh@19 -- # local var val 00:03:18.877 08:42:07 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.877 08:42:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.877 08:42:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:18.877 08:42:07 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:18.877 08:42:07 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.877 08:42:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.877 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541692 kB' 'MemFree: 45886056 kB' 'MemAvailable: 49387556 kB' 'Buffers: 2704 kB' 'Cached: 10177884 kB' 'SwapCached: 0 kB' 'Active: 7187924 kB' 'Inactive: 3506596 kB' 'Active(anon): 6793332 kB' 'Inactive(anon): 0 kB' 'Active(file): 394592 kB' 'Inactive(file): 3506596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 517132 kB' 'Mapped: 190828 kB' 'Shmem: 6279400 kB' 'KReclaimable: 188304 kB' 'Slab: 553744 kB' 'SReclaimable: 188304 kB' 'SUnreclaim: 365440 kB' 'KernelStack: 12864 kB' 'PageTables: 8000 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37609848 kB' 'Committed_AS: 7902332 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196148 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1758812 kB' 'DirectMap2M: 13889536 kB' 'DirectMap1G: 53477376 kB' 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.878 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.878 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.879 08:42:07 -- setup/common.sh@33 -- # echo 0 00:03:18.879 08:42:07 -- setup/common.sh@33 -- # return 0 00:03:18.879 08:42:07 -- setup/hugepages.sh@100 -- # resv=0 00:03:18.879 08:42:07 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:03:18.879 nr_hugepages=1025 00:03:18.879 08:42:07 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:18.879 resv_hugepages=0 00:03:18.879 08:42:07 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:18.879 surplus_hugepages=0 00:03:18.879 08:42:07 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:18.879 anon_hugepages=0 00:03:18.879 08:42:07 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:18.879 08:42:07 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:03:18.879 08:42:07 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:18.879 08:42:07 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:18.879 08:42:07 -- setup/common.sh@18 -- # local node= 00:03:18.879 08:42:07 -- setup/common.sh@19 -- # local var val 00:03:18.879 08:42:07 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.879 08:42:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.879 08:42:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:18.879 08:42:07 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:18.879 08:42:07 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.879 08:42:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.879 08:42:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541692 kB' 'MemFree: 45889044 kB' 'MemAvailable: 49390544 kB' 'Buffers: 2704 kB' 'Cached: 10177896 kB' 'SwapCached: 0 kB' 'Active: 7183616 kB' 'Inactive: 3506596 kB' 'Active(anon): 6789024 kB' 'Inactive(anon): 0 kB' 'Active(file): 394592 kB' 'Inactive(file): 3506596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 512988 kB' 'Mapped: 189880 kB' 'Shmem: 6279412 kB' 'KReclaimable: 188304 kB' 'Slab: 553752 kB' 'SReclaimable: 188304 kB' 'SUnreclaim: 365448 kB' 'KernelStack: 12976 kB' 'PageTables: 8312 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37609848 kB' 'Committed_AS: 7899780 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196208 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1758812 kB' 'DirectMap2M: 13889536 kB' 'DirectMap1G: 53477376 kB' 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.879 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.879 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.880 08:42:07 -- setup/common.sh@33 -- # echo 1025 00:03:18.880 08:42:07 -- setup/common.sh@33 -- # return 0 00:03:18.880 08:42:07 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:18.880 08:42:07 -- setup/hugepages.sh@112 -- # get_nodes 00:03:18.880 08:42:07 -- setup/hugepages.sh@27 -- # local node 00:03:18.880 08:42:07 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:18.880 08:42:07 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:18.880 08:42:07 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:18.880 08:42:07 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:03:18.880 08:42:07 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:18.880 08:42:07 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:18.880 08:42:07 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:18.880 08:42:07 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:18.880 08:42:07 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:18.880 08:42:07 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:18.880 08:42:07 -- setup/common.sh@18 -- # local node=0 00:03:18.880 08:42:07 -- setup/common.sh@19 -- # local var val 00:03:18.880 08:42:07 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.880 08:42:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.880 08:42:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:18.880 08:42:07 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:18.880 08:42:07 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.880 08:42:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.880 08:42:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32876940 kB' 'MemFree: 22612552 kB' 'MemUsed: 10264388 kB' 'SwapCached: 0 kB' 'Active: 4971040 kB' 'Inactive: 3264144 kB' 'Active(anon): 4782468 kB' 'Inactive(anon): 0 kB' 'Active(file): 188572 kB' 'Inactive(file): 3264144 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7952856 kB' 'Mapped: 62356 kB' 'AnonPages: 285672 kB' 'Shmem: 4500140 kB' 'KernelStack: 7208 kB' 'PageTables: 5928 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 112012 kB' 'Slab: 297516 kB' 'SReclaimable: 112012 kB' 'SUnreclaim: 185504 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.880 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.880 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.881 08:42:07 -- setup/common.sh@33 -- # echo 0 00:03:18.881 08:42:07 -- setup/common.sh@33 -- # return 0 00:03:18.881 08:42:07 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:18.881 08:42:07 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:18.881 08:42:07 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:18.881 08:42:07 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:18.881 08:42:07 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:18.881 08:42:07 -- setup/common.sh@18 -- # local node=1 00:03:18.881 08:42:07 -- setup/common.sh@19 -- # local var val 00:03:18.881 08:42:07 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.881 08:42:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.881 08:42:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:18.881 08:42:07 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:18.881 08:42:07 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.881 08:42:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.881 08:42:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27664752 kB' 'MemFree: 23275924 kB' 'MemUsed: 4388828 kB' 'SwapCached: 0 kB' 'Active: 2214880 kB' 'Inactive: 242452 kB' 'Active(anon): 2008860 kB' 'Inactive(anon): 0 kB' 'Active(file): 206020 kB' 'Inactive(file): 242452 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2227768 kB' 'Mapped: 127524 kB' 'AnonPages: 229700 kB' 'Shmem: 1779296 kB' 'KernelStack: 6232 kB' 'PageTables: 3652 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 76292 kB' 'Slab: 256232 kB' 'SReclaimable: 76292 kB' 'SUnreclaim: 179940 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.881 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.881 08:42:07 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.882 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.882 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.882 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.882 08:42:07 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.882 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.882 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.882 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.882 08:42:07 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.882 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.882 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.882 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.882 08:42:07 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.882 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.882 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.882 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.882 08:42:07 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.882 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.882 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.882 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.882 08:42:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.882 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.882 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.882 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.882 08:42:07 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.882 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.882 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.882 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.882 08:42:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.882 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.882 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.882 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.882 08:42:07 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.882 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.882 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.882 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.882 08:42:07 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.882 08:42:07 -- setup/common.sh@32 -- # continue 00:03:18.882 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.882 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # continue 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # continue 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # continue 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # continue 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # continue 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # continue 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # continue 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # continue 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # continue 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # continue 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # continue 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # continue 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # continue 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # continue 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # continue 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # continue 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # continue 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # continue 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # continue 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # continue 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # continue 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # continue 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # continue 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # continue 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.140 08:42:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.140 08:42:07 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.140 08:42:07 -- setup/common.sh@33 -- # echo 0 00:03:19.140 08:42:07 -- setup/common.sh@33 -- # return 0 00:03:19.140 08:42:07 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:19.141 08:42:07 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:19.141 08:42:07 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:19.141 08:42:07 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:19.141 08:42:07 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:03:19.141 node0=512 expecting 513 00:03:19.141 08:42:07 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:19.141 08:42:07 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:19.141 08:42:07 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:19.141 08:42:07 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:03:19.141 node1=513 expecting 512 00:03:19.141 08:42:07 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:03:19.141 00:03:19.141 real 0m1.418s 00:03:19.141 user 0m0.570s 00:03:19.141 sys 0m0.811s 00:03:19.141 08:42:07 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:19.141 08:42:07 -- common/autotest_common.sh@10 -- # set +x 00:03:19.141 ************************************ 00:03:19.141 END TEST odd_alloc 00:03:19.141 ************************************ 00:03:19.141 08:42:07 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:03:19.141 08:42:07 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:19.141 08:42:07 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:19.141 08:42:07 -- common/autotest_common.sh@10 -- # set +x 00:03:19.141 ************************************ 00:03:19.141 START TEST custom_alloc 00:03:19.141 ************************************ 00:03:19.141 08:42:07 -- common/autotest_common.sh@1104 -- # custom_alloc 00:03:19.141 08:42:07 -- setup/hugepages.sh@167 -- # local IFS=, 00:03:19.141 08:42:07 -- setup/hugepages.sh@169 -- # local node 00:03:19.141 08:42:07 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:03:19.141 08:42:07 -- setup/hugepages.sh@170 -- # local nodes_hp 00:03:19.141 08:42:07 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:03:19.141 08:42:07 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:03:19.141 08:42:07 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:19.141 08:42:07 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:19.141 08:42:07 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:19.141 08:42:07 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:19.141 08:42:07 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:19.141 08:42:07 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:19.141 08:42:07 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:19.141 08:42:07 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:19.141 08:42:07 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:19.141 08:42:07 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:19.141 08:42:07 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:19.141 08:42:07 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:19.141 08:42:07 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:19.141 08:42:07 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:19.141 08:42:07 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:19.141 08:42:07 -- setup/hugepages.sh@83 -- # : 256 00:03:19.141 08:42:07 -- setup/hugepages.sh@84 -- # : 1 00:03:19.141 08:42:07 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:19.141 08:42:07 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:19.141 08:42:07 -- setup/hugepages.sh@83 -- # : 0 00:03:19.141 08:42:07 -- setup/hugepages.sh@84 -- # : 0 00:03:19.141 08:42:07 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:19.141 08:42:07 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:03:19.141 08:42:07 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:03:19.141 08:42:07 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:03:19.141 08:42:07 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:19.141 08:42:07 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:19.141 08:42:07 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:19.141 08:42:07 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:19.141 08:42:07 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:19.141 08:42:07 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:19.141 08:42:07 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:19.141 08:42:07 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:19.141 08:42:07 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:19.141 08:42:07 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:19.141 08:42:07 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:19.141 08:42:07 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:19.141 08:42:07 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:03:19.141 08:42:07 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:19.141 08:42:07 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:19.141 08:42:07 -- setup/hugepages.sh@78 -- # return 0 00:03:19.141 08:42:07 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:03:19.141 08:42:07 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:19.141 08:42:07 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:19.141 08:42:07 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:19.141 08:42:07 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:19.141 08:42:07 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:19.141 08:42:07 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:19.141 08:42:07 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:03:19.141 08:42:07 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:19.141 08:42:07 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:19.141 08:42:07 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:19.141 08:42:07 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:19.141 08:42:07 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:19.141 08:42:07 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:19.141 08:42:07 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:19.141 08:42:07 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:03:19.141 08:42:07 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:19.141 08:42:07 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:19.141 08:42:07 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:19.141 08:42:07 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:03:19.141 08:42:07 -- setup/hugepages.sh@78 -- # return 0 00:03:19.141 08:42:07 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:03:19.141 08:42:07 -- setup/hugepages.sh@187 -- # setup output 00:03:19.141 08:42:07 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:19.141 08:42:07 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:20.079 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:20.079 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:20.079 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:20.079 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:20.079 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:20.079 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:20.079 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:20.079 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:20.079 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:20.079 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:20.079 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:20.079 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:20.079 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:20.079 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:20.079 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:20.079 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:20.079 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:20.079 08:42:08 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:03:20.079 08:42:08 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:03:20.079 08:42:08 -- setup/hugepages.sh@89 -- # local node 00:03:20.079 08:42:08 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:20.079 08:42:08 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:20.079 08:42:08 -- setup/hugepages.sh@92 -- # local surp 00:03:20.079 08:42:08 -- setup/hugepages.sh@93 -- # local resv 00:03:20.079 08:42:08 -- setup/hugepages.sh@94 -- # local anon 00:03:20.079 08:42:08 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:20.079 08:42:08 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:20.079 08:42:08 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:20.079 08:42:08 -- setup/common.sh@18 -- # local node= 00:03:20.079 08:42:08 -- setup/common.sh@19 -- # local var val 00:03:20.079 08:42:08 -- setup/common.sh@20 -- # local mem_f mem 00:03:20.079 08:42:08 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:20.079 08:42:08 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:20.079 08:42:08 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:20.079 08:42:08 -- setup/common.sh@28 -- # mapfile -t mem 00:03:20.079 08:42:08 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:20.079 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.079 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.079 08:42:08 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541692 kB' 'MemFree: 44849068 kB' 'MemAvailable: 48350568 kB' 'Buffers: 2704 kB' 'Cached: 10177964 kB' 'SwapCached: 0 kB' 'Active: 7188916 kB' 'Inactive: 3506596 kB' 'Active(anon): 6794324 kB' 'Inactive(anon): 0 kB' 'Active(file): 394592 kB' 'Inactive(file): 3506596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 517992 kB' 'Mapped: 190664 kB' 'Shmem: 6279480 kB' 'KReclaimable: 188304 kB' 'Slab: 553840 kB' 'SReclaimable: 188304 kB' 'SUnreclaim: 365536 kB' 'KernelStack: 13040 kB' 'PageTables: 8684 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37086584 kB' 'Committed_AS: 7902400 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196276 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1758812 kB' 'DirectMap2M: 13889536 kB' 'DirectMap1G: 53477376 kB' 00:03:20.079 08:42:08 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.079 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.079 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.079 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.079 08:42:08 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.079 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.079 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.079 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.079 08:42:08 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.079 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.079 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.079 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.079 08:42:08 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.079 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.079 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.079 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.079 08:42:08 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.079 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.079 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.079 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.079 08:42:08 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.079 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.079 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.079 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.079 08:42:08 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.079 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.079 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.079 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.079 08:42:08 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.079 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.079 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.079 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.079 08:42:08 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.079 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.079 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.079 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.079 08:42:08 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.079 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.079 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.079 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.079 08:42:08 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.079 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.079 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.079 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.079 08:42:08 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.079 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.079 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.079 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.079 08:42:08 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.079 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.079 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.079 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.079 08:42:08 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.079 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.079 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.079 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.079 08:42:08 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.079 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.079 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.079 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.079 08:42:08 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.079 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.079 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.079 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.079 08:42:08 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.079 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.079 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.080 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.080 08:42:08 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.080 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.080 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.080 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.080 08:42:08 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.080 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.080 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.342 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.342 08:42:08 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.342 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.342 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.342 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.342 08:42:08 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.342 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.342 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.342 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.342 08:42:08 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.342 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.342 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.342 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.342 08:42:08 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.342 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.342 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.342 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.342 08:42:08 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.342 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.342 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.342 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.342 08:42:08 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.342 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.342 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.342 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.342 08:42:08 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.342 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.342 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.342 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.342 08:42:08 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.342 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.342 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.342 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.342 08:42:08 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.342 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.342 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.342 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.342 08:42:08 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.342 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.342 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.342 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.342 08:42:08 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.342 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.342 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.342 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.342 08:42:08 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.343 08:42:08 -- setup/common.sh@33 -- # echo 0 00:03:20.343 08:42:08 -- setup/common.sh@33 -- # return 0 00:03:20.343 08:42:08 -- setup/hugepages.sh@97 -- # anon=0 00:03:20.343 08:42:08 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:20.343 08:42:08 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:20.343 08:42:08 -- setup/common.sh@18 -- # local node= 00:03:20.343 08:42:08 -- setup/common.sh@19 -- # local var val 00:03:20.343 08:42:08 -- setup/common.sh@20 -- # local mem_f mem 00:03:20.343 08:42:08 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:20.343 08:42:08 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:20.343 08:42:08 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:20.343 08:42:08 -- setup/common.sh@28 -- # mapfile -t mem 00:03:20.343 08:42:08 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.343 08:42:08 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541692 kB' 'MemFree: 44854620 kB' 'MemAvailable: 48356120 kB' 'Buffers: 2704 kB' 'Cached: 10177968 kB' 'SwapCached: 0 kB' 'Active: 7188572 kB' 'Inactive: 3506596 kB' 'Active(anon): 6793980 kB' 'Inactive(anon): 0 kB' 'Active(file): 394592 kB' 'Inactive(file): 3506596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 517140 kB' 'Mapped: 190668 kB' 'Shmem: 6279484 kB' 'KReclaimable: 188304 kB' 'Slab: 553812 kB' 'SReclaimable: 188304 kB' 'SUnreclaim: 365508 kB' 'KernelStack: 12816 kB' 'PageTables: 8040 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37086584 kB' 'Committed_AS: 7902412 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196116 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1758812 kB' 'DirectMap2M: 13889536 kB' 'DirectMap1G: 53477376 kB' 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.343 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.343 08:42:08 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.344 08:42:08 -- setup/common.sh@33 -- # echo 0 00:03:20.344 08:42:08 -- setup/common.sh@33 -- # return 0 00:03:20.344 08:42:08 -- setup/hugepages.sh@99 -- # surp=0 00:03:20.344 08:42:08 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:20.344 08:42:08 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:20.344 08:42:08 -- setup/common.sh@18 -- # local node= 00:03:20.344 08:42:08 -- setup/common.sh@19 -- # local var val 00:03:20.344 08:42:08 -- setup/common.sh@20 -- # local mem_f mem 00:03:20.344 08:42:08 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:20.344 08:42:08 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:20.344 08:42:08 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:20.344 08:42:08 -- setup/common.sh@28 -- # mapfile -t mem 00:03:20.344 08:42:08 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.344 08:42:08 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541692 kB' 'MemFree: 44854492 kB' 'MemAvailable: 48355992 kB' 'Buffers: 2704 kB' 'Cached: 10177968 kB' 'SwapCached: 0 kB' 'Active: 7183196 kB' 'Inactive: 3506596 kB' 'Active(anon): 6788604 kB' 'Inactive(anon): 0 kB' 'Active(file): 394592 kB' 'Inactive(file): 3506596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 512324 kB' 'Mapped: 189840 kB' 'Shmem: 6279484 kB' 'KReclaimable: 188304 kB' 'Slab: 553936 kB' 'SReclaimable: 188304 kB' 'SUnreclaim: 365632 kB' 'KernelStack: 12992 kB' 'PageTables: 8032 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37086584 kB' 'Committed_AS: 7898716 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196160 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1758812 kB' 'DirectMap2M: 13889536 kB' 'DirectMap1G: 53477376 kB' 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.344 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.344 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.345 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.345 08:42:08 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.345 08:42:08 -- setup/common.sh@33 -- # echo 0 00:03:20.345 08:42:08 -- setup/common.sh@33 -- # return 0 00:03:20.345 08:42:08 -- setup/hugepages.sh@100 -- # resv=0 00:03:20.345 08:42:08 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:03:20.345 nr_hugepages=1536 00:03:20.345 08:42:08 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:20.345 resv_hugepages=0 00:03:20.345 08:42:08 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:20.345 surplus_hugepages=0 00:03:20.345 08:42:08 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:20.345 anon_hugepages=0 00:03:20.345 08:42:08 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:20.345 08:42:08 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:03:20.346 08:42:08 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:20.346 08:42:08 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:20.346 08:42:08 -- setup/common.sh@18 -- # local node= 00:03:20.346 08:42:08 -- setup/common.sh@19 -- # local var val 00:03:20.346 08:42:08 -- setup/common.sh@20 -- # local mem_f mem 00:03:20.346 08:42:08 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:20.346 08:42:08 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:20.346 08:42:08 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:20.346 08:42:08 -- setup/common.sh@28 -- # mapfile -t mem 00:03:20.346 08:42:08 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.346 08:42:08 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541692 kB' 'MemFree: 44852696 kB' 'MemAvailable: 48354196 kB' 'Buffers: 2704 kB' 'Cached: 10177968 kB' 'SwapCached: 0 kB' 'Active: 7184392 kB' 'Inactive: 3506596 kB' 'Active(anon): 6789800 kB' 'Inactive(anon): 0 kB' 'Active(file): 394592 kB' 'Inactive(file): 3506596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 513648 kB' 'Mapped: 189840 kB' 'Shmem: 6279484 kB' 'KReclaimable: 188304 kB' 'Slab: 553936 kB' 'SReclaimable: 188304 kB' 'SUnreclaim: 365632 kB' 'KernelStack: 13120 kB' 'PageTables: 8528 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37086584 kB' 'Committed_AS: 7898324 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196224 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1758812 kB' 'DirectMap2M: 13889536 kB' 'DirectMap1G: 53477376 kB' 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.346 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.346 08:42:08 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.347 08:42:08 -- setup/common.sh@33 -- # echo 1536 00:03:20.347 08:42:08 -- setup/common.sh@33 -- # return 0 00:03:20.347 08:42:08 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:20.347 08:42:08 -- setup/hugepages.sh@112 -- # get_nodes 00:03:20.347 08:42:08 -- setup/hugepages.sh@27 -- # local node 00:03:20.347 08:42:08 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:20.347 08:42:08 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:20.347 08:42:08 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:20.347 08:42:08 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:20.347 08:42:08 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:20.347 08:42:08 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:20.347 08:42:08 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:20.347 08:42:08 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:20.347 08:42:08 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:20.347 08:42:08 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:20.347 08:42:08 -- setup/common.sh@18 -- # local node=0 00:03:20.347 08:42:08 -- setup/common.sh@19 -- # local var val 00:03:20.347 08:42:08 -- setup/common.sh@20 -- # local mem_f mem 00:03:20.347 08:42:08 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:20.347 08:42:08 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:20.347 08:42:08 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:20.347 08:42:08 -- setup/common.sh@28 -- # mapfile -t mem 00:03:20.347 08:42:08 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.347 08:42:08 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32876940 kB' 'MemFree: 22641420 kB' 'MemUsed: 10235520 kB' 'SwapCached: 0 kB' 'Active: 4968728 kB' 'Inactive: 3264144 kB' 'Active(anon): 4780156 kB' 'Inactive(anon): 0 kB' 'Active(file): 188572 kB' 'Inactive(file): 3264144 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7952860 kB' 'Mapped: 62820 kB' 'AnonPages: 283144 kB' 'Shmem: 4500144 kB' 'KernelStack: 6888 kB' 'PageTables: 5100 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 112012 kB' 'Slab: 297768 kB' 'SReclaimable: 112012 kB' 'SUnreclaim: 185756 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.347 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.347 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.348 08:42:08 -- setup/common.sh@33 -- # echo 0 00:03:20.348 08:42:08 -- setup/common.sh@33 -- # return 0 00:03:20.348 08:42:08 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:20.348 08:42:08 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:20.348 08:42:08 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:20.348 08:42:08 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:20.348 08:42:08 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:20.348 08:42:08 -- setup/common.sh@18 -- # local node=1 00:03:20.348 08:42:08 -- setup/common.sh@19 -- # local var val 00:03:20.348 08:42:08 -- setup/common.sh@20 -- # local mem_f mem 00:03:20.348 08:42:08 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:20.348 08:42:08 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:20.348 08:42:08 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:20.348 08:42:08 -- setup/common.sh@28 -- # mapfile -t mem 00:03:20.348 08:42:08 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.348 08:42:08 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27664752 kB' 'MemFree: 22203192 kB' 'MemUsed: 5461560 kB' 'SwapCached: 0 kB' 'Active: 2219404 kB' 'Inactive: 242452 kB' 'Active(anon): 2013384 kB' 'Inactive(anon): 0 kB' 'Active(file): 206020 kB' 'Inactive(file): 242452 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2227840 kB' 'Mapped: 127524 kB' 'AnonPages: 234152 kB' 'Shmem: 1779368 kB' 'KernelStack: 5992 kB' 'PageTables: 2912 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 76292 kB' 'Slab: 256104 kB' 'SReclaimable: 76292 kB' 'SUnreclaim: 179812 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.348 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.348 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # continue 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.349 08:42:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.349 08:42:08 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.349 08:42:08 -- setup/common.sh@33 -- # echo 0 00:03:20.349 08:42:08 -- setup/common.sh@33 -- # return 0 00:03:20.349 08:42:08 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:20.349 08:42:08 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:20.349 08:42:08 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:20.349 08:42:08 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:20.349 08:42:08 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:20.349 node0=512 expecting 512 00:03:20.349 08:42:08 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:20.349 08:42:08 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:20.349 08:42:08 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:20.349 08:42:08 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:03:20.349 node1=1024 expecting 1024 00:03:20.349 08:42:08 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:03:20.349 00:03:20.349 real 0m1.300s 00:03:20.349 user 0m0.560s 00:03:20.349 sys 0m0.703s 00:03:20.349 08:42:08 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:20.349 08:42:08 -- common/autotest_common.sh@10 -- # set +x 00:03:20.349 ************************************ 00:03:20.349 END TEST custom_alloc 00:03:20.349 ************************************ 00:03:20.349 08:42:08 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:03:20.349 08:42:08 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:20.349 08:42:08 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:20.349 08:42:08 -- common/autotest_common.sh@10 -- # set +x 00:03:20.349 ************************************ 00:03:20.349 START TEST no_shrink_alloc 00:03:20.349 ************************************ 00:03:20.349 08:42:08 -- common/autotest_common.sh@1104 -- # no_shrink_alloc 00:03:20.349 08:42:08 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:03:20.349 08:42:08 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:20.349 08:42:08 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:20.349 08:42:08 -- setup/hugepages.sh@51 -- # shift 00:03:20.349 08:42:08 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:20.349 08:42:08 -- setup/hugepages.sh@52 -- # local node_ids 00:03:20.349 08:42:08 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:20.349 08:42:08 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:20.349 08:42:08 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:20.349 08:42:08 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:20.349 08:42:08 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:20.349 08:42:08 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:20.349 08:42:08 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:20.349 08:42:08 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:20.349 08:42:08 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:20.349 08:42:08 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:20.349 08:42:08 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:20.349 08:42:08 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:20.349 08:42:08 -- setup/hugepages.sh@73 -- # return 0 00:03:20.349 08:42:08 -- setup/hugepages.sh@198 -- # setup output 00:03:20.349 08:42:08 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:20.349 08:42:08 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:21.728 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:21.728 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:21.728 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:21.728 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:21.728 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:21.728 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:21.728 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:21.728 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:21.728 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:21.728 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:21.728 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:21.728 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:21.728 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:21.728 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:21.728 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:21.728 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:21.728 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:21.728 08:42:10 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:03:21.728 08:42:10 -- setup/hugepages.sh@89 -- # local node 00:03:21.728 08:42:10 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:21.728 08:42:10 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:21.728 08:42:10 -- setup/hugepages.sh@92 -- # local surp 00:03:21.728 08:42:10 -- setup/hugepages.sh@93 -- # local resv 00:03:21.728 08:42:10 -- setup/hugepages.sh@94 -- # local anon 00:03:21.728 08:42:10 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:21.728 08:42:10 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:21.728 08:42:10 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:21.728 08:42:10 -- setup/common.sh@18 -- # local node= 00:03:21.728 08:42:10 -- setup/common.sh@19 -- # local var val 00:03:21.728 08:42:10 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.728 08:42:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.728 08:42:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:21.728 08:42:10 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:21.728 08:42:10 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.728 08:42:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.728 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.728 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.728 08:42:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541692 kB' 'MemFree: 45880920 kB' 'MemAvailable: 49382420 kB' 'Buffers: 2704 kB' 'Cached: 10178056 kB' 'SwapCached: 0 kB' 'Active: 7183260 kB' 'Inactive: 3506596 kB' 'Active(anon): 6788668 kB' 'Inactive(anon): 0 kB' 'Active(file): 394592 kB' 'Inactive(file): 3506596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 512708 kB' 'Mapped: 190384 kB' 'Shmem: 6279572 kB' 'KReclaimable: 188304 kB' 'Slab: 553564 kB' 'SReclaimable: 188304 kB' 'SUnreclaim: 365260 kB' 'KernelStack: 12784 kB' 'PageTables: 7652 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610872 kB' 'Committed_AS: 7896144 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196112 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1758812 kB' 'DirectMap2M: 13889536 kB' 'DirectMap1G: 53477376 kB' 00:03:21.728 08:42:10 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.728 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.728 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.728 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.728 08:42:10 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.728 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.728 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.728 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.728 08:42:10 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.728 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.728 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.728 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.728 08:42:10 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.728 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.728 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.728 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.728 08:42:10 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.728 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.728 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.728 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.728 08:42:10 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.728 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.728 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.728 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.728 08:42:10 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.728 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.728 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.728 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.728 08:42:10 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.728 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.728 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.728 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.728 08:42:10 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.728 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.728 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.728 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.728 08:42:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.728 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.729 08:42:10 -- setup/common.sh@33 -- # echo 0 00:03:21.729 08:42:10 -- setup/common.sh@33 -- # return 0 00:03:21.729 08:42:10 -- setup/hugepages.sh@97 -- # anon=0 00:03:21.729 08:42:10 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:21.729 08:42:10 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:21.729 08:42:10 -- setup/common.sh@18 -- # local node= 00:03:21.729 08:42:10 -- setup/common.sh@19 -- # local var val 00:03:21.729 08:42:10 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.729 08:42:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.729 08:42:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:21.729 08:42:10 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:21.729 08:42:10 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.729 08:42:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 08:42:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541692 kB' 'MemFree: 45880816 kB' 'MemAvailable: 49382316 kB' 'Buffers: 2704 kB' 'Cached: 10178064 kB' 'SwapCached: 0 kB' 'Active: 7186704 kB' 'Inactive: 3506596 kB' 'Active(anon): 6792112 kB' 'Inactive(anon): 0 kB' 'Active(file): 394592 kB' 'Inactive(file): 3506596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 515984 kB' 'Mapped: 190292 kB' 'Shmem: 6279580 kB' 'KReclaimable: 188304 kB' 'Slab: 553552 kB' 'SReclaimable: 188304 kB' 'SUnreclaim: 365248 kB' 'KernelStack: 12832 kB' 'PageTables: 7764 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610872 kB' 'Committed_AS: 7898940 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196068 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1758812 kB' 'DirectMap2M: 13889536 kB' 'DirectMap1G: 53477376 kB' 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 08:42:10 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 08:42:10 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.731 08:42:10 -- setup/common.sh@33 -- # echo 0 00:03:21.731 08:42:10 -- setup/common.sh@33 -- # return 0 00:03:21.731 08:42:10 -- setup/hugepages.sh@99 -- # surp=0 00:03:21.731 08:42:10 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:21.731 08:42:10 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:21.731 08:42:10 -- setup/common.sh@18 -- # local node= 00:03:21.731 08:42:10 -- setup/common.sh@19 -- # local var val 00:03:21.731 08:42:10 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.731 08:42:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.731 08:42:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:21.731 08:42:10 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:21.731 08:42:10 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.731 08:42:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 08:42:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541692 kB' 'MemFree: 45881656 kB' 'MemAvailable: 49383156 kB' 'Buffers: 2704 kB' 'Cached: 10178068 kB' 'SwapCached: 0 kB' 'Active: 7186708 kB' 'Inactive: 3506596 kB' 'Active(anon): 6792116 kB' 'Inactive(anon): 0 kB' 'Active(file): 394592 kB' 'Inactive(file): 3506596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 515956 kB' 'Mapped: 190624 kB' 'Shmem: 6279584 kB' 'KReclaimable: 188304 kB' 'Slab: 553552 kB' 'SReclaimable: 188304 kB' 'SUnreclaim: 365248 kB' 'KernelStack: 12816 kB' 'PageTables: 7740 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610872 kB' 'Committed_AS: 7898956 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196068 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1758812 kB' 'DirectMap2M: 13889536 kB' 'DirectMap1G: 53477376 kB' 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 08:42:10 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 08:42:10 -- setup/common.sh@33 -- # echo 0 00:03:21.732 08:42:10 -- setup/common.sh@33 -- # return 0 00:03:21.732 08:42:10 -- setup/hugepages.sh@100 -- # resv=0 00:03:21.732 08:42:10 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:21.732 nr_hugepages=1024 00:03:21.732 08:42:10 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:21.732 resv_hugepages=0 00:03:21.732 08:42:10 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:21.732 surplus_hugepages=0 00:03:21.732 08:42:10 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:21.732 anon_hugepages=0 00:03:21.732 08:42:10 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:21.732 08:42:10 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:21.732 08:42:10 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:21.732 08:42:10 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:21.732 08:42:10 -- setup/common.sh@18 -- # local node= 00:03:21.732 08:42:10 -- setup/common.sh@19 -- # local var val 00:03:21.732 08:42:10 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.732 08:42:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.732 08:42:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:21.732 08:42:10 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:21.732 08:42:10 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.732 08:42:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 08:42:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541692 kB' 'MemFree: 45880792 kB' 'MemAvailable: 49382292 kB' 'Buffers: 2704 kB' 'Cached: 10178084 kB' 'SwapCached: 0 kB' 'Active: 7183200 kB' 'Inactive: 3506596 kB' 'Active(anon): 6788608 kB' 'Inactive(anon): 0 kB' 'Active(file): 394592 kB' 'Inactive(file): 3506596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 512368 kB' 'Mapped: 190284 kB' 'Shmem: 6279600 kB' 'KReclaimable: 188304 kB' 'Slab: 553552 kB' 'SReclaimable: 188304 kB' 'SUnreclaim: 365248 kB' 'KernelStack: 12768 kB' 'PageTables: 7564 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610872 kB' 'Committed_AS: 7895924 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196080 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1758812 kB' 'DirectMap2M: 13889536 kB' 'DirectMap1G: 53477376 kB' 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 08:42:10 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.734 08:42:10 -- setup/common.sh@33 -- # echo 1024 00:03:21.734 08:42:10 -- setup/common.sh@33 -- # return 0 00:03:21.734 08:42:10 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:21.734 08:42:10 -- setup/hugepages.sh@112 -- # get_nodes 00:03:21.734 08:42:10 -- setup/hugepages.sh@27 -- # local node 00:03:21.734 08:42:10 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:21.734 08:42:10 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:21.734 08:42:10 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:21.734 08:42:10 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:21.734 08:42:10 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:21.734 08:42:10 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:21.734 08:42:10 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:21.734 08:42:10 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:21.734 08:42:10 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:21.734 08:42:10 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:21.734 08:42:10 -- setup/common.sh@18 -- # local node=0 00:03:21.734 08:42:10 -- setup/common.sh@19 -- # local var val 00:03:21.734 08:42:10 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.734 08:42:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.734 08:42:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:21.734 08:42:10 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:21.734 08:42:10 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.734 08:42:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 08:42:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32876940 kB' 'MemFree: 21595496 kB' 'MemUsed: 11281444 kB' 'SwapCached: 0 kB' 'Active: 4966976 kB' 'Inactive: 3264144 kB' 'Active(anon): 4778404 kB' 'Inactive(anon): 0 kB' 'Active(file): 188572 kB' 'Inactive(file): 3264144 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7953004 kB' 'Mapped: 62760 kB' 'AnonPages: 281280 kB' 'Shmem: 4500288 kB' 'KernelStack: 6808 kB' 'PageTables: 4820 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 112012 kB' 'Slab: 297540 kB' 'SReclaimable: 112012 kB' 'SUnreclaim: 185528 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.734 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.735 08:42:10 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.735 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.735 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.735 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.735 08:42:10 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.735 08:42:10 -- setup/common.sh@32 -- # continue 00:03:21.735 08:42:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.735 08:42:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.735 08:42:10 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.735 08:42:10 -- setup/common.sh@33 -- # echo 0 00:03:21.735 08:42:10 -- setup/common.sh@33 -- # return 0 00:03:21.735 08:42:10 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:21.735 08:42:10 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:21.735 08:42:10 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:21.735 08:42:10 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:21.735 08:42:10 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:21.735 node0=1024 expecting 1024 00:03:21.735 08:42:10 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:21.735 08:42:10 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:03:21.735 08:42:10 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:03:21.735 08:42:10 -- setup/hugepages.sh@202 -- # setup output 00:03:21.735 08:42:10 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:21.735 08:42:10 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:23.111 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:23.111 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:23.111 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:23.111 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:23.111 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:23.111 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:23.111 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:23.111 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:23.111 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:23.111 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:23.111 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:23.111 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:23.111 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:23.111 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:23.111 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:23.111 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:23.111 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:23.111 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:03:23.111 08:42:11 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:03:23.111 08:42:11 -- setup/hugepages.sh@89 -- # local node 00:03:23.111 08:42:11 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:23.111 08:42:11 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:23.111 08:42:11 -- setup/hugepages.sh@92 -- # local surp 00:03:23.111 08:42:11 -- setup/hugepages.sh@93 -- # local resv 00:03:23.111 08:42:11 -- setup/hugepages.sh@94 -- # local anon 00:03:23.111 08:42:11 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:23.111 08:42:11 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:23.111 08:42:11 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:23.111 08:42:11 -- setup/common.sh@18 -- # local node= 00:03:23.111 08:42:11 -- setup/common.sh@19 -- # local var val 00:03:23.111 08:42:11 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.111 08:42:11 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.111 08:42:11 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.111 08:42:11 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.111 08:42:11 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.111 08:42:11 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.111 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.111 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.112 08:42:11 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541692 kB' 'MemFree: 45899268 kB' 'MemAvailable: 49400768 kB' 'Buffers: 2704 kB' 'Cached: 10178136 kB' 'SwapCached: 0 kB' 'Active: 7181108 kB' 'Inactive: 3506596 kB' 'Active(anon): 6786516 kB' 'Inactive(anon): 0 kB' 'Active(file): 394592 kB' 'Inactive(file): 3506596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 510108 kB' 'Mapped: 189892 kB' 'Shmem: 6279652 kB' 'KReclaimable: 188304 kB' 'Slab: 553440 kB' 'SReclaimable: 188304 kB' 'SUnreclaim: 365136 kB' 'KernelStack: 12848 kB' 'PageTables: 7788 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610872 kB' 'Committed_AS: 7893192 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196176 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1758812 kB' 'DirectMap2M: 13889536 kB' 'DirectMap1G: 53477376 kB' 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.112 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.112 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.113 08:42:11 -- setup/common.sh@33 -- # echo 0 00:03:23.113 08:42:11 -- setup/common.sh@33 -- # return 0 00:03:23.113 08:42:11 -- setup/hugepages.sh@97 -- # anon=0 00:03:23.113 08:42:11 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:23.113 08:42:11 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:23.113 08:42:11 -- setup/common.sh@18 -- # local node= 00:03:23.113 08:42:11 -- setup/common.sh@19 -- # local var val 00:03:23.113 08:42:11 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.113 08:42:11 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.113 08:42:11 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.113 08:42:11 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.113 08:42:11 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.113 08:42:11 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.113 08:42:11 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541692 kB' 'MemFree: 45898764 kB' 'MemAvailable: 49400264 kB' 'Buffers: 2704 kB' 'Cached: 10178136 kB' 'SwapCached: 0 kB' 'Active: 7181492 kB' 'Inactive: 3506596 kB' 'Active(anon): 6786900 kB' 'Inactive(anon): 0 kB' 'Active(file): 394592 kB' 'Inactive(file): 3506596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 510524 kB' 'Mapped: 189968 kB' 'Shmem: 6279652 kB' 'KReclaimable: 188304 kB' 'Slab: 553544 kB' 'SReclaimable: 188304 kB' 'SUnreclaim: 365240 kB' 'KernelStack: 12864 kB' 'PageTables: 7844 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610872 kB' 'Committed_AS: 7893204 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196160 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1758812 kB' 'DirectMap2M: 13889536 kB' 'DirectMap1G: 53477376 kB' 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.113 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.113 08:42:11 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.114 08:42:11 -- setup/common.sh@33 -- # echo 0 00:03:23.114 08:42:11 -- setup/common.sh@33 -- # return 0 00:03:23.114 08:42:11 -- setup/hugepages.sh@99 -- # surp=0 00:03:23.114 08:42:11 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:23.114 08:42:11 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:23.114 08:42:11 -- setup/common.sh@18 -- # local node= 00:03:23.114 08:42:11 -- setup/common.sh@19 -- # local var val 00:03:23.114 08:42:11 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.114 08:42:11 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.114 08:42:11 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.114 08:42:11 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.114 08:42:11 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.114 08:42:11 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.114 08:42:11 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541692 kB' 'MemFree: 45898616 kB' 'MemAvailable: 49400116 kB' 'Buffers: 2704 kB' 'Cached: 10178152 kB' 'SwapCached: 0 kB' 'Active: 7180996 kB' 'Inactive: 3506596 kB' 'Active(anon): 6786404 kB' 'Inactive(anon): 0 kB' 'Active(file): 394592 kB' 'Inactive(file): 3506596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 510048 kB' 'Mapped: 189852 kB' 'Shmem: 6279668 kB' 'KReclaimable: 188304 kB' 'Slab: 553552 kB' 'SReclaimable: 188304 kB' 'SUnreclaim: 365248 kB' 'KernelStack: 12848 kB' 'PageTables: 7772 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610872 kB' 'Committed_AS: 7893220 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196128 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1758812 kB' 'DirectMap2M: 13889536 kB' 'DirectMap1G: 53477376 kB' 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.114 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.114 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.115 08:42:11 -- setup/common.sh@33 -- # echo 0 00:03:23.115 08:42:11 -- setup/common.sh@33 -- # return 0 00:03:23.115 08:42:11 -- setup/hugepages.sh@100 -- # resv=0 00:03:23.115 08:42:11 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:23.115 nr_hugepages=1024 00:03:23.115 08:42:11 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:23.115 resv_hugepages=0 00:03:23.115 08:42:11 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:23.115 surplus_hugepages=0 00:03:23.115 08:42:11 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:23.115 anon_hugepages=0 00:03:23.115 08:42:11 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:23.115 08:42:11 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:23.115 08:42:11 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:23.115 08:42:11 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:23.115 08:42:11 -- setup/common.sh@18 -- # local node= 00:03:23.115 08:42:11 -- setup/common.sh@19 -- # local var val 00:03:23.115 08:42:11 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.115 08:42:11 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.115 08:42:11 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.115 08:42:11 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.115 08:42:11 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.115 08:42:11 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.115 08:42:11 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541692 kB' 'MemFree: 45898616 kB' 'MemAvailable: 49400116 kB' 'Buffers: 2704 kB' 'Cached: 10178164 kB' 'SwapCached: 0 kB' 'Active: 7181008 kB' 'Inactive: 3506596 kB' 'Active(anon): 6786416 kB' 'Inactive(anon): 0 kB' 'Active(file): 394592 kB' 'Inactive(file): 3506596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 510044 kB' 'Mapped: 189852 kB' 'Shmem: 6279680 kB' 'KReclaimable: 188304 kB' 'Slab: 553552 kB' 'SReclaimable: 188304 kB' 'SUnreclaim: 365248 kB' 'KernelStack: 12848 kB' 'PageTables: 7772 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610872 kB' 'Committed_AS: 7893236 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196128 kB' 'VmallocChunk: 0 kB' 'Percpu: 34944 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1758812 kB' 'DirectMap2M: 13889536 kB' 'DirectMap1G: 53477376 kB' 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.115 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.115 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.116 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.116 08:42:11 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.117 08:42:11 -- setup/common.sh@33 -- # echo 1024 00:03:23.117 08:42:11 -- setup/common.sh@33 -- # return 0 00:03:23.117 08:42:11 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:23.117 08:42:11 -- setup/hugepages.sh@112 -- # get_nodes 00:03:23.117 08:42:11 -- setup/hugepages.sh@27 -- # local node 00:03:23.117 08:42:11 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:23.117 08:42:11 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:23.117 08:42:11 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:23.117 08:42:11 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:23.117 08:42:11 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:23.117 08:42:11 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:23.117 08:42:11 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:23.117 08:42:11 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:23.117 08:42:11 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:23.117 08:42:11 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:23.117 08:42:11 -- setup/common.sh@18 -- # local node=0 00:03:23.117 08:42:11 -- setup/common.sh@19 -- # local var val 00:03:23.117 08:42:11 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.117 08:42:11 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.117 08:42:11 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:23.117 08:42:11 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:23.117 08:42:11 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.117 08:42:11 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.117 08:42:11 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32876940 kB' 'MemFree: 21601992 kB' 'MemUsed: 11274948 kB' 'SwapCached: 0 kB' 'Active: 4967196 kB' 'Inactive: 3264144 kB' 'Active(anon): 4778624 kB' 'Inactive(anon): 0 kB' 'Active(file): 188572 kB' 'Inactive(file): 3264144 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7953088 kB' 'Mapped: 62328 kB' 'AnonPages: 281416 kB' 'Shmem: 4500372 kB' 'KernelStack: 6872 kB' 'PageTables: 4972 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 112012 kB' 'Slab: 297532 kB' 'SReclaimable: 112012 kB' 'SUnreclaim: 185520 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.117 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.117 08:42:11 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.118 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.118 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.118 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.118 08:42:11 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.118 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.118 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.118 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.118 08:42:11 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.118 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.118 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.118 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.118 08:42:11 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.118 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.118 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.118 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.118 08:42:11 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.118 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.118 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.118 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.118 08:42:11 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.118 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.118 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.118 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.118 08:42:11 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.118 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.118 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.118 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.118 08:42:11 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.118 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.118 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.118 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.118 08:42:11 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.118 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.118 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.118 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.118 08:42:11 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.118 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.118 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.118 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.118 08:42:11 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.118 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.118 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.118 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.118 08:42:11 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.118 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.118 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.118 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.118 08:42:11 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.118 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.118 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.118 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.118 08:42:11 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.118 08:42:11 -- setup/common.sh@32 -- # continue 00:03:23.118 08:42:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.118 08:42:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.118 08:42:11 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.118 08:42:11 -- setup/common.sh@33 -- # echo 0 00:03:23.118 08:42:11 -- setup/common.sh@33 -- # return 0 00:03:23.118 08:42:11 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:23.118 08:42:11 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:23.118 08:42:11 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:23.118 08:42:11 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:23.118 08:42:11 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:23.118 node0=1024 expecting 1024 00:03:23.118 08:42:11 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:23.118 00:03:23.118 real 0m2.805s 00:03:23.118 user 0m1.179s 00:03:23.118 sys 0m1.556s 00:03:23.118 08:42:11 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:23.118 08:42:11 -- common/autotest_common.sh@10 -- # set +x 00:03:23.118 ************************************ 00:03:23.118 END TEST no_shrink_alloc 00:03:23.118 ************************************ 00:03:23.118 08:42:11 -- setup/hugepages.sh@217 -- # clear_hp 00:03:23.118 08:42:11 -- setup/hugepages.sh@37 -- # local node hp 00:03:23.118 08:42:11 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:23.118 08:42:11 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:23.118 08:42:11 -- setup/hugepages.sh@41 -- # echo 0 00:03:23.118 08:42:11 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:23.118 08:42:11 -- setup/hugepages.sh@41 -- # echo 0 00:03:23.118 08:42:11 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:23.118 08:42:11 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:23.118 08:42:11 -- setup/hugepages.sh@41 -- # echo 0 00:03:23.118 08:42:11 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:23.118 08:42:11 -- setup/hugepages.sh@41 -- # echo 0 00:03:23.118 08:42:11 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:23.118 08:42:11 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:23.118 00:03:23.118 real 0m11.008s 00:03:23.118 user 0m4.253s 00:03:23.118 sys 0m5.670s 00:03:23.118 08:42:11 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:23.118 08:42:11 -- common/autotest_common.sh@10 -- # set +x 00:03:23.118 ************************************ 00:03:23.118 END TEST hugepages 00:03:23.118 ************************************ 00:03:23.118 08:42:11 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:23.118 08:42:11 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:23.118 08:42:11 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:23.118 08:42:11 -- common/autotest_common.sh@10 -- # set +x 00:03:23.118 ************************************ 00:03:23.118 START TEST driver 00:03:23.118 ************************************ 00:03:23.118 08:42:11 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:23.376 * Looking for test storage... 00:03:23.376 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:23.376 08:42:11 -- setup/driver.sh@68 -- # setup reset 00:03:23.376 08:42:11 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:23.376 08:42:11 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:25.899 08:42:14 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:03:25.899 08:42:14 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:25.899 08:42:14 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:25.899 08:42:14 -- common/autotest_common.sh@10 -- # set +x 00:03:25.899 ************************************ 00:03:25.899 START TEST guess_driver 00:03:25.899 ************************************ 00:03:25.899 08:42:14 -- common/autotest_common.sh@1104 -- # guess_driver 00:03:25.899 08:42:14 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:03:25.899 08:42:14 -- setup/driver.sh@47 -- # local fail=0 00:03:25.899 08:42:14 -- setup/driver.sh@49 -- # pick_driver 00:03:25.899 08:42:14 -- setup/driver.sh@36 -- # vfio 00:03:25.899 08:42:14 -- setup/driver.sh@21 -- # local iommu_grups 00:03:25.899 08:42:14 -- setup/driver.sh@22 -- # local unsafe_vfio 00:03:25.899 08:42:14 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:03:25.899 08:42:14 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:03:25.899 08:42:14 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:03:25.899 08:42:14 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:03:25.899 08:42:14 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:03:25.899 08:42:14 -- setup/driver.sh@14 -- # mod vfio_pci 00:03:25.899 08:42:14 -- setup/driver.sh@12 -- # dep vfio_pci 00:03:25.899 08:42:14 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:03:25.899 08:42:14 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:03:25.899 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:25.899 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:25.899 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:25.899 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:25.899 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:03:25.899 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:03:25.899 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:03:25.899 08:42:14 -- setup/driver.sh@30 -- # return 0 00:03:25.899 08:42:14 -- setup/driver.sh@37 -- # echo vfio-pci 00:03:25.899 08:42:14 -- setup/driver.sh@49 -- # driver=vfio-pci 00:03:25.899 08:42:14 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:03:25.899 08:42:14 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:03:25.899 Looking for driver=vfio-pci 00:03:25.899 08:42:14 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:25.899 08:42:14 -- setup/driver.sh@45 -- # setup output config 00:03:25.899 08:42:14 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:25.899 08:42:14 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:27.271 08:42:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:27.271 08:42:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:27.271 08:42:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:27.271 08:42:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:27.271 08:42:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:27.271 08:42:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:27.271 08:42:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:27.271 08:42:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:27.271 08:42:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:27.271 08:42:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:27.271 08:42:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:27.271 08:42:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:27.271 08:42:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:27.271 08:42:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:27.271 08:42:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:27.271 08:42:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:27.271 08:42:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:27.271 08:42:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:27.271 08:42:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:27.271 08:42:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:27.271 08:42:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:27.271 08:42:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:27.271 08:42:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:27.271 08:42:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:27.271 08:42:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:27.271 08:42:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:27.271 08:42:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:27.271 08:42:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:27.271 08:42:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:27.271 08:42:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:27.271 08:42:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:27.271 08:42:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:27.271 08:42:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:27.271 08:42:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:27.271 08:42:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:27.271 08:42:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:27.271 08:42:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:27.271 08:42:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:27.271 08:42:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:27.271 08:42:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:27.271 08:42:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:27.271 08:42:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:27.271 08:42:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:27.271 08:42:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:27.271 08:42:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:27.271 08:42:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:27.271 08:42:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:27.271 08:42:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:27.837 08:42:16 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:27.837 08:42:16 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:27.837 08:42:16 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:28.094 08:42:16 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:03:28.095 08:42:16 -- setup/driver.sh@65 -- # setup reset 00:03:28.095 08:42:16 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:28.095 08:42:16 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:30.624 00:03:30.624 real 0m4.867s 00:03:30.624 user 0m1.145s 00:03:30.624 sys 0m1.891s 00:03:30.624 08:42:19 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:30.624 08:42:19 -- common/autotest_common.sh@10 -- # set +x 00:03:30.624 ************************************ 00:03:30.624 END TEST guess_driver 00:03:30.624 ************************************ 00:03:30.624 00:03:30.624 real 0m7.401s 00:03:30.624 user 0m1.705s 00:03:30.624 sys 0m2.893s 00:03:30.624 08:42:19 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:30.624 08:42:19 -- common/autotest_common.sh@10 -- # set +x 00:03:30.624 ************************************ 00:03:30.624 END TEST driver 00:03:30.624 ************************************ 00:03:30.624 08:42:19 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:30.624 08:42:19 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:30.624 08:42:19 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:30.624 08:42:19 -- common/autotest_common.sh@10 -- # set +x 00:03:30.624 ************************************ 00:03:30.624 START TEST devices 00:03:30.624 ************************************ 00:03:30.624 08:42:19 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:30.624 * Looking for test storage... 00:03:30.624 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:30.624 08:42:19 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:03:30.624 08:42:19 -- setup/devices.sh@192 -- # setup reset 00:03:30.624 08:42:19 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:30.624 08:42:19 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:32.003 08:42:20 -- setup/devices.sh@194 -- # get_zoned_devs 00:03:32.003 08:42:20 -- common/autotest_common.sh@1654 -- # zoned_devs=() 00:03:32.003 08:42:20 -- common/autotest_common.sh@1654 -- # local -gA zoned_devs 00:03:32.003 08:42:20 -- common/autotest_common.sh@1655 -- # local nvme bdf 00:03:32.003 08:42:20 -- common/autotest_common.sh@1657 -- # for nvme in /sys/block/nvme* 00:03:32.003 08:42:20 -- common/autotest_common.sh@1658 -- # is_block_zoned nvme0n1 00:03:32.003 08:42:20 -- common/autotest_common.sh@1647 -- # local device=nvme0n1 00:03:32.003 08:42:20 -- common/autotest_common.sh@1649 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:32.003 08:42:20 -- common/autotest_common.sh@1650 -- # [[ none != none ]] 00:03:32.003 08:42:20 -- setup/devices.sh@196 -- # blocks=() 00:03:32.003 08:42:20 -- setup/devices.sh@196 -- # declare -a blocks 00:03:32.003 08:42:20 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:03:32.003 08:42:20 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:03:32.003 08:42:20 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:03:32.003 08:42:20 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:03:32.003 08:42:20 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:03:32.003 08:42:20 -- setup/devices.sh@201 -- # ctrl=nvme0 00:03:32.003 08:42:20 -- setup/devices.sh@202 -- # pci=0000:88:00.0 00:03:32.003 08:42:20 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:03:32.003 08:42:20 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:03:32.003 08:42:20 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:03:32.003 08:42:20 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:03:32.303 No valid GPT data, bailing 00:03:32.303 08:42:20 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:32.303 08:42:20 -- scripts/common.sh@393 -- # pt= 00:03:32.303 08:42:20 -- scripts/common.sh@394 -- # return 1 00:03:32.303 08:42:20 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:03:32.303 08:42:20 -- setup/common.sh@76 -- # local dev=nvme0n1 00:03:32.303 08:42:20 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:03:32.303 08:42:20 -- setup/common.sh@80 -- # echo 1000204886016 00:03:32.303 08:42:20 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:03:32.303 08:42:20 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:03:32.303 08:42:20 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:88:00.0 00:03:32.303 08:42:20 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:03:32.303 08:42:20 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:03:32.303 08:42:20 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:03:32.303 08:42:20 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:32.303 08:42:20 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:32.303 08:42:20 -- common/autotest_common.sh@10 -- # set +x 00:03:32.303 ************************************ 00:03:32.303 START TEST nvme_mount 00:03:32.303 ************************************ 00:03:32.303 08:42:20 -- common/autotest_common.sh@1104 -- # nvme_mount 00:03:32.303 08:42:20 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:03:32.303 08:42:20 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:03:32.303 08:42:20 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:32.303 08:42:20 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:32.303 08:42:20 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:03:32.303 08:42:20 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:32.303 08:42:20 -- setup/common.sh@40 -- # local part_no=1 00:03:32.303 08:42:20 -- setup/common.sh@41 -- # local size=1073741824 00:03:32.303 08:42:20 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:32.303 08:42:20 -- setup/common.sh@44 -- # parts=() 00:03:32.303 08:42:20 -- setup/common.sh@44 -- # local parts 00:03:32.303 08:42:20 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:32.303 08:42:20 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:32.303 08:42:20 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:32.303 08:42:20 -- setup/common.sh@46 -- # (( part++ )) 00:03:32.303 08:42:20 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:32.303 08:42:20 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:32.303 08:42:20 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:32.303 08:42:20 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:03:33.236 Creating new GPT entries in memory. 00:03:33.236 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:33.236 other utilities. 00:03:33.236 08:42:21 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:33.236 08:42:21 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:33.237 08:42:21 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:33.237 08:42:21 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:33.237 08:42:21 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:34.169 Creating new GPT entries in memory. 00:03:34.169 The operation has completed successfully. 00:03:34.169 08:42:22 -- setup/common.sh@57 -- # (( part++ )) 00:03:34.169 08:42:22 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:34.169 08:42:22 -- setup/common.sh@62 -- # wait 1367249 00:03:34.169 08:42:22 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:34.169 08:42:22 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:03:34.169 08:42:22 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:34.169 08:42:22 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:03:34.169 08:42:22 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:03:34.169 08:42:22 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:34.169 08:42:22 -- setup/devices.sh@105 -- # verify 0000:88:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:34.169 08:42:22 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:34.169 08:42:22 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:03:34.169 08:42:22 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:34.169 08:42:22 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:34.169 08:42:22 -- setup/devices.sh@53 -- # local found=0 00:03:34.169 08:42:22 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:34.169 08:42:22 -- setup/devices.sh@56 -- # : 00:03:34.169 08:42:22 -- setup/devices.sh@59 -- # local pci status 00:03:34.169 08:42:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.169 08:42:22 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:34.169 08:42:22 -- setup/devices.sh@47 -- # setup output config 00:03:34.169 08:42:22 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:34.169 08:42:22 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:35.541 08:42:23 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.541 08:42:23 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:03:35.541 08:42:23 -- setup/devices.sh@63 -- # found=1 00:03:35.541 08:42:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.541 08:42:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.541 08:42:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.541 08:42:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.541 08:42:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.541 08:42:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.541 08:42:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.541 08:42:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.541 08:42:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.541 08:42:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.541 08:42:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.541 08:42:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.541 08:42:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.541 08:42:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.541 08:42:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.541 08:42:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.541 08:42:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.541 08:42:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.541 08:42:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.541 08:42:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.541 08:42:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.541 08:42:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.541 08:42:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.541 08:42:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.541 08:42:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.541 08:42:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.541 08:42:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.541 08:42:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.541 08:42:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.541 08:42:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.541 08:42:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.541 08:42:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.541 08:42:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.541 08:42:23 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:35.541 08:42:23 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:35.541 08:42:23 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:35.541 08:42:23 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:35.541 08:42:23 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:35.541 08:42:23 -- setup/devices.sh@110 -- # cleanup_nvme 00:03:35.541 08:42:23 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:35.541 08:42:23 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:35.541 08:42:23 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:35.541 08:42:23 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:35.541 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:35.541 08:42:24 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:35.541 08:42:24 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:35.799 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:35.799 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:35.799 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:35.799 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:35.799 08:42:24 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:03:35.799 08:42:24 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:03:35.799 08:42:24 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:35.799 08:42:24 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:03:35.799 08:42:24 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:03:35.799 08:42:24 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:35.799 08:42:24 -- setup/devices.sh@116 -- # verify 0000:88:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:35.799 08:42:24 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:35.799 08:42:24 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:03:35.799 08:42:24 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:35.799 08:42:24 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:35.799 08:42:24 -- setup/devices.sh@53 -- # local found=0 00:03:35.799 08:42:24 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:35.799 08:42:24 -- setup/devices.sh@56 -- # : 00:03:35.799 08:42:24 -- setup/devices.sh@59 -- # local pci status 00:03:35.799 08:42:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.799 08:42:24 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:35.799 08:42:24 -- setup/devices.sh@47 -- # setup output config 00:03:35.799 08:42:24 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:35.799 08:42:24 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:37.174 08:42:25 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.174 08:42:25 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:03:37.174 08:42:25 -- setup/devices.sh@63 -- # found=1 00:03:37.174 08:42:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.174 08:42:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.174 08:42:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.174 08:42:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.174 08:42:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.174 08:42:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.174 08:42:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.174 08:42:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.174 08:42:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.174 08:42:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.174 08:42:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.174 08:42:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.174 08:42:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.174 08:42:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.174 08:42:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.174 08:42:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.174 08:42:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.174 08:42:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.174 08:42:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.174 08:42:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.174 08:42:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.174 08:42:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.174 08:42:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.174 08:42:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.174 08:42:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.174 08:42:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.174 08:42:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.174 08:42:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.174 08:42:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.174 08:42:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.174 08:42:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.174 08:42:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.174 08:42:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.174 08:42:25 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:37.174 08:42:25 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:37.174 08:42:25 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:37.174 08:42:25 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:37.174 08:42:25 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:37.174 08:42:25 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:37.174 08:42:25 -- setup/devices.sh@125 -- # verify 0000:88:00.0 data@nvme0n1 '' '' 00:03:37.174 08:42:25 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:37.174 08:42:25 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:03:37.174 08:42:25 -- setup/devices.sh@50 -- # local mount_point= 00:03:37.174 08:42:25 -- setup/devices.sh@51 -- # local test_file= 00:03:37.174 08:42:25 -- setup/devices.sh@53 -- # local found=0 00:03:37.174 08:42:25 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:37.174 08:42:25 -- setup/devices.sh@59 -- # local pci status 00:03:37.174 08:42:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.174 08:42:25 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:37.174 08:42:25 -- setup/devices.sh@47 -- # setup output config 00:03:37.174 08:42:25 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:37.174 08:42:25 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:38.110 08:42:26 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.110 08:42:26 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:03:38.110 08:42:26 -- setup/devices.sh@63 -- # found=1 00:03:38.110 08:42:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.110 08:42:26 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.110 08:42:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.110 08:42:26 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.110 08:42:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.110 08:42:26 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.110 08:42:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.110 08:42:26 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.110 08:42:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.110 08:42:26 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.110 08:42:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.110 08:42:26 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.110 08:42:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.110 08:42:26 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.110 08:42:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.110 08:42:26 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.110 08:42:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.110 08:42:26 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.110 08:42:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.110 08:42:26 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.110 08:42:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.110 08:42:26 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.110 08:42:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.110 08:42:26 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.110 08:42:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.110 08:42:26 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.110 08:42:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.110 08:42:26 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.110 08:42:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.110 08:42:26 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.110 08:42:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.110 08:42:26 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.110 08:42:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.369 08:42:26 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:38.369 08:42:26 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:38.369 08:42:26 -- setup/devices.sh@68 -- # return 0 00:03:38.369 08:42:26 -- setup/devices.sh@128 -- # cleanup_nvme 00:03:38.369 08:42:26 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:38.370 08:42:26 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:38.370 08:42:26 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:38.370 08:42:26 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:38.370 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:38.370 00:03:38.370 real 0m6.208s 00:03:38.370 user 0m1.423s 00:03:38.370 sys 0m2.377s 00:03:38.370 08:42:26 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:38.370 08:42:26 -- common/autotest_common.sh@10 -- # set +x 00:03:38.370 ************************************ 00:03:38.370 END TEST nvme_mount 00:03:38.370 ************************************ 00:03:38.370 08:42:26 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:03:38.370 08:42:26 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:38.370 08:42:26 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:38.370 08:42:26 -- common/autotest_common.sh@10 -- # set +x 00:03:38.370 ************************************ 00:03:38.370 START TEST dm_mount 00:03:38.370 ************************************ 00:03:38.370 08:42:26 -- common/autotest_common.sh@1104 -- # dm_mount 00:03:38.370 08:42:26 -- setup/devices.sh@144 -- # pv=nvme0n1 00:03:38.370 08:42:26 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:03:38.370 08:42:26 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:03:38.370 08:42:26 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:03:38.370 08:42:26 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:38.370 08:42:26 -- setup/common.sh@40 -- # local part_no=2 00:03:38.370 08:42:26 -- setup/common.sh@41 -- # local size=1073741824 00:03:38.370 08:42:26 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:38.370 08:42:26 -- setup/common.sh@44 -- # parts=() 00:03:38.370 08:42:26 -- setup/common.sh@44 -- # local parts 00:03:38.370 08:42:26 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:38.370 08:42:26 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:38.370 08:42:26 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:38.370 08:42:26 -- setup/common.sh@46 -- # (( part++ )) 00:03:38.370 08:42:26 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:38.370 08:42:26 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:38.370 08:42:26 -- setup/common.sh@46 -- # (( part++ )) 00:03:38.370 08:42:26 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:38.370 08:42:26 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:38.370 08:42:26 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:38.370 08:42:26 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:03:39.308 Creating new GPT entries in memory. 00:03:39.308 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:39.308 other utilities. 00:03:39.308 08:42:27 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:39.308 08:42:27 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:39.308 08:42:27 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:39.308 08:42:27 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:39.308 08:42:27 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:40.686 Creating new GPT entries in memory. 00:03:40.686 The operation has completed successfully. 00:03:40.686 08:42:28 -- setup/common.sh@57 -- # (( part++ )) 00:03:40.686 08:42:28 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:40.686 08:42:28 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:40.686 08:42:28 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:40.686 08:42:28 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:03:41.624 The operation has completed successfully. 00:03:41.624 08:42:29 -- setup/common.sh@57 -- # (( part++ )) 00:03:41.624 08:42:29 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:41.624 08:42:29 -- setup/common.sh@62 -- # wait 1369711 00:03:41.624 08:42:29 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:03:41.624 08:42:29 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:41.624 08:42:29 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:41.624 08:42:29 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:03:41.624 08:42:29 -- setup/devices.sh@160 -- # for t in {1..5} 00:03:41.624 08:42:29 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:41.624 08:42:29 -- setup/devices.sh@161 -- # break 00:03:41.624 08:42:29 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:41.624 08:42:29 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:03:41.624 08:42:29 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:03:41.624 08:42:29 -- setup/devices.sh@166 -- # dm=dm-0 00:03:41.624 08:42:29 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:03:41.624 08:42:29 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:03:41.624 08:42:29 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:41.624 08:42:29 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:03:41.624 08:42:29 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:41.624 08:42:29 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:41.624 08:42:29 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:03:41.624 08:42:29 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:41.624 08:42:29 -- setup/devices.sh@174 -- # verify 0000:88:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:41.624 08:42:29 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:41.624 08:42:29 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:03:41.624 08:42:29 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:41.624 08:42:29 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:41.624 08:42:29 -- setup/devices.sh@53 -- # local found=0 00:03:41.624 08:42:29 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:41.624 08:42:29 -- setup/devices.sh@56 -- # : 00:03:41.624 08:42:29 -- setup/devices.sh@59 -- # local pci status 00:03:41.624 08:42:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:41.624 08:42:29 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:41.624 08:42:29 -- setup/devices.sh@47 -- # setup output config 00:03:41.624 08:42:29 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:41.624 08:42:29 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:42.561 08:42:30 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.561 08:42:30 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:03:42.561 08:42:30 -- setup/devices.sh@63 -- # found=1 00:03:42.561 08:42:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.561 08:42:30 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.561 08:42:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.561 08:42:30 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.561 08:42:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.561 08:42:30 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.561 08:42:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.561 08:42:30 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.561 08:42:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.561 08:42:30 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.561 08:42:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.561 08:42:30 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.561 08:42:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.561 08:42:30 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.561 08:42:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.561 08:42:30 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.561 08:42:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.561 08:42:30 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.561 08:42:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.561 08:42:30 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.561 08:42:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.561 08:42:30 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.561 08:42:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.561 08:42:30 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.561 08:42:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.561 08:42:30 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.561 08:42:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.561 08:42:30 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.561 08:42:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.561 08:42:30 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.561 08:42:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.561 08:42:30 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.561 08:42:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.820 08:42:31 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:42.820 08:42:31 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:03:42.820 08:42:31 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:42.820 08:42:31 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:42.820 08:42:31 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:42.820 08:42:31 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:42.820 08:42:31 -- setup/devices.sh@184 -- # verify 0000:88:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:03:42.820 08:42:31 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:42.820 08:42:31 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:03:42.820 08:42:31 -- setup/devices.sh@50 -- # local mount_point= 00:03:42.820 08:42:31 -- setup/devices.sh@51 -- # local test_file= 00:03:42.820 08:42:31 -- setup/devices.sh@53 -- # local found=0 00:03:42.820 08:42:31 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:42.820 08:42:31 -- setup/devices.sh@59 -- # local pci status 00:03:42.820 08:42:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.820 08:42:31 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:42.820 08:42:31 -- setup/devices.sh@47 -- # setup output config 00:03:42.820 08:42:31 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:42.820 08:42:31 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:43.769 08:42:32 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.769 08:42:32 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:03:43.769 08:42:32 -- setup/devices.sh@63 -- # found=1 00:03:43.769 08:42:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.769 08:42:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.769 08:42:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.769 08:42:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.769 08:42:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.769 08:42:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.769 08:42:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.769 08:42:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.769 08:42:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.769 08:42:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.769 08:42:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.769 08:42:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.769 08:42:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.769 08:42:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.769 08:42:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.769 08:42:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.769 08:42:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.769 08:42:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.769 08:42:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.769 08:42:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.769 08:42:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.769 08:42:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.769 08:42:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.769 08:42:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.769 08:42:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.769 08:42:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.769 08:42:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.769 08:42:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.769 08:42:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.769 08:42:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.769 08:42:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.769 08:42:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.769 08:42:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.028 08:42:32 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:44.028 08:42:32 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:44.028 08:42:32 -- setup/devices.sh@68 -- # return 0 00:03:44.028 08:42:32 -- setup/devices.sh@187 -- # cleanup_dm 00:03:44.028 08:42:32 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:44.028 08:42:32 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:44.028 08:42:32 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:03:44.028 08:42:32 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:44.028 08:42:32 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:03:44.028 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:44.028 08:42:32 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:44.028 08:42:32 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:03:44.028 00:03:44.028 real 0m5.569s 00:03:44.028 user 0m0.894s 00:03:44.028 sys 0m1.539s 00:03:44.028 08:42:32 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:44.028 08:42:32 -- common/autotest_common.sh@10 -- # set +x 00:03:44.028 ************************************ 00:03:44.028 END TEST dm_mount 00:03:44.028 ************************************ 00:03:44.028 08:42:32 -- setup/devices.sh@1 -- # cleanup 00:03:44.028 08:42:32 -- setup/devices.sh@11 -- # cleanup_nvme 00:03:44.028 08:42:32 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:44.028 08:42:32 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:44.028 08:42:32 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:44.028 08:42:32 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:44.028 08:42:32 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:44.285 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:44.285 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:44.285 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:44.285 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:44.285 08:42:32 -- setup/devices.sh@12 -- # cleanup_dm 00:03:44.285 08:42:32 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:44.285 08:42:32 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:44.285 08:42:32 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:44.285 08:42:32 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:44.285 08:42:32 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:03:44.285 08:42:32 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:03:44.285 00:03:44.285 real 0m13.644s 00:03:44.285 user 0m2.942s 00:03:44.285 sys 0m4.936s 00:03:44.285 08:42:32 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:44.285 08:42:32 -- common/autotest_common.sh@10 -- # set +x 00:03:44.285 ************************************ 00:03:44.285 END TEST devices 00:03:44.286 ************************************ 00:03:44.286 00:03:44.286 real 0m42.466s 00:03:44.286 user 0m11.977s 00:03:44.286 sys 0m18.845s 00:03:44.286 08:42:32 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:44.286 08:42:32 -- common/autotest_common.sh@10 -- # set +x 00:03:44.286 ************************************ 00:03:44.286 END TEST setup.sh 00:03:44.286 ************************************ 00:03:44.286 08:42:32 -- spdk/autotest.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:45.219 Hugepages 00:03:45.219 node hugesize free / total 00:03:45.219 node0 1048576kB 0 / 0 00:03:45.219 node0 2048kB 2048 / 2048 00:03:45.219 node1 1048576kB 0 / 0 00:03:45.219 node1 2048kB 0 / 0 00:03:45.219 00:03:45.219 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:45.219 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:03:45.219 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:03:45.219 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:03:45.219 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:03:45.219 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:03:45.219 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:03:45.219 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:03:45.219 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:03:45.219 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:03:45.219 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:03:45.477 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:03:45.477 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:03:45.477 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:03:45.477 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:03:45.477 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:03:45.477 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:03:45.477 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:03:45.477 08:42:33 -- spdk/autotest.sh@141 -- # uname -s 00:03:45.477 08:42:33 -- spdk/autotest.sh@141 -- # [[ Linux == Linux ]] 00:03:45.477 08:42:33 -- spdk/autotest.sh@143 -- # nvme_namespace_revert 00:03:45.477 08:42:33 -- common/autotest_common.sh@1516 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:46.848 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:46.848 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:46.848 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:46.848 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:46.848 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:46.848 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:46.848 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:46.848 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:46.848 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:46.848 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:46.848 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:46.848 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:46.848 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:46.848 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:46.848 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:46.848 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:47.780 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:47.780 08:42:36 -- common/autotest_common.sh@1517 -- # sleep 1 00:03:48.713 08:42:37 -- common/autotest_common.sh@1518 -- # bdfs=() 00:03:48.713 08:42:37 -- common/autotest_common.sh@1518 -- # local bdfs 00:03:48.713 08:42:37 -- common/autotest_common.sh@1519 -- # bdfs=($(get_nvme_bdfs)) 00:03:48.713 08:42:37 -- common/autotest_common.sh@1519 -- # get_nvme_bdfs 00:03:48.713 08:42:37 -- common/autotest_common.sh@1498 -- # bdfs=() 00:03:48.713 08:42:37 -- common/autotest_common.sh@1498 -- # local bdfs 00:03:48.713 08:42:37 -- common/autotest_common.sh@1499 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:03:48.713 08:42:37 -- common/autotest_common.sh@1499 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:03:48.713 08:42:37 -- common/autotest_common.sh@1499 -- # jq -r '.config[].params.traddr' 00:03:48.713 08:42:37 -- common/autotest_common.sh@1500 -- # (( 1 == 0 )) 00:03:48.713 08:42:37 -- common/autotest_common.sh@1504 -- # printf '%s\n' 0000:88:00.0 00:03:48.713 08:42:37 -- common/autotest_common.sh@1521 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:50.134 Waiting for block devices as requested 00:03:50.134 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:03:50.134 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:03:50.134 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:03:50.392 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:03:50.392 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:03:50.392 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:03:50.392 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:03:50.649 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:03:50.649 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:03:50.649 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:03:50.649 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:03:50.907 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:03:50.907 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:03:50.907 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:03:50.907 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:03:51.166 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:03:51.166 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:03:51.166 08:42:39 -- common/autotest_common.sh@1523 -- # for bdf in "${bdfs[@]}" 00:03:51.166 08:42:39 -- common/autotest_common.sh@1524 -- # get_nvme_ctrlr_from_bdf 0000:88:00.0 00:03:51.166 08:42:39 -- common/autotest_common.sh@1487 -- # readlink -f /sys/class/nvme/nvme0 00:03:51.166 08:42:39 -- common/autotest_common.sh@1487 -- # grep 0000:88:00.0/nvme/nvme 00:03:51.166 08:42:39 -- common/autotest_common.sh@1487 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:03:51.166 08:42:39 -- common/autotest_common.sh@1488 -- # [[ -z /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 ]] 00:03:51.166 08:42:39 -- common/autotest_common.sh@1492 -- # basename /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:03:51.166 08:42:39 -- common/autotest_common.sh@1492 -- # printf '%s\n' nvme0 00:03:51.166 08:42:39 -- common/autotest_common.sh@1524 -- # nvme_ctrlr=/dev/nvme0 00:03:51.166 08:42:39 -- common/autotest_common.sh@1525 -- # [[ -z /dev/nvme0 ]] 00:03:51.166 08:42:39 -- common/autotest_common.sh@1530 -- # nvme id-ctrl /dev/nvme0 00:03:51.166 08:42:39 -- common/autotest_common.sh@1530 -- # grep oacs 00:03:51.166 08:42:39 -- common/autotest_common.sh@1530 -- # cut -d: -f2 00:03:51.166 08:42:39 -- common/autotest_common.sh@1530 -- # oacs=' 0xf' 00:03:51.166 08:42:39 -- common/autotest_common.sh@1531 -- # oacs_ns_manage=8 00:03:51.166 08:42:39 -- common/autotest_common.sh@1533 -- # [[ 8 -ne 0 ]] 00:03:51.166 08:42:39 -- common/autotest_common.sh@1539 -- # nvme id-ctrl /dev/nvme0 00:03:51.166 08:42:39 -- common/autotest_common.sh@1539 -- # grep unvmcap 00:03:51.166 08:42:39 -- common/autotest_common.sh@1539 -- # cut -d: -f2 00:03:51.166 08:42:39 -- common/autotest_common.sh@1539 -- # unvmcap=' 0' 00:03:51.166 08:42:39 -- common/autotest_common.sh@1540 -- # [[ 0 -eq 0 ]] 00:03:51.166 08:42:39 -- common/autotest_common.sh@1542 -- # continue 00:03:51.166 08:42:39 -- spdk/autotest.sh@146 -- # timing_exit pre_cleanup 00:03:51.166 08:42:39 -- common/autotest_common.sh@718 -- # xtrace_disable 00:03:51.166 08:42:39 -- common/autotest_common.sh@10 -- # set +x 00:03:51.425 08:42:39 -- spdk/autotest.sh@149 -- # timing_enter afterboot 00:03:51.425 08:42:39 -- common/autotest_common.sh@712 -- # xtrace_disable 00:03:51.425 08:42:39 -- common/autotest_common.sh@10 -- # set +x 00:03:51.425 08:42:39 -- spdk/autotest.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:52.804 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:52.804 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:52.804 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:52.804 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:52.804 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:52.804 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:52.804 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:52.804 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:52.804 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:52.804 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:52.804 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:52.804 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:52.804 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:52.804 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:52.804 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:52.804 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:53.741 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:53.741 08:42:42 -- spdk/autotest.sh@151 -- # timing_exit afterboot 00:03:53.741 08:42:42 -- common/autotest_common.sh@718 -- # xtrace_disable 00:03:53.741 08:42:42 -- common/autotest_common.sh@10 -- # set +x 00:03:53.741 08:42:42 -- spdk/autotest.sh@155 -- # opal_revert_cleanup 00:03:53.741 08:42:42 -- common/autotest_common.sh@1576 -- # mapfile -t bdfs 00:03:53.741 08:42:42 -- common/autotest_common.sh@1576 -- # get_nvme_bdfs_by_id 0x0a54 00:03:53.741 08:42:42 -- common/autotest_common.sh@1562 -- # bdfs=() 00:03:53.741 08:42:42 -- common/autotest_common.sh@1562 -- # local bdfs 00:03:53.741 08:42:42 -- common/autotest_common.sh@1564 -- # get_nvme_bdfs 00:03:53.741 08:42:42 -- common/autotest_common.sh@1498 -- # bdfs=() 00:03:53.741 08:42:42 -- common/autotest_common.sh@1498 -- # local bdfs 00:03:53.741 08:42:42 -- common/autotest_common.sh@1499 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:03:53.741 08:42:42 -- common/autotest_common.sh@1499 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:03:53.741 08:42:42 -- common/autotest_common.sh@1499 -- # jq -r '.config[].params.traddr' 00:03:53.741 08:42:42 -- common/autotest_common.sh@1500 -- # (( 1 == 0 )) 00:03:53.741 08:42:42 -- common/autotest_common.sh@1504 -- # printf '%s\n' 0000:88:00.0 00:03:53.741 08:42:42 -- common/autotest_common.sh@1564 -- # for bdf in $(get_nvme_bdfs) 00:03:53.741 08:42:42 -- common/autotest_common.sh@1565 -- # cat /sys/bus/pci/devices/0000:88:00.0/device 00:03:53.741 08:42:42 -- common/autotest_common.sh@1565 -- # device=0x0a54 00:03:53.741 08:42:42 -- common/autotest_common.sh@1566 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:03:53.741 08:42:42 -- common/autotest_common.sh@1567 -- # bdfs+=($bdf) 00:03:53.741 08:42:42 -- common/autotest_common.sh@1571 -- # printf '%s\n' 0000:88:00.0 00:03:53.741 08:42:42 -- common/autotest_common.sh@1577 -- # [[ -z 0000:88:00.0 ]] 00:03:53.741 08:42:42 -- common/autotest_common.sh@1582 -- # spdk_tgt_pid=1375016 00:03:53.741 08:42:42 -- common/autotest_common.sh@1581 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:03:53.741 08:42:42 -- common/autotest_common.sh@1583 -- # waitforlisten 1375016 00:03:53.742 08:42:42 -- common/autotest_common.sh@819 -- # '[' -z 1375016 ']' 00:03:53.742 08:42:42 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:03:53.742 08:42:42 -- common/autotest_common.sh@824 -- # local max_retries=100 00:03:53.742 08:42:42 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:03:53.742 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:03:53.742 08:42:42 -- common/autotest_common.sh@828 -- # xtrace_disable 00:03:53.742 08:42:42 -- common/autotest_common.sh@10 -- # set +x 00:03:53.742 [2024-07-15 08:42:42.251120] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:03:53.742 [2024-07-15 08:42:42.251239] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1375016 ] 00:03:53.742 EAL: No free 2048 kB hugepages reported on node 1 00:03:54.001 [2024-07-15 08:42:42.310342] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:54.001 [2024-07-15 08:42:42.417768] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:54.001 [2024-07-15 08:42:42.417944] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:54.936 08:42:43 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:03:54.936 08:42:43 -- common/autotest_common.sh@852 -- # return 0 00:03:54.936 08:42:43 -- common/autotest_common.sh@1585 -- # bdf_id=0 00:03:54.936 08:42:43 -- common/autotest_common.sh@1586 -- # for bdf in "${bdfs[@]}" 00:03:54.936 08:42:43 -- common/autotest_common.sh@1587 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:88:00.0 00:03:58.216 nvme0n1 00:03:58.216 08:42:46 -- common/autotest_common.sh@1589 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:03:58.216 [2024-07-15 08:42:46.458891] nvme_opal.c:2059:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:03:58.216 [2024-07-15 08:42:46.458950] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:03:58.216 request: 00:03:58.216 { 00:03:58.216 "nvme_ctrlr_name": "nvme0", 00:03:58.216 "password": "test", 00:03:58.216 "method": "bdev_nvme_opal_revert", 00:03:58.216 "req_id": 1 00:03:58.216 } 00:03:58.216 Got JSON-RPC error response 00:03:58.216 response: 00:03:58.216 { 00:03:58.216 "code": -32603, 00:03:58.216 "message": "Internal error" 00:03:58.216 } 00:03:58.216 08:42:46 -- common/autotest_common.sh@1589 -- # true 00:03:58.216 08:42:46 -- common/autotest_common.sh@1590 -- # (( ++bdf_id )) 00:03:58.216 08:42:46 -- common/autotest_common.sh@1593 -- # killprocess 1375016 00:03:58.216 08:42:46 -- common/autotest_common.sh@926 -- # '[' -z 1375016 ']' 00:03:58.216 08:42:46 -- common/autotest_common.sh@930 -- # kill -0 1375016 00:03:58.216 08:42:46 -- common/autotest_common.sh@931 -- # uname 00:03:58.216 08:42:46 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:03:58.216 08:42:46 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1375016 00:03:58.216 08:42:46 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:03:58.216 08:42:46 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:03:58.216 08:42:46 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1375016' 00:03:58.216 killing process with pid 1375016 00:03:58.216 08:42:46 -- common/autotest_common.sh@945 -- # kill 1375016 00:03:58.216 08:42:46 -- common/autotest_common.sh@950 -- # wait 1375016 00:04:00.115 08:42:48 -- spdk/autotest.sh@161 -- # '[' 0 -eq 1 ']' 00:04:00.115 08:42:48 -- spdk/autotest.sh@165 -- # '[' 1 -eq 1 ']' 00:04:00.115 08:42:48 -- spdk/autotest.sh@166 -- # [[ 0 -eq 1 ]] 00:04:00.115 08:42:48 -- spdk/autotest.sh@166 -- # [[ 0 -eq 1 ]] 00:04:00.115 08:42:48 -- spdk/autotest.sh@173 -- # timing_enter lib 00:04:00.115 08:42:48 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:00.115 08:42:48 -- common/autotest_common.sh@10 -- # set +x 00:04:00.115 08:42:48 -- spdk/autotest.sh@175 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:04:00.115 08:42:48 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:00.115 08:42:48 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:00.115 08:42:48 -- common/autotest_common.sh@10 -- # set +x 00:04:00.115 ************************************ 00:04:00.115 START TEST env 00:04:00.115 ************************************ 00:04:00.115 08:42:48 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:04:00.115 * Looking for test storage... 00:04:00.115 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:04:00.115 08:42:48 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:04:00.115 08:42:48 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:00.115 08:42:48 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:00.115 08:42:48 -- common/autotest_common.sh@10 -- # set +x 00:04:00.115 ************************************ 00:04:00.115 START TEST env_memory 00:04:00.115 ************************************ 00:04:00.115 08:42:48 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:04:00.115 00:04:00.115 00:04:00.115 CUnit - A unit testing framework for C - Version 2.1-3 00:04:00.115 http://cunit.sourceforge.net/ 00:04:00.115 00:04:00.115 00:04:00.115 Suite: memory 00:04:00.115 Test: alloc and free memory map ...[2024-07-15 08:42:48.375373] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:04:00.115 passed 00:04:00.115 Test: mem map translation ...[2024-07-15 08:42:48.397404] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:04:00.115 [2024-07-15 08:42:48.397428] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:04:00.115 [2024-07-15 08:42:48.397484] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:04:00.115 [2024-07-15 08:42:48.397497] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:04:00.115 passed 00:04:00.115 Test: mem map registration ...[2024-07-15 08:42:48.440881] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:04:00.115 [2024-07-15 08:42:48.440916] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:04:00.115 passed 00:04:00.115 Test: mem map adjacent registrations ...passed 00:04:00.115 00:04:00.115 Run Summary: Type Total Ran Passed Failed Inactive 00:04:00.115 suites 1 1 n/a 0 0 00:04:00.115 tests 4 4 4 0 0 00:04:00.115 asserts 152 152 152 0 n/a 00:04:00.115 00:04:00.115 Elapsed time = 0.148 seconds 00:04:00.115 00:04:00.115 real 0m0.155s 00:04:00.115 user 0m0.146s 00:04:00.115 sys 0m0.008s 00:04:00.115 08:42:48 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:00.115 08:42:48 -- common/autotest_common.sh@10 -- # set +x 00:04:00.115 ************************************ 00:04:00.115 END TEST env_memory 00:04:00.115 ************************************ 00:04:00.115 08:42:48 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:00.115 08:42:48 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:00.115 08:42:48 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:00.115 08:42:48 -- common/autotest_common.sh@10 -- # set +x 00:04:00.115 ************************************ 00:04:00.115 START TEST env_vtophys 00:04:00.115 ************************************ 00:04:00.115 08:42:48 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:00.115 EAL: lib.eal log level changed from notice to debug 00:04:00.115 EAL: Detected lcore 0 as core 0 on socket 0 00:04:00.115 EAL: Detected lcore 1 as core 1 on socket 0 00:04:00.115 EAL: Detected lcore 2 as core 2 on socket 0 00:04:00.115 EAL: Detected lcore 3 as core 3 on socket 0 00:04:00.115 EAL: Detected lcore 4 as core 4 on socket 0 00:04:00.115 EAL: Detected lcore 5 as core 5 on socket 0 00:04:00.115 EAL: Detected lcore 6 as core 8 on socket 0 00:04:00.115 EAL: Detected lcore 7 as core 9 on socket 0 00:04:00.115 EAL: Detected lcore 8 as core 10 on socket 0 00:04:00.115 EAL: Detected lcore 9 as core 11 on socket 0 00:04:00.115 EAL: Detected lcore 10 as core 12 on socket 0 00:04:00.115 EAL: Detected lcore 11 as core 13 on socket 0 00:04:00.115 EAL: Detected lcore 12 as core 0 on socket 1 00:04:00.115 EAL: Detected lcore 13 as core 1 on socket 1 00:04:00.115 EAL: Detected lcore 14 as core 2 on socket 1 00:04:00.115 EAL: Detected lcore 15 as core 3 on socket 1 00:04:00.115 EAL: Detected lcore 16 as core 4 on socket 1 00:04:00.115 EAL: Detected lcore 17 as core 5 on socket 1 00:04:00.115 EAL: Detected lcore 18 as core 8 on socket 1 00:04:00.115 EAL: Detected lcore 19 as core 9 on socket 1 00:04:00.115 EAL: Detected lcore 20 as core 10 on socket 1 00:04:00.115 EAL: Detected lcore 21 as core 11 on socket 1 00:04:00.115 EAL: Detected lcore 22 as core 12 on socket 1 00:04:00.115 EAL: Detected lcore 23 as core 13 on socket 1 00:04:00.115 EAL: Detected lcore 24 as core 0 on socket 0 00:04:00.115 EAL: Detected lcore 25 as core 1 on socket 0 00:04:00.115 EAL: Detected lcore 26 as core 2 on socket 0 00:04:00.115 EAL: Detected lcore 27 as core 3 on socket 0 00:04:00.115 EAL: Detected lcore 28 as core 4 on socket 0 00:04:00.115 EAL: Detected lcore 29 as core 5 on socket 0 00:04:00.115 EAL: Detected lcore 30 as core 8 on socket 0 00:04:00.115 EAL: Detected lcore 31 as core 9 on socket 0 00:04:00.115 EAL: Detected lcore 32 as core 10 on socket 0 00:04:00.115 EAL: Detected lcore 33 as core 11 on socket 0 00:04:00.115 EAL: Detected lcore 34 as core 12 on socket 0 00:04:00.115 EAL: Detected lcore 35 as core 13 on socket 0 00:04:00.115 EAL: Detected lcore 36 as core 0 on socket 1 00:04:00.115 EAL: Detected lcore 37 as core 1 on socket 1 00:04:00.115 EAL: Detected lcore 38 as core 2 on socket 1 00:04:00.115 EAL: Detected lcore 39 as core 3 on socket 1 00:04:00.115 EAL: Detected lcore 40 as core 4 on socket 1 00:04:00.115 EAL: Detected lcore 41 as core 5 on socket 1 00:04:00.115 EAL: Detected lcore 42 as core 8 on socket 1 00:04:00.115 EAL: Detected lcore 43 as core 9 on socket 1 00:04:00.115 EAL: Detected lcore 44 as core 10 on socket 1 00:04:00.115 EAL: Detected lcore 45 as core 11 on socket 1 00:04:00.115 EAL: Detected lcore 46 as core 12 on socket 1 00:04:00.115 EAL: Detected lcore 47 as core 13 on socket 1 00:04:00.115 EAL: Maximum logical cores by configuration: 128 00:04:00.115 EAL: Detected CPU lcores: 48 00:04:00.115 EAL: Detected NUMA nodes: 2 00:04:00.115 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:04:00.115 EAL: Detected shared linkage of DPDK 00:04:00.115 EAL: No shared files mode enabled, IPC will be disabled 00:04:00.115 EAL: Bus pci wants IOVA as 'DC' 00:04:00.115 EAL: Buses did not request a specific IOVA mode. 00:04:00.115 EAL: IOMMU is available, selecting IOVA as VA mode. 00:04:00.115 EAL: Selected IOVA mode 'VA' 00:04:00.115 EAL: No free 2048 kB hugepages reported on node 1 00:04:00.115 EAL: Probing VFIO support... 00:04:00.115 EAL: IOMMU type 1 (Type 1) is supported 00:04:00.115 EAL: IOMMU type 7 (sPAPR) is not supported 00:04:00.115 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:04:00.115 EAL: VFIO support initialized 00:04:00.115 EAL: Ask a virtual area of 0x2e000 bytes 00:04:00.115 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:04:00.115 EAL: Setting up physically contiguous memory... 00:04:00.115 EAL: Setting maximum number of open files to 524288 00:04:00.115 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:04:00.115 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:04:00.115 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:04:00.116 EAL: Ask a virtual area of 0x61000 bytes 00:04:00.116 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:04:00.116 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:00.116 EAL: Ask a virtual area of 0x400000000 bytes 00:04:00.116 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:04:00.116 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:04:00.116 EAL: Ask a virtual area of 0x61000 bytes 00:04:00.116 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:04:00.116 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:00.116 EAL: Ask a virtual area of 0x400000000 bytes 00:04:00.116 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:04:00.116 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:04:00.116 EAL: Ask a virtual area of 0x61000 bytes 00:04:00.116 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:04:00.116 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:00.116 EAL: Ask a virtual area of 0x400000000 bytes 00:04:00.116 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:04:00.116 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:04:00.116 EAL: Ask a virtual area of 0x61000 bytes 00:04:00.116 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:04:00.116 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:00.116 EAL: Ask a virtual area of 0x400000000 bytes 00:04:00.116 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:04:00.116 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:04:00.116 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:04:00.116 EAL: Ask a virtual area of 0x61000 bytes 00:04:00.116 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:04:00.116 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:00.116 EAL: Ask a virtual area of 0x400000000 bytes 00:04:00.116 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:04:00.116 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:04:00.116 EAL: Ask a virtual area of 0x61000 bytes 00:04:00.116 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:04:00.116 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:00.116 EAL: Ask a virtual area of 0x400000000 bytes 00:04:00.116 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:04:00.116 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:04:00.116 EAL: Ask a virtual area of 0x61000 bytes 00:04:00.116 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:04:00.116 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:00.116 EAL: Ask a virtual area of 0x400000000 bytes 00:04:00.116 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:04:00.116 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:04:00.116 EAL: Ask a virtual area of 0x61000 bytes 00:04:00.116 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:04:00.116 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:00.116 EAL: Ask a virtual area of 0x400000000 bytes 00:04:00.116 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:04:00.116 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:04:00.116 EAL: Hugepages will be freed exactly as allocated. 00:04:00.116 EAL: No shared files mode enabled, IPC is disabled 00:04:00.116 EAL: No shared files mode enabled, IPC is disabled 00:04:00.116 EAL: TSC frequency is ~2700000 KHz 00:04:00.116 EAL: Main lcore 0 is ready (tid=7f8f2c08da00;cpuset=[0]) 00:04:00.116 EAL: Trying to obtain current memory policy. 00:04:00.116 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:00.116 EAL: Restoring previous memory policy: 0 00:04:00.116 EAL: request: mp_malloc_sync 00:04:00.116 EAL: No shared files mode enabled, IPC is disabled 00:04:00.116 EAL: Heap on socket 0 was expanded by 2MB 00:04:00.116 EAL: No shared files mode enabled, IPC is disabled 00:04:00.116 EAL: No PCI address specified using 'addr=' in: bus=pci 00:04:00.116 EAL: Mem event callback 'spdk:(nil)' registered 00:04:00.116 00:04:00.116 00:04:00.116 CUnit - A unit testing framework for C - Version 2.1-3 00:04:00.116 http://cunit.sourceforge.net/ 00:04:00.116 00:04:00.116 00:04:00.116 Suite: components_suite 00:04:00.116 Test: vtophys_malloc_test ...passed 00:04:00.116 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:04:00.116 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:00.116 EAL: Restoring previous memory policy: 4 00:04:00.116 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.116 EAL: request: mp_malloc_sync 00:04:00.116 EAL: No shared files mode enabled, IPC is disabled 00:04:00.116 EAL: Heap on socket 0 was expanded by 4MB 00:04:00.116 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.116 EAL: request: mp_malloc_sync 00:04:00.116 EAL: No shared files mode enabled, IPC is disabled 00:04:00.116 EAL: Heap on socket 0 was shrunk by 4MB 00:04:00.116 EAL: Trying to obtain current memory policy. 00:04:00.116 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:00.116 EAL: Restoring previous memory policy: 4 00:04:00.116 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.116 EAL: request: mp_malloc_sync 00:04:00.116 EAL: No shared files mode enabled, IPC is disabled 00:04:00.116 EAL: Heap on socket 0 was expanded by 6MB 00:04:00.116 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.116 EAL: request: mp_malloc_sync 00:04:00.116 EAL: No shared files mode enabled, IPC is disabled 00:04:00.116 EAL: Heap on socket 0 was shrunk by 6MB 00:04:00.116 EAL: Trying to obtain current memory policy. 00:04:00.116 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:00.116 EAL: Restoring previous memory policy: 4 00:04:00.116 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.116 EAL: request: mp_malloc_sync 00:04:00.116 EAL: No shared files mode enabled, IPC is disabled 00:04:00.116 EAL: Heap on socket 0 was expanded by 10MB 00:04:00.116 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.116 EAL: request: mp_malloc_sync 00:04:00.116 EAL: No shared files mode enabled, IPC is disabled 00:04:00.116 EAL: Heap on socket 0 was shrunk by 10MB 00:04:00.116 EAL: Trying to obtain current memory policy. 00:04:00.116 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:00.116 EAL: Restoring previous memory policy: 4 00:04:00.116 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.116 EAL: request: mp_malloc_sync 00:04:00.116 EAL: No shared files mode enabled, IPC is disabled 00:04:00.116 EAL: Heap on socket 0 was expanded by 18MB 00:04:00.116 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.116 EAL: request: mp_malloc_sync 00:04:00.116 EAL: No shared files mode enabled, IPC is disabled 00:04:00.116 EAL: Heap on socket 0 was shrunk by 18MB 00:04:00.116 EAL: Trying to obtain current memory policy. 00:04:00.116 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:00.116 EAL: Restoring previous memory policy: 4 00:04:00.116 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.116 EAL: request: mp_malloc_sync 00:04:00.116 EAL: No shared files mode enabled, IPC is disabled 00:04:00.116 EAL: Heap on socket 0 was expanded by 34MB 00:04:00.116 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.116 EAL: request: mp_malloc_sync 00:04:00.116 EAL: No shared files mode enabled, IPC is disabled 00:04:00.116 EAL: Heap on socket 0 was shrunk by 34MB 00:04:00.116 EAL: Trying to obtain current memory policy. 00:04:00.116 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:00.116 EAL: Restoring previous memory policy: 4 00:04:00.116 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.116 EAL: request: mp_malloc_sync 00:04:00.116 EAL: No shared files mode enabled, IPC is disabled 00:04:00.116 EAL: Heap on socket 0 was expanded by 66MB 00:04:00.374 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.374 EAL: request: mp_malloc_sync 00:04:00.374 EAL: No shared files mode enabled, IPC is disabled 00:04:00.374 EAL: Heap on socket 0 was shrunk by 66MB 00:04:00.374 EAL: Trying to obtain current memory policy. 00:04:00.374 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:00.374 EAL: Restoring previous memory policy: 4 00:04:00.374 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.374 EAL: request: mp_malloc_sync 00:04:00.374 EAL: No shared files mode enabled, IPC is disabled 00:04:00.374 EAL: Heap on socket 0 was expanded by 130MB 00:04:00.374 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.374 EAL: request: mp_malloc_sync 00:04:00.374 EAL: No shared files mode enabled, IPC is disabled 00:04:00.374 EAL: Heap on socket 0 was shrunk by 130MB 00:04:00.374 EAL: Trying to obtain current memory policy. 00:04:00.374 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:00.374 EAL: Restoring previous memory policy: 4 00:04:00.374 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.375 EAL: request: mp_malloc_sync 00:04:00.375 EAL: No shared files mode enabled, IPC is disabled 00:04:00.375 EAL: Heap on socket 0 was expanded by 258MB 00:04:00.375 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.632 EAL: request: mp_malloc_sync 00:04:00.632 EAL: No shared files mode enabled, IPC is disabled 00:04:00.632 EAL: Heap on socket 0 was shrunk by 258MB 00:04:00.632 EAL: Trying to obtain current memory policy. 00:04:00.632 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:00.632 EAL: Restoring previous memory policy: 4 00:04:00.632 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.632 EAL: request: mp_malloc_sync 00:04:00.632 EAL: No shared files mode enabled, IPC is disabled 00:04:00.632 EAL: Heap on socket 0 was expanded by 514MB 00:04:00.891 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.891 EAL: request: mp_malloc_sync 00:04:00.891 EAL: No shared files mode enabled, IPC is disabled 00:04:00.891 EAL: Heap on socket 0 was shrunk by 514MB 00:04:00.891 EAL: Trying to obtain current memory policy. 00:04:00.891 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:01.149 EAL: Restoring previous memory policy: 4 00:04:01.149 EAL: Calling mem event callback 'spdk:(nil)' 00:04:01.149 EAL: request: mp_malloc_sync 00:04:01.149 EAL: No shared files mode enabled, IPC is disabled 00:04:01.149 EAL: Heap on socket 0 was expanded by 1026MB 00:04:01.406 EAL: Calling mem event callback 'spdk:(nil)' 00:04:01.664 EAL: request: mp_malloc_sync 00:04:01.664 EAL: No shared files mode enabled, IPC is disabled 00:04:01.664 EAL: Heap on socket 0 was shrunk by 1026MB 00:04:01.664 passed 00:04:01.664 00:04:01.664 Run Summary: Type Total Ran Passed Failed Inactive 00:04:01.664 suites 1 1 n/a 0 0 00:04:01.664 tests 2 2 2 0 0 00:04:01.664 asserts 497 497 497 0 n/a 00:04:01.664 00:04:01.664 Elapsed time = 1.376 seconds 00:04:01.664 EAL: Calling mem event callback 'spdk:(nil)' 00:04:01.664 EAL: request: mp_malloc_sync 00:04:01.664 EAL: No shared files mode enabled, IPC is disabled 00:04:01.664 EAL: Heap on socket 0 was shrunk by 2MB 00:04:01.664 EAL: No shared files mode enabled, IPC is disabled 00:04:01.665 EAL: No shared files mode enabled, IPC is disabled 00:04:01.665 EAL: No shared files mode enabled, IPC is disabled 00:04:01.665 00:04:01.665 real 0m1.507s 00:04:01.665 user 0m0.866s 00:04:01.665 sys 0m0.597s 00:04:01.665 08:42:50 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:01.665 08:42:50 -- common/autotest_common.sh@10 -- # set +x 00:04:01.665 ************************************ 00:04:01.665 END TEST env_vtophys 00:04:01.665 ************************************ 00:04:01.665 08:42:50 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:04:01.665 08:42:50 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:01.665 08:42:50 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:01.665 08:42:50 -- common/autotest_common.sh@10 -- # set +x 00:04:01.665 ************************************ 00:04:01.665 START TEST env_pci 00:04:01.665 ************************************ 00:04:01.665 08:42:50 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:04:01.665 00:04:01.665 00:04:01.665 CUnit - A unit testing framework for C - Version 2.1-3 00:04:01.665 http://cunit.sourceforge.net/ 00:04:01.665 00:04:01.665 00:04:01.665 Suite: pci 00:04:01.665 Test: pci_hook ...[2024-07-15 08:42:50.069288] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 1376041 has claimed it 00:04:01.665 EAL: Cannot find device (10000:00:01.0) 00:04:01.665 EAL: Failed to attach device on primary process 00:04:01.665 passed 00:04:01.665 00:04:01.665 Run Summary: Type Total Ran Passed Failed Inactive 00:04:01.665 suites 1 1 n/a 0 0 00:04:01.665 tests 1 1 1 0 0 00:04:01.665 asserts 25 25 25 0 n/a 00:04:01.665 00:04:01.665 Elapsed time = 0.022 seconds 00:04:01.665 00:04:01.665 real 0m0.034s 00:04:01.665 user 0m0.009s 00:04:01.665 sys 0m0.025s 00:04:01.665 08:42:50 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:01.665 08:42:50 -- common/autotest_common.sh@10 -- # set +x 00:04:01.665 ************************************ 00:04:01.665 END TEST env_pci 00:04:01.665 ************************************ 00:04:01.665 08:42:50 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:04:01.665 08:42:50 -- env/env.sh@15 -- # uname 00:04:01.665 08:42:50 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:04:01.665 08:42:50 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:04:01.665 08:42:50 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:01.665 08:42:50 -- common/autotest_common.sh@1077 -- # '[' 5 -le 1 ']' 00:04:01.665 08:42:50 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:01.665 08:42:50 -- common/autotest_common.sh@10 -- # set +x 00:04:01.665 ************************************ 00:04:01.665 START TEST env_dpdk_post_init 00:04:01.665 ************************************ 00:04:01.665 08:42:50 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:01.665 EAL: Detected CPU lcores: 48 00:04:01.665 EAL: Detected NUMA nodes: 2 00:04:01.665 EAL: Detected shared linkage of DPDK 00:04:01.665 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:01.665 EAL: Selected IOVA mode 'VA' 00:04:01.665 EAL: No free 2048 kB hugepages reported on node 1 00:04:01.665 EAL: VFIO support initialized 00:04:01.665 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:01.924 EAL: Using IOMMU type 1 (Type 1) 00:04:01.924 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:04:01.924 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:04:01.924 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:04:01.924 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:04:01.924 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:04:01.924 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:04:01.924 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:04:01.924 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:04:01.924 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:04:01.924 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:04:01.924 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:04:01.924 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:04:01.924 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:04:01.924 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:04:01.924 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:04:01.924 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:04:02.859 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:88:00.0 (socket 1) 00:04:06.138 EAL: Releasing PCI mapped resource for 0000:88:00.0 00:04:06.138 EAL: Calling pci_unmap_resource for 0000:88:00.0 at 0x202001040000 00:04:06.138 Starting DPDK initialization... 00:04:06.138 Starting SPDK post initialization... 00:04:06.138 SPDK NVMe probe 00:04:06.138 Attaching to 0000:88:00.0 00:04:06.138 Attached to 0000:88:00.0 00:04:06.138 Cleaning up... 00:04:06.138 00:04:06.138 real 0m4.394s 00:04:06.138 user 0m3.292s 00:04:06.138 sys 0m0.159s 00:04:06.138 08:42:54 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:06.138 08:42:54 -- common/autotest_common.sh@10 -- # set +x 00:04:06.138 ************************************ 00:04:06.138 END TEST env_dpdk_post_init 00:04:06.138 ************************************ 00:04:06.138 08:42:54 -- env/env.sh@26 -- # uname 00:04:06.138 08:42:54 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:04:06.138 08:42:54 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:06.138 08:42:54 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:06.138 08:42:54 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:06.138 08:42:54 -- common/autotest_common.sh@10 -- # set +x 00:04:06.138 ************************************ 00:04:06.138 START TEST env_mem_callbacks 00:04:06.138 ************************************ 00:04:06.138 08:42:54 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:06.138 EAL: Detected CPU lcores: 48 00:04:06.138 EAL: Detected NUMA nodes: 2 00:04:06.138 EAL: Detected shared linkage of DPDK 00:04:06.138 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:06.138 EAL: Selected IOVA mode 'VA' 00:04:06.138 EAL: No free 2048 kB hugepages reported on node 1 00:04:06.138 EAL: VFIO support initialized 00:04:06.138 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:06.138 00:04:06.138 00:04:06.138 CUnit - A unit testing framework for C - Version 2.1-3 00:04:06.138 http://cunit.sourceforge.net/ 00:04:06.138 00:04:06.138 00:04:06.138 Suite: memory 00:04:06.138 Test: test ... 00:04:06.138 register 0x200000200000 2097152 00:04:06.138 malloc 3145728 00:04:06.138 register 0x200000400000 4194304 00:04:06.138 buf 0x200000500000 len 3145728 PASSED 00:04:06.138 malloc 64 00:04:06.138 buf 0x2000004fff40 len 64 PASSED 00:04:06.138 malloc 4194304 00:04:06.138 register 0x200000800000 6291456 00:04:06.138 buf 0x200000a00000 len 4194304 PASSED 00:04:06.138 free 0x200000500000 3145728 00:04:06.138 free 0x2000004fff40 64 00:04:06.138 unregister 0x200000400000 4194304 PASSED 00:04:06.138 free 0x200000a00000 4194304 00:04:06.138 unregister 0x200000800000 6291456 PASSED 00:04:06.138 malloc 8388608 00:04:06.138 register 0x200000400000 10485760 00:04:06.138 buf 0x200000600000 len 8388608 PASSED 00:04:06.138 free 0x200000600000 8388608 00:04:06.138 unregister 0x200000400000 10485760 PASSED 00:04:06.138 passed 00:04:06.138 00:04:06.138 Run Summary: Type Total Ran Passed Failed Inactive 00:04:06.138 suites 1 1 n/a 0 0 00:04:06.138 tests 1 1 1 0 0 00:04:06.138 asserts 15 15 15 0 n/a 00:04:06.138 00:04:06.138 Elapsed time = 0.005 seconds 00:04:06.138 00:04:06.138 real 0m0.044s 00:04:06.138 user 0m0.013s 00:04:06.138 sys 0m0.031s 00:04:06.138 08:42:54 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:06.138 08:42:54 -- common/autotest_common.sh@10 -- # set +x 00:04:06.138 ************************************ 00:04:06.138 END TEST env_mem_callbacks 00:04:06.138 ************************************ 00:04:06.138 00:04:06.138 real 0m6.316s 00:04:06.138 user 0m4.399s 00:04:06.138 sys 0m0.956s 00:04:06.138 08:42:54 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:06.138 08:42:54 -- common/autotest_common.sh@10 -- # set +x 00:04:06.138 ************************************ 00:04:06.138 END TEST env 00:04:06.138 ************************************ 00:04:06.138 08:42:54 -- spdk/autotest.sh@176 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:04:06.138 08:42:54 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:06.138 08:42:54 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:06.138 08:42:54 -- common/autotest_common.sh@10 -- # set +x 00:04:06.138 ************************************ 00:04:06.138 START TEST rpc 00:04:06.138 ************************************ 00:04:06.138 08:42:54 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:04:06.138 * Looking for test storage... 00:04:06.138 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:06.138 08:42:54 -- rpc/rpc.sh@65 -- # spdk_pid=1376711 00:04:06.138 08:42:54 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:04:06.138 08:42:54 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:06.138 08:42:54 -- rpc/rpc.sh@67 -- # waitforlisten 1376711 00:04:06.138 08:42:54 -- common/autotest_common.sh@819 -- # '[' -z 1376711 ']' 00:04:06.138 08:42:54 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:06.138 08:42:54 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:06.138 08:42:54 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:06.138 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:06.138 08:42:54 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:06.138 08:42:54 -- common/autotest_common.sh@10 -- # set +x 00:04:06.397 [2024-07-15 08:42:54.717411] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:04:06.397 [2024-07-15 08:42:54.717492] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1376711 ] 00:04:06.397 EAL: No free 2048 kB hugepages reported on node 1 00:04:06.397 [2024-07-15 08:42:54.774839] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:06.397 [2024-07-15 08:42:54.879444] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:06.397 [2024-07-15 08:42:54.879596] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:04:06.397 [2024-07-15 08:42:54.879613] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 1376711' to capture a snapshot of events at runtime. 00:04:06.397 [2024-07-15 08:42:54.879630] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid1376711 for offline analysis/debug. 00:04:06.397 [2024-07-15 08:42:54.879657] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:07.331 08:42:55 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:07.332 08:42:55 -- common/autotest_common.sh@852 -- # return 0 00:04:07.332 08:42:55 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:07.332 08:42:55 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:07.332 08:42:55 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:04:07.332 08:42:55 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:04:07.332 08:42:55 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:07.332 08:42:55 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:07.332 08:42:55 -- common/autotest_common.sh@10 -- # set +x 00:04:07.332 ************************************ 00:04:07.332 START TEST rpc_integrity 00:04:07.332 ************************************ 00:04:07.332 08:42:55 -- common/autotest_common.sh@1104 -- # rpc_integrity 00:04:07.332 08:42:55 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:07.332 08:42:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:07.332 08:42:55 -- common/autotest_common.sh@10 -- # set +x 00:04:07.332 08:42:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:07.332 08:42:55 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:07.332 08:42:55 -- rpc/rpc.sh@13 -- # jq length 00:04:07.332 08:42:55 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:07.332 08:42:55 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:07.332 08:42:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:07.332 08:42:55 -- common/autotest_common.sh@10 -- # set +x 00:04:07.332 08:42:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:07.332 08:42:55 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:04:07.332 08:42:55 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:07.332 08:42:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:07.332 08:42:55 -- common/autotest_common.sh@10 -- # set +x 00:04:07.332 08:42:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:07.332 08:42:55 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:07.332 { 00:04:07.332 "name": "Malloc0", 00:04:07.332 "aliases": [ 00:04:07.332 "eec75615-c446-4ad6-93ef-5b5da3b2ff97" 00:04:07.332 ], 00:04:07.332 "product_name": "Malloc disk", 00:04:07.332 "block_size": 512, 00:04:07.332 "num_blocks": 16384, 00:04:07.332 "uuid": "eec75615-c446-4ad6-93ef-5b5da3b2ff97", 00:04:07.332 "assigned_rate_limits": { 00:04:07.332 "rw_ios_per_sec": 0, 00:04:07.332 "rw_mbytes_per_sec": 0, 00:04:07.332 "r_mbytes_per_sec": 0, 00:04:07.332 "w_mbytes_per_sec": 0 00:04:07.332 }, 00:04:07.332 "claimed": false, 00:04:07.332 "zoned": false, 00:04:07.332 "supported_io_types": { 00:04:07.332 "read": true, 00:04:07.332 "write": true, 00:04:07.332 "unmap": true, 00:04:07.332 "write_zeroes": true, 00:04:07.332 "flush": true, 00:04:07.332 "reset": true, 00:04:07.332 "compare": false, 00:04:07.332 "compare_and_write": false, 00:04:07.332 "abort": true, 00:04:07.332 "nvme_admin": false, 00:04:07.332 "nvme_io": false 00:04:07.332 }, 00:04:07.332 "memory_domains": [ 00:04:07.332 { 00:04:07.332 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:07.332 "dma_device_type": 2 00:04:07.332 } 00:04:07.332 ], 00:04:07.332 "driver_specific": {} 00:04:07.332 } 00:04:07.332 ]' 00:04:07.332 08:42:55 -- rpc/rpc.sh@17 -- # jq length 00:04:07.332 08:42:55 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:07.332 08:42:55 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:04:07.332 08:42:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:07.332 08:42:55 -- common/autotest_common.sh@10 -- # set +x 00:04:07.332 [2024-07-15 08:42:55.745991] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:04:07.332 [2024-07-15 08:42:55.746034] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:07.332 [2024-07-15 08:42:55.746055] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x1e1cf70 00:04:07.332 [2024-07-15 08:42:55.746069] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:07.332 [2024-07-15 08:42:55.747579] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:07.332 [2024-07-15 08:42:55.747607] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:07.332 Passthru0 00:04:07.332 08:42:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:07.332 08:42:55 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:07.332 08:42:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:07.332 08:42:55 -- common/autotest_common.sh@10 -- # set +x 00:04:07.332 08:42:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:07.332 08:42:55 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:07.332 { 00:04:07.332 "name": "Malloc0", 00:04:07.332 "aliases": [ 00:04:07.332 "eec75615-c446-4ad6-93ef-5b5da3b2ff97" 00:04:07.332 ], 00:04:07.332 "product_name": "Malloc disk", 00:04:07.332 "block_size": 512, 00:04:07.332 "num_blocks": 16384, 00:04:07.332 "uuid": "eec75615-c446-4ad6-93ef-5b5da3b2ff97", 00:04:07.332 "assigned_rate_limits": { 00:04:07.332 "rw_ios_per_sec": 0, 00:04:07.332 "rw_mbytes_per_sec": 0, 00:04:07.332 "r_mbytes_per_sec": 0, 00:04:07.332 "w_mbytes_per_sec": 0 00:04:07.332 }, 00:04:07.332 "claimed": true, 00:04:07.332 "claim_type": "exclusive_write", 00:04:07.332 "zoned": false, 00:04:07.332 "supported_io_types": { 00:04:07.332 "read": true, 00:04:07.332 "write": true, 00:04:07.332 "unmap": true, 00:04:07.332 "write_zeroes": true, 00:04:07.332 "flush": true, 00:04:07.332 "reset": true, 00:04:07.332 "compare": false, 00:04:07.332 "compare_and_write": false, 00:04:07.332 "abort": true, 00:04:07.332 "nvme_admin": false, 00:04:07.332 "nvme_io": false 00:04:07.332 }, 00:04:07.332 "memory_domains": [ 00:04:07.332 { 00:04:07.332 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:07.332 "dma_device_type": 2 00:04:07.332 } 00:04:07.332 ], 00:04:07.332 "driver_specific": {} 00:04:07.332 }, 00:04:07.332 { 00:04:07.332 "name": "Passthru0", 00:04:07.332 "aliases": [ 00:04:07.332 "b9ff6c4c-bb35-5e17-8f4a-55b51f608f31" 00:04:07.332 ], 00:04:07.332 "product_name": "passthru", 00:04:07.332 "block_size": 512, 00:04:07.332 "num_blocks": 16384, 00:04:07.332 "uuid": "b9ff6c4c-bb35-5e17-8f4a-55b51f608f31", 00:04:07.332 "assigned_rate_limits": { 00:04:07.332 "rw_ios_per_sec": 0, 00:04:07.332 "rw_mbytes_per_sec": 0, 00:04:07.332 "r_mbytes_per_sec": 0, 00:04:07.332 "w_mbytes_per_sec": 0 00:04:07.332 }, 00:04:07.332 "claimed": false, 00:04:07.332 "zoned": false, 00:04:07.332 "supported_io_types": { 00:04:07.332 "read": true, 00:04:07.332 "write": true, 00:04:07.332 "unmap": true, 00:04:07.332 "write_zeroes": true, 00:04:07.332 "flush": true, 00:04:07.332 "reset": true, 00:04:07.332 "compare": false, 00:04:07.332 "compare_and_write": false, 00:04:07.332 "abort": true, 00:04:07.332 "nvme_admin": false, 00:04:07.332 "nvme_io": false 00:04:07.332 }, 00:04:07.332 "memory_domains": [ 00:04:07.332 { 00:04:07.332 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:07.332 "dma_device_type": 2 00:04:07.332 } 00:04:07.332 ], 00:04:07.332 "driver_specific": { 00:04:07.332 "passthru": { 00:04:07.332 "name": "Passthru0", 00:04:07.332 "base_bdev_name": "Malloc0" 00:04:07.332 } 00:04:07.332 } 00:04:07.332 } 00:04:07.332 ]' 00:04:07.332 08:42:55 -- rpc/rpc.sh@21 -- # jq length 00:04:07.332 08:42:55 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:07.332 08:42:55 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:07.332 08:42:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:07.332 08:42:55 -- common/autotest_common.sh@10 -- # set +x 00:04:07.332 08:42:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:07.332 08:42:55 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:04:07.332 08:42:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:07.332 08:42:55 -- common/autotest_common.sh@10 -- # set +x 00:04:07.332 08:42:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:07.332 08:42:55 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:07.332 08:42:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:07.332 08:42:55 -- common/autotest_common.sh@10 -- # set +x 00:04:07.332 08:42:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:07.332 08:42:55 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:07.332 08:42:55 -- rpc/rpc.sh@26 -- # jq length 00:04:07.332 08:42:55 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:07.332 00:04:07.332 real 0m0.224s 00:04:07.332 user 0m0.149s 00:04:07.332 sys 0m0.018s 00:04:07.332 08:42:55 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:07.332 08:42:55 -- common/autotest_common.sh@10 -- # set +x 00:04:07.332 ************************************ 00:04:07.332 END TEST rpc_integrity 00:04:07.332 ************************************ 00:04:07.590 08:42:55 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:04:07.590 08:42:55 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:07.590 08:42:55 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:07.590 08:42:55 -- common/autotest_common.sh@10 -- # set +x 00:04:07.590 ************************************ 00:04:07.590 START TEST rpc_plugins 00:04:07.590 ************************************ 00:04:07.590 08:42:55 -- common/autotest_common.sh@1104 -- # rpc_plugins 00:04:07.590 08:42:55 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:04:07.590 08:42:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:07.590 08:42:55 -- common/autotest_common.sh@10 -- # set +x 00:04:07.590 08:42:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:07.590 08:42:55 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:04:07.590 08:42:55 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:04:07.590 08:42:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:07.590 08:42:55 -- common/autotest_common.sh@10 -- # set +x 00:04:07.590 08:42:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:07.590 08:42:55 -- rpc/rpc.sh@31 -- # bdevs='[ 00:04:07.590 { 00:04:07.590 "name": "Malloc1", 00:04:07.590 "aliases": [ 00:04:07.590 "93caccc8-e4cd-49e3-839e-3a347e40333a" 00:04:07.590 ], 00:04:07.590 "product_name": "Malloc disk", 00:04:07.590 "block_size": 4096, 00:04:07.590 "num_blocks": 256, 00:04:07.590 "uuid": "93caccc8-e4cd-49e3-839e-3a347e40333a", 00:04:07.590 "assigned_rate_limits": { 00:04:07.590 "rw_ios_per_sec": 0, 00:04:07.590 "rw_mbytes_per_sec": 0, 00:04:07.590 "r_mbytes_per_sec": 0, 00:04:07.590 "w_mbytes_per_sec": 0 00:04:07.590 }, 00:04:07.590 "claimed": false, 00:04:07.590 "zoned": false, 00:04:07.590 "supported_io_types": { 00:04:07.590 "read": true, 00:04:07.590 "write": true, 00:04:07.590 "unmap": true, 00:04:07.590 "write_zeroes": true, 00:04:07.590 "flush": true, 00:04:07.590 "reset": true, 00:04:07.590 "compare": false, 00:04:07.590 "compare_and_write": false, 00:04:07.590 "abort": true, 00:04:07.590 "nvme_admin": false, 00:04:07.590 "nvme_io": false 00:04:07.590 }, 00:04:07.590 "memory_domains": [ 00:04:07.590 { 00:04:07.590 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:07.590 "dma_device_type": 2 00:04:07.590 } 00:04:07.590 ], 00:04:07.590 "driver_specific": {} 00:04:07.590 } 00:04:07.590 ]' 00:04:07.590 08:42:55 -- rpc/rpc.sh@32 -- # jq length 00:04:07.590 08:42:55 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:04:07.590 08:42:55 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:04:07.590 08:42:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:07.590 08:42:55 -- common/autotest_common.sh@10 -- # set +x 00:04:07.590 08:42:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:07.590 08:42:55 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:04:07.590 08:42:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:07.590 08:42:55 -- common/autotest_common.sh@10 -- # set +x 00:04:07.590 08:42:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:07.590 08:42:55 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:04:07.590 08:42:55 -- rpc/rpc.sh@36 -- # jq length 00:04:07.590 08:42:56 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:04:07.590 00:04:07.591 real 0m0.117s 00:04:07.591 user 0m0.076s 00:04:07.591 sys 0m0.009s 00:04:07.591 08:42:56 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:07.591 08:42:56 -- common/autotest_common.sh@10 -- # set +x 00:04:07.591 ************************************ 00:04:07.591 END TEST rpc_plugins 00:04:07.591 ************************************ 00:04:07.591 08:42:56 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:04:07.591 08:42:56 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:07.591 08:42:56 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:07.591 08:42:56 -- common/autotest_common.sh@10 -- # set +x 00:04:07.591 ************************************ 00:04:07.591 START TEST rpc_trace_cmd_test 00:04:07.591 ************************************ 00:04:07.591 08:42:56 -- common/autotest_common.sh@1104 -- # rpc_trace_cmd_test 00:04:07.591 08:42:56 -- rpc/rpc.sh@40 -- # local info 00:04:07.591 08:42:56 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:04:07.591 08:42:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:07.591 08:42:56 -- common/autotest_common.sh@10 -- # set +x 00:04:07.591 08:42:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:07.591 08:42:56 -- rpc/rpc.sh@42 -- # info='{ 00:04:07.591 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid1376711", 00:04:07.591 "tpoint_group_mask": "0x8", 00:04:07.591 "iscsi_conn": { 00:04:07.591 "mask": "0x2", 00:04:07.591 "tpoint_mask": "0x0" 00:04:07.591 }, 00:04:07.591 "scsi": { 00:04:07.591 "mask": "0x4", 00:04:07.591 "tpoint_mask": "0x0" 00:04:07.591 }, 00:04:07.591 "bdev": { 00:04:07.591 "mask": "0x8", 00:04:07.591 "tpoint_mask": "0xffffffffffffffff" 00:04:07.591 }, 00:04:07.591 "nvmf_rdma": { 00:04:07.591 "mask": "0x10", 00:04:07.591 "tpoint_mask": "0x0" 00:04:07.591 }, 00:04:07.591 "nvmf_tcp": { 00:04:07.591 "mask": "0x20", 00:04:07.591 "tpoint_mask": "0x0" 00:04:07.591 }, 00:04:07.591 "ftl": { 00:04:07.591 "mask": "0x40", 00:04:07.591 "tpoint_mask": "0x0" 00:04:07.591 }, 00:04:07.591 "blobfs": { 00:04:07.591 "mask": "0x80", 00:04:07.591 "tpoint_mask": "0x0" 00:04:07.591 }, 00:04:07.591 "dsa": { 00:04:07.591 "mask": "0x200", 00:04:07.591 "tpoint_mask": "0x0" 00:04:07.591 }, 00:04:07.591 "thread": { 00:04:07.591 "mask": "0x400", 00:04:07.591 "tpoint_mask": "0x0" 00:04:07.591 }, 00:04:07.591 "nvme_pcie": { 00:04:07.591 "mask": "0x800", 00:04:07.591 "tpoint_mask": "0x0" 00:04:07.591 }, 00:04:07.591 "iaa": { 00:04:07.591 "mask": "0x1000", 00:04:07.591 "tpoint_mask": "0x0" 00:04:07.591 }, 00:04:07.591 "nvme_tcp": { 00:04:07.591 "mask": "0x2000", 00:04:07.591 "tpoint_mask": "0x0" 00:04:07.591 }, 00:04:07.591 "bdev_nvme": { 00:04:07.591 "mask": "0x4000", 00:04:07.591 "tpoint_mask": "0x0" 00:04:07.591 } 00:04:07.591 }' 00:04:07.591 08:42:56 -- rpc/rpc.sh@43 -- # jq length 00:04:07.591 08:42:56 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:04:07.591 08:42:56 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:04:07.591 08:42:56 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:04:07.591 08:42:56 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:04:07.849 08:42:56 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:04:07.849 08:42:56 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:04:07.849 08:42:56 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:04:07.849 08:42:56 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:04:07.849 08:42:56 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:04:07.849 00:04:07.849 real 0m0.191s 00:04:07.849 user 0m0.169s 00:04:07.849 sys 0m0.014s 00:04:07.849 08:42:56 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:07.849 08:42:56 -- common/autotest_common.sh@10 -- # set +x 00:04:07.849 ************************************ 00:04:07.849 END TEST rpc_trace_cmd_test 00:04:07.849 ************************************ 00:04:07.849 08:42:56 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:04:07.849 08:42:56 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:04:07.849 08:42:56 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:04:07.849 08:42:56 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:07.849 08:42:56 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:07.849 08:42:56 -- common/autotest_common.sh@10 -- # set +x 00:04:07.849 ************************************ 00:04:07.849 START TEST rpc_daemon_integrity 00:04:07.849 ************************************ 00:04:07.849 08:42:56 -- common/autotest_common.sh@1104 -- # rpc_integrity 00:04:07.849 08:42:56 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:07.849 08:42:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:07.849 08:42:56 -- common/autotest_common.sh@10 -- # set +x 00:04:07.849 08:42:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:07.849 08:42:56 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:07.849 08:42:56 -- rpc/rpc.sh@13 -- # jq length 00:04:07.849 08:42:56 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:07.849 08:42:56 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:07.849 08:42:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:07.849 08:42:56 -- common/autotest_common.sh@10 -- # set +x 00:04:07.849 08:42:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:07.849 08:42:56 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:04:07.849 08:42:56 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:07.849 08:42:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:07.849 08:42:56 -- common/autotest_common.sh@10 -- # set +x 00:04:07.849 08:42:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:07.849 08:42:56 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:07.849 { 00:04:07.849 "name": "Malloc2", 00:04:07.849 "aliases": [ 00:04:07.849 "6e066a5e-c59e-4354-91bf-f2f633fbbd2b" 00:04:07.849 ], 00:04:07.849 "product_name": "Malloc disk", 00:04:07.849 "block_size": 512, 00:04:07.849 "num_blocks": 16384, 00:04:07.850 "uuid": "6e066a5e-c59e-4354-91bf-f2f633fbbd2b", 00:04:07.850 "assigned_rate_limits": { 00:04:07.850 "rw_ios_per_sec": 0, 00:04:07.850 "rw_mbytes_per_sec": 0, 00:04:07.850 "r_mbytes_per_sec": 0, 00:04:07.850 "w_mbytes_per_sec": 0 00:04:07.850 }, 00:04:07.850 "claimed": false, 00:04:07.850 "zoned": false, 00:04:07.850 "supported_io_types": { 00:04:07.850 "read": true, 00:04:07.850 "write": true, 00:04:07.850 "unmap": true, 00:04:07.850 "write_zeroes": true, 00:04:07.850 "flush": true, 00:04:07.850 "reset": true, 00:04:07.850 "compare": false, 00:04:07.850 "compare_and_write": false, 00:04:07.850 "abort": true, 00:04:07.850 "nvme_admin": false, 00:04:07.850 "nvme_io": false 00:04:07.850 }, 00:04:07.850 "memory_domains": [ 00:04:07.850 { 00:04:07.850 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:07.850 "dma_device_type": 2 00:04:07.850 } 00:04:07.850 ], 00:04:07.850 "driver_specific": {} 00:04:07.850 } 00:04:07.850 ]' 00:04:07.850 08:42:56 -- rpc/rpc.sh@17 -- # jq length 00:04:07.850 08:42:56 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:07.850 08:42:56 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:04:07.850 08:42:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:07.850 08:42:56 -- common/autotest_common.sh@10 -- # set +x 00:04:07.850 [2024-07-15 08:42:56.355791] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:04:07.850 [2024-07-15 08:42:56.355836] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:07.850 [2024-07-15 08:42:56.355858] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x1fbc970 00:04:07.850 [2024-07-15 08:42:56.355873] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:07.850 [2024-07-15 08:42:56.357253] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:07.850 [2024-07-15 08:42:56.357282] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:07.850 Passthru0 00:04:07.850 08:42:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:07.850 08:42:56 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:07.850 08:42:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:07.850 08:42:56 -- common/autotest_common.sh@10 -- # set +x 00:04:07.850 08:42:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:07.850 08:42:56 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:07.850 { 00:04:07.850 "name": "Malloc2", 00:04:07.850 "aliases": [ 00:04:07.850 "6e066a5e-c59e-4354-91bf-f2f633fbbd2b" 00:04:07.850 ], 00:04:07.850 "product_name": "Malloc disk", 00:04:07.850 "block_size": 512, 00:04:07.850 "num_blocks": 16384, 00:04:07.850 "uuid": "6e066a5e-c59e-4354-91bf-f2f633fbbd2b", 00:04:07.850 "assigned_rate_limits": { 00:04:07.850 "rw_ios_per_sec": 0, 00:04:07.850 "rw_mbytes_per_sec": 0, 00:04:07.850 "r_mbytes_per_sec": 0, 00:04:07.850 "w_mbytes_per_sec": 0 00:04:07.850 }, 00:04:07.850 "claimed": true, 00:04:07.850 "claim_type": "exclusive_write", 00:04:07.850 "zoned": false, 00:04:07.850 "supported_io_types": { 00:04:07.850 "read": true, 00:04:07.850 "write": true, 00:04:07.850 "unmap": true, 00:04:07.850 "write_zeroes": true, 00:04:07.850 "flush": true, 00:04:07.850 "reset": true, 00:04:07.850 "compare": false, 00:04:07.850 "compare_and_write": false, 00:04:07.850 "abort": true, 00:04:07.850 "nvme_admin": false, 00:04:07.850 "nvme_io": false 00:04:07.850 }, 00:04:07.850 "memory_domains": [ 00:04:07.850 { 00:04:07.850 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:07.850 "dma_device_type": 2 00:04:07.850 } 00:04:07.850 ], 00:04:07.850 "driver_specific": {} 00:04:07.850 }, 00:04:07.850 { 00:04:07.850 "name": "Passthru0", 00:04:07.850 "aliases": [ 00:04:07.850 "1f3cbea1-de2c-5a39-8d07-acde67e00b5e" 00:04:07.850 ], 00:04:07.850 "product_name": "passthru", 00:04:07.850 "block_size": 512, 00:04:07.850 "num_blocks": 16384, 00:04:07.850 "uuid": "1f3cbea1-de2c-5a39-8d07-acde67e00b5e", 00:04:07.850 "assigned_rate_limits": { 00:04:07.850 "rw_ios_per_sec": 0, 00:04:07.850 "rw_mbytes_per_sec": 0, 00:04:07.850 "r_mbytes_per_sec": 0, 00:04:07.850 "w_mbytes_per_sec": 0 00:04:07.850 }, 00:04:07.850 "claimed": false, 00:04:07.850 "zoned": false, 00:04:07.850 "supported_io_types": { 00:04:07.850 "read": true, 00:04:07.850 "write": true, 00:04:07.850 "unmap": true, 00:04:07.850 "write_zeroes": true, 00:04:07.850 "flush": true, 00:04:07.850 "reset": true, 00:04:07.850 "compare": false, 00:04:07.850 "compare_and_write": false, 00:04:07.850 "abort": true, 00:04:07.850 "nvme_admin": false, 00:04:07.850 "nvme_io": false 00:04:07.850 }, 00:04:07.850 "memory_domains": [ 00:04:07.850 { 00:04:07.850 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:07.850 "dma_device_type": 2 00:04:07.850 } 00:04:07.850 ], 00:04:07.850 "driver_specific": { 00:04:07.850 "passthru": { 00:04:07.850 "name": "Passthru0", 00:04:07.850 "base_bdev_name": "Malloc2" 00:04:07.850 } 00:04:07.850 } 00:04:07.850 } 00:04:07.850 ]' 00:04:07.850 08:42:56 -- rpc/rpc.sh@21 -- # jq length 00:04:08.141 08:42:56 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:08.141 08:42:56 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:08.141 08:42:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:08.141 08:42:56 -- common/autotest_common.sh@10 -- # set +x 00:04:08.141 08:42:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:08.141 08:42:56 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:04:08.141 08:42:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:08.141 08:42:56 -- common/autotest_common.sh@10 -- # set +x 00:04:08.141 08:42:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:08.141 08:42:56 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:08.141 08:42:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:08.141 08:42:56 -- common/autotest_common.sh@10 -- # set +x 00:04:08.141 08:42:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:08.141 08:42:56 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:08.141 08:42:56 -- rpc/rpc.sh@26 -- # jq length 00:04:08.141 08:42:56 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:08.141 00:04:08.141 real 0m0.224s 00:04:08.141 user 0m0.149s 00:04:08.141 sys 0m0.018s 00:04:08.141 08:42:56 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:08.141 08:42:56 -- common/autotest_common.sh@10 -- # set +x 00:04:08.141 ************************************ 00:04:08.141 END TEST rpc_daemon_integrity 00:04:08.141 ************************************ 00:04:08.141 08:42:56 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:04:08.141 08:42:56 -- rpc/rpc.sh@84 -- # killprocess 1376711 00:04:08.141 08:42:56 -- common/autotest_common.sh@926 -- # '[' -z 1376711 ']' 00:04:08.141 08:42:56 -- common/autotest_common.sh@930 -- # kill -0 1376711 00:04:08.141 08:42:56 -- common/autotest_common.sh@931 -- # uname 00:04:08.141 08:42:56 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:08.141 08:42:56 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1376711 00:04:08.141 08:42:56 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:08.141 08:42:56 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:08.141 08:42:56 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1376711' 00:04:08.141 killing process with pid 1376711 00:04:08.141 08:42:56 -- common/autotest_common.sh@945 -- # kill 1376711 00:04:08.141 08:42:56 -- common/autotest_common.sh@950 -- # wait 1376711 00:04:08.431 00:04:08.431 real 0m2.337s 00:04:08.431 user 0m2.983s 00:04:08.431 sys 0m0.547s 00:04:08.431 08:42:56 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:08.431 08:42:56 -- common/autotest_common.sh@10 -- # set +x 00:04:08.431 ************************************ 00:04:08.431 END TEST rpc 00:04:08.431 ************************************ 00:04:08.690 08:42:56 -- spdk/autotest.sh@177 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:08.690 08:42:56 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:08.690 08:42:56 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:08.690 08:42:56 -- common/autotest_common.sh@10 -- # set +x 00:04:08.690 ************************************ 00:04:08.690 START TEST rpc_client 00:04:08.690 ************************************ 00:04:08.690 08:42:56 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:08.690 * Looking for test storage... 00:04:08.690 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:04:08.690 08:42:57 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:04:08.690 OK 00:04:08.690 08:42:57 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:04:08.690 00:04:08.690 real 0m0.066s 00:04:08.690 user 0m0.032s 00:04:08.690 sys 0m0.039s 00:04:08.690 08:42:57 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:08.690 08:42:57 -- common/autotest_common.sh@10 -- # set +x 00:04:08.690 ************************************ 00:04:08.690 END TEST rpc_client 00:04:08.690 ************************************ 00:04:08.690 08:42:57 -- spdk/autotest.sh@178 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:04:08.690 08:42:57 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:08.690 08:42:57 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:08.690 08:42:57 -- common/autotest_common.sh@10 -- # set +x 00:04:08.690 ************************************ 00:04:08.690 START TEST json_config 00:04:08.690 ************************************ 00:04:08.690 08:42:57 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:04:08.690 08:42:57 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:08.690 08:42:57 -- nvmf/common.sh@7 -- # uname -s 00:04:08.690 08:42:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:08.690 08:42:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:08.690 08:42:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:08.690 08:42:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:08.690 08:42:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:08.690 08:42:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:08.690 08:42:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:08.690 08:42:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:08.690 08:42:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:08.690 08:42:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:08.690 08:42:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:04:08.690 08:42:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:04:08.690 08:42:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:08.690 08:42:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:08.690 08:42:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:08.690 08:42:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:08.690 08:42:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:08.690 08:42:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:08.690 08:42:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:08.690 08:42:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:08.690 08:42:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:08.690 08:42:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:08.690 08:42:57 -- paths/export.sh@5 -- # export PATH 00:04:08.690 08:42:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:08.690 08:42:57 -- nvmf/common.sh@46 -- # : 0 00:04:08.690 08:42:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:08.690 08:42:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:08.690 08:42:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:08.690 08:42:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:08.690 08:42:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:08.690 08:42:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:08.690 08:42:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:08.690 08:42:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:08.690 08:42:57 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:04:08.690 08:42:57 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:04:08.690 08:42:57 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:04:08.690 08:42:57 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:04:08.690 08:42:57 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:04:08.690 08:42:57 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:04:08.690 08:42:57 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:04:08.690 08:42:57 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:04:08.690 08:42:57 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:04:08.690 08:42:57 -- json_config/json_config.sh@32 -- # declare -A app_params 00:04:08.690 08:42:57 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:04:08.690 08:42:57 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:04:08.690 08:42:57 -- json_config/json_config.sh@43 -- # last_event_id=0 00:04:08.690 08:42:57 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:08.690 08:42:57 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:04:08.690 INFO: JSON configuration test init 00:04:08.690 08:42:57 -- json_config/json_config.sh@420 -- # json_config_test_init 00:04:08.691 08:42:57 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:04:08.691 08:42:57 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:08.691 08:42:57 -- common/autotest_common.sh@10 -- # set +x 00:04:08.691 08:42:57 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:04:08.691 08:42:57 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:08.691 08:42:57 -- common/autotest_common.sh@10 -- # set +x 00:04:08.691 08:42:57 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:04:08.691 08:42:57 -- json_config/json_config.sh@98 -- # local app=target 00:04:08.691 08:42:57 -- json_config/json_config.sh@99 -- # shift 00:04:08.691 08:42:57 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:04:08.691 08:42:57 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:04:08.691 08:42:57 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:04:08.691 08:42:57 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:08.691 08:42:57 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:08.691 08:42:57 -- json_config/json_config.sh@111 -- # app_pid[$app]=1377192 00:04:08.691 08:42:57 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:04:08.691 Waiting for target to run... 00:04:08.691 08:42:57 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:04:08.691 08:42:57 -- json_config/json_config.sh@114 -- # waitforlisten 1377192 /var/tmp/spdk_tgt.sock 00:04:08.691 08:42:57 -- common/autotest_common.sh@819 -- # '[' -z 1377192 ']' 00:04:08.691 08:42:57 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:08.691 08:42:57 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:08.691 08:42:57 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:08.691 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:08.691 08:42:57 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:08.691 08:42:57 -- common/autotest_common.sh@10 -- # set +x 00:04:08.691 [2024-07-15 08:42:57.181714] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:04:08.691 [2024-07-15 08:42:57.181797] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1377192 ] 00:04:08.691 EAL: No free 2048 kB hugepages reported on node 1 00:04:09.258 [2024-07-15 08:42:57.684782] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:09.258 [2024-07-15 08:42:57.789639] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:09.258 [2024-07-15 08:42:57.789844] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:09.825 08:42:58 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:09.825 08:42:58 -- common/autotest_common.sh@852 -- # return 0 00:04:09.825 08:42:58 -- json_config/json_config.sh@115 -- # echo '' 00:04:09.825 00:04:09.825 08:42:58 -- json_config/json_config.sh@322 -- # create_accel_config 00:04:09.825 08:42:58 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:04:09.825 08:42:58 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:09.825 08:42:58 -- common/autotest_common.sh@10 -- # set +x 00:04:09.825 08:42:58 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:04:09.825 08:42:58 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:04:09.825 08:42:58 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:09.825 08:42:58 -- common/autotest_common.sh@10 -- # set +x 00:04:09.825 08:42:58 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:04:09.825 08:42:58 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:04:09.825 08:42:58 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:04:13.105 08:43:01 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:04:13.105 08:43:01 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:04:13.105 08:43:01 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:13.105 08:43:01 -- common/autotest_common.sh@10 -- # set +x 00:04:13.105 08:43:01 -- json_config/json_config.sh@48 -- # local ret=0 00:04:13.105 08:43:01 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:04:13.105 08:43:01 -- json_config/json_config.sh@49 -- # local enabled_types 00:04:13.105 08:43:01 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:04:13.105 08:43:01 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:04:13.105 08:43:01 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:04:13.105 08:43:01 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:04:13.105 08:43:01 -- json_config/json_config.sh@51 -- # local get_types 00:04:13.105 08:43:01 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:04:13.105 08:43:01 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:04:13.105 08:43:01 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:13.105 08:43:01 -- common/autotest_common.sh@10 -- # set +x 00:04:13.105 08:43:01 -- json_config/json_config.sh@58 -- # return 0 00:04:13.105 08:43:01 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:04:13.105 08:43:01 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:04:13.105 08:43:01 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:04:13.105 08:43:01 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:04:13.105 08:43:01 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:04:13.105 08:43:01 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:04:13.105 08:43:01 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:13.105 08:43:01 -- common/autotest_common.sh@10 -- # set +x 00:04:13.105 08:43:01 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:04:13.105 08:43:01 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:04:13.105 08:43:01 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:04:13.105 08:43:01 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:13.106 08:43:01 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:13.361 MallocForNvmf0 00:04:13.361 08:43:01 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:13.361 08:43:01 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:13.618 MallocForNvmf1 00:04:13.618 08:43:02 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:04:13.618 08:43:02 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:04:13.876 [2024-07-15 08:43:02.258412] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:13.876 08:43:02 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:13.876 08:43:02 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:14.133 08:43:02 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:14.133 08:43:02 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:14.392 08:43:02 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:14.392 08:43:02 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:14.648 08:43:03 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:14.648 08:43:03 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:14.904 [2024-07-15 08:43:03.221548] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:14.904 08:43:03 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:04:14.904 08:43:03 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:14.904 08:43:03 -- common/autotest_common.sh@10 -- # set +x 00:04:14.904 08:43:03 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:04:14.904 08:43:03 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:14.904 08:43:03 -- common/autotest_common.sh@10 -- # set +x 00:04:14.904 08:43:03 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:04:14.905 08:43:03 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:14.905 08:43:03 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:15.162 MallocBdevForConfigChangeCheck 00:04:15.162 08:43:03 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:04:15.162 08:43:03 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:15.162 08:43:03 -- common/autotest_common.sh@10 -- # set +x 00:04:15.162 08:43:03 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:04:15.162 08:43:03 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:15.418 08:43:03 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:04:15.418 INFO: shutting down applications... 00:04:15.418 08:43:03 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:04:15.418 08:43:03 -- json_config/json_config.sh@431 -- # json_config_clear target 00:04:15.418 08:43:03 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:04:15.419 08:43:03 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:04:17.315 Calling clear_iscsi_subsystem 00:04:17.315 Calling clear_nvmf_subsystem 00:04:17.315 Calling clear_nbd_subsystem 00:04:17.315 Calling clear_ublk_subsystem 00:04:17.315 Calling clear_vhost_blk_subsystem 00:04:17.315 Calling clear_vhost_scsi_subsystem 00:04:17.315 Calling clear_scheduler_subsystem 00:04:17.315 Calling clear_bdev_subsystem 00:04:17.315 Calling clear_accel_subsystem 00:04:17.315 Calling clear_vmd_subsystem 00:04:17.315 Calling clear_sock_subsystem 00:04:17.315 Calling clear_iobuf_subsystem 00:04:17.315 08:43:05 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:04:17.315 08:43:05 -- json_config/json_config.sh@396 -- # count=100 00:04:17.315 08:43:05 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:04:17.315 08:43:05 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:17.315 08:43:05 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:04:17.315 08:43:05 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:04:17.572 08:43:05 -- json_config/json_config.sh@398 -- # break 00:04:17.572 08:43:05 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:04:17.572 08:43:05 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:04:17.572 08:43:05 -- json_config/json_config.sh@120 -- # local app=target 00:04:17.572 08:43:05 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:04:17.572 08:43:05 -- json_config/json_config.sh@124 -- # [[ -n 1377192 ]] 00:04:17.572 08:43:05 -- json_config/json_config.sh@127 -- # kill -SIGINT 1377192 00:04:17.572 08:43:05 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:04:17.572 08:43:05 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:04:17.573 08:43:05 -- json_config/json_config.sh@130 -- # kill -0 1377192 00:04:17.573 08:43:05 -- json_config/json_config.sh@134 -- # sleep 0.5 00:04:18.140 08:43:06 -- json_config/json_config.sh@129 -- # (( i++ )) 00:04:18.140 08:43:06 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:04:18.140 08:43:06 -- json_config/json_config.sh@130 -- # kill -0 1377192 00:04:18.140 08:43:06 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:04:18.140 08:43:06 -- json_config/json_config.sh@132 -- # break 00:04:18.140 08:43:06 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:04:18.140 08:43:06 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:04:18.140 SPDK target shutdown done 00:04:18.140 08:43:06 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:04:18.140 INFO: relaunching applications... 00:04:18.140 08:43:06 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:18.140 08:43:06 -- json_config/json_config.sh@98 -- # local app=target 00:04:18.140 08:43:06 -- json_config/json_config.sh@99 -- # shift 00:04:18.140 08:43:06 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:04:18.140 08:43:06 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:04:18.140 08:43:06 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:04:18.140 08:43:06 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:18.140 08:43:06 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:18.140 08:43:06 -- json_config/json_config.sh@111 -- # app_pid[$app]=1378419 00:04:18.140 08:43:06 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:18.140 08:43:06 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:04:18.140 Waiting for target to run... 00:04:18.141 08:43:06 -- json_config/json_config.sh@114 -- # waitforlisten 1378419 /var/tmp/spdk_tgt.sock 00:04:18.141 08:43:06 -- common/autotest_common.sh@819 -- # '[' -z 1378419 ']' 00:04:18.141 08:43:06 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:18.141 08:43:06 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:18.141 08:43:06 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:18.141 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:18.141 08:43:06 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:18.141 08:43:06 -- common/autotest_common.sh@10 -- # set +x 00:04:18.141 [2024-07-15 08:43:06.470482] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:04:18.141 [2024-07-15 08:43:06.470583] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1378419 ] 00:04:18.141 EAL: No free 2048 kB hugepages reported on node 1 00:04:18.707 [2024-07-15 08:43:06.977586] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:18.707 [2024-07-15 08:43:07.083091] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:18.707 [2024-07-15 08:43:07.083298] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:21.990 [2024-07-15 08:43:10.119758] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:21.990 [2024-07-15 08:43:10.152299] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:21.990 08:43:10 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:21.990 08:43:10 -- common/autotest_common.sh@852 -- # return 0 00:04:21.990 08:43:10 -- json_config/json_config.sh@115 -- # echo '' 00:04:21.990 00:04:21.990 08:43:10 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:04:21.990 08:43:10 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:04:21.990 INFO: Checking if target configuration is the same... 00:04:21.990 08:43:10 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:21.990 08:43:10 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:04:21.990 08:43:10 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:21.990 + '[' 2 -ne 2 ']' 00:04:21.990 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:21.990 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:21.990 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:21.990 +++ basename /dev/fd/62 00:04:21.990 ++ mktemp /tmp/62.XXX 00:04:21.990 + tmp_file_1=/tmp/62.7Nr 00:04:21.990 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:21.990 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:21.990 + tmp_file_2=/tmp/spdk_tgt_config.json.QjL 00:04:21.990 + ret=0 00:04:21.990 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:22.248 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:22.248 + diff -u /tmp/62.7Nr /tmp/spdk_tgt_config.json.QjL 00:04:22.248 + echo 'INFO: JSON config files are the same' 00:04:22.248 INFO: JSON config files are the same 00:04:22.248 + rm /tmp/62.7Nr /tmp/spdk_tgt_config.json.QjL 00:04:22.248 + exit 0 00:04:22.248 08:43:10 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:04:22.248 08:43:10 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:04:22.248 INFO: changing configuration and checking if this can be detected... 00:04:22.248 08:43:10 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:22.248 08:43:10 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:22.517 08:43:10 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:22.517 08:43:10 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:04:22.517 08:43:10 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:22.517 + '[' 2 -ne 2 ']' 00:04:22.517 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:22.517 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:22.517 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:22.517 +++ basename /dev/fd/62 00:04:22.517 ++ mktemp /tmp/62.XXX 00:04:22.517 + tmp_file_1=/tmp/62.l7J 00:04:22.517 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:22.517 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:22.517 + tmp_file_2=/tmp/spdk_tgt_config.json.FfL 00:04:22.517 + ret=0 00:04:22.517 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:22.782 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:23.040 + diff -u /tmp/62.l7J /tmp/spdk_tgt_config.json.FfL 00:04:23.040 + ret=1 00:04:23.040 + echo '=== Start of file: /tmp/62.l7J ===' 00:04:23.040 + cat /tmp/62.l7J 00:04:23.040 + echo '=== End of file: /tmp/62.l7J ===' 00:04:23.040 + echo '' 00:04:23.040 + echo '=== Start of file: /tmp/spdk_tgt_config.json.FfL ===' 00:04:23.040 + cat /tmp/spdk_tgt_config.json.FfL 00:04:23.040 + echo '=== End of file: /tmp/spdk_tgt_config.json.FfL ===' 00:04:23.040 + echo '' 00:04:23.040 + rm /tmp/62.l7J /tmp/spdk_tgt_config.json.FfL 00:04:23.040 + exit 1 00:04:23.040 08:43:11 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:04:23.040 INFO: configuration change detected. 00:04:23.040 08:43:11 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:04:23.040 08:43:11 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:04:23.040 08:43:11 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:23.040 08:43:11 -- common/autotest_common.sh@10 -- # set +x 00:04:23.040 08:43:11 -- json_config/json_config.sh@360 -- # local ret=0 00:04:23.040 08:43:11 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:04:23.040 08:43:11 -- json_config/json_config.sh@370 -- # [[ -n 1378419 ]] 00:04:23.040 08:43:11 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:04:23.040 08:43:11 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:04:23.040 08:43:11 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:23.040 08:43:11 -- common/autotest_common.sh@10 -- # set +x 00:04:23.040 08:43:11 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:04:23.040 08:43:11 -- json_config/json_config.sh@246 -- # uname -s 00:04:23.040 08:43:11 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:04:23.040 08:43:11 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:04:23.040 08:43:11 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:04:23.040 08:43:11 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:04:23.040 08:43:11 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:23.040 08:43:11 -- common/autotest_common.sh@10 -- # set +x 00:04:23.040 08:43:11 -- json_config/json_config.sh@376 -- # killprocess 1378419 00:04:23.040 08:43:11 -- common/autotest_common.sh@926 -- # '[' -z 1378419 ']' 00:04:23.040 08:43:11 -- common/autotest_common.sh@930 -- # kill -0 1378419 00:04:23.040 08:43:11 -- common/autotest_common.sh@931 -- # uname 00:04:23.040 08:43:11 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:23.040 08:43:11 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1378419 00:04:23.040 08:43:11 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:23.040 08:43:11 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:23.040 08:43:11 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1378419' 00:04:23.040 killing process with pid 1378419 00:04:23.040 08:43:11 -- common/autotest_common.sh@945 -- # kill 1378419 00:04:23.040 08:43:11 -- common/autotest_common.sh@950 -- # wait 1378419 00:04:24.940 08:43:13 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:24.940 08:43:13 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:04:24.940 08:43:13 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:24.940 08:43:13 -- common/autotest_common.sh@10 -- # set +x 00:04:24.940 08:43:13 -- json_config/json_config.sh@381 -- # return 0 00:04:24.940 08:43:13 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:04:24.940 INFO: Success 00:04:24.940 00:04:24.940 real 0m16.018s 00:04:24.940 user 0m18.152s 00:04:24.940 sys 0m2.247s 00:04:24.940 08:43:13 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:24.940 08:43:13 -- common/autotest_common.sh@10 -- # set +x 00:04:24.940 ************************************ 00:04:24.940 END TEST json_config 00:04:24.940 ************************************ 00:04:24.940 08:43:13 -- spdk/autotest.sh@179 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:24.940 08:43:13 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:24.940 08:43:13 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:24.940 08:43:13 -- common/autotest_common.sh@10 -- # set +x 00:04:24.940 ************************************ 00:04:24.940 START TEST json_config_extra_key 00:04:24.940 ************************************ 00:04:24.940 08:43:13 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:24.940 08:43:13 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:24.940 08:43:13 -- nvmf/common.sh@7 -- # uname -s 00:04:24.940 08:43:13 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:24.940 08:43:13 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:24.940 08:43:13 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:24.940 08:43:13 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:24.940 08:43:13 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:24.940 08:43:13 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:24.940 08:43:13 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:24.940 08:43:13 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:24.940 08:43:13 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:24.940 08:43:13 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:24.940 08:43:13 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:04:24.940 08:43:13 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:04:24.940 08:43:13 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:24.940 08:43:13 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:24.940 08:43:13 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:24.940 08:43:13 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:24.940 08:43:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:24.940 08:43:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:24.940 08:43:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:24.940 08:43:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:24.940 08:43:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:24.940 08:43:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:24.940 08:43:13 -- paths/export.sh@5 -- # export PATH 00:04:24.940 08:43:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:24.940 08:43:13 -- nvmf/common.sh@46 -- # : 0 00:04:24.940 08:43:13 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:24.940 08:43:13 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:24.940 08:43:13 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:24.940 08:43:13 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:24.940 08:43:13 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:24.940 08:43:13 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:24.940 08:43:13 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:24.940 08:43:13 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:24.940 08:43:13 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:04:24.940 08:43:13 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:04:24.940 08:43:13 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:04:24.940 08:43:13 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:04:24.940 08:43:13 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:04:24.940 08:43:13 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:04:24.940 08:43:13 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:04:24.940 08:43:13 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:04:24.940 08:43:13 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:24.940 08:43:13 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:04:24.940 INFO: launching applications... 00:04:24.940 08:43:13 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:24.940 08:43:13 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:04:24.940 08:43:13 -- json_config/json_config_extra_key.sh@25 -- # shift 00:04:24.940 08:43:13 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:04:24.940 08:43:13 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:04:24.940 08:43:13 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=1379353 00:04:24.940 08:43:13 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:04:24.940 08:43:13 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:24.940 Waiting for target to run... 00:04:24.940 08:43:13 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 1379353 /var/tmp/spdk_tgt.sock 00:04:24.940 08:43:13 -- common/autotest_common.sh@819 -- # '[' -z 1379353 ']' 00:04:24.940 08:43:13 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:24.940 08:43:13 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:24.940 08:43:13 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:24.940 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:24.940 08:43:13 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:24.940 08:43:13 -- common/autotest_common.sh@10 -- # set +x 00:04:24.940 [2024-07-15 08:43:13.217210] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:04:24.940 [2024-07-15 08:43:13.217295] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1379353 ] 00:04:24.940 EAL: No free 2048 kB hugepages reported on node 1 00:04:25.197 [2024-07-15 08:43:13.563715] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:25.197 [2024-07-15 08:43:13.651500] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:25.197 [2024-07-15 08:43:13.651693] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:25.763 08:43:14 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:25.763 08:43:14 -- common/autotest_common.sh@852 -- # return 0 00:04:25.763 08:43:14 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:04:25.763 00:04:25.763 08:43:14 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:04:25.763 INFO: shutting down applications... 00:04:25.763 08:43:14 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:04:25.763 08:43:14 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:04:25.763 08:43:14 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:04:25.763 08:43:14 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 1379353 ]] 00:04:25.763 08:43:14 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 1379353 00:04:25.763 08:43:14 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:04:25.763 08:43:14 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:25.763 08:43:14 -- json_config/json_config_extra_key.sh@50 -- # kill -0 1379353 00:04:25.763 08:43:14 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:04:26.329 08:43:14 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:04:26.329 08:43:14 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:26.329 08:43:14 -- json_config/json_config_extra_key.sh@50 -- # kill -0 1379353 00:04:26.329 08:43:14 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:04:26.329 08:43:14 -- json_config/json_config_extra_key.sh@52 -- # break 00:04:26.329 08:43:14 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:04:26.329 08:43:14 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:04:26.329 SPDK target shutdown done 00:04:26.329 08:43:14 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:04:26.329 Success 00:04:26.329 00:04:26.329 real 0m1.510s 00:04:26.329 user 0m1.480s 00:04:26.329 sys 0m0.439s 00:04:26.329 08:43:14 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:26.329 08:43:14 -- common/autotest_common.sh@10 -- # set +x 00:04:26.329 ************************************ 00:04:26.329 END TEST json_config_extra_key 00:04:26.329 ************************************ 00:04:26.329 08:43:14 -- spdk/autotest.sh@180 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:26.329 08:43:14 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:26.329 08:43:14 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:26.329 08:43:14 -- common/autotest_common.sh@10 -- # set +x 00:04:26.329 ************************************ 00:04:26.329 START TEST alias_rpc 00:04:26.329 ************************************ 00:04:26.329 08:43:14 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:26.329 * Looking for test storage... 00:04:26.329 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:04:26.329 08:43:14 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:04:26.329 08:43:14 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=1379665 00:04:26.329 08:43:14 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:26.329 08:43:14 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 1379665 00:04:26.329 08:43:14 -- common/autotest_common.sh@819 -- # '[' -z 1379665 ']' 00:04:26.329 08:43:14 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:26.329 08:43:14 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:26.329 08:43:14 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:26.329 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:26.329 08:43:14 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:26.329 08:43:14 -- common/autotest_common.sh@10 -- # set +x 00:04:26.329 [2024-07-15 08:43:14.757304] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:04:26.329 [2024-07-15 08:43:14.757395] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1379665 ] 00:04:26.329 EAL: No free 2048 kB hugepages reported on node 1 00:04:26.329 [2024-07-15 08:43:14.813852] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:26.623 [2024-07-15 08:43:14.918691] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:26.623 [2024-07-15 08:43:14.918848] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:27.193 08:43:15 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:27.193 08:43:15 -- common/autotest_common.sh@852 -- # return 0 00:04:27.193 08:43:15 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:04:27.451 08:43:15 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 1379665 00:04:27.451 08:43:15 -- common/autotest_common.sh@926 -- # '[' -z 1379665 ']' 00:04:27.451 08:43:15 -- common/autotest_common.sh@930 -- # kill -0 1379665 00:04:27.451 08:43:15 -- common/autotest_common.sh@931 -- # uname 00:04:27.451 08:43:15 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:27.451 08:43:15 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1379665 00:04:27.451 08:43:15 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:27.451 08:43:15 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:27.451 08:43:15 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1379665' 00:04:27.451 killing process with pid 1379665 00:04:27.451 08:43:15 -- common/autotest_common.sh@945 -- # kill 1379665 00:04:27.451 08:43:15 -- common/autotest_common.sh@950 -- # wait 1379665 00:04:28.016 00:04:28.016 real 0m1.783s 00:04:28.016 user 0m2.028s 00:04:28.016 sys 0m0.455s 00:04:28.016 08:43:16 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:28.016 08:43:16 -- common/autotest_common.sh@10 -- # set +x 00:04:28.016 ************************************ 00:04:28.016 END TEST alias_rpc 00:04:28.016 ************************************ 00:04:28.016 08:43:16 -- spdk/autotest.sh@182 -- # [[ 0 -eq 0 ]] 00:04:28.016 08:43:16 -- spdk/autotest.sh@183 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:28.017 08:43:16 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:28.017 08:43:16 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:28.017 08:43:16 -- common/autotest_common.sh@10 -- # set +x 00:04:28.017 ************************************ 00:04:28.017 START TEST spdkcli_tcp 00:04:28.017 ************************************ 00:04:28.017 08:43:16 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:28.017 * Looking for test storage... 00:04:28.017 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:04:28.017 08:43:16 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:04:28.017 08:43:16 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:04:28.017 08:43:16 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:04:28.017 08:43:16 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:04:28.017 08:43:16 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:04:28.017 08:43:16 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:04:28.017 08:43:16 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:04:28.017 08:43:16 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:28.017 08:43:16 -- common/autotest_common.sh@10 -- # set +x 00:04:28.017 08:43:16 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=1379865 00:04:28.017 08:43:16 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:04:28.017 08:43:16 -- spdkcli/tcp.sh@27 -- # waitforlisten 1379865 00:04:28.017 08:43:16 -- common/autotest_common.sh@819 -- # '[' -z 1379865 ']' 00:04:28.017 08:43:16 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:28.017 08:43:16 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:28.017 08:43:16 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:28.017 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:28.017 08:43:16 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:28.017 08:43:16 -- common/autotest_common.sh@10 -- # set +x 00:04:28.017 [2024-07-15 08:43:16.558076] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:04:28.017 [2024-07-15 08:43:16.558189] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1379865 ] 00:04:28.275 EAL: No free 2048 kB hugepages reported on node 1 00:04:28.276 [2024-07-15 08:43:16.616478] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:28.276 [2024-07-15 08:43:16.720512] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:28.276 [2024-07-15 08:43:16.720724] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:28.276 [2024-07-15 08:43:16.720729] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:29.218 08:43:17 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:29.218 08:43:17 -- common/autotest_common.sh@852 -- # return 0 00:04:29.218 08:43:17 -- spdkcli/tcp.sh@31 -- # socat_pid=1380004 00:04:29.218 08:43:17 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:04:29.218 08:43:17 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:04:29.218 [ 00:04:29.218 "bdev_malloc_delete", 00:04:29.218 "bdev_malloc_create", 00:04:29.218 "bdev_null_resize", 00:04:29.218 "bdev_null_delete", 00:04:29.218 "bdev_null_create", 00:04:29.218 "bdev_nvme_cuse_unregister", 00:04:29.218 "bdev_nvme_cuse_register", 00:04:29.218 "bdev_opal_new_user", 00:04:29.218 "bdev_opal_set_lock_state", 00:04:29.218 "bdev_opal_delete", 00:04:29.218 "bdev_opal_get_info", 00:04:29.218 "bdev_opal_create", 00:04:29.218 "bdev_nvme_opal_revert", 00:04:29.218 "bdev_nvme_opal_init", 00:04:29.218 "bdev_nvme_send_cmd", 00:04:29.218 "bdev_nvme_get_path_iostat", 00:04:29.218 "bdev_nvme_get_mdns_discovery_info", 00:04:29.218 "bdev_nvme_stop_mdns_discovery", 00:04:29.218 "bdev_nvme_start_mdns_discovery", 00:04:29.218 "bdev_nvme_set_multipath_policy", 00:04:29.218 "bdev_nvme_set_preferred_path", 00:04:29.218 "bdev_nvme_get_io_paths", 00:04:29.218 "bdev_nvme_remove_error_injection", 00:04:29.218 "bdev_nvme_add_error_injection", 00:04:29.218 "bdev_nvme_get_discovery_info", 00:04:29.218 "bdev_nvme_stop_discovery", 00:04:29.218 "bdev_nvme_start_discovery", 00:04:29.218 "bdev_nvme_get_controller_health_info", 00:04:29.218 "bdev_nvme_disable_controller", 00:04:29.218 "bdev_nvme_enable_controller", 00:04:29.218 "bdev_nvme_reset_controller", 00:04:29.218 "bdev_nvme_get_transport_statistics", 00:04:29.218 "bdev_nvme_apply_firmware", 00:04:29.218 "bdev_nvme_detach_controller", 00:04:29.218 "bdev_nvme_get_controllers", 00:04:29.218 "bdev_nvme_attach_controller", 00:04:29.218 "bdev_nvme_set_hotplug", 00:04:29.218 "bdev_nvme_set_options", 00:04:29.218 "bdev_passthru_delete", 00:04:29.218 "bdev_passthru_create", 00:04:29.218 "bdev_lvol_grow_lvstore", 00:04:29.218 "bdev_lvol_get_lvols", 00:04:29.218 "bdev_lvol_get_lvstores", 00:04:29.218 "bdev_lvol_delete", 00:04:29.218 "bdev_lvol_set_read_only", 00:04:29.218 "bdev_lvol_resize", 00:04:29.218 "bdev_lvol_decouple_parent", 00:04:29.218 "bdev_lvol_inflate", 00:04:29.218 "bdev_lvol_rename", 00:04:29.218 "bdev_lvol_clone_bdev", 00:04:29.218 "bdev_lvol_clone", 00:04:29.218 "bdev_lvol_snapshot", 00:04:29.218 "bdev_lvol_create", 00:04:29.218 "bdev_lvol_delete_lvstore", 00:04:29.218 "bdev_lvol_rename_lvstore", 00:04:29.218 "bdev_lvol_create_lvstore", 00:04:29.218 "bdev_raid_set_options", 00:04:29.218 "bdev_raid_remove_base_bdev", 00:04:29.218 "bdev_raid_add_base_bdev", 00:04:29.218 "bdev_raid_delete", 00:04:29.218 "bdev_raid_create", 00:04:29.218 "bdev_raid_get_bdevs", 00:04:29.218 "bdev_error_inject_error", 00:04:29.218 "bdev_error_delete", 00:04:29.218 "bdev_error_create", 00:04:29.218 "bdev_split_delete", 00:04:29.218 "bdev_split_create", 00:04:29.218 "bdev_delay_delete", 00:04:29.218 "bdev_delay_create", 00:04:29.218 "bdev_delay_update_latency", 00:04:29.218 "bdev_zone_block_delete", 00:04:29.218 "bdev_zone_block_create", 00:04:29.218 "blobfs_create", 00:04:29.218 "blobfs_detect", 00:04:29.218 "blobfs_set_cache_size", 00:04:29.218 "bdev_aio_delete", 00:04:29.218 "bdev_aio_rescan", 00:04:29.218 "bdev_aio_create", 00:04:29.218 "bdev_ftl_set_property", 00:04:29.218 "bdev_ftl_get_properties", 00:04:29.218 "bdev_ftl_get_stats", 00:04:29.218 "bdev_ftl_unmap", 00:04:29.218 "bdev_ftl_unload", 00:04:29.218 "bdev_ftl_delete", 00:04:29.218 "bdev_ftl_load", 00:04:29.218 "bdev_ftl_create", 00:04:29.218 "bdev_virtio_attach_controller", 00:04:29.218 "bdev_virtio_scsi_get_devices", 00:04:29.218 "bdev_virtio_detach_controller", 00:04:29.218 "bdev_virtio_blk_set_hotplug", 00:04:29.218 "bdev_iscsi_delete", 00:04:29.218 "bdev_iscsi_create", 00:04:29.218 "bdev_iscsi_set_options", 00:04:29.218 "accel_error_inject_error", 00:04:29.218 "ioat_scan_accel_module", 00:04:29.218 "dsa_scan_accel_module", 00:04:29.218 "iaa_scan_accel_module", 00:04:29.218 "iscsi_set_options", 00:04:29.218 "iscsi_get_auth_groups", 00:04:29.218 "iscsi_auth_group_remove_secret", 00:04:29.218 "iscsi_auth_group_add_secret", 00:04:29.218 "iscsi_delete_auth_group", 00:04:29.218 "iscsi_create_auth_group", 00:04:29.218 "iscsi_set_discovery_auth", 00:04:29.218 "iscsi_get_options", 00:04:29.218 "iscsi_target_node_request_logout", 00:04:29.218 "iscsi_target_node_set_redirect", 00:04:29.218 "iscsi_target_node_set_auth", 00:04:29.218 "iscsi_target_node_add_lun", 00:04:29.218 "iscsi_get_connections", 00:04:29.219 "iscsi_portal_group_set_auth", 00:04:29.219 "iscsi_start_portal_group", 00:04:29.219 "iscsi_delete_portal_group", 00:04:29.219 "iscsi_create_portal_group", 00:04:29.219 "iscsi_get_portal_groups", 00:04:29.219 "iscsi_delete_target_node", 00:04:29.219 "iscsi_target_node_remove_pg_ig_maps", 00:04:29.219 "iscsi_target_node_add_pg_ig_maps", 00:04:29.219 "iscsi_create_target_node", 00:04:29.219 "iscsi_get_target_nodes", 00:04:29.219 "iscsi_delete_initiator_group", 00:04:29.219 "iscsi_initiator_group_remove_initiators", 00:04:29.219 "iscsi_initiator_group_add_initiators", 00:04:29.219 "iscsi_create_initiator_group", 00:04:29.219 "iscsi_get_initiator_groups", 00:04:29.219 "nvmf_set_crdt", 00:04:29.219 "nvmf_set_config", 00:04:29.219 "nvmf_set_max_subsystems", 00:04:29.219 "nvmf_subsystem_get_listeners", 00:04:29.219 "nvmf_subsystem_get_qpairs", 00:04:29.219 "nvmf_subsystem_get_controllers", 00:04:29.219 "nvmf_get_stats", 00:04:29.219 "nvmf_get_transports", 00:04:29.219 "nvmf_create_transport", 00:04:29.219 "nvmf_get_targets", 00:04:29.219 "nvmf_delete_target", 00:04:29.219 "nvmf_create_target", 00:04:29.219 "nvmf_subsystem_allow_any_host", 00:04:29.219 "nvmf_subsystem_remove_host", 00:04:29.219 "nvmf_subsystem_add_host", 00:04:29.219 "nvmf_subsystem_remove_ns", 00:04:29.219 "nvmf_subsystem_add_ns", 00:04:29.219 "nvmf_subsystem_listener_set_ana_state", 00:04:29.219 "nvmf_discovery_get_referrals", 00:04:29.219 "nvmf_discovery_remove_referral", 00:04:29.219 "nvmf_discovery_add_referral", 00:04:29.219 "nvmf_subsystem_remove_listener", 00:04:29.219 "nvmf_subsystem_add_listener", 00:04:29.219 "nvmf_delete_subsystem", 00:04:29.219 "nvmf_create_subsystem", 00:04:29.219 "nvmf_get_subsystems", 00:04:29.219 "env_dpdk_get_mem_stats", 00:04:29.219 "nbd_get_disks", 00:04:29.219 "nbd_stop_disk", 00:04:29.219 "nbd_start_disk", 00:04:29.219 "ublk_recover_disk", 00:04:29.219 "ublk_get_disks", 00:04:29.219 "ublk_stop_disk", 00:04:29.219 "ublk_start_disk", 00:04:29.219 "ublk_destroy_target", 00:04:29.219 "ublk_create_target", 00:04:29.219 "virtio_blk_create_transport", 00:04:29.219 "virtio_blk_get_transports", 00:04:29.219 "vhost_controller_set_coalescing", 00:04:29.219 "vhost_get_controllers", 00:04:29.219 "vhost_delete_controller", 00:04:29.219 "vhost_create_blk_controller", 00:04:29.219 "vhost_scsi_controller_remove_target", 00:04:29.219 "vhost_scsi_controller_add_target", 00:04:29.219 "vhost_start_scsi_controller", 00:04:29.219 "vhost_create_scsi_controller", 00:04:29.219 "thread_set_cpumask", 00:04:29.219 "framework_get_scheduler", 00:04:29.219 "framework_set_scheduler", 00:04:29.219 "framework_get_reactors", 00:04:29.219 "thread_get_io_channels", 00:04:29.219 "thread_get_pollers", 00:04:29.219 "thread_get_stats", 00:04:29.219 "framework_monitor_context_switch", 00:04:29.219 "spdk_kill_instance", 00:04:29.219 "log_enable_timestamps", 00:04:29.219 "log_get_flags", 00:04:29.219 "log_clear_flag", 00:04:29.219 "log_set_flag", 00:04:29.219 "log_get_level", 00:04:29.219 "log_set_level", 00:04:29.219 "log_get_print_level", 00:04:29.219 "log_set_print_level", 00:04:29.219 "framework_enable_cpumask_locks", 00:04:29.219 "framework_disable_cpumask_locks", 00:04:29.219 "framework_wait_init", 00:04:29.219 "framework_start_init", 00:04:29.219 "scsi_get_devices", 00:04:29.219 "bdev_get_histogram", 00:04:29.219 "bdev_enable_histogram", 00:04:29.219 "bdev_set_qos_limit", 00:04:29.219 "bdev_set_qd_sampling_period", 00:04:29.219 "bdev_get_bdevs", 00:04:29.219 "bdev_reset_iostat", 00:04:29.219 "bdev_get_iostat", 00:04:29.219 "bdev_examine", 00:04:29.219 "bdev_wait_for_examine", 00:04:29.219 "bdev_set_options", 00:04:29.219 "notify_get_notifications", 00:04:29.219 "notify_get_types", 00:04:29.219 "accel_get_stats", 00:04:29.219 "accel_set_options", 00:04:29.219 "accel_set_driver", 00:04:29.219 "accel_crypto_key_destroy", 00:04:29.219 "accel_crypto_keys_get", 00:04:29.219 "accel_crypto_key_create", 00:04:29.219 "accel_assign_opc", 00:04:29.219 "accel_get_module_info", 00:04:29.219 "accel_get_opc_assignments", 00:04:29.219 "vmd_rescan", 00:04:29.219 "vmd_remove_device", 00:04:29.219 "vmd_enable", 00:04:29.219 "sock_set_default_impl", 00:04:29.219 "sock_impl_set_options", 00:04:29.219 "sock_impl_get_options", 00:04:29.219 "iobuf_get_stats", 00:04:29.219 "iobuf_set_options", 00:04:29.219 "framework_get_pci_devices", 00:04:29.219 "framework_get_config", 00:04:29.219 "framework_get_subsystems", 00:04:29.219 "trace_get_info", 00:04:29.219 "trace_get_tpoint_group_mask", 00:04:29.219 "trace_disable_tpoint_group", 00:04:29.219 "trace_enable_tpoint_group", 00:04:29.219 "trace_clear_tpoint_mask", 00:04:29.219 "trace_set_tpoint_mask", 00:04:29.219 "spdk_get_version", 00:04:29.219 "rpc_get_methods" 00:04:29.219 ] 00:04:29.219 08:43:17 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:04:29.219 08:43:17 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:29.219 08:43:17 -- common/autotest_common.sh@10 -- # set +x 00:04:29.219 08:43:17 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:04:29.219 08:43:17 -- spdkcli/tcp.sh@38 -- # killprocess 1379865 00:04:29.219 08:43:17 -- common/autotest_common.sh@926 -- # '[' -z 1379865 ']' 00:04:29.219 08:43:17 -- common/autotest_common.sh@930 -- # kill -0 1379865 00:04:29.219 08:43:17 -- common/autotest_common.sh@931 -- # uname 00:04:29.219 08:43:17 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:29.219 08:43:17 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1379865 00:04:29.219 08:43:17 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:29.219 08:43:17 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:29.219 08:43:17 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1379865' 00:04:29.219 killing process with pid 1379865 00:04:29.219 08:43:17 -- common/autotest_common.sh@945 -- # kill 1379865 00:04:29.219 08:43:17 -- common/autotest_common.sh@950 -- # wait 1379865 00:04:29.784 00:04:29.784 real 0m1.741s 00:04:29.784 user 0m3.318s 00:04:29.784 sys 0m0.476s 00:04:29.784 08:43:18 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:29.784 08:43:18 -- common/autotest_common.sh@10 -- # set +x 00:04:29.784 ************************************ 00:04:29.784 END TEST spdkcli_tcp 00:04:29.784 ************************************ 00:04:29.784 08:43:18 -- spdk/autotest.sh@186 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:29.784 08:43:18 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:29.784 08:43:18 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:29.784 08:43:18 -- common/autotest_common.sh@10 -- # set +x 00:04:29.784 ************************************ 00:04:29.784 START TEST dpdk_mem_utility 00:04:29.784 ************************************ 00:04:29.784 08:43:18 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:29.784 * Looking for test storage... 00:04:29.784 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:04:29.784 08:43:18 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:29.784 08:43:18 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=1380195 00:04:29.784 08:43:18 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:29.784 08:43:18 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 1380195 00:04:29.784 08:43:18 -- common/autotest_common.sh@819 -- # '[' -z 1380195 ']' 00:04:29.784 08:43:18 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:29.784 08:43:18 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:29.784 08:43:18 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:29.784 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:29.784 08:43:18 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:29.784 08:43:18 -- common/autotest_common.sh@10 -- # set +x 00:04:30.043 [2024-07-15 08:43:18.331675] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:04:30.043 [2024-07-15 08:43:18.331775] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1380195 ] 00:04:30.043 EAL: No free 2048 kB hugepages reported on node 1 00:04:30.043 [2024-07-15 08:43:18.390569] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:30.043 [2024-07-15 08:43:18.494973] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:30.043 [2024-07-15 08:43:18.495134] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:30.976 08:43:19 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:30.976 08:43:19 -- common/autotest_common.sh@852 -- # return 0 00:04:30.976 08:43:19 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:04:30.976 08:43:19 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:04:30.976 08:43:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:30.976 08:43:19 -- common/autotest_common.sh@10 -- # set +x 00:04:30.976 { 00:04:30.976 "filename": "/tmp/spdk_mem_dump.txt" 00:04:30.976 } 00:04:30.976 08:43:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:30.976 08:43:19 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:30.976 DPDK memory size 814.000000 MiB in 1 heap(s) 00:04:30.976 1 heaps totaling size 814.000000 MiB 00:04:30.976 size: 814.000000 MiB heap id: 0 00:04:30.976 end heaps---------- 00:04:30.976 8 mempools totaling size 598.116089 MiB 00:04:30.976 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:04:30.976 size: 158.602051 MiB name: PDU_data_out_Pool 00:04:30.976 size: 84.521057 MiB name: bdev_io_1380195 00:04:30.976 size: 51.011292 MiB name: evtpool_1380195 00:04:30.976 size: 50.003479 MiB name: msgpool_1380195 00:04:30.976 size: 21.763794 MiB name: PDU_Pool 00:04:30.976 size: 19.513306 MiB name: SCSI_TASK_Pool 00:04:30.976 size: 0.026123 MiB name: Session_Pool 00:04:30.976 end mempools------- 00:04:30.976 6 memzones totaling size 4.142822 MiB 00:04:30.976 size: 1.000366 MiB name: RG_ring_0_1380195 00:04:30.976 size: 1.000366 MiB name: RG_ring_1_1380195 00:04:30.976 size: 1.000366 MiB name: RG_ring_4_1380195 00:04:30.977 size: 1.000366 MiB name: RG_ring_5_1380195 00:04:30.977 size: 0.125366 MiB name: RG_ring_2_1380195 00:04:30.977 size: 0.015991 MiB name: RG_ring_3_1380195 00:04:30.977 end memzones------- 00:04:30.977 08:43:19 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:04:30.977 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:04:30.977 list of free elements. size: 12.519348 MiB 00:04:30.977 element at address: 0x200000400000 with size: 1.999512 MiB 00:04:30.977 element at address: 0x200018e00000 with size: 0.999878 MiB 00:04:30.977 element at address: 0x200019000000 with size: 0.999878 MiB 00:04:30.977 element at address: 0x200003e00000 with size: 0.996277 MiB 00:04:30.977 element at address: 0x200031c00000 with size: 0.994446 MiB 00:04:30.977 element at address: 0x200013800000 with size: 0.978699 MiB 00:04:30.977 element at address: 0x200007000000 with size: 0.959839 MiB 00:04:30.977 element at address: 0x200019200000 with size: 0.936584 MiB 00:04:30.977 element at address: 0x200000200000 with size: 0.841614 MiB 00:04:30.977 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:04:30.977 element at address: 0x20000b200000 with size: 0.490723 MiB 00:04:30.977 element at address: 0x200000800000 with size: 0.487793 MiB 00:04:30.977 element at address: 0x200019400000 with size: 0.485657 MiB 00:04:30.977 element at address: 0x200027e00000 with size: 0.410034 MiB 00:04:30.977 element at address: 0x200003a00000 with size: 0.355530 MiB 00:04:30.977 list of standard malloc elements. size: 199.218079 MiB 00:04:30.977 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:04:30.977 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:04:30.977 element at address: 0x200018efff80 with size: 1.000122 MiB 00:04:30.977 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:04:30.977 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:04:30.977 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:04:30.977 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:04:30.977 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:04:30.977 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:04:30.977 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:04:30.977 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:04:30.977 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:04:30.977 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:04:30.977 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:04:30.977 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:04:30.977 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:04:30.977 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:04:30.977 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:04:30.977 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:04:30.977 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:04:30.977 element at address: 0x200003adb300 with size: 0.000183 MiB 00:04:30.977 element at address: 0x200003adb500 with size: 0.000183 MiB 00:04:30.977 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:04:30.977 element at address: 0x200003affa80 with size: 0.000183 MiB 00:04:30.977 element at address: 0x200003affb40 with size: 0.000183 MiB 00:04:30.977 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:04:30.977 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:04:30.977 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:04:30.977 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:04:30.977 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:04:30.977 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:04:30.977 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:04:30.977 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:04:30.977 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:04:30.977 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:04:30.977 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:04:30.977 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:04:30.977 element at address: 0x200027e69040 with size: 0.000183 MiB 00:04:30.977 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:04:30.977 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:04:30.977 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:04:30.977 list of memzone associated elements. size: 602.262573 MiB 00:04:30.977 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:04:30.977 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:04:30.977 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:04:30.977 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:04:30.977 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:04:30.977 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_1380195_0 00:04:30.977 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:04:30.977 associated memzone info: size: 48.002930 MiB name: MP_evtpool_1380195_0 00:04:30.977 element at address: 0x200003fff380 with size: 48.003052 MiB 00:04:30.977 associated memzone info: size: 48.002930 MiB name: MP_msgpool_1380195_0 00:04:30.977 element at address: 0x2000195be940 with size: 20.255554 MiB 00:04:30.977 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:04:30.977 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:04:30.977 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:04:30.977 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:04:30.977 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_1380195 00:04:30.977 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:04:30.977 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_1380195 00:04:30.977 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:04:30.977 associated memzone info: size: 1.007996 MiB name: MP_evtpool_1380195 00:04:30.977 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:04:30.977 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:04:30.977 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:04:30.977 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:04:30.977 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:04:30.977 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:04:30.977 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:04:30.977 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:04:30.977 element at address: 0x200003eff180 with size: 1.000488 MiB 00:04:30.977 associated memzone info: size: 1.000366 MiB name: RG_ring_0_1380195 00:04:30.977 element at address: 0x200003affc00 with size: 1.000488 MiB 00:04:30.977 associated memzone info: size: 1.000366 MiB name: RG_ring_1_1380195 00:04:30.977 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:04:30.977 associated memzone info: size: 1.000366 MiB name: RG_ring_4_1380195 00:04:30.977 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:04:30.977 associated memzone info: size: 1.000366 MiB name: RG_ring_5_1380195 00:04:30.977 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:04:30.977 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_1380195 00:04:30.977 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:04:30.977 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:04:30.977 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:04:30.977 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:04:30.977 element at address: 0x20001947c540 with size: 0.250488 MiB 00:04:30.977 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:04:30.977 element at address: 0x200003adf880 with size: 0.125488 MiB 00:04:30.977 associated memzone info: size: 0.125366 MiB name: RG_ring_2_1380195 00:04:30.977 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:04:30.977 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:04:30.977 element at address: 0x200027e69100 with size: 0.023743 MiB 00:04:30.977 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:04:30.977 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:04:30.977 associated memzone info: size: 0.015991 MiB name: RG_ring_3_1380195 00:04:30.977 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:04:30.977 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:04:30.977 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:04:30.977 associated memzone info: size: 0.000183 MiB name: MP_msgpool_1380195 00:04:30.977 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:04:30.977 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_1380195 00:04:30.977 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:04:30.977 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:04:30.977 08:43:19 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:04:30.977 08:43:19 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 1380195 00:04:30.977 08:43:19 -- common/autotest_common.sh@926 -- # '[' -z 1380195 ']' 00:04:30.977 08:43:19 -- common/autotest_common.sh@930 -- # kill -0 1380195 00:04:30.977 08:43:19 -- common/autotest_common.sh@931 -- # uname 00:04:30.977 08:43:19 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:30.977 08:43:19 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1380195 00:04:30.977 08:43:19 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:30.977 08:43:19 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:30.977 08:43:19 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1380195' 00:04:30.977 killing process with pid 1380195 00:04:30.977 08:43:19 -- common/autotest_common.sh@945 -- # kill 1380195 00:04:30.977 08:43:19 -- common/autotest_common.sh@950 -- # wait 1380195 00:04:31.543 00:04:31.543 real 0m1.652s 00:04:31.543 user 0m1.812s 00:04:31.543 sys 0m0.427s 00:04:31.543 08:43:19 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:31.543 08:43:19 -- common/autotest_common.sh@10 -- # set +x 00:04:31.543 ************************************ 00:04:31.543 END TEST dpdk_mem_utility 00:04:31.543 ************************************ 00:04:31.543 08:43:19 -- spdk/autotest.sh@187 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:31.543 08:43:19 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:31.543 08:43:19 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:31.543 08:43:19 -- common/autotest_common.sh@10 -- # set +x 00:04:31.543 ************************************ 00:04:31.543 START TEST event 00:04:31.543 ************************************ 00:04:31.543 08:43:19 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:31.543 * Looking for test storage... 00:04:31.543 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:04:31.543 08:43:19 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:04:31.543 08:43:19 -- bdev/nbd_common.sh@6 -- # set -e 00:04:31.543 08:43:19 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:31.543 08:43:19 -- common/autotest_common.sh@1077 -- # '[' 6 -le 1 ']' 00:04:31.543 08:43:19 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:31.543 08:43:19 -- common/autotest_common.sh@10 -- # set +x 00:04:31.543 ************************************ 00:04:31.543 START TEST event_perf 00:04:31.543 ************************************ 00:04:31.543 08:43:19 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:31.543 Running I/O for 1 seconds...[2024-07-15 08:43:19.984339] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:04:31.543 [2024-07-15 08:43:19.984425] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1380395 ] 00:04:31.543 EAL: No free 2048 kB hugepages reported on node 1 00:04:31.543 [2024-07-15 08:43:20.050700] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:31.801 [2024-07-15 08:43:20.164429] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:31.801 [2024-07-15 08:43:20.164487] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:31.801 [2024-07-15 08:43:20.164551] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:31.801 [2024-07-15 08:43:20.164554] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:33.172 Running I/O for 1 seconds... 00:04:33.172 lcore 0: 239884 00:04:33.172 lcore 1: 239882 00:04:33.172 lcore 2: 239883 00:04:33.172 lcore 3: 239883 00:04:33.172 done. 00:04:33.172 00:04:33.172 real 0m1.323s 00:04:33.172 user 0m4.223s 00:04:33.172 sys 0m0.091s 00:04:33.172 08:43:21 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:33.172 08:43:21 -- common/autotest_common.sh@10 -- # set +x 00:04:33.172 ************************************ 00:04:33.172 END TEST event_perf 00:04:33.172 ************************************ 00:04:33.172 08:43:21 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:33.172 08:43:21 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:04:33.172 08:43:21 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:33.172 08:43:21 -- common/autotest_common.sh@10 -- # set +x 00:04:33.172 ************************************ 00:04:33.172 START TEST event_reactor 00:04:33.172 ************************************ 00:04:33.172 08:43:21 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:33.172 [2024-07-15 08:43:21.327760] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:04:33.172 [2024-07-15 08:43:21.327832] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1380622 ] 00:04:33.172 EAL: No free 2048 kB hugepages reported on node 1 00:04:33.172 [2024-07-15 08:43:21.392051] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:33.172 [2024-07-15 08:43:21.508338] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:34.104 test_start 00:04:34.104 oneshot 00:04:34.104 tick 100 00:04:34.104 tick 100 00:04:34.104 tick 250 00:04:34.104 tick 100 00:04:34.104 tick 100 00:04:34.104 tick 250 00:04:34.104 tick 500 00:04:34.104 tick 100 00:04:34.104 tick 100 00:04:34.104 tick 100 00:04:34.104 tick 250 00:04:34.104 tick 100 00:04:34.104 tick 100 00:04:34.104 test_end 00:04:34.104 00:04:34.104 real 0m1.316s 00:04:34.104 user 0m1.230s 00:04:34.104 sys 0m0.081s 00:04:34.104 08:43:22 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:34.104 08:43:22 -- common/autotest_common.sh@10 -- # set +x 00:04:34.104 ************************************ 00:04:34.104 END TEST event_reactor 00:04:34.104 ************************************ 00:04:34.362 08:43:22 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:34.362 08:43:22 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:04:34.362 08:43:22 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:34.362 08:43:22 -- common/autotest_common.sh@10 -- # set +x 00:04:34.362 ************************************ 00:04:34.362 START TEST event_reactor_perf 00:04:34.362 ************************************ 00:04:34.362 08:43:22 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:34.362 [2024-07-15 08:43:22.675818] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:04:34.362 [2024-07-15 08:43:22.675914] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1380840 ] 00:04:34.362 EAL: No free 2048 kB hugepages reported on node 1 00:04:34.362 [2024-07-15 08:43:22.739867] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:34.362 [2024-07-15 08:43:22.853922] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:35.730 test_start 00:04:35.730 test_end 00:04:35.730 Performance: 347737 events per second 00:04:35.730 00:04:35.731 real 0m1.317s 00:04:35.731 user 0m1.227s 00:04:35.731 sys 0m0.084s 00:04:35.731 08:43:23 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:35.731 08:43:23 -- common/autotest_common.sh@10 -- # set +x 00:04:35.731 ************************************ 00:04:35.731 END TEST event_reactor_perf 00:04:35.731 ************************************ 00:04:35.731 08:43:24 -- event/event.sh@49 -- # uname -s 00:04:35.731 08:43:24 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:04:35.731 08:43:24 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:35.731 08:43:24 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:35.731 08:43:24 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:35.731 08:43:24 -- common/autotest_common.sh@10 -- # set +x 00:04:35.731 ************************************ 00:04:35.731 START TEST event_scheduler 00:04:35.731 ************************************ 00:04:35.731 08:43:24 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:35.731 * Looking for test storage... 00:04:35.731 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:04:35.731 08:43:24 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:04:35.731 08:43:24 -- scheduler/scheduler.sh@35 -- # scheduler_pid=1381019 00:04:35.731 08:43:24 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:04:35.731 08:43:24 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:04:35.731 08:43:24 -- scheduler/scheduler.sh@37 -- # waitforlisten 1381019 00:04:35.731 08:43:24 -- common/autotest_common.sh@819 -- # '[' -z 1381019 ']' 00:04:35.731 08:43:24 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:35.731 08:43:24 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:35.731 08:43:24 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:35.731 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:35.731 08:43:24 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:35.731 08:43:24 -- common/autotest_common.sh@10 -- # set +x 00:04:35.731 [2024-07-15 08:43:24.098022] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:04:35.731 [2024-07-15 08:43:24.098105] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1381019 ] 00:04:35.731 EAL: No free 2048 kB hugepages reported on node 1 00:04:35.731 [2024-07-15 08:43:24.155808] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:35.731 [2024-07-15 08:43:24.262013] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:35.731 [2024-07-15 08:43:24.262069] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:35.731 [2024-07-15 08:43:24.262135] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:35.731 [2024-07-15 08:43:24.262139] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:36.010 08:43:24 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:36.010 08:43:24 -- common/autotest_common.sh@852 -- # return 0 00:04:36.010 08:43:24 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:04:36.010 08:43:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:36.010 08:43:24 -- common/autotest_common.sh@10 -- # set +x 00:04:36.010 POWER: Env isn't set yet! 00:04:36.010 POWER: Attempting to initialise ACPI cpufreq power management... 00:04:36.010 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:04:36.010 POWER: Cannot get available frequencies of lcore 0 00:04:36.010 POWER: Attempting to initialise PSTAT power management... 00:04:36.010 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:04:36.010 POWER: Initialized successfully for lcore 0 power management 00:04:36.010 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:04:36.010 POWER: Initialized successfully for lcore 1 power management 00:04:36.010 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:04:36.010 POWER: Initialized successfully for lcore 2 power management 00:04:36.010 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:04:36.010 POWER: Initialized successfully for lcore 3 power management 00:04:36.011 [2024-07-15 08:43:24.333072] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:04:36.011 [2024-07-15 08:43:24.333090] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:04:36.011 [2024-07-15 08:43:24.333101] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:04:36.011 08:43:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:36.011 08:43:24 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:04:36.011 08:43:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:36.011 08:43:24 -- common/autotest_common.sh@10 -- # set +x 00:04:36.011 [2024-07-15 08:43:24.437049] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:04:36.011 08:43:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:36.011 08:43:24 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:04:36.011 08:43:24 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:36.011 08:43:24 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:36.011 08:43:24 -- common/autotest_common.sh@10 -- # set +x 00:04:36.011 ************************************ 00:04:36.011 START TEST scheduler_create_thread 00:04:36.011 ************************************ 00:04:36.011 08:43:24 -- common/autotest_common.sh@1104 -- # scheduler_create_thread 00:04:36.011 08:43:24 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:04:36.011 08:43:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:36.011 08:43:24 -- common/autotest_common.sh@10 -- # set +x 00:04:36.011 2 00:04:36.011 08:43:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:36.011 08:43:24 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:04:36.011 08:43:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:36.011 08:43:24 -- common/autotest_common.sh@10 -- # set +x 00:04:36.011 3 00:04:36.011 08:43:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:36.011 08:43:24 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:04:36.011 08:43:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:36.011 08:43:24 -- common/autotest_common.sh@10 -- # set +x 00:04:36.011 4 00:04:36.011 08:43:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:36.011 08:43:24 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:04:36.011 08:43:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:36.011 08:43:24 -- common/autotest_common.sh@10 -- # set +x 00:04:36.011 5 00:04:36.011 08:43:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:36.011 08:43:24 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:04:36.011 08:43:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:36.011 08:43:24 -- common/autotest_common.sh@10 -- # set +x 00:04:36.011 6 00:04:36.011 08:43:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:36.011 08:43:24 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:04:36.011 08:43:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:36.011 08:43:24 -- common/autotest_common.sh@10 -- # set +x 00:04:36.011 7 00:04:36.011 08:43:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:36.011 08:43:24 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:04:36.011 08:43:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:36.011 08:43:24 -- common/autotest_common.sh@10 -- # set +x 00:04:36.011 8 00:04:36.011 08:43:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:36.011 08:43:24 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:04:36.011 08:43:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:36.011 08:43:24 -- common/autotest_common.sh@10 -- # set +x 00:04:36.011 9 00:04:36.011 08:43:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:36.011 08:43:24 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:04:36.011 08:43:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:36.011 08:43:24 -- common/autotest_common.sh@10 -- # set +x 00:04:36.011 10 00:04:36.011 08:43:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:36.011 08:43:24 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:04:36.011 08:43:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:36.011 08:43:24 -- common/autotest_common.sh@10 -- # set +x 00:04:36.011 08:43:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:36.011 08:43:24 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:04:36.011 08:43:24 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:04:36.011 08:43:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:36.011 08:43:24 -- common/autotest_common.sh@10 -- # set +x 00:04:36.011 08:43:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:36.011 08:43:24 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:04:36.011 08:43:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:36.011 08:43:24 -- common/autotest_common.sh@10 -- # set +x 00:04:37.907 08:43:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:37.907 08:43:25 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:04:37.907 08:43:25 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:04:37.907 08:43:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:37.907 08:43:25 -- common/autotest_common.sh@10 -- # set +x 00:04:38.840 08:43:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:38.840 00:04:38.840 real 0m2.617s 00:04:38.840 user 0m0.014s 00:04:38.840 sys 0m0.000s 00:04:38.840 08:43:27 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:38.840 08:43:27 -- common/autotest_common.sh@10 -- # set +x 00:04:38.840 ************************************ 00:04:38.840 END TEST scheduler_create_thread 00:04:38.840 ************************************ 00:04:38.840 08:43:27 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:04:38.840 08:43:27 -- scheduler/scheduler.sh@46 -- # killprocess 1381019 00:04:38.840 08:43:27 -- common/autotest_common.sh@926 -- # '[' -z 1381019 ']' 00:04:38.840 08:43:27 -- common/autotest_common.sh@930 -- # kill -0 1381019 00:04:38.840 08:43:27 -- common/autotest_common.sh@931 -- # uname 00:04:38.840 08:43:27 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:38.840 08:43:27 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1381019 00:04:38.840 08:43:27 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:04:38.840 08:43:27 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:04:38.840 08:43:27 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1381019' 00:04:38.840 killing process with pid 1381019 00:04:38.840 08:43:27 -- common/autotest_common.sh@945 -- # kill 1381019 00:04:38.840 08:43:27 -- common/autotest_common.sh@950 -- # wait 1381019 00:04:39.098 [2024-07-15 08:43:27.540451] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:04:39.357 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:04:39.357 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:04:39.357 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:04:39.357 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:04:39.357 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:04:39.357 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:04:39.357 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:04:39.357 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:04:39.357 00:04:39.357 real 0m3.801s 00:04:39.357 user 0m5.715s 00:04:39.357 sys 0m0.301s 00:04:39.357 08:43:27 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:39.357 08:43:27 -- common/autotest_common.sh@10 -- # set +x 00:04:39.357 ************************************ 00:04:39.357 END TEST event_scheduler 00:04:39.357 ************************************ 00:04:39.357 08:43:27 -- event/event.sh@51 -- # modprobe -n nbd 00:04:39.357 08:43:27 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:04:39.357 08:43:27 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:39.357 08:43:27 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:39.357 08:43:27 -- common/autotest_common.sh@10 -- # set +x 00:04:39.357 ************************************ 00:04:39.357 START TEST app_repeat 00:04:39.357 ************************************ 00:04:39.357 08:43:27 -- common/autotest_common.sh@1104 -- # app_repeat_test 00:04:39.357 08:43:27 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:39.357 08:43:27 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:39.357 08:43:27 -- event/event.sh@13 -- # local nbd_list 00:04:39.357 08:43:27 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:39.357 08:43:27 -- event/event.sh@14 -- # local bdev_list 00:04:39.357 08:43:27 -- event/event.sh@15 -- # local repeat_times=4 00:04:39.357 08:43:27 -- event/event.sh@17 -- # modprobe nbd 00:04:39.357 08:43:27 -- event/event.sh@19 -- # repeat_pid=1381483 00:04:39.357 08:43:27 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:04:39.357 08:43:27 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:04:39.357 08:43:27 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 1381483' 00:04:39.357 Process app_repeat pid: 1381483 00:04:39.357 08:43:27 -- event/event.sh@23 -- # for i in {0..2} 00:04:39.357 08:43:27 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:04:39.357 spdk_app_start Round 0 00:04:39.357 08:43:27 -- event/event.sh@25 -- # waitforlisten 1381483 /var/tmp/spdk-nbd.sock 00:04:39.357 08:43:27 -- common/autotest_common.sh@819 -- # '[' -z 1381483 ']' 00:04:39.357 08:43:27 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:39.357 08:43:27 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:39.357 08:43:27 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:39.357 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:39.357 08:43:27 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:39.357 08:43:27 -- common/autotest_common.sh@10 -- # set +x 00:04:39.357 [2024-07-15 08:43:27.868706] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:04:39.357 [2024-07-15 08:43:27.868787] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1381483 ] 00:04:39.357 EAL: No free 2048 kB hugepages reported on node 1 00:04:39.615 [2024-07-15 08:43:27.935150] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:39.615 [2024-07-15 08:43:28.059770] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:39.615 [2024-07-15 08:43:28.059773] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:40.550 08:43:28 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:40.550 08:43:28 -- common/autotest_common.sh@852 -- # return 0 00:04:40.550 08:43:28 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:40.550 Malloc0 00:04:40.550 08:43:29 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:40.808 Malloc1 00:04:40.808 08:43:29 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:40.808 08:43:29 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:41.066 08:43:29 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:41.066 08:43:29 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:41.066 08:43:29 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:41.066 08:43:29 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:41.066 08:43:29 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:41.066 08:43:29 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:41.066 08:43:29 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:41.066 08:43:29 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:41.066 08:43:29 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:41.066 08:43:29 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:41.066 08:43:29 -- bdev/nbd_common.sh@12 -- # local i 00:04:41.066 08:43:29 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:41.066 08:43:29 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:41.066 08:43:29 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:41.066 /dev/nbd0 00:04:41.066 08:43:29 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:41.066 08:43:29 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:41.066 08:43:29 -- common/autotest_common.sh@856 -- # local nbd_name=nbd0 00:04:41.066 08:43:29 -- common/autotest_common.sh@857 -- # local i 00:04:41.066 08:43:29 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:04:41.066 08:43:29 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:04:41.066 08:43:29 -- common/autotest_common.sh@860 -- # grep -q -w nbd0 /proc/partitions 00:04:41.066 08:43:29 -- common/autotest_common.sh@861 -- # break 00:04:41.066 08:43:29 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:04:41.066 08:43:29 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:04:41.066 08:43:29 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:41.325 1+0 records in 00:04:41.325 1+0 records out 00:04:41.325 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000186498 s, 22.0 MB/s 00:04:41.325 08:43:29 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:41.325 08:43:29 -- common/autotest_common.sh@874 -- # size=4096 00:04:41.325 08:43:29 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:41.325 08:43:29 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:04:41.325 08:43:29 -- common/autotest_common.sh@877 -- # return 0 00:04:41.325 08:43:29 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:41.325 08:43:29 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:41.325 08:43:29 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:41.325 /dev/nbd1 00:04:41.325 08:43:29 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:41.325 08:43:29 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:41.325 08:43:29 -- common/autotest_common.sh@856 -- # local nbd_name=nbd1 00:04:41.325 08:43:29 -- common/autotest_common.sh@857 -- # local i 00:04:41.325 08:43:29 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:04:41.325 08:43:29 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:04:41.325 08:43:29 -- common/autotest_common.sh@860 -- # grep -q -w nbd1 /proc/partitions 00:04:41.325 08:43:29 -- common/autotest_common.sh@861 -- # break 00:04:41.325 08:43:29 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:04:41.325 08:43:29 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:04:41.325 08:43:29 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:41.583 1+0 records in 00:04:41.583 1+0 records out 00:04:41.583 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000193237 s, 21.2 MB/s 00:04:41.583 08:43:29 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:41.583 08:43:29 -- common/autotest_common.sh@874 -- # size=4096 00:04:41.583 08:43:29 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:41.583 08:43:29 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:04:41.583 08:43:29 -- common/autotest_common.sh@877 -- # return 0 00:04:41.583 08:43:29 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:41.583 08:43:29 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:41.583 08:43:29 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:41.583 08:43:29 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:41.583 08:43:29 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:41.583 08:43:30 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:41.583 { 00:04:41.583 "nbd_device": "/dev/nbd0", 00:04:41.583 "bdev_name": "Malloc0" 00:04:41.583 }, 00:04:41.583 { 00:04:41.583 "nbd_device": "/dev/nbd1", 00:04:41.583 "bdev_name": "Malloc1" 00:04:41.583 } 00:04:41.583 ]' 00:04:41.583 08:43:30 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:41.583 { 00:04:41.583 "nbd_device": "/dev/nbd0", 00:04:41.583 "bdev_name": "Malloc0" 00:04:41.583 }, 00:04:41.583 { 00:04:41.583 "nbd_device": "/dev/nbd1", 00:04:41.583 "bdev_name": "Malloc1" 00:04:41.583 } 00:04:41.583 ]' 00:04:41.583 08:43:30 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:41.841 08:43:30 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:41.841 /dev/nbd1' 00:04:41.841 08:43:30 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:41.841 /dev/nbd1' 00:04:41.841 08:43:30 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:41.841 08:43:30 -- bdev/nbd_common.sh@65 -- # count=2 00:04:41.841 08:43:30 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:41.841 08:43:30 -- bdev/nbd_common.sh@95 -- # count=2 00:04:41.841 08:43:30 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:41.841 08:43:30 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:41.841 08:43:30 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:41.841 08:43:30 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:41.841 08:43:30 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:41.841 08:43:30 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:41.841 08:43:30 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:41.841 08:43:30 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:41.841 256+0 records in 00:04:41.841 256+0 records out 00:04:41.841 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00508074 s, 206 MB/s 00:04:41.841 08:43:30 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:41.841 08:43:30 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:41.841 256+0 records in 00:04:41.841 256+0 records out 00:04:41.841 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206999 s, 50.7 MB/s 00:04:41.841 08:43:30 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:41.841 08:43:30 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:41.841 256+0 records in 00:04:41.842 256+0 records out 00:04:41.842 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262002 s, 40.0 MB/s 00:04:41.842 08:43:30 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:41.842 08:43:30 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:41.842 08:43:30 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:41.842 08:43:30 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:41.842 08:43:30 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:41.842 08:43:30 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:41.842 08:43:30 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:41.842 08:43:30 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:41.842 08:43:30 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:41.842 08:43:30 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:41.842 08:43:30 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:41.842 08:43:30 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:41.842 08:43:30 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:41.842 08:43:30 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:41.842 08:43:30 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:41.842 08:43:30 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:41.842 08:43:30 -- bdev/nbd_common.sh@51 -- # local i 00:04:41.842 08:43:30 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:41.842 08:43:30 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:42.100 08:43:30 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:42.100 08:43:30 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:42.100 08:43:30 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:42.100 08:43:30 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:42.100 08:43:30 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:42.100 08:43:30 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:42.100 08:43:30 -- bdev/nbd_common.sh@41 -- # break 00:04:42.100 08:43:30 -- bdev/nbd_common.sh@45 -- # return 0 00:04:42.100 08:43:30 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:42.100 08:43:30 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:42.358 08:43:30 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:42.358 08:43:30 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:42.358 08:43:30 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:42.358 08:43:30 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:42.358 08:43:30 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:42.358 08:43:30 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:42.358 08:43:30 -- bdev/nbd_common.sh@41 -- # break 00:04:42.358 08:43:30 -- bdev/nbd_common.sh@45 -- # return 0 00:04:42.358 08:43:30 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:42.358 08:43:30 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:42.358 08:43:30 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:42.651 08:43:31 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:42.651 08:43:31 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:42.651 08:43:31 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:42.651 08:43:31 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:42.651 08:43:31 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:42.651 08:43:31 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:42.651 08:43:31 -- bdev/nbd_common.sh@65 -- # true 00:04:42.651 08:43:31 -- bdev/nbd_common.sh@65 -- # count=0 00:04:42.651 08:43:31 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:42.651 08:43:31 -- bdev/nbd_common.sh@104 -- # count=0 00:04:42.651 08:43:31 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:42.651 08:43:31 -- bdev/nbd_common.sh@109 -- # return 0 00:04:42.651 08:43:31 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:42.909 08:43:31 -- event/event.sh@35 -- # sleep 3 00:04:43.168 [2024-07-15 08:43:31.572932] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:43.168 [2024-07-15 08:43:31.687758] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:43.168 [2024-07-15 08:43:31.687760] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:43.425 [2024-07-15 08:43:31.748897] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:43.425 [2024-07-15 08:43:31.748984] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:45.947 08:43:34 -- event/event.sh@23 -- # for i in {0..2} 00:04:45.947 08:43:34 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:04:45.947 spdk_app_start Round 1 00:04:45.947 08:43:34 -- event/event.sh@25 -- # waitforlisten 1381483 /var/tmp/spdk-nbd.sock 00:04:45.947 08:43:34 -- common/autotest_common.sh@819 -- # '[' -z 1381483 ']' 00:04:45.947 08:43:34 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:45.947 08:43:34 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:45.947 08:43:34 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:45.947 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:45.947 08:43:34 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:45.947 08:43:34 -- common/autotest_common.sh@10 -- # set +x 00:04:46.203 08:43:34 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:46.203 08:43:34 -- common/autotest_common.sh@852 -- # return 0 00:04:46.203 08:43:34 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:46.461 Malloc0 00:04:46.461 08:43:34 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:46.720 Malloc1 00:04:46.720 08:43:35 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:46.720 08:43:35 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:46.720 08:43:35 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:46.720 08:43:35 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:46.720 08:43:35 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:46.720 08:43:35 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:46.720 08:43:35 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:46.720 08:43:35 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:46.720 08:43:35 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:46.720 08:43:35 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:46.720 08:43:35 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:46.720 08:43:35 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:46.720 08:43:35 -- bdev/nbd_common.sh@12 -- # local i 00:04:46.720 08:43:35 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:46.720 08:43:35 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:46.720 08:43:35 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:46.977 /dev/nbd0 00:04:46.977 08:43:35 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:46.977 08:43:35 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:46.977 08:43:35 -- common/autotest_common.sh@856 -- # local nbd_name=nbd0 00:04:46.977 08:43:35 -- common/autotest_common.sh@857 -- # local i 00:04:46.977 08:43:35 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:04:46.977 08:43:35 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:04:46.977 08:43:35 -- common/autotest_common.sh@860 -- # grep -q -w nbd0 /proc/partitions 00:04:46.977 08:43:35 -- common/autotest_common.sh@861 -- # break 00:04:46.977 08:43:35 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:04:46.977 08:43:35 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:04:46.977 08:43:35 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:46.977 1+0 records in 00:04:46.977 1+0 records out 00:04:46.977 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000184482 s, 22.2 MB/s 00:04:46.977 08:43:35 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:46.977 08:43:35 -- common/autotest_common.sh@874 -- # size=4096 00:04:46.977 08:43:35 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:46.977 08:43:35 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:04:46.977 08:43:35 -- common/autotest_common.sh@877 -- # return 0 00:04:46.978 08:43:35 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:46.978 08:43:35 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:46.978 08:43:35 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:47.235 /dev/nbd1 00:04:47.235 08:43:35 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:47.235 08:43:35 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:47.235 08:43:35 -- common/autotest_common.sh@856 -- # local nbd_name=nbd1 00:04:47.235 08:43:35 -- common/autotest_common.sh@857 -- # local i 00:04:47.235 08:43:35 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:04:47.235 08:43:35 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:04:47.235 08:43:35 -- common/autotest_common.sh@860 -- # grep -q -w nbd1 /proc/partitions 00:04:47.235 08:43:35 -- common/autotest_common.sh@861 -- # break 00:04:47.235 08:43:35 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:04:47.235 08:43:35 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:04:47.235 08:43:35 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:47.235 1+0 records in 00:04:47.235 1+0 records out 00:04:47.235 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000210238 s, 19.5 MB/s 00:04:47.235 08:43:35 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:47.235 08:43:35 -- common/autotest_common.sh@874 -- # size=4096 00:04:47.235 08:43:35 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:47.235 08:43:35 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:04:47.235 08:43:35 -- common/autotest_common.sh@877 -- # return 0 00:04:47.235 08:43:35 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:47.235 08:43:35 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:47.235 08:43:35 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:47.235 08:43:35 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:47.235 08:43:35 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:47.493 08:43:35 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:47.493 { 00:04:47.493 "nbd_device": "/dev/nbd0", 00:04:47.493 "bdev_name": "Malloc0" 00:04:47.493 }, 00:04:47.493 { 00:04:47.493 "nbd_device": "/dev/nbd1", 00:04:47.493 "bdev_name": "Malloc1" 00:04:47.493 } 00:04:47.493 ]' 00:04:47.493 08:43:35 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:47.493 { 00:04:47.493 "nbd_device": "/dev/nbd0", 00:04:47.493 "bdev_name": "Malloc0" 00:04:47.493 }, 00:04:47.493 { 00:04:47.493 "nbd_device": "/dev/nbd1", 00:04:47.493 "bdev_name": "Malloc1" 00:04:47.493 } 00:04:47.493 ]' 00:04:47.493 08:43:35 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:47.493 08:43:35 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:47.493 /dev/nbd1' 00:04:47.493 08:43:35 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:47.493 /dev/nbd1' 00:04:47.493 08:43:35 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:47.493 08:43:35 -- bdev/nbd_common.sh@65 -- # count=2 00:04:47.493 08:43:35 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:47.493 08:43:35 -- bdev/nbd_common.sh@95 -- # count=2 00:04:47.493 08:43:35 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:47.493 08:43:35 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:47.493 08:43:35 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:47.493 08:43:35 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:47.493 08:43:35 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:47.493 08:43:35 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:47.493 08:43:35 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:47.493 08:43:35 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:47.493 256+0 records in 00:04:47.493 256+0 records out 00:04:47.493 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00500296 s, 210 MB/s 00:04:47.493 08:43:35 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:47.493 08:43:35 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:47.493 256+0 records in 00:04:47.493 256+0 records out 00:04:47.493 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213794 s, 49.0 MB/s 00:04:47.493 08:43:35 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:47.493 08:43:35 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:47.493 256+0 records in 00:04:47.493 256+0 records out 00:04:47.493 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234683 s, 44.7 MB/s 00:04:47.493 08:43:35 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:47.493 08:43:35 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:47.493 08:43:35 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:47.493 08:43:35 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:47.493 08:43:35 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:47.493 08:43:35 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:47.493 08:43:35 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:47.493 08:43:35 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:47.493 08:43:35 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:47.493 08:43:35 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:47.493 08:43:35 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:47.494 08:43:35 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:47.494 08:43:35 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:47.494 08:43:35 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:47.494 08:43:35 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:47.494 08:43:35 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:47.494 08:43:35 -- bdev/nbd_common.sh@51 -- # local i 00:04:47.494 08:43:35 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:47.494 08:43:35 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:47.752 08:43:36 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:47.752 08:43:36 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:47.752 08:43:36 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:47.752 08:43:36 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:47.752 08:43:36 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:47.752 08:43:36 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:47.752 08:43:36 -- bdev/nbd_common.sh@41 -- # break 00:04:47.752 08:43:36 -- bdev/nbd_common.sh@45 -- # return 0 00:04:47.752 08:43:36 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:47.752 08:43:36 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:48.010 08:43:36 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:48.010 08:43:36 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:48.010 08:43:36 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:48.010 08:43:36 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:48.010 08:43:36 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:48.010 08:43:36 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:48.010 08:43:36 -- bdev/nbd_common.sh@41 -- # break 00:04:48.010 08:43:36 -- bdev/nbd_common.sh@45 -- # return 0 00:04:48.010 08:43:36 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:48.010 08:43:36 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:48.010 08:43:36 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:48.269 08:43:36 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:48.269 08:43:36 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:48.269 08:43:36 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:48.269 08:43:36 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:48.269 08:43:36 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:48.269 08:43:36 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:48.269 08:43:36 -- bdev/nbd_common.sh@65 -- # true 00:04:48.269 08:43:36 -- bdev/nbd_common.sh@65 -- # count=0 00:04:48.269 08:43:36 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:48.269 08:43:36 -- bdev/nbd_common.sh@104 -- # count=0 00:04:48.269 08:43:36 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:48.269 08:43:36 -- bdev/nbd_common.sh@109 -- # return 0 00:04:48.269 08:43:36 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:48.528 08:43:37 -- event/event.sh@35 -- # sleep 3 00:04:48.786 [2024-07-15 08:43:37.318380] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:49.045 [2024-07-15 08:43:37.431418] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:49.045 [2024-07-15 08:43:37.431423] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:49.045 [2024-07-15 08:43:37.492428] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:49.045 [2024-07-15 08:43:37.492508] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:51.575 08:43:40 -- event/event.sh@23 -- # for i in {0..2} 00:04:51.575 08:43:40 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:04:51.575 spdk_app_start Round 2 00:04:51.575 08:43:40 -- event/event.sh@25 -- # waitforlisten 1381483 /var/tmp/spdk-nbd.sock 00:04:51.575 08:43:40 -- common/autotest_common.sh@819 -- # '[' -z 1381483 ']' 00:04:51.575 08:43:40 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:51.575 08:43:40 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:51.575 08:43:40 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:51.575 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:51.575 08:43:40 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:51.575 08:43:40 -- common/autotest_common.sh@10 -- # set +x 00:04:51.832 08:43:40 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:51.832 08:43:40 -- common/autotest_common.sh@852 -- # return 0 00:04:51.832 08:43:40 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:52.091 Malloc0 00:04:52.091 08:43:40 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:52.350 Malloc1 00:04:52.350 08:43:40 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:52.350 08:43:40 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:52.350 08:43:40 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:52.350 08:43:40 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:52.350 08:43:40 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:52.350 08:43:40 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:52.350 08:43:40 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:52.350 08:43:40 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:52.350 08:43:40 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:52.350 08:43:40 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:52.350 08:43:40 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:52.350 08:43:40 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:52.350 08:43:40 -- bdev/nbd_common.sh@12 -- # local i 00:04:52.350 08:43:40 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:52.350 08:43:40 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:52.350 08:43:40 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:52.609 /dev/nbd0 00:04:52.609 08:43:41 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:52.609 08:43:41 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:52.609 08:43:41 -- common/autotest_common.sh@856 -- # local nbd_name=nbd0 00:04:52.609 08:43:41 -- common/autotest_common.sh@857 -- # local i 00:04:52.609 08:43:41 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:04:52.609 08:43:41 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:04:52.609 08:43:41 -- common/autotest_common.sh@860 -- # grep -q -w nbd0 /proc/partitions 00:04:52.609 08:43:41 -- common/autotest_common.sh@861 -- # break 00:04:52.609 08:43:41 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:04:52.609 08:43:41 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:04:52.609 08:43:41 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:52.609 1+0 records in 00:04:52.609 1+0 records out 00:04:52.609 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000207864 s, 19.7 MB/s 00:04:52.609 08:43:41 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:52.609 08:43:41 -- common/autotest_common.sh@874 -- # size=4096 00:04:52.609 08:43:41 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:52.609 08:43:41 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:04:52.609 08:43:41 -- common/autotest_common.sh@877 -- # return 0 00:04:52.609 08:43:41 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:52.609 08:43:41 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:52.609 08:43:41 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:52.867 /dev/nbd1 00:04:52.867 08:43:41 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:52.867 08:43:41 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:52.867 08:43:41 -- common/autotest_common.sh@856 -- # local nbd_name=nbd1 00:04:52.867 08:43:41 -- common/autotest_common.sh@857 -- # local i 00:04:52.867 08:43:41 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:04:52.867 08:43:41 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:04:52.867 08:43:41 -- common/autotest_common.sh@860 -- # grep -q -w nbd1 /proc/partitions 00:04:52.867 08:43:41 -- common/autotest_common.sh@861 -- # break 00:04:52.867 08:43:41 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:04:52.867 08:43:41 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:04:52.867 08:43:41 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:52.867 1+0 records in 00:04:52.867 1+0 records out 00:04:52.867 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000212428 s, 19.3 MB/s 00:04:52.867 08:43:41 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:52.867 08:43:41 -- common/autotest_common.sh@874 -- # size=4096 00:04:52.867 08:43:41 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:52.867 08:43:41 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:04:52.867 08:43:41 -- common/autotest_common.sh@877 -- # return 0 00:04:52.867 08:43:41 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:52.867 08:43:41 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:52.867 08:43:41 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:52.867 08:43:41 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:52.867 08:43:41 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:53.125 08:43:41 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:53.125 { 00:04:53.125 "nbd_device": "/dev/nbd0", 00:04:53.125 "bdev_name": "Malloc0" 00:04:53.125 }, 00:04:53.125 { 00:04:53.125 "nbd_device": "/dev/nbd1", 00:04:53.125 "bdev_name": "Malloc1" 00:04:53.125 } 00:04:53.125 ]' 00:04:53.125 08:43:41 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:53.125 { 00:04:53.125 "nbd_device": "/dev/nbd0", 00:04:53.125 "bdev_name": "Malloc0" 00:04:53.125 }, 00:04:53.125 { 00:04:53.125 "nbd_device": "/dev/nbd1", 00:04:53.125 "bdev_name": "Malloc1" 00:04:53.125 } 00:04:53.125 ]' 00:04:53.125 08:43:41 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:53.125 08:43:41 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:53.125 /dev/nbd1' 00:04:53.125 08:43:41 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:53.125 /dev/nbd1' 00:04:53.125 08:43:41 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:53.125 08:43:41 -- bdev/nbd_common.sh@65 -- # count=2 00:04:53.125 08:43:41 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:53.125 08:43:41 -- bdev/nbd_common.sh@95 -- # count=2 00:04:53.125 08:43:41 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:53.125 08:43:41 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:53.125 08:43:41 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:53.125 08:43:41 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:53.125 08:43:41 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:53.125 08:43:41 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:53.125 08:43:41 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:53.125 08:43:41 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:53.125 256+0 records in 00:04:53.125 256+0 records out 00:04:53.125 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00502367 s, 209 MB/s 00:04:53.125 08:43:41 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:53.125 08:43:41 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:53.383 256+0 records in 00:04:53.383 256+0 records out 00:04:53.383 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242243 s, 43.3 MB/s 00:04:53.383 08:43:41 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:53.383 08:43:41 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:53.383 256+0 records in 00:04:53.383 256+0 records out 00:04:53.383 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257313 s, 40.8 MB/s 00:04:53.383 08:43:41 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:53.383 08:43:41 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:53.383 08:43:41 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:53.383 08:43:41 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:53.384 08:43:41 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:53.384 08:43:41 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:53.384 08:43:41 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:53.384 08:43:41 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:53.384 08:43:41 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:53.384 08:43:41 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:53.384 08:43:41 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:53.384 08:43:41 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:53.384 08:43:41 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:53.384 08:43:41 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:53.384 08:43:41 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:53.384 08:43:41 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:53.384 08:43:41 -- bdev/nbd_common.sh@51 -- # local i 00:04:53.384 08:43:41 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:53.384 08:43:41 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:53.642 08:43:41 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:53.642 08:43:41 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:53.642 08:43:41 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:53.642 08:43:41 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:53.642 08:43:41 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:53.642 08:43:41 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:53.642 08:43:41 -- bdev/nbd_common.sh@41 -- # break 00:04:53.642 08:43:41 -- bdev/nbd_common.sh@45 -- # return 0 00:04:53.642 08:43:41 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:53.642 08:43:41 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:53.900 08:43:42 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:53.900 08:43:42 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:53.900 08:43:42 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:53.900 08:43:42 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:53.900 08:43:42 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:53.900 08:43:42 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:53.900 08:43:42 -- bdev/nbd_common.sh@41 -- # break 00:04:53.900 08:43:42 -- bdev/nbd_common.sh@45 -- # return 0 00:04:53.900 08:43:42 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:53.900 08:43:42 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:53.900 08:43:42 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:54.158 08:43:42 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:54.158 08:43:42 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:54.158 08:43:42 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:54.158 08:43:42 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:54.158 08:43:42 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:54.158 08:43:42 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:54.158 08:43:42 -- bdev/nbd_common.sh@65 -- # true 00:04:54.158 08:43:42 -- bdev/nbd_common.sh@65 -- # count=0 00:04:54.158 08:43:42 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:54.158 08:43:42 -- bdev/nbd_common.sh@104 -- # count=0 00:04:54.158 08:43:42 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:54.158 08:43:42 -- bdev/nbd_common.sh@109 -- # return 0 00:04:54.158 08:43:42 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:54.415 08:43:42 -- event/event.sh@35 -- # sleep 3 00:04:54.673 [2024-07-15 08:43:43.058523] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:54.673 [2024-07-15 08:43:43.171163] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:54.673 [2024-07-15 08:43:43.171170] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:54.931 [2024-07-15 08:43:43.232473] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:54.931 [2024-07-15 08:43:43.232544] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:57.455 08:43:45 -- event/event.sh@38 -- # waitforlisten 1381483 /var/tmp/spdk-nbd.sock 00:04:57.455 08:43:45 -- common/autotest_common.sh@819 -- # '[' -z 1381483 ']' 00:04:57.455 08:43:45 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:57.455 08:43:45 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:57.455 08:43:45 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:57.455 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:57.455 08:43:45 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:57.455 08:43:45 -- common/autotest_common.sh@10 -- # set +x 00:04:57.713 08:43:46 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:57.713 08:43:46 -- common/autotest_common.sh@852 -- # return 0 00:04:57.713 08:43:46 -- event/event.sh@39 -- # killprocess 1381483 00:04:57.713 08:43:46 -- common/autotest_common.sh@926 -- # '[' -z 1381483 ']' 00:04:57.713 08:43:46 -- common/autotest_common.sh@930 -- # kill -0 1381483 00:04:57.713 08:43:46 -- common/autotest_common.sh@931 -- # uname 00:04:57.713 08:43:46 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:57.713 08:43:46 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1381483 00:04:57.713 08:43:46 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:57.713 08:43:46 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:57.713 08:43:46 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1381483' 00:04:57.713 killing process with pid 1381483 00:04:57.713 08:43:46 -- common/autotest_common.sh@945 -- # kill 1381483 00:04:57.713 08:43:46 -- common/autotest_common.sh@950 -- # wait 1381483 00:04:57.971 spdk_app_start is called in Round 0. 00:04:57.971 Shutdown signal received, stop current app iteration 00:04:57.971 Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 reinitialization... 00:04:57.971 spdk_app_start is called in Round 1. 00:04:57.971 Shutdown signal received, stop current app iteration 00:04:57.971 Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 reinitialization... 00:04:57.971 spdk_app_start is called in Round 2. 00:04:57.971 Shutdown signal received, stop current app iteration 00:04:57.971 Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 reinitialization... 00:04:57.971 spdk_app_start is called in Round 3. 00:04:57.971 Shutdown signal received, stop current app iteration 00:04:57.971 08:43:46 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:04:57.971 08:43:46 -- event/event.sh@42 -- # return 0 00:04:57.971 00:04:57.971 real 0m18.477s 00:04:57.971 user 0m40.006s 00:04:57.971 sys 0m3.141s 00:04:57.971 08:43:46 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:57.971 08:43:46 -- common/autotest_common.sh@10 -- # set +x 00:04:57.971 ************************************ 00:04:57.971 END TEST app_repeat 00:04:57.971 ************************************ 00:04:57.971 08:43:46 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:04:57.971 08:43:46 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:04:57.971 08:43:46 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:57.971 08:43:46 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:57.971 08:43:46 -- common/autotest_common.sh@10 -- # set +x 00:04:57.971 ************************************ 00:04:57.971 START TEST cpu_locks 00:04:57.971 ************************************ 00:04:57.971 08:43:46 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:04:57.971 * Looking for test storage... 00:04:57.971 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:04:57.971 08:43:46 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:04:57.971 08:43:46 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:04:57.971 08:43:46 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:04:57.971 08:43:46 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:04:57.971 08:43:46 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:57.971 08:43:46 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:57.971 08:43:46 -- common/autotest_common.sh@10 -- # set +x 00:04:57.971 ************************************ 00:04:57.971 START TEST default_locks 00:04:57.971 ************************************ 00:04:57.971 08:43:46 -- common/autotest_common.sh@1104 -- # default_locks 00:04:57.971 08:43:46 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=1384024 00:04:57.971 08:43:46 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:57.971 08:43:46 -- event/cpu_locks.sh@47 -- # waitforlisten 1384024 00:04:57.971 08:43:46 -- common/autotest_common.sh@819 -- # '[' -z 1384024 ']' 00:04:57.971 08:43:46 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:57.971 08:43:46 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:57.971 08:43:46 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:57.971 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:57.971 08:43:46 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:57.971 08:43:46 -- common/autotest_common.sh@10 -- # set +x 00:04:57.971 [2024-07-15 08:43:46.441079] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:04:57.971 [2024-07-15 08:43:46.441185] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1384024 ] 00:04:57.971 EAL: No free 2048 kB hugepages reported on node 1 00:04:57.971 [2024-07-15 08:43:46.509872] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:58.230 [2024-07-15 08:43:46.624332] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:58.230 [2024-07-15 08:43:46.624510] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:59.163 08:43:47 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:59.163 08:43:47 -- common/autotest_common.sh@852 -- # return 0 00:04:59.163 08:43:47 -- event/cpu_locks.sh@49 -- # locks_exist 1384024 00:04:59.163 08:43:47 -- event/cpu_locks.sh@22 -- # lslocks -p 1384024 00:04:59.163 08:43:47 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:04:59.163 lslocks: write error 00:04:59.163 08:43:47 -- event/cpu_locks.sh@50 -- # killprocess 1384024 00:04:59.163 08:43:47 -- common/autotest_common.sh@926 -- # '[' -z 1384024 ']' 00:04:59.164 08:43:47 -- common/autotest_common.sh@930 -- # kill -0 1384024 00:04:59.164 08:43:47 -- common/autotest_common.sh@931 -- # uname 00:04:59.164 08:43:47 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:59.164 08:43:47 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1384024 00:04:59.422 08:43:47 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:59.422 08:43:47 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:59.422 08:43:47 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1384024' 00:04:59.422 killing process with pid 1384024 00:04:59.422 08:43:47 -- common/autotest_common.sh@945 -- # kill 1384024 00:04:59.422 08:43:47 -- common/autotest_common.sh@950 -- # wait 1384024 00:04:59.766 08:43:48 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 1384024 00:04:59.766 08:43:48 -- common/autotest_common.sh@640 -- # local es=0 00:04:59.766 08:43:48 -- common/autotest_common.sh@642 -- # valid_exec_arg waitforlisten 1384024 00:04:59.766 08:43:48 -- common/autotest_common.sh@628 -- # local arg=waitforlisten 00:04:59.766 08:43:48 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:04:59.766 08:43:48 -- common/autotest_common.sh@632 -- # type -t waitforlisten 00:04:59.766 08:43:48 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:04:59.766 08:43:48 -- common/autotest_common.sh@643 -- # waitforlisten 1384024 00:04:59.766 08:43:48 -- common/autotest_common.sh@819 -- # '[' -z 1384024 ']' 00:04:59.766 08:43:48 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:59.766 08:43:48 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:59.766 08:43:48 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:59.766 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:59.766 08:43:48 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:59.766 08:43:48 -- common/autotest_common.sh@10 -- # set +x 00:04:59.766 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 834: kill: (1384024) - No such process 00:04:59.766 ERROR: process (pid: 1384024) is no longer running 00:04:59.766 08:43:48 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:59.766 08:43:48 -- common/autotest_common.sh@852 -- # return 1 00:04:59.766 08:43:48 -- common/autotest_common.sh@643 -- # es=1 00:04:59.766 08:43:48 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:04:59.766 08:43:48 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:04:59.766 08:43:48 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:04:59.766 08:43:48 -- event/cpu_locks.sh@54 -- # no_locks 00:04:59.766 08:43:48 -- event/cpu_locks.sh@26 -- # lock_files=() 00:04:59.766 08:43:48 -- event/cpu_locks.sh@26 -- # local lock_files 00:04:59.766 08:43:48 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:04:59.766 00:04:59.766 real 0m1.788s 00:04:59.766 user 0m1.894s 00:04:59.766 sys 0m0.561s 00:04:59.766 08:43:48 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:59.766 08:43:48 -- common/autotest_common.sh@10 -- # set +x 00:04:59.766 ************************************ 00:04:59.766 END TEST default_locks 00:04:59.766 ************************************ 00:04:59.766 08:43:48 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:04:59.766 08:43:48 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:59.766 08:43:48 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:59.766 08:43:48 -- common/autotest_common.sh@10 -- # set +x 00:04:59.766 ************************************ 00:04:59.766 START TEST default_locks_via_rpc 00:04:59.766 ************************************ 00:04:59.766 08:43:48 -- common/autotest_common.sh@1104 -- # default_locks_via_rpc 00:04:59.766 08:43:48 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=1384294 00:04:59.766 08:43:48 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:59.766 08:43:48 -- event/cpu_locks.sh@63 -- # waitforlisten 1384294 00:04:59.766 08:43:48 -- common/autotest_common.sh@819 -- # '[' -z 1384294 ']' 00:04:59.766 08:43:48 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:59.766 08:43:48 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:59.766 08:43:48 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:59.766 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:59.766 08:43:48 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:59.766 08:43:48 -- common/autotest_common.sh@10 -- # set +x 00:04:59.766 [2024-07-15 08:43:48.257446] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:04:59.766 [2024-07-15 08:43:48.257531] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1384294 ] 00:04:59.766 EAL: No free 2048 kB hugepages reported on node 1 00:05:00.024 [2024-07-15 08:43:48.320263] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:00.024 [2024-07-15 08:43:48.429774] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:00.024 [2024-07-15 08:43:48.429957] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:00.958 08:43:49 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:00.958 08:43:49 -- common/autotest_common.sh@852 -- # return 0 00:05:00.958 08:43:49 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:05:00.958 08:43:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:00.958 08:43:49 -- common/autotest_common.sh@10 -- # set +x 00:05:00.958 08:43:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:00.958 08:43:49 -- event/cpu_locks.sh@67 -- # no_locks 00:05:00.958 08:43:49 -- event/cpu_locks.sh@26 -- # lock_files=() 00:05:00.958 08:43:49 -- event/cpu_locks.sh@26 -- # local lock_files 00:05:00.958 08:43:49 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:05:00.958 08:43:49 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:05:00.958 08:43:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:00.958 08:43:49 -- common/autotest_common.sh@10 -- # set +x 00:05:00.958 08:43:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:00.958 08:43:49 -- event/cpu_locks.sh@71 -- # locks_exist 1384294 00:05:00.958 08:43:49 -- event/cpu_locks.sh@22 -- # lslocks -p 1384294 00:05:00.958 08:43:49 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:01.215 08:43:49 -- event/cpu_locks.sh@73 -- # killprocess 1384294 00:05:01.215 08:43:49 -- common/autotest_common.sh@926 -- # '[' -z 1384294 ']' 00:05:01.215 08:43:49 -- common/autotest_common.sh@930 -- # kill -0 1384294 00:05:01.215 08:43:49 -- common/autotest_common.sh@931 -- # uname 00:05:01.215 08:43:49 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:01.215 08:43:49 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1384294 00:05:01.215 08:43:49 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:01.215 08:43:49 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:01.215 08:43:49 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1384294' 00:05:01.215 killing process with pid 1384294 00:05:01.215 08:43:49 -- common/autotest_common.sh@945 -- # kill 1384294 00:05:01.215 08:43:49 -- common/autotest_common.sh@950 -- # wait 1384294 00:05:01.473 00:05:01.473 real 0m1.770s 00:05:01.473 user 0m1.904s 00:05:01.473 sys 0m0.582s 00:05:01.473 08:43:49 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:01.473 08:43:49 -- common/autotest_common.sh@10 -- # set +x 00:05:01.473 ************************************ 00:05:01.473 END TEST default_locks_via_rpc 00:05:01.473 ************************************ 00:05:01.473 08:43:50 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:05:01.473 08:43:50 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:01.473 08:43:50 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:01.473 08:43:50 -- common/autotest_common.sh@10 -- # set +x 00:05:01.473 ************************************ 00:05:01.473 START TEST non_locking_app_on_locked_coremask 00:05:01.473 ************************************ 00:05:01.473 08:43:50 -- common/autotest_common.sh@1104 -- # non_locking_app_on_locked_coremask 00:05:01.473 08:43:50 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=1384499 00:05:01.473 08:43:50 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:01.473 08:43:50 -- event/cpu_locks.sh@81 -- # waitforlisten 1384499 /var/tmp/spdk.sock 00:05:01.473 08:43:50 -- common/autotest_common.sh@819 -- # '[' -z 1384499 ']' 00:05:01.473 08:43:50 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:01.473 08:43:50 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:01.473 08:43:50 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:01.473 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:01.473 08:43:50 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:01.473 08:43:50 -- common/autotest_common.sh@10 -- # set +x 00:05:01.731 [2024-07-15 08:43:50.052474] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:01.731 [2024-07-15 08:43:50.052571] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1384499 ] 00:05:01.731 EAL: No free 2048 kB hugepages reported on node 1 00:05:01.731 [2024-07-15 08:43:50.112124] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:01.731 [2024-07-15 08:43:50.220556] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:01.731 [2024-07-15 08:43:50.220713] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:02.663 08:43:50 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:02.663 08:43:50 -- common/autotest_common.sh@852 -- # return 0 00:05:02.663 08:43:50 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=1384636 00:05:02.663 08:43:50 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:05:02.663 08:43:50 -- event/cpu_locks.sh@85 -- # waitforlisten 1384636 /var/tmp/spdk2.sock 00:05:02.663 08:43:50 -- common/autotest_common.sh@819 -- # '[' -z 1384636 ']' 00:05:02.663 08:43:50 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:02.663 08:43:50 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:02.663 08:43:50 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:02.663 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:02.663 08:43:50 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:02.663 08:43:50 -- common/autotest_common.sh@10 -- # set +x 00:05:02.663 [2024-07-15 08:43:51.036661] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:02.663 [2024-07-15 08:43:51.036758] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1384636 ] 00:05:02.663 EAL: No free 2048 kB hugepages reported on node 1 00:05:02.663 [2024-07-15 08:43:51.136175] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:02.663 [2024-07-15 08:43:51.136217] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:02.922 [2024-07-15 08:43:51.367688] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:02.922 [2024-07-15 08:43:51.367888] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:03.488 08:43:51 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:03.488 08:43:51 -- common/autotest_common.sh@852 -- # return 0 00:05:03.488 08:43:51 -- event/cpu_locks.sh@87 -- # locks_exist 1384499 00:05:03.488 08:43:51 -- event/cpu_locks.sh@22 -- # lslocks -p 1384499 00:05:03.488 08:43:51 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:04.054 lslocks: write error 00:05:04.054 08:43:52 -- event/cpu_locks.sh@89 -- # killprocess 1384499 00:05:04.054 08:43:52 -- common/autotest_common.sh@926 -- # '[' -z 1384499 ']' 00:05:04.054 08:43:52 -- common/autotest_common.sh@930 -- # kill -0 1384499 00:05:04.054 08:43:52 -- common/autotest_common.sh@931 -- # uname 00:05:04.054 08:43:52 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:04.054 08:43:52 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1384499 00:05:04.054 08:43:52 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:04.054 08:43:52 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:04.054 08:43:52 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1384499' 00:05:04.054 killing process with pid 1384499 00:05:04.054 08:43:52 -- common/autotest_common.sh@945 -- # kill 1384499 00:05:04.054 08:43:52 -- common/autotest_common.sh@950 -- # wait 1384499 00:05:04.985 08:43:53 -- event/cpu_locks.sh@90 -- # killprocess 1384636 00:05:04.985 08:43:53 -- common/autotest_common.sh@926 -- # '[' -z 1384636 ']' 00:05:04.985 08:43:53 -- common/autotest_common.sh@930 -- # kill -0 1384636 00:05:04.985 08:43:53 -- common/autotest_common.sh@931 -- # uname 00:05:04.985 08:43:53 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:04.985 08:43:53 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1384636 00:05:04.985 08:43:53 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:04.985 08:43:53 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:04.985 08:43:53 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1384636' 00:05:04.985 killing process with pid 1384636 00:05:04.985 08:43:53 -- common/autotest_common.sh@945 -- # kill 1384636 00:05:04.985 08:43:53 -- common/autotest_common.sh@950 -- # wait 1384636 00:05:05.550 00:05:05.550 real 0m3.819s 00:05:05.550 user 0m4.153s 00:05:05.550 sys 0m1.044s 00:05:05.550 08:43:53 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:05.550 08:43:53 -- common/autotest_common.sh@10 -- # set +x 00:05:05.550 ************************************ 00:05:05.550 END TEST non_locking_app_on_locked_coremask 00:05:05.550 ************************************ 00:05:05.550 08:43:53 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:05:05.550 08:43:53 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:05.550 08:43:53 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:05.550 08:43:53 -- common/autotest_common.sh@10 -- # set +x 00:05:05.550 ************************************ 00:05:05.550 START TEST locking_app_on_unlocked_coremask 00:05:05.550 ************************************ 00:05:05.550 08:43:53 -- common/autotest_common.sh@1104 -- # locking_app_on_unlocked_coremask 00:05:05.550 08:43:53 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=1385018 00:05:05.550 08:43:53 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:05:05.550 08:43:53 -- event/cpu_locks.sh@99 -- # waitforlisten 1385018 /var/tmp/spdk.sock 00:05:05.550 08:43:53 -- common/autotest_common.sh@819 -- # '[' -z 1385018 ']' 00:05:05.550 08:43:53 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:05.550 08:43:53 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:05.550 08:43:53 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:05.550 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:05.550 08:43:53 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:05.550 08:43:53 -- common/autotest_common.sh@10 -- # set +x 00:05:05.550 [2024-07-15 08:43:53.902474] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:05.550 [2024-07-15 08:43:53.902572] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1385018 ] 00:05:05.550 EAL: No free 2048 kB hugepages reported on node 1 00:05:05.550 [2024-07-15 08:43:53.960610] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:05.550 [2024-07-15 08:43:53.960635] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:05.550 [2024-07-15 08:43:54.072583] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:05.550 [2024-07-15 08:43:54.072764] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:06.483 08:43:54 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:06.483 08:43:54 -- common/autotest_common.sh@852 -- # return 0 00:05:06.483 08:43:54 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=1385087 00:05:06.483 08:43:54 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:06.483 08:43:54 -- event/cpu_locks.sh@103 -- # waitforlisten 1385087 /var/tmp/spdk2.sock 00:05:06.483 08:43:54 -- common/autotest_common.sh@819 -- # '[' -z 1385087 ']' 00:05:06.483 08:43:54 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:06.483 08:43:54 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:06.483 08:43:54 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:06.483 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:06.483 08:43:54 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:06.483 08:43:54 -- common/autotest_common.sh@10 -- # set +x 00:05:06.483 [2024-07-15 08:43:54.866222] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:06.483 [2024-07-15 08:43:54.866293] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1385087 ] 00:05:06.483 EAL: No free 2048 kB hugepages reported on node 1 00:05:06.483 [2024-07-15 08:43:54.958562] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:06.742 [2024-07-15 08:43:55.194888] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:06.742 [2024-07-15 08:43:55.195071] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:07.308 08:43:55 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:07.308 08:43:55 -- common/autotest_common.sh@852 -- # return 0 00:05:07.308 08:43:55 -- event/cpu_locks.sh@105 -- # locks_exist 1385087 00:05:07.308 08:43:55 -- event/cpu_locks.sh@22 -- # lslocks -p 1385087 00:05:07.308 08:43:55 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:07.873 lslocks: write error 00:05:07.873 08:43:56 -- event/cpu_locks.sh@107 -- # killprocess 1385018 00:05:07.873 08:43:56 -- common/autotest_common.sh@926 -- # '[' -z 1385018 ']' 00:05:07.873 08:43:56 -- common/autotest_common.sh@930 -- # kill -0 1385018 00:05:07.873 08:43:56 -- common/autotest_common.sh@931 -- # uname 00:05:07.873 08:43:56 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:07.873 08:43:56 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1385018 00:05:07.873 08:43:56 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:07.873 08:43:56 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:07.873 08:43:56 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1385018' 00:05:07.874 killing process with pid 1385018 00:05:07.874 08:43:56 -- common/autotest_common.sh@945 -- # kill 1385018 00:05:07.874 08:43:56 -- common/autotest_common.sh@950 -- # wait 1385018 00:05:08.806 08:43:57 -- event/cpu_locks.sh@108 -- # killprocess 1385087 00:05:08.806 08:43:57 -- common/autotest_common.sh@926 -- # '[' -z 1385087 ']' 00:05:08.806 08:43:57 -- common/autotest_common.sh@930 -- # kill -0 1385087 00:05:08.806 08:43:57 -- common/autotest_common.sh@931 -- # uname 00:05:08.806 08:43:57 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:08.806 08:43:57 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1385087 00:05:08.806 08:43:57 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:08.806 08:43:57 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:08.806 08:43:57 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1385087' 00:05:08.806 killing process with pid 1385087 00:05:08.806 08:43:57 -- common/autotest_common.sh@945 -- # kill 1385087 00:05:08.806 08:43:57 -- common/autotest_common.sh@950 -- # wait 1385087 00:05:09.371 00:05:09.371 real 0m3.936s 00:05:09.371 user 0m4.248s 00:05:09.371 sys 0m1.130s 00:05:09.371 08:43:57 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:09.371 08:43:57 -- common/autotest_common.sh@10 -- # set +x 00:05:09.371 ************************************ 00:05:09.371 END TEST locking_app_on_unlocked_coremask 00:05:09.371 ************************************ 00:05:09.371 08:43:57 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:05:09.371 08:43:57 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:09.371 08:43:57 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:09.371 08:43:57 -- common/autotest_common.sh@10 -- # set +x 00:05:09.371 ************************************ 00:05:09.371 START TEST locking_app_on_locked_coremask 00:05:09.371 ************************************ 00:05:09.371 08:43:57 -- common/autotest_common.sh@1104 -- # locking_app_on_locked_coremask 00:05:09.371 08:43:57 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=1385523 00:05:09.371 08:43:57 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:09.371 08:43:57 -- event/cpu_locks.sh@116 -- # waitforlisten 1385523 /var/tmp/spdk.sock 00:05:09.371 08:43:57 -- common/autotest_common.sh@819 -- # '[' -z 1385523 ']' 00:05:09.371 08:43:57 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:09.371 08:43:57 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:09.371 08:43:57 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:09.371 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:09.371 08:43:57 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:09.371 08:43:57 -- common/autotest_common.sh@10 -- # set +x 00:05:09.371 [2024-07-15 08:43:57.862622] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:09.371 [2024-07-15 08:43:57.862717] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1385523 ] 00:05:09.371 EAL: No free 2048 kB hugepages reported on node 1 00:05:09.630 [2024-07-15 08:43:57.924738] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:09.630 [2024-07-15 08:43:58.039095] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:09.630 [2024-07-15 08:43:58.039296] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:10.562 08:43:58 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:10.562 08:43:58 -- common/autotest_common.sh@852 -- # return 0 00:05:10.562 08:43:58 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=1385663 00:05:10.562 08:43:58 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:10.562 08:43:58 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 1385663 /var/tmp/spdk2.sock 00:05:10.562 08:43:58 -- common/autotest_common.sh@640 -- # local es=0 00:05:10.562 08:43:58 -- common/autotest_common.sh@642 -- # valid_exec_arg waitforlisten 1385663 /var/tmp/spdk2.sock 00:05:10.562 08:43:58 -- common/autotest_common.sh@628 -- # local arg=waitforlisten 00:05:10.562 08:43:58 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:10.562 08:43:58 -- common/autotest_common.sh@632 -- # type -t waitforlisten 00:05:10.562 08:43:58 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:10.562 08:43:58 -- common/autotest_common.sh@643 -- # waitforlisten 1385663 /var/tmp/spdk2.sock 00:05:10.562 08:43:58 -- common/autotest_common.sh@819 -- # '[' -z 1385663 ']' 00:05:10.562 08:43:58 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:10.562 08:43:58 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:10.562 08:43:58 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:10.562 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:10.562 08:43:58 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:10.562 08:43:58 -- common/autotest_common.sh@10 -- # set +x 00:05:10.562 [2024-07-15 08:43:58.831351] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:10.562 [2024-07-15 08:43:58.831445] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1385663 ] 00:05:10.562 EAL: No free 2048 kB hugepages reported on node 1 00:05:10.562 [2024-07-15 08:43:58.929981] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 1385523 has claimed it. 00:05:10.562 [2024-07-15 08:43:58.930046] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:11.127 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 834: kill: (1385663) - No such process 00:05:11.127 ERROR: process (pid: 1385663) is no longer running 00:05:11.127 08:43:59 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:11.127 08:43:59 -- common/autotest_common.sh@852 -- # return 1 00:05:11.127 08:43:59 -- common/autotest_common.sh@643 -- # es=1 00:05:11.127 08:43:59 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:05:11.127 08:43:59 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:05:11.127 08:43:59 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:05:11.127 08:43:59 -- event/cpu_locks.sh@122 -- # locks_exist 1385523 00:05:11.127 08:43:59 -- event/cpu_locks.sh@22 -- # lslocks -p 1385523 00:05:11.127 08:43:59 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:11.385 lslocks: write error 00:05:11.385 08:43:59 -- event/cpu_locks.sh@124 -- # killprocess 1385523 00:05:11.385 08:43:59 -- common/autotest_common.sh@926 -- # '[' -z 1385523 ']' 00:05:11.385 08:43:59 -- common/autotest_common.sh@930 -- # kill -0 1385523 00:05:11.385 08:43:59 -- common/autotest_common.sh@931 -- # uname 00:05:11.385 08:43:59 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:11.385 08:43:59 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1385523 00:05:11.385 08:43:59 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:11.385 08:43:59 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:11.385 08:43:59 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1385523' 00:05:11.385 killing process with pid 1385523 00:05:11.385 08:43:59 -- common/autotest_common.sh@945 -- # kill 1385523 00:05:11.385 08:43:59 -- common/autotest_common.sh@950 -- # wait 1385523 00:05:11.950 00:05:11.950 real 0m2.391s 00:05:11.950 user 0m2.701s 00:05:11.950 sys 0m0.623s 00:05:11.950 08:44:00 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:11.950 08:44:00 -- common/autotest_common.sh@10 -- # set +x 00:05:11.950 ************************************ 00:05:11.950 END TEST locking_app_on_locked_coremask 00:05:11.950 ************************************ 00:05:11.950 08:44:00 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:05:11.950 08:44:00 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:11.950 08:44:00 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:11.950 08:44:00 -- common/autotest_common.sh@10 -- # set +x 00:05:11.950 ************************************ 00:05:11.950 START TEST locking_overlapped_coremask 00:05:11.950 ************************************ 00:05:11.950 08:44:00 -- common/autotest_common.sh@1104 -- # locking_overlapped_coremask 00:05:11.950 08:44:00 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=1385837 00:05:11.950 08:44:00 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:05:11.950 08:44:00 -- event/cpu_locks.sh@133 -- # waitforlisten 1385837 /var/tmp/spdk.sock 00:05:11.950 08:44:00 -- common/autotest_common.sh@819 -- # '[' -z 1385837 ']' 00:05:11.950 08:44:00 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:11.950 08:44:00 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:11.950 08:44:00 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:11.950 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:11.950 08:44:00 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:11.950 08:44:00 -- common/autotest_common.sh@10 -- # set +x 00:05:11.950 [2024-07-15 08:44:00.279478] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:11.950 [2024-07-15 08:44:00.279565] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1385837 ] 00:05:11.950 EAL: No free 2048 kB hugepages reported on node 1 00:05:11.950 [2024-07-15 08:44:00.337931] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:11.950 [2024-07-15 08:44:00.447854] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:11.950 [2024-07-15 08:44:00.448068] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:11.950 [2024-07-15 08:44:00.448125] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:11.950 [2024-07-15 08:44:00.448128] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:12.883 08:44:01 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:12.883 08:44:01 -- common/autotest_common.sh@852 -- # return 0 00:05:12.883 08:44:01 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=1385977 00:05:12.883 08:44:01 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 1385977 /var/tmp/spdk2.sock 00:05:12.883 08:44:01 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:05:12.883 08:44:01 -- common/autotest_common.sh@640 -- # local es=0 00:05:12.883 08:44:01 -- common/autotest_common.sh@642 -- # valid_exec_arg waitforlisten 1385977 /var/tmp/spdk2.sock 00:05:12.883 08:44:01 -- common/autotest_common.sh@628 -- # local arg=waitforlisten 00:05:12.883 08:44:01 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:12.883 08:44:01 -- common/autotest_common.sh@632 -- # type -t waitforlisten 00:05:12.883 08:44:01 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:12.883 08:44:01 -- common/autotest_common.sh@643 -- # waitforlisten 1385977 /var/tmp/spdk2.sock 00:05:12.883 08:44:01 -- common/autotest_common.sh@819 -- # '[' -z 1385977 ']' 00:05:12.883 08:44:01 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:12.884 08:44:01 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:12.884 08:44:01 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:12.884 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:12.884 08:44:01 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:12.884 08:44:01 -- common/autotest_common.sh@10 -- # set +x 00:05:12.884 [2024-07-15 08:44:01.253556] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:12.884 [2024-07-15 08:44:01.253647] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1385977 ] 00:05:12.884 EAL: No free 2048 kB hugepages reported on node 1 00:05:12.884 [2024-07-15 08:44:01.343031] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 1385837 has claimed it. 00:05:12.884 [2024-07-15 08:44:01.343093] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:13.448 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 834: kill: (1385977) - No such process 00:05:13.448 ERROR: process (pid: 1385977) is no longer running 00:05:13.448 08:44:01 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:13.448 08:44:01 -- common/autotest_common.sh@852 -- # return 1 00:05:13.448 08:44:01 -- common/autotest_common.sh@643 -- # es=1 00:05:13.448 08:44:01 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:05:13.448 08:44:01 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:05:13.448 08:44:01 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:05:13.448 08:44:01 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:05:13.448 08:44:01 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:13.448 08:44:01 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:13.448 08:44:01 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:13.448 08:44:01 -- event/cpu_locks.sh@141 -- # killprocess 1385837 00:05:13.448 08:44:01 -- common/autotest_common.sh@926 -- # '[' -z 1385837 ']' 00:05:13.448 08:44:01 -- common/autotest_common.sh@930 -- # kill -0 1385837 00:05:13.448 08:44:01 -- common/autotest_common.sh@931 -- # uname 00:05:13.448 08:44:01 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:13.448 08:44:01 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1385837 00:05:13.448 08:44:01 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:13.448 08:44:01 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:13.448 08:44:01 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1385837' 00:05:13.448 killing process with pid 1385837 00:05:13.448 08:44:01 -- common/autotest_common.sh@945 -- # kill 1385837 00:05:13.448 08:44:01 -- common/autotest_common.sh@950 -- # wait 1385837 00:05:14.013 00:05:14.013 real 0m2.202s 00:05:14.013 user 0m6.197s 00:05:14.013 sys 0m0.473s 00:05:14.013 08:44:02 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:14.013 08:44:02 -- common/autotest_common.sh@10 -- # set +x 00:05:14.013 ************************************ 00:05:14.013 END TEST locking_overlapped_coremask 00:05:14.013 ************************************ 00:05:14.013 08:44:02 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:05:14.013 08:44:02 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:14.013 08:44:02 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:14.013 08:44:02 -- common/autotest_common.sh@10 -- # set +x 00:05:14.013 ************************************ 00:05:14.013 START TEST locking_overlapped_coremask_via_rpc 00:05:14.013 ************************************ 00:05:14.013 08:44:02 -- common/autotest_common.sh@1104 -- # locking_overlapped_coremask_via_rpc 00:05:14.013 08:44:02 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=1386143 00:05:14.013 08:44:02 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:05:14.013 08:44:02 -- event/cpu_locks.sh@149 -- # waitforlisten 1386143 /var/tmp/spdk.sock 00:05:14.013 08:44:02 -- common/autotest_common.sh@819 -- # '[' -z 1386143 ']' 00:05:14.013 08:44:02 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:14.013 08:44:02 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:14.013 08:44:02 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:14.013 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:14.013 08:44:02 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:14.013 08:44:02 -- common/autotest_common.sh@10 -- # set +x 00:05:14.013 [2024-07-15 08:44:02.509131] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:14.013 [2024-07-15 08:44:02.509236] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1386143 ] 00:05:14.013 EAL: No free 2048 kB hugepages reported on node 1 00:05:14.271 [2024-07-15 08:44:02.567750] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:14.271 [2024-07-15 08:44:02.567791] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:14.271 [2024-07-15 08:44:02.676317] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:14.271 [2024-07-15 08:44:02.676504] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:14.271 [2024-07-15 08:44:02.676563] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:14.271 [2024-07-15 08:44:02.676566] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:15.210 08:44:03 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:15.210 08:44:03 -- common/autotest_common.sh@852 -- # return 0 00:05:15.210 08:44:03 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=1386285 00:05:15.210 08:44:03 -- event/cpu_locks.sh@153 -- # waitforlisten 1386285 /var/tmp/spdk2.sock 00:05:15.210 08:44:03 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:05:15.210 08:44:03 -- common/autotest_common.sh@819 -- # '[' -z 1386285 ']' 00:05:15.210 08:44:03 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:15.210 08:44:03 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:15.210 08:44:03 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:15.210 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:15.210 08:44:03 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:15.210 08:44:03 -- common/autotest_common.sh@10 -- # set +x 00:05:15.210 [2024-07-15 08:44:03.487328] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:15.210 [2024-07-15 08:44:03.487421] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1386285 ] 00:05:15.210 EAL: No free 2048 kB hugepages reported on node 1 00:05:15.210 [2024-07-15 08:44:03.574350] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:15.210 [2024-07-15 08:44:03.574383] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:15.548 [2024-07-15 08:44:03.798245] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:15.548 [2024-07-15 08:44:03.798440] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:15.548 [2024-07-15 08:44:03.798502] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:05:15.548 [2024-07-15 08:44:03.798505] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:16.113 08:44:04 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:16.113 08:44:04 -- common/autotest_common.sh@852 -- # return 0 00:05:16.113 08:44:04 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:05:16.113 08:44:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:16.113 08:44:04 -- common/autotest_common.sh@10 -- # set +x 00:05:16.113 08:44:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:16.113 08:44:04 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:16.113 08:44:04 -- common/autotest_common.sh@640 -- # local es=0 00:05:16.113 08:44:04 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:16.113 08:44:04 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:05:16.113 08:44:04 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:16.113 08:44:04 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:05:16.113 08:44:04 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:16.113 08:44:04 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:16.113 08:44:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:16.113 08:44:04 -- common/autotest_common.sh@10 -- # set +x 00:05:16.113 [2024-07-15 08:44:04.426969] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 1386143 has claimed it. 00:05:16.113 request: 00:05:16.113 { 00:05:16.113 "method": "framework_enable_cpumask_locks", 00:05:16.113 "req_id": 1 00:05:16.113 } 00:05:16.113 Got JSON-RPC error response 00:05:16.113 response: 00:05:16.113 { 00:05:16.113 "code": -32603, 00:05:16.113 "message": "Failed to claim CPU core: 2" 00:05:16.113 } 00:05:16.113 08:44:04 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:05:16.113 08:44:04 -- common/autotest_common.sh@643 -- # es=1 00:05:16.113 08:44:04 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:05:16.113 08:44:04 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:05:16.113 08:44:04 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:05:16.113 08:44:04 -- event/cpu_locks.sh@158 -- # waitforlisten 1386143 /var/tmp/spdk.sock 00:05:16.113 08:44:04 -- common/autotest_common.sh@819 -- # '[' -z 1386143 ']' 00:05:16.113 08:44:04 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:16.113 08:44:04 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:16.113 08:44:04 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:16.113 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:16.113 08:44:04 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:16.113 08:44:04 -- common/autotest_common.sh@10 -- # set +x 00:05:16.370 08:44:04 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:16.370 08:44:04 -- common/autotest_common.sh@852 -- # return 0 00:05:16.370 08:44:04 -- event/cpu_locks.sh@159 -- # waitforlisten 1386285 /var/tmp/spdk2.sock 00:05:16.370 08:44:04 -- common/autotest_common.sh@819 -- # '[' -z 1386285 ']' 00:05:16.370 08:44:04 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:16.370 08:44:04 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:16.370 08:44:04 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:16.370 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:16.370 08:44:04 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:16.370 08:44:04 -- common/autotest_common.sh@10 -- # set +x 00:05:16.627 08:44:04 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:16.627 08:44:04 -- common/autotest_common.sh@852 -- # return 0 00:05:16.627 08:44:04 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:05:16.627 08:44:04 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:16.627 08:44:04 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:16.627 08:44:04 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:16.627 00:05:16.627 real 0m2.462s 00:05:16.627 user 0m1.163s 00:05:16.627 sys 0m0.228s 00:05:16.627 08:44:04 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:16.627 08:44:04 -- common/autotest_common.sh@10 -- # set +x 00:05:16.627 ************************************ 00:05:16.627 END TEST locking_overlapped_coremask_via_rpc 00:05:16.627 ************************************ 00:05:16.627 08:44:04 -- event/cpu_locks.sh@174 -- # cleanup 00:05:16.627 08:44:04 -- event/cpu_locks.sh@15 -- # [[ -z 1386143 ]] 00:05:16.627 08:44:04 -- event/cpu_locks.sh@15 -- # killprocess 1386143 00:05:16.627 08:44:04 -- common/autotest_common.sh@926 -- # '[' -z 1386143 ']' 00:05:16.627 08:44:04 -- common/autotest_common.sh@930 -- # kill -0 1386143 00:05:16.627 08:44:04 -- common/autotest_common.sh@931 -- # uname 00:05:16.627 08:44:04 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:16.627 08:44:04 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1386143 00:05:16.627 08:44:04 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:16.627 08:44:04 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:16.627 08:44:04 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1386143' 00:05:16.627 killing process with pid 1386143 00:05:16.627 08:44:04 -- common/autotest_common.sh@945 -- # kill 1386143 00:05:16.627 08:44:04 -- common/autotest_common.sh@950 -- # wait 1386143 00:05:16.884 08:44:05 -- event/cpu_locks.sh@16 -- # [[ -z 1386285 ]] 00:05:16.884 08:44:05 -- event/cpu_locks.sh@16 -- # killprocess 1386285 00:05:16.884 08:44:05 -- common/autotest_common.sh@926 -- # '[' -z 1386285 ']' 00:05:16.884 08:44:05 -- common/autotest_common.sh@930 -- # kill -0 1386285 00:05:16.884 08:44:05 -- common/autotest_common.sh@931 -- # uname 00:05:16.884 08:44:05 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:16.884 08:44:05 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1386285 00:05:17.142 08:44:05 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:05:17.142 08:44:05 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:05:17.142 08:44:05 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1386285' 00:05:17.142 killing process with pid 1386285 00:05:17.142 08:44:05 -- common/autotest_common.sh@945 -- # kill 1386285 00:05:17.142 08:44:05 -- common/autotest_common.sh@950 -- # wait 1386285 00:05:17.400 08:44:05 -- event/cpu_locks.sh@18 -- # rm -f 00:05:17.400 08:44:05 -- event/cpu_locks.sh@1 -- # cleanup 00:05:17.400 08:44:05 -- event/cpu_locks.sh@15 -- # [[ -z 1386143 ]] 00:05:17.400 08:44:05 -- event/cpu_locks.sh@15 -- # killprocess 1386143 00:05:17.400 08:44:05 -- common/autotest_common.sh@926 -- # '[' -z 1386143 ']' 00:05:17.400 08:44:05 -- common/autotest_common.sh@930 -- # kill -0 1386143 00:05:17.400 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (1386143) - No such process 00:05:17.400 08:44:05 -- common/autotest_common.sh@953 -- # echo 'Process with pid 1386143 is not found' 00:05:17.400 Process with pid 1386143 is not found 00:05:17.400 08:44:05 -- event/cpu_locks.sh@16 -- # [[ -z 1386285 ]] 00:05:17.400 08:44:05 -- event/cpu_locks.sh@16 -- # killprocess 1386285 00:05:17.400 08:44:05 -- common/autotest_common.sh@926 -- # '[' -z 1386285 ']' 00:05:17.400 08:44:05 -- common/autotest_common.sh@930 -- # kill -0 1386285 00:05:17.400 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (1386285) - No such process 00:05:17.400 08:44:05 -- common/autotest_common.sh@953 -- # echo 'Process with pid 1386285 is not found' 00:05:17.400 Process with pid 1386285 is not found 00:05:17.400 08:44:05 -- event/cpu_locks.sh@18 -- # rm -f 00:05:17.400 00:05:17.400 real 0m19.545s 00:05:17.400 user 0m34.474s 00:05:17.400 sys 0m5.454s 00:05:17.400 08:44:05 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:17.400 08:44:05 -- common/autotest_common.sh@10 -- # set +x 00:05:17.400 ************************************ 00:05:17.400 END TEST cpu_locks 00:05:17.400 ************************************ 00:05:17.400 00:05:17.400 real 0m46.000s 00:05:17.400 user 1m26.961s 00:05:17.400 sys 0m9.316s 00:05:17.400 08:44:05 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:17.400 08:44:05 -- common/autotest_common.sh@10 -- # set +x 00:05:17.400 ************************************ 00:05:17.400 END TEST event 00:05:17.400 ************************************ 00:05:17.400 08:44:05 -- spdk/autotest.sh@188 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:05:17.400 08:44:05 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:17.400 08:44:05 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:17.400 08:44:05 -- common/autotest_common.sh@10 -- # set +x 00:05:17.400 ************************************ 00:05:17.400 START TEST thread 00:05:17.400 ************************************ 00:05:17.400 08:44:05 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:05:17.659 * Looking for test storage... 00:05:17.659 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:05:17.659 08:44:05 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:17.659 08:44:05 -- common/autotest_common.sh@1077 -- # '[' 8 -le 1 ']' 00:05:17.659 08:44:05 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:17.659 08:44:05 -- common/autotest_common.sh@10 -- # set +x 00:05:17.659 ************************************ 00:05:17.659 START TEST thread_poller_perf 00:05:17.659 ************************************ 00:05:17.659 08:44:05 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:17.659 [2024-07-15 08:44:06.001659] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:17.659 [2024-07-15 08:44:06.001743] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1386670 ] 00:05:17.659 EAL: No free 2048 kB hugepages reported on node 1 00:05:17.659 [2024-07-15 08:44:06.062321] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:17.659 [2024-07-15 08:44:06.170086] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:17.659 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:05:19.031 ====================================== 00:05:19.031 busy:2707811779 (cyc) 00:05:19.031 total_run_count: 281000 00:05:19.031 tsc_hz: 2700000000 (cyc) 00:05:19.031 ====================================== 00:05:19.031 poller_cost: 9636 (cyc), 3568 (nsec) 00:05:19.031 00:05:19.031 real 0m1.311s 00:05:19.031 user 0m1.223s 00:05:19.031 sys 0m0.082s 00:05:19.031 08:44:07 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:19.031 08:44:07 -- common/autotest_common.sh@10 -- # set +x 00:05:19.031 ************************************ 00:05:19.031 END TEST thread_poller_perf 00:05:19.031 ************************************ 00:05:19.031 08:44:07 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:19.031 08:44:07 -- common/autotest_common.sh@1077 -- # '[' 8 -le 1 ']' 00:05:19.031 08:44:07 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:19.031 08:44:07 -- common/autotest_common.sh@10 -- # set +x 00:05:19.031 ************************************ 00:05:19.031 START TEST thread_poller_perf 00:05:19.031 ************************************ 00:05:19.031 08:44:07 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:19.031 [2024-07-15 08:44:07.339725] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:19.031 [2024-07-15 08:44:07.339806] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1386842 ] 00:05:19.031 EAL: No free 2048 kB hugepages reported on node 1 00:05:19.031 [2024-07-15 08:44:07.404118] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:19.031 [2024-07-15 08:44:07.519118] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:19.031 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:05:20.401 ====================================== 00:05:20.401 busy:2703672135 (cyc) 00:05:20.401 total_run_count: 3827000 00:05:20.401 tsc_hz: 2700000000 (cyc) 00:05:20.401 ====================================== 00:05:20.401 poller_cost: 706 (cyc), 261 (nsec) 00:05:20.401 00:05:20.401 real 0m1.313s 00:05:20.401 user 0m1.224s 00:05:20.401 sys 0m0.082s 00:05:20.401 08:44:08 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:20.401 08:44:08 -- common/autotest_common.sh@10 -- # set +x 00:05:20.401 ************************************ 00:05:20.401 END TEST thread_poller_perf 00:05:20.401 ************************************ 00:05:20.401 08:44:08 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:05:20.401 00:05:20.401 real 0m2.723s 00:05:20.401 user 0m2.477s 00:05:20.401 sys 0m0.245s 00:05:20.401 08:44:08 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:20.401 08:44:08 -- common/autotest_common.sh@10 -- # set +x 00:05:20.401 ************************************ 00:05:20.401 END TEST thread 00:05:20.401 ************************************ 00:05:20.401 08:44:08 -- spdk/autotest.sh@189 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:20.401 08:44:08 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:20.402 08:44:08 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:20.402 08:44:08 -- common/autotest_common.sh@10 -- # set +x 00:05:20.402 ************************************ 00:05:20.402 START TEST accel 00:05:20.402 ************************************ 00:05:20.402 08:44:08 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:20.402 * Looking for test storage... 00:05:20.402 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:05:20.402 08:44:08 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:05:20.402 08:44:08 -- accel/accel.sh@74 -- # get_expected_opcs 00:05:20.402 08:44:08 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:20.402 08:44:08 -- accel/accel.sh@59 -- # spdk_tgt_pid=1387148 00:05:20.402 08:44:08 -- accel/accel.sh@60 -- # waitforlisten 1387148 00:05:20.402 08:44:08 -- common/autotest_common.sh@819 -- # '[' -z 1387148 ']' 00:05:20.402 08:44:08 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:05:20.402 08:44:08 -- accel/accel.sh@58 -- # build_accel_config 00:05:20.402 08:44:08 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:20.402 08:44:08 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:20.402 08:44:08 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:20.402 08:44:08 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:20.402 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:20.402 08:44:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:20.402 08:44:08 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:20.402 08:44:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:20.402 08:44:08 -- common/autotest_common.sh@10 -- # set +x 00:05:20.402 08:44:08 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:20.402 08:44:08 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:20.402 08:44:08 -- accel/accel.sh@41 -- # local IFS=, 00:05:20.402 08:44:08 -- accel/accel.sh@42 -- # jq -r . 00:05:20.402 [2024-07-15 08:44:08.778814] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:20.402 [2024-07-15 08:44:08.778918] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1387148 ] 00:05:20.402 EAL: No free 2048 kB hugepages reported on node 1 00:05:20.402 [2024-07-15 08:44:08.835589] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:20.402 [2024-07-15 08:44:08.941854] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:20.402 [2024-07-15 08:44:08.942046] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:21.335 08:44:09 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:21.335 08:44:09 -- common/autotest_common.sh@852 -- # return 0 00:05:21.335 08:44:09 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:05:21.335 08:44:09 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:05:21.335 08:44:09 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:05:21.335 08:44:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:21.335 08:44:09 -- common/autotest_common.sh@10 -- # set +x 00:05:21.335 08:44:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:21.335 08:44:09 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:21.335 08:44:09 -- accel/accel.sh@64 -- # IFS== 00:05:21.335 08:44:09 -- accel/accel.sh@64 -- # read -r opc module 00:05:21.335 08:44:09 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:21.335 08:44:09 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:21.335 08:44:09 -- accel/accel.sh@64 -- # IFS== 00:05:21.335 08:44:09 -- accel/accel.sh@64 -- # read -r opc module 00:05:21.335 08:44:09 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:21.335 08:44:09 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:21.335 08:44:09 -- accel/accel.sh@64 -- # IFS== 00:05:21.335 08:44:09 -- accel/accel.sh@64 -- # read -r opc module 00:05:21.335 08:44:09 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:21.335 08:44:09 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:21.335 08:44:09 -- accel/accel.sh@64 -- # IFS== 00:05:21.335 08:44:09 -- accel/accel.sh@64 -- # read -r opc module 00:05:21.335 08:44:09 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:21.335 08:44:09 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:21.335 08:44:09 -- accel/accel.sh@64 -- # IFS== 00:05:21.335 08:44:09 -- accel/accel.sh@64 -- # read -r opc module 00:05:21.335 08:44:09 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:21.335 08:44:09 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:21.335 08:44:09 -- accel/accel.sh@64 -- # IFS== 00:05:21.335 08:44:09 -- accel/accel.sh@64 -- # read -r opc module 00:05:21.335 08:44:09 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:21.335 08:44:09 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:21.335 08:44:09 -- accel/accel.sh@64 -- # IFS== 00:05:21.335 08:44:09 -- accel/accel.sh@64 -- # read -r opc module 00:05:21.335 08:44:09 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:21.335 08:44:09 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:21.335 08:44:09 -- accel/accel.sh@64 -- # IFS== 00:05:21.335 08:44:09 -- accel/accel.sh@64 -- # read -r opc module 00:05:21.335 08:44:09 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:21.335 08:44:09 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:21.335 08:44:09 -- accel/accel.sh@64 -- # IFS== 00:05:21.335 08:44:09 -- accel/accel.sh@64 -- # read -r opc module 00:05:21.335 08:44:09 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:21.335 08:44:09 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:21.335 08:44:09 -- accel/accel.sh@64 -- # IFS== 00:05:21.335 08:44:09 -- accel/accel.sh@64 -- # read -r opc module 00:05:21.335 08:44:09 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:21.335 08:44:09 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:21.335 08:44:09 -- accel/accel.sh@64 -- # IFS== 00:05:21.335 08:44:09 -- accel/accel.sh@64 -- # read -r opc module 00:05:21.335 08:44:09 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:21.335 08:44:09 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:21.335 08:44:09 -- accel/accel.sh@64 -- # IFS== 00:05:21.335 08:44:09 -- accel/accel.sh@64 -- # read -r opc module 00:05:21.335 08:44:09 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:21.335 08:44:09 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:21.335 08:44:09 -- accel/accel.sh@64 -- # IFS== 00:05:21.335 08:44:09 -- accel/accel.sh@64 -- # read -r opc module 00:05:21.335 08:44:09 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:21.335 08:44:09 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:21.335 08:44:09 -- accel/accel.sh@64 -- # IFS== 00:05:21.335 08:44:09 -- accel/accel.sh@64 -- # read -r opc module 00:05:21.335 08:44:09 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:21.335 08:44:09 -- accel/accel.sh@67 -- # killprocess 1387148 00:05:21.335 08:44:09 -- common/autotest_common.sh@926 -- # '[' -z 1387148 ']' 00:05:21.335 08:44:09 -- common/autotest_common.sh@930 -- # kill -0 1387148 00:05:21.335 08:44:09 -- common/autotest_common.sh@931 -- # uname 00:05:21.335 08:44:09 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:21.335 08:44:09 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1387148 00:05:21.335 08:44:09 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:21.335 08:44:09 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:21.335 08:44:09 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1387148' 00:05:21.335 killing process with pid 1387148 00:05:21.335 08:44:09 -- common/autotest_common.sh@945 -- # kill 1387148 00:05:21.335 08:44:09 -- common/autotest_common.sh@950 -- # wait 1387148 00:05:21.901 08:44:10 -- accel/accel.sh@68 -- # trap - ERR 00:05:21.901 08:44:10 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:05:21.901 08:44:10 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:05:21.901 08:44:10 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:21.901 08:44:10 -- common/autotest_common.sh@10 -- # set +x 00:05:21.901 08:44:10 -- common/autotest_common.sh@1104 -- # accel_perf -h 00:05:21.901 08:44:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:05:21.901 08:44:10 -- accel/accel.sh@12 -- # build_accel_config 00:05:21.901 08:44:10 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:21.901 08:44:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:21.901 08:44:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:21.901 08:44:10 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:21.901 08:44:10 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:21.901 08:44:10 -- accel/accel.sh@41 -- # local IFS=, 00:05:21.901 08:44:10 -- accel/accel.sh@42 -- # jq -r . 00:05:21.901 08:44:10 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:21.901 08:44:10 -- common/autotest_common.sh@10 -- # set +x 00:05:21.901 08:44:10 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:05:21.901 08:44:10 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:05:21.901 08:44:10 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:21.901 08:44:10 -- common/autotest_common.sh@10 -- # set +x 00:05:21.901 ************************************ 00:05:21.901 START TEST accel_missing_filename 00:05:21.901 ************************************ 00:05:21.901 08:44:10 -- common/autotest_common.sh@1104 -- # NOT accel_perf -t 1 -w compress 00:05:21.901 08:44:10 -- common/autotest_common.sh@640 -- # local es=0 00:05:21.901 08:44:10 -- common/autotest_common.sh@642 -- # valid_exec_arg accel_perf -t 1 -w compress 00:05:21.901 08:44:10 -- common/autotest_common.sh@628 -- # local arg=accel_perf 00:05:21.901 08:44:10 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:21.901 08:44:10 -- common/autotest_common.sh@632 -- # type -t accel_perf 00:05:21.901 08:44:10 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:21.901 08:44:10 -- common/autotest_common.sh@643 -- # accel_perf -t 1 -w compress 00:05:21.901 08:44:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:05:21.901 08:44:10 -- accel/accel.sh@12 -- # build_accel_config 00:05:21.901 08:44:10 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:21.901 08:44:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:21.901 08:44:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:21.901 08:44:10 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:21.901 08:44:10 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:21.901 08:44:10 -- accel/accel.sh@41 -- # local IFS=, 00:05:21.901 08:44:10 -- accel/accel.sh@42 -- # jq -r . 00:05:21.901 [2024-07-15 08:44:10.327384] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:21.901 [2024-07-15 08:44:10.327470] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1387328 ] 00:05:21.901 EAL: No free 2048 kB hugepages reported on node 1 00:05:21.901 [2024-07-15 08:44:10.393543] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:22.159 [2024-07-15 08:44:10.508868] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:22.159 [2024-07-15 08:44:10.566789] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:22.159 [2024-07-15 08:44:10.650115] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:05:22.416 A filename is required. 00:05:22.416 08:44:10 -- common/autotest_common.sh@643 -- # es=234 00:05:22.416 08:44:10 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:05:22.417 08:44:10 -- common/autotest_common.sh@652 -- # es=106 00:05:22.417 08:44:10 -- common/autotest_common.sh@653 -- # case "$es" in 00:05:22.417 08:44:10 -- common/autotest_common.sh@660 -- # es=1 00:05:22.417 08:44:10 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:05:22.417 00:05:22.417 real 0m0.462s 00:05:22.417 user 0m0.354s 00:05:22.417 sys 0m0.144s 00:05:22.417 08:44:10 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:22.417 08:44:10 -- common/autotest_common.sh@10 -- # set +x 00:05:22.417 ************************************ 00:05:22.417 END TEST accel_missing_filename 00:05:22.417 ************************************ 00:05:22.417 08:44:10 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:22.417 08:44:10 -- common/autotest_common.sh@1077 -- # '[' 10 -le 1 ']' 00:05:22.417 08:44:10 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:22.417 08:44:10 -- common/autotest_common.sh@10 -- # set +x 00:05:22.417 ************************************ 00:05:22.417 START TEST accel_compress_verify 00:05:22.417 ************************************ 00:05:22.417 08:44:10 -- common/autotest_common.sh@1104 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:22.417 08:44:10 -- common/autotest_common.sh@640 -- # local es=0 00:05:22.417 08:44:10 -- common/autotest_common.sh@642 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:22.417 08:44:10 -- common/autotest_common.sh@628 -- # local arg=accel_perf 00:05:22.417 08:44:10 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:22.417 08:44:10 -- common/autotest_common.sh@632 -- # type -t accel_perf 00:05:22.417 08:44:10 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:22.417 08:44:10 -- common/autotest_common.sh@643 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:22.417 08:44:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:22.417 08:44:10 -- accel/accel.sh@12 -- # build_accel_config 00:05:22.417 08:44:10 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:22.417 08:44:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:22.417 08:44:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:22.417 08:44:10 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:22.417 08:44:10 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:22.417 08:44:10 -- accel/accel.sh@41 -- # local IFS=, 00:05:22.417 08:44:10 -- accel/accel.sh@42 -- # jq -r . 00:05:22.417 [2024-07-15 08:44:10.817639] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:22.417 [2024-07-15 08:44:10.817721] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1387439 ] 00:05:22.417 EAL: No free 2048 kB hugepages reported on node 1 00:05:22.417 [2024-07-15 08:44:10.881646] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:22.673 [2024-07-15 08:44:10.995676] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:22.673 [2024-07-15 08:44:11.056966] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:22.673 [2024-07-15 08:44:11.140792] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:05:22.931 00:05:22.931 Compression does not support the verify option, aborting. 00:05:22.931 08:44:11 -- common/autotest_common.sh@643 -- # es=161 00:05:22.931 08:44:11 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:05:22.931 08:44:11 -- common/autotest_common.sh@652 -- # es=33 00:05:22.931 08:44:11 -- common/autotest_common.sh@653 -- # case "$es" in 00:05:22.931 08:44:11 -- common/autotest_common.sh@660 -- # es=1 00:05:22.931 08:44:11 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:05:22.931 00:05:22.931 real 0m0.467s 00:05:22.931 user 0m0.362s 00:05:22.931 sys 0m0.141s 00:05:22.931 08:44:11 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:22.931 08:44:11 -- common/autotest_common.sh@10 -- # set +x 00:05:22.931 ************************************ 00:05:22.931 END TEST accel_compress_verify 00:05:22.931 ************************************ 00:05:22.931 08:44:11 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:05:22.931 08:44:11 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:05:22.931 08:44:11 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:22.931 08:44:11 -- common/autotest_common.sh@10 -- # set +x 00:05:22.931 ************************************ 00:05:22.931 START TEST accel_wrong_workload 00:05:22.931 ************************************ 00:05:22.931 08:44:11 -- common/autotest_common.sh@1104 -- # NOT accel_perf -t 1 -w foobar 00:05:22.931 08:44:11 -- common/autotest_common.sh@640 -- # local es=0 00:05:22.931 08:44:11 -- common/autotest_common.sh@642 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:05:22.931 08:44:11 -- common/autotest_common.sh@628 -- # local arg=accel_perf 00:05:22.931 08:44:11 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:22.931 08:44:11 -- common/autotest_common.sh@632 -- # type -t accel_perf 00:05:22.931 08:44:11 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:22.931 08:44:11 -- common/autotest_common.sh@643 -- # accel_perf -t 1 -w foobar 00:05:22.931 08:44:11 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:05:22.931 08:44:11 -- accel/accel.sh@12 -- # build_accel_config 00:05:22.931 08:44:11 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:22.931 08:44:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:22.931 08:44:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:22.931 08:44:11 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:22.931 08:44:11 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:22.931 08:44:11 -- accel/accel.sh@41 -- # local IFS=, 00:05:22.931 08:44:11 -- accel/accel.sh@42 -- # jq -r . 00:05:22.931 Unsupported workload type: foobar 00:05:22.931 [2024-07-15 08:44:11.308916] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:05:22.931 accel_perf options: 00:05:22.931 [-h help message] 00:05:22.931 [-q queue depth per core] 00:05:22.931 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:22.931 [-T number of threads per core 00:05:22.931 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:22.931 [-t time in seconds] 00:05:22.931 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:22.931 [ dif_verify, , dif_generate, dif_generate_copy 00:05:22.931 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:22.931 [-l for compress/decompress workloads, name of uncompressed input file 00:05:22.931 [-S for crc32c workload, use this seed value (default 0) 00:05:22.931 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:22.931 [-f for fill workload, use this BYTE value (default 255) 00:05:22.931 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:22.931 [-y verify result if this switch is on] 00:05:22.931 [-a tasks to allocate per core (default: same value as -q)] 00:05:22.931 Can be used to spread operations across a wider range of memory. 00:05:22.931 08:44:11 -- common/autotest_common.sh@643 -- # es=1 00:05:22.931 08:44:11 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:05:22.931 08:44:11 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:05:22.931 08:44:11 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:05:22.931 00:05:22.931 real 0m0.023s 00:05:22.931 user 0m0.015s 00:05:22.931 sys 0m0.008s 00:05:22.931 08:44:11 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:22.931 08:44:11 -- common/autotest_common.sh@10 -- # set +x 00:05:22.931 ************************************ 00:05:22.931 END TEST accel_wrong_workload 00:05:22.931 ************************************ 00:05:22.931 Error: writing output failed: Broken pipe 00:05:22.931 08:44:11 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:05:22.931 08:44:11 -- common/autotest_common.sh@1077 -- # '[' 10 -le 1 ']' 00:05:22.931 08:44:11 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:22.931 08:44:11 -- common/autotest_common.sh@10 -- # set +x 00:05:22.931 ************************************ 00:05:22.931 START TEST accel_negative_buffers 00:05:22.931 ************************************ 00:05:22.931 08:44:11 -- common/autotest_common.sh@1104 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:05:22.931 08:44:11 -- common/autotest_common.sh@640 -- # local es=0 00:05:22.931 08:44:11 -- common/autotest_common.sh@642 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:05:22.931 08:44:11 -- common/autotest_common.sh@628 -- # local arg=accel_perf 00:05:22.931 08:44:11 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:22.931 08:44:11 -- common/autotest_common.sh@632 -- # type -t accel_perf 00:05:22.931 08:44:11 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:22.931 08:44:11 -- common/autotest_common.sh@643 -- # accel_perf -t 1 -w xor -y -x -1 00:05:22.931 08:44:11 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:05:22.931 08:44:11 -- accel/accel.sh@12 -- # build_accel_config 00:05:22.931 08:44:11 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:22.931 08:44:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:22.931 08:44:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:22.931 08:44:11 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:22.931 08:44:11 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:22.931 08:44:11 -- accel/accel.sh@41 -- # local IFS=, 00:05:22.931 08:44:11 -- accel/accel.sh@42 -- # jq -r . 00:05:22.931 -x option must be non-negative. 00:05:22.931 [2024-07-15 08:44:11.359273] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:05:22.931 accel_perf options: 00:05:22.931 [-h help message] 00:05:22.931 [-q queue depth per core] 00:05:22.931 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:22.931 [-T number of threads per core 00:05:22.931 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:22.931 [-t time in seconds] 00:05:22.931 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:22.931 [ dif_verify, , dif_generate, dif_generate_copy 00:05:22.931 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:22.931 [-l for compress/decompress workloads, name of uncompressed input file 00:05:22.931 [-S for crc32c workload, use this seed value (default 0) 00:05:22.931 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:22.931 [-f for fill workload, use this BYTE value (default 255) 00:05:22.931 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:22.932 [-y verify result if this switch is on] 00:05:22.932 [-a tasks to allocate per core (default: same value as -q)] 00:05:22.932 Can be used to spread operations across a wider range of memory. 00:05:22.932 08:44:11 -- common/autotest_common.sh@643 -- # es=1 00:05:22.932 08:44:11 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:05:22.932 08:44:11 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:05:22.932 08:44:11 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:05:22.932 00:05:22.932 real 0m0.024s 00:05:22.932 user 0m0.011s 00:05:22.932 sys 0m0.014s 00:05:22.932 08:44:11 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:22.932 08:44:11 -- common/autotest_common.sh@10 -- # set +x 00:05:22.932 ************************************ 00:05:22.932 END TEST accel_negative_buffers 00:05:22.932 ************************************ 00:05:22.932 Error: writing output failed: Broken pipe 00:05:22.932 08:44:11 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:05:22.932 08:44:11 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:05:22.932 08:44:11 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:22.932 08:44:11 -- common/autotest_common.sh@10 -- # set +x 00:05:22.932 ************************************ 00:05:22.932 START TEST accel_crc32c 00:05:22.932 ************************************ 00:05:22.932 08:44:11 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w crc32c -S 32 -y 00:05:22.932 08:44:11 -- accel/accel.sh@16 -- # local accel_opc 00:05:22.932 08:44:11 -- accel/accel.sh@17 -- # local accel_module 00:05:22.932 08:44:11 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:22.932 08:44:11 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:22.932 08:44:11 -- accel/accel.sh@12 -- # build_accel_config 00:05:22.932 08:44:11 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:22.932 08:44:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:22.932 08:44:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:22.932 08:44:11 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:22.932 08:44:11 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:22.932 08:44:11 -- accel/accel.sh@41 -- # local IFS=, 00:05:22.932 08:44:11 -- accel/accel.sh@42 -- # jq -r . 00:05:22.932 [2024-07-15 08:44:11.404027] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:22.932 [2024-07-15 08:44:11.404086] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1387535 ] 00:05:22.932 EAL: No free 2048 kB hugepages reported on node 1 00:05:22.932 [2024-07-15 08:44:11.468188] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:23.189 [2024-07-15 08:44:11.584435] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:24.558 08:44:12 -- accel/accel.sh@18 -- # out=' 00:05:24.558 SPDK Configuration: 00:05:24.558 Core mask: 0x1 00:05:24.558 00:05:24.558 Accel Perf Configuration: 00:05:24.558 Workload Type: crc32c 00:05:24.558 CRC-32C seed: 32 00:05:24.558 Transfer size: 4096 bytes 00:05:24.558 Vector count 1 00:05:24.558 Module: software 00:05:24.558 Queue depth: 32 00:05:24.558 Allocate depth: 32 00:05:24.558 # threads/core: 1 00:05:24.558 Run time: 1 seconds 00:05:24.558 Verify: Yes 00:05:24.558 00:05:24.558 Running for 1 seconds... 00:05:24.558 00:05:24.558 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:24.558 ------------------------------------------------------------------------------------ 00:05:24.558 0,0 405632/s 1584 MiB/s 0 0 00:05:24.558 ==================================================================================== 00:05:24.558 Total 405632/s 1584 MiB/s 0 0' 00:05:24.558 08:44:12 -- accel/accel.sh@20 -- # IFS=: 00:05:24.558 08:44:12 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:24.558 08:44:12 -- accel/accel.sh@20 -- # read -r var val 00:05:24.558 08:44:12 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:24.558 08:44:12 -- accel/accel.sh@12 -- # build_accel_config 00:05:24.558 08:44:12 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:24.558 08:44:12 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:24.558 08:44:12 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:24.558 08:44:12 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:24.558 08:44:12 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:24.558 08:44:12 -- accel/accel.sh@41 -- # local IFS=, 00:05:24.558 08:44:12 -- accel/accel.sh@42 -- # jq -r . 00:05:24.558 [2024-07-15 08:44:12.868874] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:24.558 [2024-07-15 08:44:12.868963] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1387679 ] 00:05:24.558 EAL: No free 2048 kB hugepages reported on node 1 00:05:24.558 [2024-07-15 08:44:12.932453] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:24.558 [2024-07-15 08:44:13.048676] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:24.815 08:44:13 -- accel/accel.sh@21 -- # val= 00:05:24.815 08:44:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.815 08:44:13 -- accel/accel.sh@20 -- # IFS=: 00:05:24.815 08:44:13 -- accel/accel.sh@20 -- # read -r var val 00:05:24.815 08:44:13 -- accel/accel.sh@21 -- # val= 00:05:24.815 08:44:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.815 08:44:13 -- accel/accel.sh@20 -- # IFS=: 00:05:24.815 08:44:13 -- accel/accel.sh@20 -- # read -r var val 00:05:24.815 08:44:13 -- accel/accel.sh@21 -- # val=0x1 00:05:24.815 08:44:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.815 08:44:13 -- accel/accel.sh@20 -- # IFS=: 00:05:24.815 08:44:13 -- accel/accel.sh@20 -- # read -r var val 00:05:24.815 08:44:13 -- accel/accel.sh@21 -- # val= 00:05:24.815 08:44:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.815 08:44:13 -- accel/accel.sh@20 -- # IFS=: 00:05:24.815 08:44:13 -- accel/accel.sh@20 -- # read -r var val 00:05:24.815 08:44:13 -- accel/accel.sh@21 -- # val= 00:05:24.815 08:44:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.815 08:44:13 -- accel/accel.sh@20 -- # IFS=: 00:05:24.815 08:44:13 -- accel/accel.sh@20 -- # read -r var val 00:05:24.815 08:44:13 -- accel/accel.sh@21 -- # val=crc32c 00:05:24.815 08:44:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.815 08:44:13 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:24.815 08:44:13 -- accel/accel.sh@20 -- # IFS=: 00:05:24.815 08:44:13 -- accel/accel.sh@20 -- # read -r var val 00:05:24.815 08:44:13 -- accel/accel.sh@21 -- # val=32 00:05:24.815 08:44:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.815 08:44:13 -- accel/accel.sh@20 -- # IFS=: 00:05:24.815 08:44:13 -- accel/accel.sh@20 -- # read -r var val 00:05:24.815 08:44:13 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:24.815 08:44:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.815 08:44:13 -- accel/accel.sh@20 -- # IFS=: 00:05:24.815 08:44:13 -- accel/accel.sh@20 -- # read -r var val 00:05:24.815 08:44:13 -- accel/accel.sh@21 -- # val= 00:05:24.815 08:44:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.815 08:44:13 -- accel/accel.sh@20 -- # IFS=: 00:05:24.815 08:44:13 -- accel/accel.sh@20 -- # read -r var val 00:05:24.815 08:44:13 -- accel/accel.sh@21 -- # val=software 00:05:24.815 08:44:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.815 08:44:13 -- accel/accel.sh@23 -- # accel_module=software 00:05:24.815 08:44:13 -- accel/accel.sh@20 -- # IFS=: 00:05:24.815 08:44:13 -- accel/accel.sh@20 -- # read -r var val 00:05:24.815 08:44:13 -- accel/accel.sh@21 -- # val=32 00:05:24.815 08:44:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.815 08:44:13 -- accel/accel.sh@20 -- # IFS=: 00:05:24.815 08:44:13 -- accel/accel.sh@20 -- # read -r var val 00:05:24.815 08:44:13 -- accel/accel.sh@21 -- # val=32 00:05:24.815 08:44:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.815 08:44:13 -- accel/accel.sh@20 -- # IFS=: 00:05:24.815 08:44:13 -- accel/accel.sh@20 -- # read -r var val 00:05:24.815 08:44:13 -- accel/accel.sh@21 -- # val=1 00:05:24.815 08:44:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.815 08:44:13 -- accel/accel.sh@20 -- # IFS=: 00:05:24.815 08:44:13 -- accel/accel.sh@20 -- # read -r var val 00:05:24.815 08:44:13 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:24.815 08:44:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.815 08:44:13 -- accel/accel.sh@20 -- # IFS=: 00:05:24.815 08:44:13 -- accel/accel.sh@20 -- # read -r var val 00:05:24.815 08:44:13 -- accel/accel.sh@21 -- # val=Yes 00:05:24.815 08:44:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.815 08:44:13 -- accel/accel.sh@20 -- # IFS=: 00:05:24.815 08:44:13 -- accel/accel.sh@20 -- # read -r var val 00:05:24.815 08:44:13 -- accel/accel.sh@21 -- # val= 00:05:24.815 08:44:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.815 08:44:13 -- accel/accel.sh@20 -- # IFS=: 00:05:24.815 08:44:13 -- accel/accel.sh@20 -- # read -r var val 00:05:24.815 08:44:13 -- accel/accel.sh@21 -- # val= 00:05:24.815 08:44:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.815 08:44:13 -- accel/accel.sh@20 -- # IFS=: 00:05:24.815 08:44:13 -- accel/accel.sh@20 -- # read -r var val 00:05:26.185 08:44:14 -- accel/accel.sh@21 -- # val= 00:05:26.185 08:44:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.185 08:44:14 -- accel/accel.sh@20 -- # IFS=: 00:05:26.185 08:44:14 -- accel/accel.sh@20 -- # read -r var val 00:05:26.185 08:44:14 -- accel/accel.sh@21 -- # val= 00:05:26.185 08:44:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.185 08:44:14 -- accel/accel.sh@20 -- # IFS=: 00:05:26.185 08:44:14 -- accel/accel.sh@20 -- # read -r var val 00:05:26.185 08:44:14 -- accel/accel.sh@21 -- # val= 00:05:26.185 08:44:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.185 08:44:14 -- accel/accel.sh@20 -- # IFS=: 00:05:26.185 08:44:14 -- accel/accel.sh@20 -- # read -r var val 00:05:26.185 08:44:14 -- accel/accel.sh@21 -- # val= 00:05:26.185 08:44:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.185 08:44:14 -- accel/accel.sh@20 -- # IFS=: 00:05:26.185 08:44:14 -- accel/accel.sh@20 -- # read -r var val 00:05:26.185 08:44:14 -- accel/accel.sh@21 -- # val= 00:05:26.185 08:44:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.185 08:44:14 -- accel/accel.sh@20 -- # IFS=: 00:05:26.185 08:44:14 -- accel/accel.sh@20 -- # read -r var val 00:05:26.185 08:44:14 -- accel/accel.sh@21 -- # val= 00:05:26.185 08:44:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.185 08:44:14 -- accel/accel.sh@20 -- # IFS=: 00:05:26.185 08:44:14 -- accel/accel.sh@20 -- # read -r var val 00:05:26.185 08:44:14 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:26.185 08:44:14 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:26.185 08:44:14 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:26.185 00:05:26.185 real 0m2.921s 00:05:26.185 user 0m2.631s 00:05:26.185 sys 0m0.283s 00:05:26.185 08:44:14 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:26.185 08:44:14 -- common/autotest_common.sh@10 -- # set +x 00:05:26.185 ************************************ 00:05:26.185 END TEST accel_crc32c 00:05:26.185 ************************************ 00:05:26.185 08:44:14 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:05:26.185 08:44:14 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:05:26.185 08:44:14 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:26.185 08:44:14 -- common/autotest_common.sh@10 -- # set +x 00:05:26.186 ************************************ 00:05:26.186 START TEST accel_crc32c_C2 00:05:26.186 ************************************ 00:05:26.186 08:44:14 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w crc32c -y -C 2 00:05:26.186 08:44:14 -- accel/accel.sh@16 -- # local accel_opc 00:05:26.186 08:44:14 -- accel/accel.sh@17 -- # local accel_module 00:05:26.186 08:44:14 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:26.186 08:44:14 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:26.186 08:44:14 -- accel/accel.sh@12 -- # build_accel_config 00:05:26.186 08:44:14 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:26.186 08:44:14 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:26.186 08:44:14 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:26.186 08:44:14 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:26.186 08:44:14 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:26.186 08:44:14 -- accel/accel.sh@41 -- # local IFS=, 00:05:26.186 08:44:14 -- accel/accel.sh@42 -- # jq -r . 00:05:26.186 [2024-07-15 08:44:14.349141] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:26.186 [2024-07-15 08:44:14.349216] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1387962 ] 00:05:26.186 EAL: No free 2048 kB hugepages reported on node 1 00:05:26.186 [2024-07-15 08:44:14.412528] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:26.186 [2024-07-15 08:44:14.528512] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:27.558 08:44:15 -- accel/accel.sh@18 -- # out=' 00:05:27.558 SPDK Configuration: 00:05:27.558 Core mask: 0x1 00:05:27.558 00:05:27.558 Accel Perf Configuration: 00:05:27.558 Workload Type: crc32c 00:05:27.558 CRC-32C seed: 0 00:05:27.558 Transfer size: 4096 bytes 00:05:27.558 Vector count 2 00:05:27.558 Module: software 00:05:27.558 Queue depth: 32 00:05:27.558 Allocate depth: 32 00:05:27.558 # threads/core: 1 00:05:27.558 Run time: 1 seconds 00:05:27.558 Verify: Yes 00:05:27.558 00:05:27.558 Running for 1 seconds... 00:05:27.558 00:05:27.558 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:27.558 ------------------------------------------------------------------------------------ 00:05:27.558 0,0 316608/s 2473 MiB/s 0 0 00:05:27.558 ==================================================================================== 00:05:27.558 Total 316608/s 1236 MiB/s 0 0' 00:05:27.558 08:44:15 -- accel/accel.sh@20 -- # IFS=: 00:05:27.558 08:44:15 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:27.558 08:44:15 -- accel/accel.sh@20 -- # read -r var val 00:05:27.558 08:44:15 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:27.558 08:44:15 -- accel/accel.sh@12 -- # build_accel_config 00:05:27.558 08:44:15 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:27.558 08:44:15 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:27.558 08:44:15 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:27.558 08:44:15 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:27.558 08:44:15 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:27.558 08:44:15 -- accel/accel.sh@41 -- # local IFS=, 00:05:27.558 08:44:15 -- accel/accel.sh@42 -- # jq -r . 00:05:27.558 [2024-07-15 08:44:15.820445] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:27.558 [2024-07-15 08:44:15.820529] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1388104 ] 00:05:27.558 EAL: No free 2048 kB hugepages reported on node 1 00:05:27.558 [2024-07-15 08:44:15.882365] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:27.558 [2024-07-15 08:44:15.997688] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:27.558 08:44:16 -- accel/accel.sh@21 -- # val= 00:05:27.558 08:44:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.558 08:44:16 -- accel/accel.sh@20 -- # IFS=: 00:05:27.558 08:44:16 -- accel/accel.sh@20 -- # read -r var val 00:05:27.558 08:44:16 -- accel/accel.sh@21 -- # val= 00:05:27.558 08:44:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.558 08:44:16 -- accel/accel.sh@20 -- # IFS=: 00:05:27.558 08:44:16 -- accel/accel.sh@20 -- # read -r var val 00:05:27.558 08:44:16 -- accel/accel.sh@21 -- # val=0x1 00:05:27.558 08:44:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.558 08:44:16 -- accel/accel.sh@20 -- # IFS=: 00:05:27.558 08:44:16 -- accel/accel.sh@20 -- # read -r var val 00:05:27.558 08:44:16 -- accel/accel.sh@21 -- # val= 00:05:27.558 08:44:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.558 08:44:16 -- accel/accel.sh@20 -- # IFS=: 00:05:27.558 08:44:16 -- accel/accel.sh@20 -- # read -r var val 00:05:27.558 08:44:16 -- accel/accel.sh@21 -- # val= 00:05:27.558 08:44:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.558 08:44:16 -- accel/accel.sh@20 -- # IFS=: 00:05:27.558 08:44:16 -- accel/accel.sh@20 -- # read -r var val 00:05:27.558 08:44:16 -- accel/accel.sh@21 -- # val=crc32c 00:05:27.558 08:44:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.558 08:44:16 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:27.558 08:44:16 -- accel/accel.sh@20 -- # IFS=: 00:05:27.558 08:44:16 -- accel/accel.sh@20 -- # read -r var val 00:05:27.558 08:44:16 -- accel/accel.sh@21 -- # val=0 00:05:27.558 08:44:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.558 08:44:16 -- accel/accel.sh@20 -- # IFS=: 00:05:27.558 08:44:16 -- accel/accel.sh@20 -- # read -r var val 00:05:27.558 08:44:16 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:27.558 08:44:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.558 08:44:16 -- accel/accel.sh@20 -- # IFS=: 00:05:27.558 08:44:16 -- accel/accel.sh@20 -- # read -r var val 00:05:27.558 08:44:16 -- accel/accel.sh@21 -- # val= 00:05:27.558 08:44:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.558 08:44:16 -- accel/accel.sh@20 -- # IFS=: 00:05:27.558 08:44:16 -- accel/accel.sh@20 -- # read -r var val 00:05:27.558 08:44:16 -- accel/accel.sh@21 -- # val=software 00:05:27.558 08:44:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.558 08:44:16 -- accel/accel.sh@23 -- # accel_module=software 00:05:27.558 08:44:16 -- accel/accel.sh@20 -- # IFS=: 00:05:27.558 08:44:16 -- accel/accel.sh@20 -- # read -r var val 00:05:27.558 08:44:16 -- accel/accel.sh@21 -- # val=32 00:05:27.558 08:44:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.558 08:44:16 -- accel/accel.sh@20 -- # IFS=: 00:05:27.558 08:44:16 -- accel/accel.sh@20 -- # read -r var val 00:05:27.558 08:44:16 -- accel/accel.sh@21 -- # val=32 00:05:27.558 08:44:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.558 08:44:16 -- accel/accel.sh@20 -- # IFS=: 00:05:27.558 08:44:16 -- accel/accel.sh@20 -- # read -r var val 00:05:27.558 08:44:16 -- accel/accel.sh@21 -- # val=1 00:05:27.558 08:44:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.558 08:44:16 -- accel/accel.sh@20 -- # IFS=: 00:05:27.558 08:44:16 -- accel/accel.sh@20 -- # read -r var val 00:05:27.558 08:44:16 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:27.558 08:44:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.558 08:44:16 -- accel/accel.sh@20 -- # IFS=: 00:05:27.558 08:44:16 -- accel/accel.sh@20 -- # read -r var val 00:05:27.558 08:44:16 -- accel/accel.sh@21 -- # val=Yes 00:05:27.558 08:44:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.558 08:44:16 -- accel/accel.sh@20 -- # IFS=: 00:05:27.558 08:44:16 -- accel/accel.sh@20 -- # read -r var val 00:05:27.558 08:44:16 -- accel/accel.sh@21 -- # val= 00:05:27.558 08:44:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.558 08:44:16 -- accel/accel.sh@20 -- # IFS=: 00:05:27.558 08:44:16 -- accel/accel.sh@20 -- # read -r var val 00:05:27.558 08:44:16 -- accel/accel.sh@21 -- # val= 00:05:27.558 08:44:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.558 08:44:16 -- accel/accel.sh@20 -- # IFS=: 00:05:27.558 08:44:16 -- accel/accel.sh@20 -- # read -r var val 00:05:28.931 08:44:17 -- accel/accel.sh@21 -- # val= 00:05:28.931 08:44:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.931 08:44:17 -- accel/accel.sh@20 -- # IFS=: 00:05:28.931 08:44:17 -- accel/accel.sh@20 -- # read -r var val 00:05:28.931 08:44:17 -- accel/accel.sh@21 -- # val= 00:05:28.931 08:44:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.931 08:44:17 -- accel/accel.sh@20 -- # IFS=: 00:05:28.931 08:44:17 -- accel/accel.sh@20 -- # read -r var val 00:05:28.931 08:44:17 -- accel/accel.sh@21 -- # val= 00:05:28.931 08:44:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.931 08:44:17 -- accel/accel.sh@20 -- # IFS=: 00:05:28.931 08:44:17 -- accel/accel.sh@20 -- # read -r var val 00:05:28.931 08:44:17 -- accel/accel.sh@21 -- # val= 00:05:28.931 08:44:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.931 08:44:17 -- accel/accel.sh@20 -- # IFS=: 00:05:28.931 08:44:17 -- accel/accel.sh@20 -- # read -r var val 00:05:28.931 08:44:17 -- accel/accel.sh@21 -- # val= 00:05:28.931 08:44:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.931 08:44:17 -- accel/accel.sh@20 -- # IFS=: 00:05:28.931 08:44:17 -- accel/accel.sh@20 -- # read -r var val 00:05:28.931 08:44:17 -- accel/accel.sh@21 -- # val= 00:05:28.931 08:44:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.931 08:44:17 -- accel/accel.sh@20 -- # IFS=: 00:05:28.931 08:44:17 -- accel/accel.sh@20 -- # read -r var val 00:05:28.931 08:44:17 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:28.931 08:44:17 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:28.931 08:44:17 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:28.931 00:05:28.931 real 0m2.939s 00:05:28.931 user 0m2.635s 00:05:28.931 sys 0m0.297s 00:05:28.931 08:44:17 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:28.931 08:44:17 -- common/autotest_common.sh@10 -- # set +x 00:05:28.931 ************************************ 00:05:28.931 END TEST accel_crc32c_C2 00:05:28.931 ************************************ 00:05:28.931 08:44:17 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:05:28.931 08:44:17 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:05:28.931 08:44:17 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:28.931 08:44:17 -- common/autotest_common.sh@10 -- # set +x 00:05:28.931 ************************************ 00:05:28.931 START TEST accel_copy 00:05:28.931 ************************************ 00:05:28.931 08:44:17 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w copy -y 00:05:28.931 08:44:17 -- accel/accel.sh@16 -- # local accel_opc 00:05:28.931 08:44:17 -- accel/accel.sh@17 -- # local accel_module 00:05:28.931 08:44:17 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:05:28.931 08:44:17 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:28.931 08:44:17 -- accel/accel.sh@12 -- # build_accel_config 00:05:28.931 08:44:17 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:28.931 08:44:17 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:28.931 08:44:17 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:28.931 08:44:17 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:28.931 08:44:17 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:28.931 08:44:17 -- accel/accel.sh@41 -- # local IFS=, 00:05:28.931 08:44:17 -- accel/accel.sh@42 -- # jq -r . 00:05:28.931 [2024-07-15 08:44:17.314016] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:28.931 [2024-07-15 08:44:17.314092] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1388263 ] 00:05:28.931 EAL: No free 2048 kB hugepages reported on node 1 00:05:28.931 [2024-07-15 08:44:17.375545] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:29.189 [2024-07-15 08:44:17.490811] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:30.608 08:44:18 -- accel/accel.sh@18 -- # out=' 00:05:30.608 SPDK Configuration: 00:05:30.608 Core mask: 0x1 00:05:30.608 00:05:30.608 Accel Perf Configuration: 00:05:30.608 Workload Type: copy 00:05:30.608 Transfer size: 4096 bytes 00:05:30.608 Vector count 1 00:05:30.608 Module: software 00:05:30.608 Queue depth: 32 00:05:30.608 Allocate depth: 32 00:05:30.608 # threads/core: 1 00:05:30.608 Run time: 1 seconds 00:05:30.608 Verify: Yes 00:05:30.608 00:05:30.608 Running for 1 seconds... 00:05:30.608 00:05:30.608 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:30.608 ------------------------------------------------------------------------------------ 00:05:30.608 0,0 278944/s 1089 MiB/s 0 0 00:05:30.608 ==================================================================================== 00:05:30.608 Total 278944/s 1089 MiB/s 0 0' 00:05:30.608 08:44:18 -- accel/accel.sh@20 -- # IFS=: 00:05:30.608 08:44:18 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:05:30.608 08:44:18 -- accel/accel.sh@20 -- # read -r var val 00:05:30.608 08:44:18 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:30.608 08:44:18 -- accel/accel.sh@12 -- # build_accel_config 00:05:30.608 08:44:18 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:30.608 08:44:18 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:30.608 08:44:18 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:30.609 08:44:18 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:30.609 08:44:18 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:30.609 08:44:18 -- accel/accel.sh@41 -- # local IFS=, 00:05:30.609 08:44:18 -- accel/accel.sh@42 -- # jq -r . 00:05:30.609 [2024-07-15 08:44:18.770507] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:30.609 [2024-07-15 08:44:18.770587] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1388529 ] 00:05:30.609 EAL: No free 2048 kB hugepages reported on node 1 00:05:30.609 [2024-07-15 08:44:18.832067] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:30.609 [2024-07-15 08:44:18.945759] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:30.609 08:44:19 -- accel/accel.sh@21 -- # val= 00:05:30.609 08:44:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.609 08:44:19 -- accel/accel.sh@20 -- # IFS=: 00:05:30.609 08:44:19 -- accel/accel.sh@20 -- # read -r var val 00:05:30.609 08:44:19 -- accel/accel.sh@21 -- # val= 00:05:30.609 08:44:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.609 08:44:19 -- accel/accel.sh@20 -- # IFS=: 00:05:30.609 08:44:19 -- accel/accel.sh@20 -- # read -r var val 00:05:30.609 08:44:19 -- accel/accel.sh@21 -- # val=0x1 00:05:30.609 08:44:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.609 08:44:19 -- accel/accel.sh@20 -- # IFS=: 00:05:30.609 08:44:19 -- accel/accel.sh@20 -- # read -r var val 00:05:30.609 08:44:19 -- accel/accel.sh@21 -- # val= 00:05:30.609 08:44:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.609 08:44:19 -- accel/accel.sh@20 -- # IFS=: 00:05:30.609 08:44:19 -- accel/accel.sh@20 -- # read -r var val 00:05:30.609 08:44:19 -- accel/accel.sh@21 -- # val= 00:05:30.609 08:44:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.609 08:44:19 -- accel/accel.sh@20 -- # IFS=: 00:05:30.609 08:44:19 -- accel/accel.sh@20 -- # read -r var val 00:05:30.609 08:44:19 -- accel/accel.sh@21 -- # val=copy 00:05:30.609 08:44:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.609 08:44:19 -- accel/accel.sh@24 -- # accel_opc=copy 00:05:30.609 08:44:19 -- accel/accel.sh@20 -- # IFS=: 00:05:30.609 08:44:19 -- accel/accel.sh@20 -- # read -r var val 00:05:30.609 08:44:19 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:30.609 08:44:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.609 08:44:19 -- accel/accel.sh@20 -- # IFS=: 00:05:30.609 08:44:19 -- accel/accel.sh@20 -- # read -r var val 00:05:30.609 08:44:19 -- accel/accel.sh@21 -- # val= 00:05:30.609 08:44:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.609 08:44:19 -- accel/accel.sh@20 -- # IFS=: 00:05:30.609 08:44:19 -- accel/accel.sh@20 -- # read -r var val 00:05:30.609 08:44:19 -- accel/accel.sh@21 -- # val=software 00:05:30.609 08:44:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.609 08:44:19 -- accel/accel.sh@23 -- # accel_module=software 00:05:30.609 08:44:19 -- accel/accel.sh@20 -- # IFS=: 00:05:30.609 08:44:19 -- accel/accel.sh@20 -- # read -r var val 00:05:30.609 08:44:19 -- accel/accel.sh@21 -- # val=32 00:05:30.609 08:44:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.609 08:44:19 -- accel/accel.sh@20 -- # IFS=: 00:05:30.609 08:44:19 -- accel/accel.sh@20 -- # read -r var val 00:05:30.609 08:44:19 -- accel/accel.sh@21 -- # val=32 00:05:30.609 08:44:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.609 08:44:19 -- accel/accel.sh@20 -- # IFS=: 00:05:30.609 08:44:19 -- accel/accel.sh@20 -- # read -r var val 00:05:30.609 08:44:19 -- accel/accel.sh@21 -- # val=1 00:05:30.609 08:44:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.609 08:44:19 -- accel/accel.sh@20 -- # IFS=: 00:05:30.609 08:44:19 -- accel/accel.sh@20 -- # read -r var val 00:05:30.609 08:44:19 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:30.609 08:44:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.609 08:44:19 -- accel/accel.sh@20 -- # IFS=: 00:05:30.609 08:44:19 -- accel/accel.sh@20 -- # read -r var val 00:05:30.609 08:44:19 -- accel/accel.sh@21 -- # val=Yes 00:05:30.609 08:44:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.609 08:44:19 -- accel/accel.sh@20 -- # IFS=: 00:05:30.609 08:44:19 -- accel/accel.sh@20 -- # read -r var val 00:05:30.609 08:44:19 -- accel/accel.sh@21 -- # val= 00:05:30.609 08:44:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.609 08:44:19 -- accel/accel.sh@20 -- # IFS=: 00:05:30.609 08:44:19 -- accel/accel.sh@20 -- # read -r var val 00:05:30.609 08:44:19 -- accel/accel.sh@21 -- # val= 00:05:30.609 08:44:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.609 08:44:19 -- accel/accel.sh@20 -- # IFS=: 00:05:30.609 08:44:19 -- accel/accel.sh@20 -- # read -r var val 00:05:31.981 08:44:20 -- accel/accel.sh@21 -- # val= 00:05:31.981 08:44:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.981 08:44:20 -- accel/accel.sh@20 -- # IFS=: 00:05:31.981 08:44:20 -- accel/accel.sh@20 -- # read -r var val 00:05:31.981 08:44:20 -- accel/accel.sh@21 -- # val= 00:05:31.981 08:44:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.981 08:44:20 -- accel/accel.sh@20 -- # IFS=: 00:05:31.981 08:44:20 -- accel/accel.sh@20 -- # read -r var val 00:05:31.981 08:44:20 -- accel/accel.sh@21 -- # val= 00:05:31.981 08:44:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.981 08:44:20 -- accel/accel.sh@20 -- # IFS=: 00:05:31.981 08:44:20 -- accel/accel.sh@20 -- # read -r var val 00:05:31.981 08:44:20 -- accel/accel.sh@21 -- # val= 00:05:31.981 08:44:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.981 08:44:20 -- accel/accel.sh@20 -- # IFS=: 00:05:31.981 08:44:20 -- accel/accel.sh@20 -- # read -r var val 00:05:31.981 08:44:20 -- accel/accel.sh@21 -- # val= 00:05:31.981 08:44:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.981 08:44:20 -- accel/accel.sh@20 -- # IFS=: 00:05:31.981 08:44:20 -- accel/accel.sh@20 -- # read -r var val 00:05:31.981 08:44:20 -- accel/accel.sh@21 -- # val= 00:05:31.981 08:44:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.981 08:44:20 -- accel/accel.sh@20 -- # IFS=: 00:05:31.981 08:44:20 -- accel/accel.sh@20 -- # read -r var val 00:05:31.981 08:44:20 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:31.981 08:44:20 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:05:31.981 08:44:20 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:31.981 00:05:31.981 real 0m2.928s 00:05:31.981 user 0m2.631s 00:05:31.981 sys 0m0.288s 00:05:31.981 08:44:20 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:31.981 08:44:20 -- common/autotest_common.sh@10 -- # set +x 00:05:31.981 ************************************ 00:05:31.981 END TEST accel_copy 00:05:31.981 ************************************ 00:05:31.981 08:44:20 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:31.981 08:44:20 -- common/autotest_common.sh@1077 -- # '[' 13 -le 1 ']' 00:05:31.981 08:44:20 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:31.981 08:44:20 -- common/autotest_common.sh@10 -- # set +x 00:05:31.981 ************************************ 00:05:31.981 START TEST accel_fill 00:05:31.981 ************************************ 00:05:31.981 08:44:20 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:31.981 08:44:20 -- accel/accel.sh@16 -- # local accel_opc 00:05:31.981 08:44:20 -- accel/accel.sh@17 -- # local accel_module 00:05:31.981 08:44:20 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:31.981 08:44:20 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:31.981 08:44:20 -- accel/accel.sh@12 -- # build_accel_config 00:05:31.981 08:44:20 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:31.981 08:44:20 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:31.981 08:44:20 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:31.981 08:44:20 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:31.981 08:44:20 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:31.981 08:44:20 -- accel/accel.sh@41 -- # local IFS=, 00:05:31.981 08:44:20 -- accel/accel.sh@42 -- # jq -r . 00:05:31.981 [2024-07-15 08:44:20.274595] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:31.981 [2024-07-15 08:44:20.274677] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1388694 ] 00:05:31.981 EAL: No free 2048 kB hugepages reported on node 1 00:05:31.981 [2024-07-15 08:44:20.338566] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:31.981 [2024-07-15 08:44:20.452156] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:33.354 08:44:21 -- accel/accel.sh@18 -- # out=' 00:05:33.354 SPDK Configuration: 00:05:33.354 Core mask: 0x1 00:05:33.354 00:05:33.354 Accel Perf Configuration: 00:05:33.354 Workload Type: fill 00:05:33.354 Fill pattern: 0x80 00:05:33.355 Transfer size: 4096 bytes 00:05:33.355 Vector count 1 00:05:33.355 Module: software 00:05:33.355 Queue depth: 64 00:05:33.355 Allocate depth: 64 00:05:33.355 # threads/core: 1 00:05:33.355 Run time: 1 seconds 00:05:33.355 Verify: Yes 00:05:33.355 00:05:33.355 Running for 1 seconds... 00:05:33.355 00:05:33.355 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:33.355 ------------------------------------------------------------------------------------ 00:05:33.355 0,0 405120/s 1582 MiB/s 0 0 00:05:33.355 ==================================================================================== 00:05:33.355 Total 405120/s 1582 MiB/s 0 0' 00:05:33.355 08:44:21 -- accel/accel.sh@20 -- # IFS=: 00:05:33.355 08:44:21 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:33.355 08:44:21 -- accel/accel.sh@20 -- # read -r var val 00:05:33.355 08:44:21 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:33.355 08:44:21 -- accel/accel.sh@12 -- # build_accel_config 00:05:33.355 08:44:21 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:33.355 08:44:21 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:33.355 08:44:21 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:33.355 08:44:21 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:33.355 08:44:21 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:33.355 08:44:21 -- accel/accel.sh@41 -- # local IFS=, 00:05:33.355 08:44:21 -- accel/accel.sh@42 -- # jq -r . 00:05:33.355 [2024-07-15 08:44:21.744366] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:33.355 [2024-07-15 08:44:21.744449] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1388834 ] 00:05:33.355 EAL: No free 2048 kB hugepages reported on node 1 00:05:33.355 [2024-07-15 08:44:21.806116] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:33.613 [2024-07-15 08:44:21.922101] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:33.613 08:44:21 -- accel/accel.sh@21 -- # val= 00:05:33.613 08:44:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.613 08:44:21 -- accel/accel.sh@20 -- # IFS=: 00:05:33.613 08:44:21 -- accel/accel.sh@20 -- # read -r var val 00:05:33.613 08:44:21 -- accel/accel.sh@21 -- # val= 00:05:33.613 08:44:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.613 08:44:21 -- accel/accel.sh@20 -- # IFS=: 00:05:33.613 08:44:21 -- accel/accel.sh@20 -- # read -r var val 00:05:33.613 08:44:21 -- accel/accel.sh@21 -- # val=0x1 00:05:33.613 08:44:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.613 08:44:21 -- accel/accel.sh@20 -- # IFS=: 00:05:33.613 08:44:21 -- accel/accel.sh@20 -- # read -r var val 00:05:33.613 08:44:21 -- accel/accel.sh@21 -- # val= 00:05:33.613 08:44:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.613 08:44:21 -- accel/accel.sh@20 -- # IFS=: 00:05:33.613 08:44:21 -- accel/accel.sh@20 -- # read -r var val 00:05:33.613 08:44:21 -- accel/accel.sh@21 -- # val= 00:05:33.613 08:44:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.613 08:44:21 -- accel/accel.sh@20 -- # IFS=: 00:05:33.613 08:44:21 -- accel/accel.sh@20 -- # read -r var val 00:05:33.613 08:44:21 -- accel/accel.sh@21 -- # val=fill 00:05:33.613 08:44:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.613 08:44:21 -- accel/accel.sh@24 -- # accel_opc=fill 00:05:33.613 08:44:21 -- accel/accel.sh@20 -- # IFS=: 00:05:33.613 08:44:21 -- accel/accel.sh@20 -- # read -r var val 00:05:33.613 08:44:21 -- accel/accel.sh@21 -- # val=0x80 00:05:33.613 08:44:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.613 08:44:21 -- accel/accel.sh@20 -- # IFS=: 00:05:33.613 08:44:21 -- accel/accel.sh@20 -- # read -r var val 00:05:33.613 08:44:21 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:33.613 08:44:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.613 08:44:21 -- accel/accel.sh@20 -- # IFS=: 00:05:33.613 08:44:21 -- accel/accel.sh@20 -- # read -r var val 00:05:33.613 08:44:21 -- accel/accel.sh@21 -- # val= 00:05:33.613 08:44:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.613 08:44:21 -- accel/accel.sh@20 -- # IFS=: 00:05:33.613 08:44:21 -- accel/accel.sh@20 -- # read -r var val 00:05:33.613 08:44:21 -- accel/accel.sh@21 -- # val=software 00:05:33.613 08:44:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.613 08:44:21 -- accel/accel.sh@23 -- # accel_module=software 00:05:33.613 08:44:21 -- accel/accel.sh@20 -- # IFS=: 00:05:33.613 08:44:21 -- accel/accel.sh@20 -- # read -r var val 00:05:33.613 08:44:21 -- accel/accel.sh@21 -- # val=64 00:05:33.613 08:44:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.613 08:44:21 -- accel/accel.sh@20 -- # IFS=: 00:05:33.613 08:44:21 -- accel/accel.sh@20 -- # read -r var val 00:05:33.613 08:44:21 -- accel/accel.sh@21 -- # val=64 00:05:33.613 08:44:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.613 08:44:21 -- accel/accel.sh@20 -- # IFS=: 00:05:33.613 08:44:21 -- accel/accel.sh@20 -- # read -r var val 00:05:33.613 08:44:21 -- accel/accel.sh@21 -- # val=1 00:05:33.613 08:44:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.613 08:44:21 -- accel/accel.sh@20 -- # IFS=: 00:05:33.613 08:44:21 -- accel/accel.sh@20 -- # read -r var val 00:05:33.613 08:44:21 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:33.613 08:44:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.613 08:44:21 -- accel/accel.sh@20 -- # IFS=: 00:05:33.613 08:44:21 -- accel/accel.sh@20 -- # read -r var val 00:05:33.613 08:44:21 -- accel/accel.sh@21 -- # val=Yes 00:05:33.613 08:44:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.613 08:44:21 -- accel/accel.sh@20 -- # IFS=: 00:05:33.613 08:44:21 -- accel/accel.sh@20 -- # read -r var val 00:05:33.613 08:44:21 -- accel/accel.sh@21 -- # val= 00:05:33.613 08:44:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.613 08:44:21 -- accel/accel.sh@20 -- # IFS=: 00:05:33.613 08:44:21 -- accel/accel.sh@20 -- # read -r var val 00:05:33.613 08:44:21 -- accel/accel.sh@21 -- # val= 00:05:33.613 08:44:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.613 08:44:21 -- accel/accel.sh@20 -- # IFS=: 00:05:33.613 08:44:21 -- accel/accel.sh@20 -- # read -r var val 00:05:34.991 08:44:23 -- accel/accel.sh@21 -- # val= 00:05:34.991 08:44:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.991 08:44:23 -- accel/accel.sh@20 -- # IFS=: 00:05:34.991 08:44:23 -- accel/accel.sh@20 -- # read -r var val 00:05:34.991 08:44:23 -- accel/accel.sh@21 -- # val= 00:05:34.991 08:44:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.991 08:44:23 -- accel/accel.sh@20 -- # IFS=: 00:05:34.991 08:44:23 -- accel/accel.sh@20 -- # read -r var val 00:05:34.991 08:44:23 -- accel/accel.sh@21 -- # val= 00:05:34.991 08:44:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.991 08:44:23 -- accel/accel.sh@20 -- # IFS=: 00:05:34.991 08:44:23 -- accel/accel.sh@20 -- # read -r var val 00:05:34.991 08:44:23 -- accel/accel.sh@21 -- # val= 00:05:34.991 08:44:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.991 08:44:23 -- accel/accel.sh@20 -- # IFS=: 00:05:34.991 08:44:23 -- accel/accel.sh@20 -- # read -r var val 00:05:34.991 08:44:23 -- accel/accel.sh@21 -- # val= 00:05:34.991 08:44:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.991 08:44:23 -- accel/accel.sh@20 -- # IFS=: 00:05:34.991 08:44:23 -- accel/accel.sh@20 -- # read -r var val 00:05:34.991 08:44:23 -- accel/accel.sh@21 -- # val= 00:05:34.991 08:44:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.991 08:44:23 -- accel/accel.sh@20 -- # IFS=: 00:05:34.991 08:44:23 -- accel/accel.sh@20 -- # read -r var val 00:05:34.991 08:44:23 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:34.991 08:44:23 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:05:34.991 08:44:23 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:34.991 00:05:34.991 real 0m2.949s 00:05:34.991 user 0m2.641s 00:05:34.991 sys 0m0.300s 00:05:34.991 08:44:23 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:34.991 08:44:23 -- common/autotest_common.sh@10 -- # set +x 00:05:34.991 ************************************ 00:05:34.991 END TEST accel_fill 00:05:34.991 ************************************ 00:05:34.991 08:44:23 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:05:34.991 08:44:23 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:05:34.991 08:44:23 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:34.991 08:44:23 -- common/autotest_common.sh@10 -- # set +x 00:05:34.991 ************************************ 00:05:34.991 START TEST accel_copy_crc32c 00:05:34.991 ************************************ 00:05:34.991 08:44:23 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w copy_crc32c -y 00:05:34.991 08:44:23 -- accel/accel.sh@16 -- # local accel_opc 00:05:34.991 08:44:23 -- accel/accel.sh@17 -- # local accel_module 00:05:34.991 08:44:23 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:34.991 08:44:23 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:34.991 08:44:23 -- accel/accel.sh@12 -- # build_accel_config 00:05:34.991 08:44:23 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:34.991 08:44:23 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:34.991 08:44:23 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:34.991 08:44:23 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:34.991 08:44:23 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:34.991 08:44:23 -- accel/accel.sh@41 -- # local IFS=, 00:05:34.991 08:44:23 -- accel/accel.sh@42 -- # jq -r . 00:05:34.991 [2024-07-15 08:44:23.247944] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:34.991 [2024-07-15 08:44:23.248031] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1389107 ] 00:05:34.991 EAL: No free 2048 kB hugepages reported on node 1 00:05:34.991 [2024-07-15 08:44:23.309028] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:34.991 [2024-07-15 08:44:23.435793] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:36.362 08:44:24 -- accel/accel.sh@18 -- # out=' 00:05:36.362 SPDK Configuration: 00:05:36.362 Core mask: 0x1 00:05:36.362 00:05:36.362 Accel Perf Configuration: 00:05:36.362 Workload Type: copy_crc32c 00:05:36.362 CRC-32C seed: 0 00:05:36.362 Vector size: 4096 bytes 00:05:36.362 Transfer size: 4096 bytes 00:05:36.362 Vector count 1 00:05:36.362 Module: software 00:05:36.362 Queue depth: 32 00:05:36.362 Allocate depth: 32 00:05:36.362 # threads/core: 1 00:05:36.362 Run time: 1 seconds 00:05:36.362 Verify: Yes 00:05:36.362 00:05:36.362 Running for 1 seconds... 00:05:36.362 00:05:36.362 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:36.362 ------------------------------------------------------------------------------------ 00:05:36.362 0,0 218880/s 855 MiB/s 0 0 00:05:36.362 ==================================================================================== 00:05:36.362 Total 218880/s 855 MiB/s 0 0' 00:05:36.362 08:44:24 -- accel/accel.sh@20 -- # IFS=: 00:05:36.362 08:44:24 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:36.362 08:44:24 -- accel/accel.sh@20 -- # read -r var val 00:05:36.362 08:44:24 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:36.362 08:44:24 -- accel/accel.sh@12 -- # build_accel_config 00:05:36.362 08:44:24 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:36.362 08:44:24 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:36.362 08:44:24 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:36.362 08:44:24 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:36.362 08:44:24 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:36.362 08:44:24 -- accel/accel.sh@41 -- # local IFS=, 00:05:36.362 08:44:24 -- accel/accel.sh@42 -- # jq -r . 00:05:36.362 [2024-07-15 08:44:24.730262] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:36.362 [2024-07-15 08:44:24.730350] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1389262 ] 00:05:36.362 EAL: No free 2048 kB hugepages reported on node 1 00:05:36.362 [2024-07-15 08:44:24.791746] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:36.621 [2024-07-15 08:44:24.911924] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:36.621 08:44:24 -- accel/accel.sh@21 -- # val= 00:05:36.621 08:44:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.621 08:44:24 -- accel/accel.sh@20 -- # IFS=: 00:05:36.621 08:44:24 -- accel/accel.sh@20 -- # read -r var val 00:05:36.621 08:44:24 -- accel/accel.sh@21 -- # val= 00:05:36.621 08:44:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.621 08:44:24 -- accel/accel.sh@20 -- # IFS=: 00:05:36.621 08:44:24 -- accel/accel.sh@20 -- # read -r var val 00:05:36.621 08:44:24 -- accel/accel.sh@21 -- # val=0x1 00:05:36.621 08:44:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.621 08:44:24 -- accel/accel.sh@20 -- # IFS=: 00:05:36.621 08:44:24 -- accel/accel.sh@20 -- # read -r var val 00:05:36.621 08:44:24 -- accel/accel.sh@21 -- # val= 00:05:36.621 08:44:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.621 08:44:24 -- accel/accel.sh@20 -- # IFS=: 00:05:36.621 08:44:24 -- accel/accel.sh@20 -- # read -r var val 00:05:36.621 08:44:24 -- accel/accel.sh@21 -- # val= 00:05:36.621 08:44:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.621 08:44:24 -- accel/accel.sh@20 -- # IFS=: 00:05:36.621 08:44:24 -- accel/accel.sh@20 -- # read -r var val 00:05:36.621 08:44:24 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:36.621 08:44:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.621 08:44:24 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:36.621 08:44:24 -- accel/accel.sh@20 -- # IFS=: 00:05:36.621 08:44:24 -- accel/accel.sh@20 -- # read -r var val 00:05:36.621 08:44:24 -- accel/accel.sh@21 -- # val=0 00:05:36.621 08:44:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.621 08:44:24 -- accel/accel.sh@20 -- # IFS=: 00:05:36.621 08:44:24 -- accel/accel.sh@20 -- # read -r var val 00:05:36.621 08:44:24 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:36.621 08:44:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.621 08:44:24 -- accel/accel.sh@20 -- # IFS=: 00:05:36.621 08:44:24 -- accel/accel.sh@20 -- # read -r var val 00:05:36.621 08:44:24 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:36.621 08:44:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.621 08:44:24 -- accel/accel.sh@20 -- # IFS=: 00:05:36.621 08:44:24 -- accel/accel.sh@20 -- # read -r var val 00:05:36.621 08:44:24 -- accel/accel.sh@21 -- # val= 00:05:36.621 08:44:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.621 08:44:24 -- accel/accel.sh@20 -- # IFS=: 00:05:36.621 08:44:24 -- accel/accel.sh@20 -- # read -r var val 00:05:36.621 08:44:24 -- accel/accel.sh@21 -- # val=software 00:05:36.621 08:44:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.621 08:44:24 -- accel/accel.sh@23 -- # accel_module=software 00:05:36.621 08:44:24 -- accel/accel.sh@20 -- # IFS=: 00:05:36.621 08:44:24 -- accel/accel.sh@20 -- # read -r var val 00:05:36.621 08:44:24 -- accel/accel.sh@21 -- # val=32 00:05:36.621 08:44:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.621 08:44:24 -- accel/accel.sh@20 -- # IFS=: 00:05:36.621 08:44:24 -- accel/accel.sh@20 -- # read -r var val 00:05:36.621 08:44:24 -- accel/accel.sh@21 -- # val=32 00:05:36.621 08:44:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.621 08:44:24 -- accel/accel.sh@20 -- # IFS=: 00:05:36.621 08:44:24 -- accel/accel.sh@20 -- # read -r var val 00:05:36.621 08:44:24 -- accel/accel.sh@21 -- # val=1 00:05:36.621 08:44:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.621 08:44:24 -- accel/accel.sh@20 -- # IFS=: 00:05:36.621 08:44:24 -- accel/accel.sh@20 -- # read -r var val 00:05:36.621 08:44:24 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:36.621 08:44:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.621 08:44:24 -- accel/accel.sh@20 -- # IFS=: 00:05:36.621 08:44:24 -- accel/accel.sh@20 -- # read -r var val 00:05:36.621 08:44:24 -- accel/accel.sh@21 -- # val=Yes 00:05:36.621 08:44:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.621 08:44:24 -- accel/accel.sh@20 -- # IFS=: 00:05:36.621 08:44:24 -- accel/accel.sh@20 -- # read -r var val 00:05:36.621 08:44:24 -- accel/accel.sh@21 -- # val= 00:05:36.621 08:44:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.621 08:44:24 -- accel/accel.sh@20 -- # IFS=: 00:05:36.621 08:44:24 -- accel/accel.sh@20 -- # read -r var val 00:05:36.621 08:44:24 -- accel/accel.sh@21 -- # val= 00:05:36.621 08:44:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.621 08:44:24 -- accel/accel.sh@20 -- # IFS=: 00:05:36.621 08:44:24 -- accel/accel.sh@20 -- # read -r var val 00:05:37.996 08:44:26 -- accel/accel.sh@21 -- # val= 00:05:37.996 08:44:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.996 08:44:26 -- accel/accel.sh@20 -- # IFS=: 00:05:37.996 08:44:26 -- accel/accel.sh@20 -- # read -r var val 00:05:37.996 08:44:26 -- accel/accel.sh@21 -- # val= 00:05:37.996 08:44:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.996 08:44:26 -- accel/accel.sh@20 -- # IFS=: 00:05:37.996 08:44:26 -- accel/accel.sh@20 -- # read -r var val 00:05:37.996 08:44:26 -- accel/accel.sh@21 -- # val= 00:05:37.996 08:44:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.996 08:44:26 -- accel/accel.sh@20 -- # IFS=: 00:05:37.996 08:44:26 -- accel/accel.sh@20 -- # read -r var val 00:05:37.996 08:44:26 -- accel/accel.sh@21 -- # val= 00:05:37.996 08:44:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.996 08:44:26 -- accel/accel.sh@20 -- # IFS=: 00:05:37.996 08:44:26 -- accel/accel.sh@20 -- # read -r var val 00:05:37.996 08:44:26 -- accel/accel.sh@21 -- # val= 00:05:37.996 08:44:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.996 08:44:26 -- accel/accel.sh@20 -- # IFS=: 00:05:37.996 08:44:26 -- accel/accel.sh@20 -- # read -r var val 00:05:37.996 08:44:26 -- accel/accel.sh@21 -- # val= 00:05:37.996 08:44:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.996 08:44:26 -- accel/accel.sh@20 -- # IFS=: 00:05:37.996 08:44:26 -- accel/accel.sh@20 -- # read -r var val 00:05:37.996 08:44:26 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:37.996 08:44:26 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:37.996 08:44:26 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:37.996 00:05:37.996 real 0m2.968s 00:05:37.996 user 0m2.678s 00:05:37.996 sys 0m0.283s 00:05:37.996 08:44:26 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:37.996 08:44:26 -- common/autotest_common.sh@10 -- # set +x 00:05:37.996 ************************************ 00:05:37.996 END TEST accel_copy_crc32c 00:05:37.996 ************************************ 00:05:37.996 08:44:26 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:05:37.996 08:44:26 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:05:37.996 08:44:26 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:37.996 08:44:26 -- common/autotest_common.sh@10 -- # set +x 00:05:37.996 ************************************ 00:05:37.996 START TEST accel_copy_crc32c_C2 00:05:37.996 ************************************ 00:05:37.996 08:44:26 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:05:37.996 08:44:26 -- accel/accel.sh@16 -- # local accel_opc 00:05:37.996 08:44:26 -- accel/accel.sh@17 -- # local accel_module 00:05:37.996 08:44:26 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:37.996 08:44:26 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:37.996 08:44:26 -- accel/accel.sh@12 -- # build_accel_config 00:05:37.996 08:44:26 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:37.996 08:44:26 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:37.996 08:44:26 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:37.996 08:44:26 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:37.996 08:44:26 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:37.996 08:44:26 -- accel/accel.sh@41 -- # local IFS=, 00:05:37.996 08:44:26 -- accel/accel.sh@42 -- # jq -r . 00:05:37.996 [2024-07-15 08:44:26.243023] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:37.996 [2024-07-15 08:44:26.243105] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1389415 ] 00:05:37.996 EAL: No free 2048 kB hugepages reported on node 1 00:05:37.996 [2024-07-15 08:44:26.305848] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:37.996 [2024-07-15 08:44:26.425775] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:39.369 08:44:27 -- accel/accel.sh@18 -- # out=' 00:05:39.369 SPDK Configuration: 00:05:39.369 Core mask: 0x1 00:05:39.369 00:05:39.369 Accel Perf Configuration: 00:05:39.369 Workload Type: copy_crc32c 00:05:39.369 CRC-32C seed: 0 00:05:39.369 Vector size: 4096 bytes 00:05:39.369 Transfer size: 8192 bytes 00:05:39.369 Vector count 2 00:05:39.369 Module: software 00:05:39.369 Queue depth: 32 00:05:39.369 Allocate depth: 32 00:05:39.369 # threads/core: 1 00:05:39.369 Run time: 1 seconds 00:05:39.369 Verify: Yes 00:05:39.369 00:05:39.369 Running for 1 seconds... 00:05:39.369 00:05:39.369 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:39.369 ------------------------------------------------------------------------------------ 00:05:39.369 0,0 154336/s 1205 MiB/s 0 0 00:05:39.370 ==================================================================================== 00:05:39.370 Total 154336/s 602 MiB/s 0 0' 00:05:39.370 08:44:27 -- accel/accel.sh@20 -- # IFS=: 00:05:39.370 08:44:27 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:39.370 08:44:27 -- accel/accel.sh@20 -- # read -r var val 00:05:39.370 08:44:27 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:39.370 08:44:27 -- accel/accel.sh@12 -- # build_accel_config 00:05:39.370 08:44:27 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:39.370 08:44:27 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:39.370 08:44:27 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:39.370 08:44:27 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:39.370 08:44:27 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:39.370 08:44:27 -- accel/accel.sh@41 -- # local IFS=, 00:05:39.370 08:44:27 -- accel/accel.sh@42 -- # jq -r . 00:05:39.370 [2024-07-15 08:44:27.726208] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:39.370 [2024-07-15 08:44:27.726290] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1389614 ] 00:05:39.370 EAL: No free 2048 kB hugepages reported on node 1 00:05:39.370 [2024-07-15 08:44:27.788497] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:39.370 [2024-07-15 08:44:27.907754] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:39.629 08:44:27 -- accel/accel.sh@21 -- # val= 00:05:39.629 08:44:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.629 08:44:27 -- accel/accel.sh@20 -- # IFS=: 00:05:39.629 08:44:27 -- accel/accel.sh@20 -- # read -r var val 00:05:39.629 08:44:27 -- accel/accel.sh@21 -- # val= 00:05:39.629 08:44:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.629 08:44:27 -- accel/accel.sh@20 -- # IFS=: 00:05:39.629 08:44:27 -- accel/accel.sh@20 -- # read -r var val 00:05:39.629 08:44:27 -- accel/accel.sh@21 -- # val=0x1 00:05:39.629 08:44:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.629 08:44:27 -- accel/accel.sh@20 -- # IFS=: 00:05:39.629 08:44:27 -- accel/accel.sh@20 -- # read -r var val 00:05:39.629 08:44:27 -- accel/accel.sh@21 -- # val= 00:05:39.629 08:44:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.629 08:44:27 -- accel/accel.sh@20 -- # IFS=: 00:05:39.629 08:44:27 -- accel/accel.sh@20 -- # read -r var val 00:05:39.629 08:44:27 -- accel/accel.sh@21 -- # val= 00:05:39.629 08:44:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.629 08:44:27 -- accel/accel.sh@20 -- # IFS=: 00:05:39.629 08:44:27 -- accel/accel.sh@20 -- # read -r var val 00:05:39.629 08:44:27 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:39.629 08:44:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.629 08:44:27 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:39.629 08:44:27 -- accel/accel.sh@20 -- # IFS=: 00:05:39.629 08:44:27 -- accel/accel.sh@20 -- # read -r var val 00:05:39.629 08:44:27 -- accel/accel.sh@21 -- # val=0 00:05:39.629 08:44:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.629 08:44:27 -- accel/accel.sh@20 -- # IFS=: 00:05:39.629 08:44:27 -- accel/accel.sh@20 -- # read -r var val 00:05:39.629 08:44:27 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:39.629 08:44:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.629 08:44:27 -- accel/accel.sh@20 -- # IFS=: 00:05:39.629 08:44:27 -- accel/accel.sh@20 -- # read -r var val 00:05:39.629 08:44:27 -- accel/accel.sh@21 -- # val='8192 bytes' 00:05:39.629 08:44:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.629 08:44:27 -- accel/accel.sh@20 -- # IFS=: 00:05:39.629 08:44:27 -- accel/accel.sh@20 -- # read -r var val 00:05:39.629 08:44:27 -- accel/accel.sh@21 -- # val= 00:05:39.629 08:44:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.629 08:44:27 -- accel/accel.sh@20 -- # IFS=: 00:05:39.629 08:44:27 -- accel/accel.sh@20 -- # read -r var val 00:05:39.629 08:44:27 -- accel/accel.sh@21 -- # val=software 00:05:39.629 08:44:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.629 08:44:27 -- accel/accel.sh@23 -- # accel_module=software 00:05:39.629 08:44:27 -- accel/accel.sh@20 -- # IFS=: 00:05:39.629 08:44:27 -- accel/accel.sh@20 -- # read -r var val 00:05:39.629 08:44:27 -- accel/accel.sh@21 -- # val=32 00:05:39.629 08:44:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.629 08:44:27 -- accel/accel.sh@20 -- # IFS=: 00:05:39.629 08:44:27 -- accel/accel.sh@20 -- # read -r var val 00:05:39.629 08:44:27 -- accel/accel.sh@21 -- # val=32 00:05:39.629 08:44:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.629 08:44:27 -- accel/accel.sh@20 -- # IFS=: 00:05:39.629 08:44:27 -- accel/accel.sh@20 -- # read -r var val 00:05:39.629 08:44:27 -- accel/accel.sh@21 -- # val=1 00:05:39.629 08:44:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.629 08:44:27 -- accel/accel.sh@20 -- # IFS=: 00:05:39.629 08:44:27 -- accel/accel.sh@20 -- # read -r var val 00:05:39.629 08:44:27 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:39.629 08:44:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.629 08:44:27 -- accel/accel.sh@20 -- # IFS=: 00:05:39.629 08:44:27 -- accel/accel.sh@20 -- # read -r var val 00:05:39.629 08:44:27 -- accel/accel.sh@21 -- # val=Yes 00:05:39.629 08:44:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.629 08:44:27 -- accel/accel.sh@20 -- # IFS=: 00:05:39.629 08:44:27 -- accel/accel.sh@20 -- # read -r var val 00:05:39.629 08:44:27 -- accel/accel.sh@21 -- # val= 00:05:39.629 08:44:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.629 08:44:27 -- accel/accel.sh@20 -- # IFS=: 00:05:39.629 08:44:27 -- accel/accel.sh@20 -- # read -r var val 00:05:39.629 08:44:27 -- accel/accel.sh@21 -- # val= 00:05:39.629 08:44:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.629 08:44:27 -- accel/accel.sh@20 -- # IFS=: 00:05:39.629 08:44:27 -- accel/accel.sh@20 -- # read -r var val 00:05:41.002 08:44:29 -- accel/accel.sh@21 -- # val= 00:05:41.002 08:44:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.002 08:44:29 -- accel/accel.sh@20 -- # IFS=: 00:05:41.002 08:44:29 -- accel/accel.sh@20 -- # read -r var val 00:05:41.002 08:44:29 -- accel/accel.sh@21 -- # val= 00:05:41.002 08:44:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.002 08:44:29 -- accel/accel.sh@20 -- # IFS=: 00:05:41.002 08:44:29 -- accel/accel.sh@20 -- # read -r var val 00:05:41.002 08:44:29 -- accel/accel.sh@21 -- # val= 00:05:41.002 08:44:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.002 08:44:29 -- accel/accel.sh@20 -- # IFS=: 00:05:41.002 08:44:29 -- accel/accel.sh@20 -- # read -r var val 00:05:41.002 08:44:29 -- accel/accel.sh@21 -- # val= 00:05:41.002 08:44:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.002 08:44:29 -- accel/accel.sh@20 -- # IFS=: 00:05:41.002 08:44:29 -- accel/accel.sh@20 -- # read -r var val 00:05:41.002 08:44:29 -- accel/accel.sh@21 -- # val= 00:05:41.002 08:44:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.002 08:44:29 -- accel/accel.sh@20 -- # IFS=: 00:05:41.002 08:44:29 -- accel/accel.sh@20 -- # read -r var val 00:05:41.002 08:44:29 -- accel/accel.sh@21 -- # val= 00:05:41.002 08:44:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.002 08:44:29 -- accel/accel.sh@20 -- # IFS=: 00:05:41.002 08:44:29 -- accel/accel.sh@20 -- # read -r var val 00:05:41.002 08:44:29 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:41.002 08:44:29 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:41.002 08:44:29 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:41.002 00:05:41.002 real 0m2.959s 00:05:41.002 user 0m2.658s 00:05:41.002 sys 0m0.293s 00:05:41.002 08:44:29 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:41.002 08:44:29 -- common/autotest_common.sh@10 -- # set +x 00:05:41.002 ************************************ 00:05:41.002 END TEST accel_copy_crc32c_C2 00:05:41.002 ************************************ 00:05:41.002 08:44:29 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:05:41.002 08:44:29 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:05:41.002 08:44:29 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:41.002 08:44:29 -- common/autotest_common.sh@10 -- # set +x 00:05:41.002 ************************************ 00:05:41.002 START TEST accel_dualcast 00:05:41.002 ************************************ 00:05:41.002 08:44:29 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w dualcast -y 00:05:41.002 08:44:29 -- accel/accel.sh@16 -- # local accel_opc 00:05:41.003 08:44:29 -- accel/accel.sh@17 -- # local accel_module 00:05:41.003 08:44:29 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:05:41.003 08:44:29 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:41.003 08:44:29 -- accel/accel.sh@12 -- # build_accel_config 00:05:41.003 08:44:29 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:41.003 08:44:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:41.003 08:44:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:41.003 08:44:29 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:41.003 08:44:29 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:41.003 08:44:29 -- accel/accel.sh@41 -- # local IFS=, 00:05:41.003 08:44:29 -- accel/accel.sh@42 -- # jq -r . 00:05:41.003 [2024-07-15 08:44:29.228134] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:41.003 [2024-07-15 08:44:29.228234] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1389842 ] 00:05:41.003 EAL: No free 2048 kB hugepages reported on node 1 00:05:41.003 [2024-07-15 08:44:29.290175] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:41.003 [2024-07-15 08:44:29.409822] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:42.376 08:44:30 -- accel/accel.sh@18 -- # out=' 00:05:42.376 SPDK Configuration: 00:05:42.376 Core mask: 0x1 00:05:42.376 00:05:42.376 Accel Perf Configuration: 00:05:42.376 Workload Type: dualcast 00:05:42.376 Transfer size: 4096 bytes 00:05:42.376 Vector count 1 00:05:42.376 Module: software 00:05:42.376 Queue depth: 32 00:05:42.376 Allocate depth: 32 00:05:42.376 # threads/core: 1 00:05:42.376 Run time: 1 seconds 00:05:42.376 Verify: Yes 00:05:42.376 00:05:42.376 Running for 1 seconds... 00:05:42.376 00:05:42.376 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:42.376 ------------------------------------------------------------------------------------ 00:05:42.376 0,0 297120/s 1160 MiB/s 0 0 00:05:42.376 ==================================================================================== 00:05:42.376 Total 297120/s 1160 MiB/s 0 0' 00:05:42.376 08:44:30 -- accel/accel.sh@20 -- # IFS=: 00:05:42.376 08:44:30 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:05:42.376 08:44:30 -- accel/accel.sh@20 -- # read -r var val 00:05:42.376 08:44:30 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:42.376 08:44:30 -- accel/accel.sh@12 -- # build_accel_config 00:05:42.376 08:44:30 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:42.376 08:44:30 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:42.376 08:44:30 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:42.376 08:44:30 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:42.376 08:44:30 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:42.376 08:44:30 -- accel/accel.sh@41 -- # local IFS=, 00:05:42.376 08:44:30 -- accel/accel.sh@42 -- # jq -r . 00:05:42.376 [2024-07-15 08:44:30.712661] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:42.376 [2024-07-15 08:44:30.712747] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1389989 ] 00:05:42.376 EAL: No free 2048 kB hugepages reported on node 1 00:05:42.376 [2024-07-15 08:44:30.774463] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:42.376 [2024-07-15 08:44:30.894355] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:42.634 08:44:30 -- accel/accel.sh@21 -- # val= 00:05:42.634 08:44:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.634 08:44:30 -- accel/accel.sh@20 -- # IFS=: 00:05:42.634 08:44:30 -- accel/accel.sh@20 -- # read -r var val 00:05:42.634 08:44:30 -- accel/accel.sh@21 -- # val= 00:05:42.634 08:44:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.634 08:44:30 -- accel/accel.sh@20 -- # IFS=: 00:05:42.634 08:44:30 -- accel/accel.sh@20 -- # read -r var val 00:05:42.634 08:44:30 -- accel/accel.sh@21 -- # val=0x1 00:05:42.634 08:44:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.634 08:44:30 -- accel/accel.sh@20 -- # IFS=: 00:05:42.634 08:44:30 -- accel/accel.sh@20 -- # read -r var val 00:05:42.634 08:44:30 -- accel/accel.sh@21 -- # val= 00:05:42.634 08:44:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.634 08:44:30 -- accel/accel.sh@20 -- # IFS=: 00:05:42.634 08:44:30 -- accel/accel.sh@20 -- # read -r var val 00:05:42.634 08:44:30 -- accel/accel.sh@21 -- # val= 00:05:42.634 08:44:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.634 08:44:30 -- accel/accel.sh@20 -- # IFS=: 00:05:42.634 08:44:30 -- accel/accel.sh@20 -- # read -r var val 00:05:42.634 08:44:30 -- accel/accel.sh@21 -- # val=dualcast 00:05:42.634 08:44:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.634 08:44:30 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:05:42.634 08:44:30 -- accel/accel.sh@20 -- # IFS=: 00:05:42.634 08:44:30 -- accel/accel.sh@20 -- # read -r var val 00:05:42.634 08:44:30 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:42.634 08:44:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.634 08:44:30 -- accel/accel.sh@20 -- # IFS=: 00:05:42.634 08:44:30 -- accel/accel.sh@20 -- # read -r var val 00:05:42.634 08:44:30 -- accel/accel.sh@21 -- # val= 00:05:42.634 08:44:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.634 08:44:30 -- accel/accel.sh@20 -- # IFS=: 00:05:42.634 08:44:30 -- accel/accel.sh@20 -- # read -r var val 00:05:42.634 08:44:30 -- accel/accel.sh@21 -- # val=software 00:05:42.634 08:44:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.634 08:44:30 -- accel/accel.sh@23 -- # accel_module=software 00:05:42.634 08:44:30 -- accel/accel.sh@20 -- # IFS=: 00:05:42.634 08:44:30 -- accel/accel.sh@20 -- # read -r var val 00:05:42.634 08:44:30 -- accel/accel.sh@21 -- # val=32 00:05:42.634 08:44:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.634 08:44:30 -- accel/accel.sh@20 -- # IFS=: 00:05:42.634 08:44:30 -- accel/accel.sh@20 -- # read -r var val 00:05:42.634 08:44:30 -- accel/accel.sh@21 -- # val=32 00:05:42.634 08:44:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.634 08:44:30 -- accel/accel.sh@20 -- # IFS=: 00:05:42.634 08:44:30 -- accel/accel.sh@20 -- # read -r var val 00:05:42.634 08:44:30 -- accel/accel.sh@21 -- # val=1 00:05:42.634 08:44:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.634 08:44:30 -- accel/accel.sh@20 -- # IFS=: 00:05:42.634 08:44:30 -- accel/accel.sh@20 -- # read -r var val 00:05:42.634 08:44:30 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:42.634 08:44:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.634 08:44:30 -- accel/accel.sh@20 -- # IFS=: 00:05:42.634 08:44:30 -- accel/accel.sh@20 -- # read -r var val 00:05:42.634 08:44:30 -- accel/accel.sh@21 -- # val=Yes 00:05:42.634 08:44:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.634 08:44:30 -- accel/accel.sh@20 -- # IFS=: 00:05:42.634 08:44:30 -- accel/accel.sh@20 -- # read -r var val 00:05:42.634 08:44:30 -- accel/accel.sh@21 -- # val= 00:05:42.634 08:44:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.634 08:44:30 -- accel/accel.sh@20 -- # IFS=: 00:05:42.634 08:44:30 -- accel/accel.sh@20 -- # read -r var val 00:05:42.634 08:44:30 -- accel/accel.sh@21 -- # val= 00:05:42.634 08:44:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.634 08:44:30 -- accel/accel.sh@20 -- # IFS=: 00:05:42.634 08:44:30 -- accel/accel.sh@20 -- # read -r var val 00:05:44.008 08:44:32 -- accel/accel.sh@21 -- # val= 00:05:44.008 08:44:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.008 08:44:32 -- accel/accel.sh@20 -- # IFS=: 00:05:44.008 08:44:32 -- accel/accel.sh@20 -- # read -r var val 00:05:44.008 08:44:32 -- accel/accel.sh@21 -- # val= 00:05:44.008 08:44:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.008 08:44:32 -- accel/accel.sh@20 -- # IFS=: 00:05:44.008 08:44:32 -- accel/accel.sh@20 -- # read -r var val 00:05:44.008 08:44:32 -- accel/accel.sh@21 -- # val= 00:05:44.008 08:44:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.008 08:44:32 -- accel/accel.sh@20 -- # IFS=: 00:05:44.008 08:44:32 -- accel/accel.sh@20 -- # read -r var val 00:05:44.008 08:44:32 -- accel/accel.sh@21 -- # val= 00:05:44.008 08:44:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.008 08:44:32 -- accel/accel.sh@20 -- # IFS=: 00:05:44.008 08:44:32 -- accel/accel.sh@20 -- # read -r var val 00:05:44.008 08:44:32 -- accel/accel.sh@21 -- # val= 00:05:44.008 08:44:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.008 08:44:32 -- accel/accel.sh@20 -- # IFS=: 00:05:44.008 08:44:32 -- accel/accel.sh@20 -- # read -r var val 00:05:44.008 08:44:32 -- accel/accel.sh@21 -- # val= 00:05:44.008 08:44:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.008 08:44:32 -- accel/accel.sh@20 -- # IFS=: 00:05:44.008 08:44:32 -- accel/accel.sh@20 -- # read -r var val 00:05:44.008 08:44:32 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:44.008 08:44:32 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:05:44.008 08:44:32 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:44.008 00:05:44.008 real 0m2.971s 00:05:44.008 user 0m2.677s 00:05:44.008 sys 0m0.285s 00:05:44.008 08:44:32 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:44.008 08:44:32 -- common/autotest_common.sh@10 -- # set +x 00:05:44.008 ************************************ 00:05:44.008 END TEST accel_dualcast 00:05:44.008 ************************************ 00:05:44.008 08:44:32 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:05:44.008 08:44:32 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:05:44.008 08:44:32 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:44.008 08:44:32 -- common/autotest_common.sh@10 -- # set +x 00:05:44.008 ************************************ 00:05:44.008 START TEST accel_compare 00:05:44.008 ************************************ 00:05:44.008 08:44:32 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w compare -y 00:05:44.008 08:44:32 -- accel/accel.sh@16 -- # local accel_opc 00:05:44.008 08:44:32 -- accel/accel.sh@17 -- # local accel_module 00:05:44.008 08:44:32 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:05:44.008 08:44:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:44.008 08:44:32 -- accel/accel.sh@12 -- # build_accel_config 00:05:44.008 08:44:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:44.008 08:44:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:44.008 08:44:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:44.008 08:44:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:44.008 08:44:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:44.008 08:44:32 -- accel/accel.sh@41 -- # local IFS=, 00:05:44.008 08:44:32 -- accel/accel.sh@42 -- # jq -r . 00:05:44.008 [2024-07-15 08:44:32.225830] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:44.008 [2024-07-15 08:44:32.225928] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1390154 ] 00:05:44.008 EAL: No free 2048 kB hugepages reported on node 1 00:05:44.008 [2024-07-15 08:44:32.290055] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:44.008 [2024-07-15 08:44:32.411420] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:45.379 08:44:33 -- accel/accel.sh@18 -- # out=' 00:05:45.379 SPDK Configuration: 00:05:45.379 Core mask: 0x1 00:05:45.379 00:05:45.379 Accel Perf Configuration: 00:05:45.379 Workload Type: compare 00:05:45.379 Transfer size: 4096 bytes 00:05:45.379 Vector count 1 00:05:45.379 Module: software 00:05:45.379 Queue depth: 32 00:05:45.379 Allocate depth: 32 00:05:45.379 # threads/core: 1 00:05:45.379 Run time: 1 seconds 00:05:45.379 Verify: Yes 00:05:45.379 00:05:45.379 Running for 1 seconds... 00:05:45.379 00:05:45.379 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:45.379 ------------------------------------------------------------------------------------ 00:05:45.379 0,0 400416/s 1564 MiB/s 0 0 00:05:45.379 ==================================================================================== 00:05:45.379 Total 400416/s 1564 MiB/s 0 0' 00:05:45.379 08:44:33 -- accel/accel.sh@20 -- # IFS=: 00:05:45.379 08:44:33 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:05:45.379 08:44:33 -- accel/accel.sh@20 -- # read -r var val 00:05:45.379 08:44:33 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:45.379 08:44:33 -- accel/accel.sh@12 -- # build_accel_config 00:05:45.379 08:44:33 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:45.379 08:44:33 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:45.379 08:44:33 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:45.379 08:44:33 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:45.379 08:44:33 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:45.379 08:44:33 -- accel/accel.sh@41 -- # local IFS=, 00:05:45.379 08:44:33 -- accel/accel.sh@42 -- # jq -r . 00:05:45.379 [2024-07-15 08:44:33.700840] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:45.379 [2024-07-15 08:44:33.700934] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1390416 ] 00:05:45.379 EAL: No free 2048 kB hugepages reported on node 1 00:05:45.379 [2024-07-15 08:44:33.762950] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:45.379 [2024-07-15 08:44:33.881661] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:45.637 08:44:33 -- accel/accel.sh@21 -- # val= 00:05:45.637 08:44:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.637 08:44:33 -- accel/accel.sh@20 -- # IFS=: 00:05:45.637 08:44:33 -- accel/accel.sh@20 -- # read -r var val 00:05:45.637 08:44:33 -- accel/accel.sh@21 -- # val= 00:05:45.637 08:44:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.637 08:44:33 -- accel/accel.sh@20 -- # IFS=: 00:05:45.637 08:44:33 -- accel/accel.sh@20 -- # read -r var val 00:05:45.637 08:44:33 -- accel/accel.sh@21 -- # val=0x1 00:05:45.637 08:44:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.637 08:44:33 -- accel/accel.sh@20 -- # IFS=: 00:05:45.637 08:44:33 -- accel/accel.sh@20 -- # read -r var val 00:05:45.637 08:44:33 -- accel/accel.sh@21 -- # val= 00:05:45.637 08:44:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.637 08:44:33 -- accel/accel.sh@20 -- # IFS=: 00:05:45.637 08:44:33 -- accel/accel.sh@20 -- # read -r var val 00:05:45.637 08:44:33 -- accel/accel.sh@21 -- # val= 00:05:45.637 08:44:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.637 08:44:33 -- accel/accel.sh@20 -- # IFS=: 00:05:45.637 08:44:33 -- accel/accel.sh@20 -- # read -r var val 00:05:45.637 08:44:33 -- accel/accel.sh@21 -- # val=compare 00:05:45.637 08:44:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.637 08:44:33 -- accel/accel.sh@24 -- # accel_opc=compare 00:05:45.637 08:44:33 -- accel/accel.sh@20 -- # IFS=: 00:05:45.637 08:44:33 -- accel/accel.sh@20 -- # read -r var val 00:05:45.637 08:44:33 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:45.637 08:44:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.637 08:44:33 -- accel/accel.sh@20 -- # IFS=: 00:05:45.637 08:44:33 -- accel/accel.sh@20 -- # read -r var val 00:05:45.637 08:44:33 -- accel/accel.sh@21 -- # val= 00:05:45.637 08:44:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.637 08:44:33 -- accel/accel.sh@20 -- # IFS=: 00:05:45.637 08:44:33 -- accel/accel.sh@20 -- # read -r var val 00:05:45.637 08:44:33 -- accel/accel.sh@21 -- # val=software 00:05:45.637 08:44:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.637 08:44:33 -- accel/accel.sh@23 -- # accel_module=software 00:05:45.637 08:44:33 -- accel/accel.sh@20 -- # IFS=: 00:05:45.637 08:44:33 -- accel/accel.sh@20 -- # read -r var val 00:05:45.637 08:44:33 -- accel/accel.sh@21 -- # val=32 00:05:45.637 08:44:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.637 08:44:33 -- accel/accel.sh@20 -- # IFS=: 00:05:45.637 08:44:33 -- accel/accel.sh@20 -- # read -r var val 00:05:45.637 08:44:33 -- accel/accel.sh@21 -- # val=32 00:05:45.637 08:44:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.637 08:44:33 -- accel/accel.sh@20 -- # IFS=: 00:05:45.637 08:44:33 -- accel/accel.sh@20 -- # read -r var val 00:05:45.637 08:44:33 -- accel/accel.sh@21 -- # val=1 00:05:45.637 08:44:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.637 08:44:33 -- accel/accel.sh@20 -- # IFS=: 00:05:45.637 08:44:33 -- accel/accel.sh@20 -- # read -r var val 00:05:45.637 08:44:33 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:45.637 08:44:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.637 08:44:33 -- accel/accel.sh@20 -- # IFS=: 00:05:45.637 08:44:33 -- accel/accel.sh@20 -- # read -r var val 00:05:45.637 08:44:33 -- accel/accel.sh@21 -- # val=Yes 00:05:45.637 08:44:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.637 08:44:33 -- accel/accel.sh@20 -- # IFS=: 00:05:45.637 08:44:33 -- accel/accel.sh@20 -- # read -r var val 00:05:45.637 08:44:33 -- accel/accel.sh@21 -- # val= 00:05:45.637 08:44:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.637 08:44:33 -- accel/accel.sh@20 -- # IFS=: 00:05:45.637 08:44:33 -- accel/accel.sh@20 -- # read -r var val 00:05:45.637 08:44:33 -- accel/accel.sh@21 -- # val= 00:05:45.637 08:44:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.637 08:44:33 -- accel/accel.sh@20 -- # IFS=: 00:05:45.637 08:44:33 -- accel/accel.sh@20 -- # read -r var val 00:05:47.048 08:44:35 -- accel/accel.sh@21 -- # val= 00:05:47.048 08:44:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.048 08:44:35 -- accel/accel.sh@20 -- # IFS=: 00:05:47.048 08:44:35 -- accel/accel.sh@20 -- # read -r var val 00:05:47.048 08:44:35 -- accel/accel.sh@21 -- # val= 00:05:47.048 08:44:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.048 08:44:35 -- accel/accel.sh@20 -- # IFS=: 00:05:47.048 08:44:35 -- accel/accel.sh@20 -- # read -r var val 00:05:47.048 08:44:35 -- accel/accel.sh@21 -- # val= 00:05:47.048 08:44:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.048 08:44:35 -- accel/accel.sh@20 -- # IFS=: 00:05:47.048 08:44:35 -- accel/accel.sh@20 -- # read -r var val 00:05:47.048 08:44:35 -- accel/accel.sh@21 -- # val= 00:05:47.048 08:44:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.048 08:44:35 -- accel/accel.sh@20 -- # IFS=: 00:05:47.048 08:44:35 -- accel/accel.sh@20 -- # read -r var val 00:05:47.048 08:44:35 -- accel/accel.sh@21 -- # val= 00:05:47.048 08:44:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.048 08:44:35 -- accel/accel.sh@20 -- # IFS=: 00:05:47.048 08:44:35 -- accel/accel.sh@20 -- # read -r var val 00:05:47.048 08:44:35 -- accel/accel.sh@21 -- # val= 00:05:47.048 08:44:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.048 08:44:35 -- accel/accel.sh@20 -- # IFS=: 00:05:47.048 08:44:35 -- accel/accel.sh@20 -- # read -r var val 00:05:47.048 08:44:35 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:47.048 08:44:35 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:05:47.048 08:44:35 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:47.048 00:05:47.048 real 0m2.960s 00:05:47.048 user 0m2.664s 00:05:47.048 sys 0m0.287s 00:05:47.048 08:44:35 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:47.048 08:44:35 -- common/autotest_common.sh@10 -- # set +x 00:05:47.048 ************************************ 00:05:47.048 END TEST accel_compare 00:05:47.048 ************************************ 00:05:47.048 08:44:35 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:05:47.048 08:44:35 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:05:47.048 08:44:35 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:47.048 08:44:35 -- common/autotest_common.sh@10 -- # set +x 00:05:47.048 ************************************ 00:05:47.048 START TEST accel_xor 00:05:47.048 ************************************ 00:05:47.048 08:44:35 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w xor -y 00:05:47.048 08:44:35 -- accel/accel.sh@16 -- # local accel_opc 00:05:47.048 08:44:35 -- accel/accel.sh@17 -- # local accel_module 00:05:47.048 08:44:35 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:05:47.048 08:44:35 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:05:47.048 08:44:35 -- accel/accel.sh@12 -- # build_accel_config 00:05:47.048 08:44:35 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:47.048 08:44:35 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:47.048 08:44:35 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:47.048 08:44:35 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:47.048 08:44:35 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:47.048 08:44:35 -- accel/accel.sh@41 -- # local IFS=, 00:05:47.048 08:44:35 -- accel/accel.sh@42 -- # jq -r . 00:05:47.048 [2024-07-15 08:44:35.215225] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:47.049 [2024-07-15 08:44:35.215308] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1390571 ] 00:05:47.049 EAL: No free 2048 kB hugepages reported on node 1 00:05:47.049 [2024-07-15 08:44:35.279705] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:47.049 [2024-07-15 08:44:35.397819] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:48.422 08:44:36 -- accel/accel.sh@18 -- # out=' 00:05:48.422 SPDK Configuration: 00:05:48.422 Core mask: 0x1 00:05:48.422 00:05:48.422 Accel Perf Configuration: 00:05:48.422 Workload Type: xor 00:05:48.422 Source buffers: 2 00:05:48.422 Transfer size: 4096 bytes 00:05:48.422 Vector count 1 00:05:48.422 Module: software 00:05:48.422 Queue depth: 32 00:05:48.422 Allocate depth: 32 00:05:48.422 # threads/core: 1 00:05:48.422 Run time: 1 seconds 00:05:48.422 Verify: Yes 00:05:48.422 00:05:48.422 Running for 1 seconds... 00:05:48.422 00:05:48.422 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:48.422 ------------------------------------------------------------------------------------ 00:05:48.422 0,0 191552/s 748 MiB/s 0 0 00:05:48.423 ==================================================================================== 00:05:48.423 Total 191552/s 748 MiB/s 0 0' 00:05:48.423 08:44:36 -- accel/accel.sh@20 -- # IFS=: 00:05:48.423 08:44:36 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:05:48.423 08:44:36 -- accel/accel.sh@20 -- # read -r var val 00:05:48.423 08:44:36 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:05:48.423 08:44:36 -- accel/accel.sh@12 -- # build_accel_config 00:05:48.423 08:44:36 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:48.423 08:44:36 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:48.423 08:44:36 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:48.423 08:44:36 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:48.423 08:44:36 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:48.423 08:44:36 -- accel/accel.sh@41 -- # local IFS=, 00:05:48.423 08:44:36 -- accel/accel.sh@42 -- # jq -r . 00:05:48.423 [2024-07-15 08:44:36.701554] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:48.423 [2024-07-15 08:44:36.701642] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1390718 ] 00:05:48.423 EAL: No free 2048 kB hugepages reported on node 1 00:05:48.423 [2024-07-15 08:44:36.763909] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:48.423 [2024-07-15 08:44:36.882122] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:48.423 08:44:36 -- accel/accel.sh@21 -- # val= 00:05:48.423 08:44:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.423 08:44:36 -- accel/accel.sh@20 -- # IFS=: 00:05:48.423 08:44:36 -- accel/accel.sh@20 -- # read -r var val 00:05:48.423 08:44:36 -- accel/accel.sh@21 -- # val= 00:05:48.423 08:44:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.423 08:44:36 -- accel/accel.sh@20 -- # IFS=: 00:05:48.423 08:44:36 -- accel/accel.sh@20 -- # read -r var val 00:05:48.423 08:44:36 -- accel/accel.sh@21 -- # val=0x1 00:05:48.423 08:44:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.423 08:44:36 -- accel/accel.sh@20 -- # IFS=: 00:05:48.423 08:44:36 -- accel/accel.sh@20 -- # read -r var val 00:05:48.423 08:44:36 -- accel/accel.sh@21 -- # val= 00:05:48.423 08:44:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.423 08:44:36 -- accel/accel.sh@20 -- # IFS=: 00:05:48.423 08:44:36 -- accel/accel.sh@20 -- # read -r var val 00:05:48.423 08:44:36 -- accel/accel.sh@21 -- # val= 00:05:48.423 08:44:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.423 08:44:36 -- accel/accel.sh@20 -- # IFS=: 00:05:48.423 08:44:36 -- accel/accel.sh@20 -- # read -r var val 00:05:48.423 08:44:36 -- accel/accel.sh@21 -- # val=xor 00:05:48.423 08:44:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.423 08:44:36 -- accel/accel.sh@24 -- # accel_opc=xor 00:05:48.423 08:44:36 -- accel/accel.sh@20 -- # IFS=: 00:05:48.423 08:44:36 -- accel/accel.sh@20 -- # read -r var val 00:05:48.423 08:44:36 -- accel/accel.sh@21 -- # val=2 00:05:48.423 08:44:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.423 08:44:36 -- accel/accel.sh@20 -- # IFS=: 00:05:48.423 08:44:36 -- accel/accel.sh@20 -- # read -r var val 00:05:48.423 08:44:36 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:48.423 08:44:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.423 08:44:36 -- accel/accel.sh@20 -- # IFS=: 00:05:48.423 08:44:36 -- accel/accel.sh@20 -- # read -r var val 00:05:48.423 08:44:36 -- accel/accel.sh@21 -- # val= 00:05:48.423 08:44:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.423 08:44:36 -- accel/accel.sh@20 -- # IFS=: 00:05:48.423 08:44:36 -- accel/accel.sh@20 -- # read -r var val 00:05:48.423 08:44:36 -- accel/accel.sh@21 -- # val=software 00:05:48.423 08:44:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.423 08:44:36 -- accel/accel.sh@23 -- # accel_module=software 00:05:48.423 08:44:36 -- accel/accel.sh@20 -- # IFS=: 00:05:48.423 08:44:36 -- accel/accel.sh@20 -- # read -r var val 00:05:48.423 08:44:36 -- accel/accel.sh@21 -- # val=32 00:05:48.423 08:44:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.423 08:44:36 -- accel/accel.sh@20 -- # IFS=: 00:05:48.423 08:44:36 -- accel/accel.sh@20 -- # read -r var val 00:05:48.423 08:44:36 -- accel/accel.sh@21 -- # val=32 00:05:48.423 08:44:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.423 08:44:36 -- accel/accel.sh@20 -- # IFS=: 00:05:48.423 08:44:36 -- accel/accel.sh@20 -- # read -r var val 00:05:48.423 08:44:36 -- accel/accel.sh@21 -- # val=1 00:05:48.423 08:44:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.423 08:44:36 -- accel/accel.sh@20 -- # IFS=: 00:05:48.423 08:44:36 -- accel/accel.sh@20 -- # read -r var val 00:05:48.423 08:44:36 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:48.423 08:44:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.423 08:44:36 -- accel/accel.sh@20 -- # IFS=: 00:05:48.423 08:44:36 -- accel/accel.sh@20 -- # read -r var val 00:05:48.423 08:44:36 -- accel/accel.sh@21 -- # val=Yes 00:05:48.423 08:44:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.423 08:44:36 -- accel/accel.sh@20 -- # IFS=: 00:05:48.423 08:44:36 -- accel/accel.sh@20 -- # read -r var val 00:05:48.423 08:44:36 -- accel/accel.sh@21 -- # val= 00:05:48.423 08:44:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.423 08:44:36 -- accel/accel.sh@20 -- # IFS=: 00:05:48.423 08:44:36 -- accel/accel.sh@20 -- # read -r var val 00:05:48.423 08:44:36 -- accel/accel.sh@21 -- # val= 00:05:48.423 08:44:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.423 08:44:36 -- accel/accel.sh@20 -- # IFS=: 00:05:48.423 08:44:36 -- accel/accel.sh@20 -- # read -r var val 00:05:49.813 08:44:38 -- accel/accel.sh@21 -- # val= 00:05:49.813 08:44:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.813 08:44:38 -- accel/accel.sh@20 -- # IFS=: 00:05:49.813 08:44:38 -- accel/accel.sh@20 -- # read -r var val 00:05:49.813 08:44:38 -- accel/accel.sh@21 -- # val= 00:05:49.813 08:44:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.813 08:44:38 -- accel/accel.sh@20 -- # IFS=: 00:05:49.813 08:44:38 -- accel/accel.sh@20 -- # read -r var val 00:05:49.813 08:44:38 -- accel/accel.sh@21 -- # val= 00:05:49.813 08:44:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.813 08:44:38 -- accel/accel.sh@20 -- # IFS=: 00:05:49.813 08:44:38 -- accel/accel.sh@20 -- # read -r var val 00:05:49.813 08:44:38 -- accel/accel.sh@21 -- # val= 00:05:49.813 08:44:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.813 08:44:38 -- accel/accel.sh@20 -- # IFS=: 00:05:49.813 08:44:38 -- accel/accel.sh@20 -- # read -r var val 00:05:49.813 08:44:38 -- accel/accel.sh@21 -- # val= 00:05:49.813 08:44:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.813 08:44:38 -- accel/accel.sh@20 -- # IFS=: 00:05:49.813 08:44:38 -- accel/accel.sh@20 -- # read -r var val 00:05:49.813 08:44:38 -- accel/accel.sh@21 -- # val= 00:05:49.813 08:44:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.813 08:44:38 -- accel/accel.sh@20 -- # IFS=: 00:05:49.813 08:44:38 -- accel/accel.sh@20 -- # read -r var val 00:05:49.813 08:44:38 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:49.813 08:44:38 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:05:49.813 08:44:38 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:49.813 00:05:49.813 real 0m2.965s 00:05:49.813 user 0m2.668s 00:05:49.813 sys 0m0.288s 00:05:49.813 08:44:38 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:49.813 08:44:38 -- common/autotest_common.sh@10 -- # set +x 00:05:49.813 ************************************ 00:05:49.813 END TEST accel_xor 00:05:49.813 ************************************ 00:05:49.813 08:44:38 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:05:49.813 08:44:38 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:05:49.813 08:44:38 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:49.813 08:44:38 -- common/autotest_common.sh@10 -- # set +x 00:05:49.813 ************************************ 00:05:49.813 START TEST accel_xor 00:05:49.813 ************************************ 00:05:49.813 08:44:38 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w xor -y -x 3 00:05:49.813 08:44:38 -- accel/accel.sh@16 -- # local accel_opc 00:05:49.813 08:44:38 -- accel/accel.sh@17 -- # local accel_module 00:05:49.813 08:44:38 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:05:49.813 08:44:38 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:05:49.813 08:44:38 -- accel/accel.sh@12 -- # build_accel_config 00:05:49.813 08:44:38 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:49.814 08:44:38 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:49.814 08:44:38 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:49.814 08:44:38 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:49.814 08:44:38 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:49.814 08:44:38 -- accel/accel.sh@41 -- # local IFS=, 00:05:49.814 08:44:38 -- accel/accel.sh@42 -- # jq -r . 00:05:49.814 [2024-07-15 08:44:38.205270] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:49.814 [2024-07-15 08:44:38.205351] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1390992 ] 00:05:49.814 EAL: No free 2048 kB hugepages reported on node 1 00:05:49.814 [2024-07-15 08:44:38.264969] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:50.072 [2024-07-15 08:44:38.380415] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:51.446 08:44:39 -- accel/accel.sh@18 -- # out=' 00:05:51.446 SPDK Configuration: 00:05:51.446 Core mask: 0x1 00:05:51.446 00:05:51.446 Accel Perf Configuration: 00:05:51.446 Workload Type: xor 00:05:51.446 Source buffers: 3 00:05:51.446 Transfer size: 4096 bytes 00:05:51.446 Vector count 1 00:05:51.446 Module: software 00:05:51.446 Queue depth: 32 00:05:51.446 Allocate depth: 32 00:05:51.446 # threads/core: 1 00:05:51.446 Run time: 1 seconds 00:05:51.446 Verify: Yes 00:05:51.446 00:05:51.446 Running for 1 seconds... 00:05:51.446 00:05:51.446 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:51.446 ------------------------------------------------------------------------------------ 00:05:51.446 0,0 184096/s 719 MiB/s 0 0 00:05:51.446 ==================================================================================== 00:05:51.446 Total 184096/s 719 MiB/s 0 0' 00:05:51.446 08:44:39 -- accel/accel.sh@20 -- # IFS=: 00:05:51.446 08:44:39 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:05:51.446 08:44:39 -- accel/accel.sh@20 -- # read -r var val 00:05:51.446 08:44:39 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:05:51.446 08:44:39 -- accel/accel.sh@12 -- # build_accel_config 00:05:51.446 08:44:39 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:51.446 08:44:39 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:51.446 08:44:39 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:51.446 08:44:39 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:51.446 08:44:39 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:51.446 08:44:39 -- accel/accel.sh@41 -- # local IFS=, 00:05:51.446 08:44:39 -- accel/accel.sh@42 -- # jq -r . 00:05:51.446 [2024-07-15 08:44:39.670606] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:51.446 [2024-07-15 08:44:39.670693] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1391146 ] 00:05:51.446 EAL: No free 2048 kB hugepages reported on node 1 00:05:51.446 [2024-07-15 08:44:39.732745] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:51.446 [2024-07-15 08:44:39.852368] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:51.446 08:44:39 -- accel/accel.sh@21 -- # val= 00:05:51.446 08:44:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.446 08:44:39 -- accel/accel.sh@20 -- # IFS=: 00:05:51.446 08:44:39 -- accel/accel.sh@20 -- # read -r var val 00:05:51.446 08:44:39 -- accel/accel.sh@21 -- # val= 00:05:51.446 08:44:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.446 08:44:39 -- accel/accel.sh@20 -- # IFS=: 00:05:51.446 08:44:39 -- accel/accel.sh@20 -- # read -r var val 00:05:51.446 08:44:39 -- accel/accel.sh@21 -- # val=0x1 00:05:51.446 08:44:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.446 08:44:39 -- accel/accel.sh@20 -- # IFS=: 00:05:51.446 08:44:39 -- accel/accel.sh@20 -- # read -r var val 00:05:51.446 08:44:39 -- accel/accel.sh@21 -- # val= 00:05:51.446 08:44:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.446 08:44:39 -- accel/accel.sh@20 -- # IFS=: 00:05:51.446 08:44:39 -- accel/accel.sh@20 -- # read -r var val 00:05:51.446 08:44:39 -- accel/accel.sh@21 -- # val= 00:05:51.446 08:44:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.446 08:44:39 -- accel/accel.sh@20 -- # IFS=: 00:05:51.446 08:44:39 -- accel/accel.sh@20 -- # read -r var val 00:05:51.446 08:44:39 -- accel/accel.sh@21 -- # val=xor 00:05:51.446 08:44:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.446 08:44:39 -- accel/accel.sh@24 -- # accel_opc=xor 00:05:51.446 08:44:39 -- accel/accel.sh@20 -- # IFS=: 00:05:51.446 08:44:39 -- accel/accel.sh@20 -- # read -r var val 00:05:51.446 08:44:39 -- accel/accel.sh@21 -- # val=3 00:05:51.446 08:44:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.446 08:44:39 -- accel/accel.sh@20 -- # IFS=: 00:05:51.446 08:44:39 -- accel/accel.sh@20 -- # read -r var val 00:05:51.446 08:44:39 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:51.446 08:44:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.446 08:44:39 -- accel/accel.sh@20 -- # IFS=: 00:05:51.446 08:44:39 -- accel/accel.sh@20 -- # read -r var val 00:05:51.446 08:44:39 -- accel/accel.sh@21 -- # val= 00:05:51.446 08:44:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.446 08:44:39 -- accel/accel.sh@20 -- # IFS=: 00:05:51.446 08:44:39 -- accel/accel.sh@20 -- # read -r var val 00:05:51.446 08:44:39 -- accel/accel.sh@21 -- # val=software 00:05:51.446 08:44:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.446 08:44:39 -- accel/accel.sh@23 -- # accel_module=software 00:05:51.446 08:44:39 -- accel/accel.sh@20 -- # IFS=: 00:05:51.446 08:44:39 -- accel/accel.sh@20 -- # read -r var val 00:05:51.446 08:44:39 -- accel/accel.sh@21 -- # val=32 00:05:51.446 08:44:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.446 08:44:39 -- accel/accel.sh@20 -- # IFS=: 00:05:51.446 08:44:39 -- accel/accel.sh@20 -- # read -r var val 00:05:51.446 08:44:39 -- accel/accel.sh@21 -- # val=32 00:05:51.446 08:44:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.446 08:44:39 -- accel/accel.sh@20 -- # IFS=: 00:05:51.446 08:44:39 -- accel/accel.sh@20 -- # read -r var val 00:05:51.446 08:44:39 -- accel/accel.sh@21 -- # val=1 00:05:51.446 08:44:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.446 08:44:39 -- accel/accel.sh@20 -- # IFS=: 00:05:51.446 08:44:39 -- accel/accel.sh@20 -- # read -r var val 00:05:51.446 08:44:39 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:51.446 08:44:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.446 08:44:39 -- accel/accel.sh@20 -- # IFS=: 00:05:51.446 08:44:39 -- accel/accel.sh@20 -- # read -r var val 00:05:51.446 08:44:39 -- accel/accel.sh@21 -- # val=Yes 00:05:51.446 08:44:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.446 08:44:39 -- accel/accel.sh@20 -- # IFS=: 00:05:51.446 08:44:39 -- accel/accel.sh@20 -- # read -r var val 00:05:51.446 08:44:39 -- accel/accel.sh@21 -- # val= 00:05:51.446 08:44:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.446 08:44:39 -- accel/accel.sh@20 -- # IFS=: 00:05:51.446 08:44:39 -- accel/accel.sh@20 -- # read -r var val 00:05:51.446 08:44:39 -- accel/accel.sh@21 -- # val= 00:05:51.446 08:44:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.446 08:44:39 -- accel/accel.sh@20 -- # IFS=: 00:05:51.446 08:44:39 -- accel/accel.sh@20 -- # read -r var val 00:05:52.820 08:44:41 -- accel/accel.sh@21 -- # val= 00:05:52.820 08:44:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.820 08:44:41 -- accel/accel.sh@20 -- # IFS=: 00:05:52.820 08:44:41 -- accel/accel.sh@20 -- # read -r var val 00:05:52.820 08:44:41 -- accel/accel.sh@21 -- # val= 00:05:52.820 08:44:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.820 08:44:41 -- accel/accel.sh@20 -- # IFS=: 00:05:52.820 08:44:41 -- accel/accel.sh@20 -- # read -r var val 00:05:52.820 08:44:41 -- accel/accel.sh@21 -- # val= 00:05:52.820 08:44:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.820 08:44:41 -- accel/accel.sh@20 -- # IFS=: 00:05:52.820 08:44:41 -- accel/accel.sh@20 -- # read -r var val 00:05:52.820 08:44:41 -- accel/accel.sh@21 -- # val= 00:05:52.820 08:44:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.820 08:44:41 -- accel/accel.sh@20 -- # IFS=: 00:05:52.820 08:44:41 -- accel/accel.sh@20 -- # read -r var val 00:05:52.820 08:44:41 -- accel/accel.sh@21 -- # val= 00:05:52.820 08:44:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.820 08:44:41 -- accel/accel.sh@20 -- # IFS=: 00:05:52.820 08:44:41 -- accel/accel.sh@20 -- # read -r var val 00:05:52.820 08:44:41 -- accel/accel.sh@21 -- # val= 00:05:52.820 08:44:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.820 08:44:41 -- accel/accel.sh@20 -- # IFS=: 00:05:52.820 08:44:41 -- accel/accel.sh@20 -- # read -r var val 00:05:52.820 08:44:41 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:52.820 08:44:41 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:05:52.820 08:44:41 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:52.820 00:05:52.820 real 0m2.953s 00:05:52.820 user 0m2.656s 00:05:52.820 sys 0m0.289s 00:05:52.820 08:44:41 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:52.820 08:44:41 -- common/autotest_common.sh@10 -- # set +x 00:05:52.820 ************************************ 00:05:52.820 END TEST accel_xor 00:05:52.820 ************************************ 00:05:52.820 08:44:41 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:05:52.820 08:44:41 -- common/autotest_common.sh@1077 -- # '[' 6 -le 1 ']' 00:05:52.820 08:44:41 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:52.820 08:44:41 -- common/autotest_common.sh@10 -- # set +x 00:05:52.820 ************************************ 00:05:52.820 START TEST accel_dif_verify 00:05:52.820 ************************************ 00:05:52.820 08:44:41 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w dif_verify 00:05:52.820 08:44:41 -- accel/accel.sh@16 -- # local accel_opc 00:05:52.820 08:44:41 -- accel/accel.sh@17 -- # local accel_module 00:05:52.820 08:44:41 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:05:52.820 08:44:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:05:52.820 08:44:41 -- accel/accel.sh@12 -- # build_accel_config 00:05:52.820 08:44:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:52.820 08:44:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:52.820 08:44:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:52.820 08:44:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:52.820 08:44:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:52.820 08:44:41 -- accel/accel.sh@41 -- # local IFS=, 00:05:52.820 08:44:41 -- accel/accel.sh@42 -- # jq -r . 00:05:52.820 [2024-07-15 08:44:41.183600] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:52.820 [2024-07-15 08:44:41.183684] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1391299 ] 00:05:52.820 EAL: No free 2048 kB hugepages reported on node 1 00:05:52.820 [2024-07-15 08:44:41.246211] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:53.079 [2024-07-15 08:44:41.366145] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:54.453 08:44:42 -- accel/accel.sh@18 -- # out=' 00:05:54.453 SPDK Configuration: 00:05:54.453 Core mask: 0x1 00:05:54.453 00:05:54.453 Accel Perf Configuration: 00:05:54.453 Workload Type: dif_verify 00:05:54.453 Vector size: 4096 bytes 00:05:54.453 Transfer size: 4096 bytes 00:05:54.453 Block size: 512 bytes 00:05:54.453 Metadata size: 8 bytes 00:05:54.453 Vector count 1 00:05:54.453 Module: software 00:05:54.453 Queue depth: 32 00:05:54.453 Allocate depth: 32 00:05:54.453 # threads/core: 1 00:05:54.453 Run time: 1 seconds 00:05:54.453 Verify: No 00:05:54.453 00:05:54.453 Running for 1 seconds... 00:05:54.453 00:05:54.453 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:54.453 ------------------------------------------------------------------------------------ 00:05:54.453 0,0 80960/s 321 MiB/s 0 0 00:05:54.453 ==================================================================================== 00:05:54.453 Total 80960/s 316 MiB/s 0 0' 00:05:54.453 08:44:42 -- accel/accel.sh@20 -- # IFS=: 00:05:54.453 08:44:42 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:05:54.453 08:44:42 -- accel/accel.sh@20 -- # read -r var val 00:05:54.453 08:44:42 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:05:54.453 08:44:42 -- accel/accel.sh@12 -- # build_accel_config 00:05:54.453 08:44:42 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:54.453 08:44:42 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:54.453 08:44:42 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:54.453 08:44:42 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:54.453 08:44:42 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:54.453 08:44:42 -- accel/accel.sh@41 -- # local IFS=, 00:05:54.453 08:44:42 -- accel/accel.sh@42 -- # jq -r . 00:05:54.453 [2024-07-15 08:44:42.657139] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:54.453 [2024-07-15 08:44:42.657226] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1391564 ] 00:05:54.453 EAL: No free 2048 kB hugepages reported on node 1 00:05:54.453 [2024-07-15 08:44:42.718972] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:54.453 [2024-07-15 08:44:42.838230] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:54.453 08:44:42 -- accel/accel.sh@21 -- # val= 00:05:54.453 08:44:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.453 08:44:42 -- accel/accel.sh@20 -- # IFS=: 00:05:54.453 08:44:42 -- accel/accel.sh@20 -- # read -r var val 00:05:54.453 08:44:42 -- accel/accel.sh@21 -- # val= 00:05:54.453 08:44:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.453 08:44:42 -- accel/accel.sh@20 -- # IFS=: 00:05:54.453 08:44:42 -- accel/accel.sh@20 -- # read -r var val 00:05:54.453 08:44:42 -- accel/accel.sh@21 -- # val=0x1 00:05:54.453 08:44:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.453 08:44:42 -- accel/accel.sh@20 -- # IFS=: 00:05:54.453 08:44:42 -- accel/accel.sh@20 -- # read -r var val 00:05:54.453 08:44:42 -- accel/accel.sh@21 -- # val= 00:05:54.453 08:44:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.453 08:44:42 -- accel/accel.sh@20 -- # IFS=: 00:05:54.453 08:44:42 -- accel/accel.sh@20 -- # read -r var val 00:05:54.453 08:44:42 -- accel/accel.sh@21 -- # val= 00:05:54.453 08:44:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.453 08:44:42 -- accel/accel.sh@20 -- # IFS=: 00:05:54.453 08:44:42 -- accel/accel.sh@20 -- # read -r var val 00:05:54.453 08:44:42 -- accel/accel.sh@21 -- # val=dif_verify 00:05:54.453 08:44:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.453 08:44:42 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:05:54.453 08:44:42 -- accel/accel.sh@20 -- # IFS=: 00:05:54.453 08:44:42 -- accel/accel.sh@20 -- # read -r var val 00:05:54.453 08:44:42 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:54.453 08:44:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.453 08:44:42 -- accel/accel.sh@20 -- # IFS=: 00:05:54.453 08:44:42 -- accel/accel.sh@20 -- # read -r var val 00:05:54.453 08:44:42 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:54.453 08:44:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.453 08:44:42 -- accel/accel.sh@20 -- # IFS=: 00:05:54.453 08:44:42 -- accel/accel.sh@20 -- # read -r var val 00:05:54.453 08:44:42 -- accel/accel.sh@21 -- # val='512 bytes' 00:05:54.453 08:44:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.453 08:44:42 -- accel/accel.sh@20 -- # IFS=: 00:05:54.453 08:44:42 -- accel/accel.sh@20 -- # read -r var val 00:05:54.453 08:44:42 -- accel/accel.sh@21 -- # val='8 bytes' 00:05:54.453 08:44:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.453 08:44:42 -- accel/accel.sh@20 -- # IFS=: 00:05:54.453 08:44:42 -- accel/accel.sh@20 -- # read -r var val 00:05:54.453 08:44:42 -- accel/accel.sh@21 -- # val= 00:05:54.453 08:44:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.453 08:44:42 -- accel/accel.sh@20 -- # IFS=: 00:05:54.453 08:44:42 -- accel/accel.sh@20 -- # read -r var val 00:05:54.453 08:44:42 -- accel/accel.sh@21 -- # val=software 00:05:54.453 08:44:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.453 08:44:42 -- accel/accel.sh@23 -- # accel_module=software 00:05:54.453 08:44:42 -- accel/accel.sh@20 -- # IFS=: 00:05:54.453 08:44:42 -- accel/accel.sh@20 -- # read -r var val 00:05:54.453 08:44:42 -- accel/accel.sh@21 -- # val=32 00:05:54.453 08:44:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.453 08:44:42 -- accel/accel.sh@20 -- # IFS=: 00:05:54.453 08:44:42 -- accel/accel.sh@20 -- # read -r var val 00:05:54.453 08:44:42 -- accel/accel.sh@21 -- # val=32 00:05:54.453 08:44:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.453 08:44:42 -- accel/accel.sh@20 -- # IFS=: 00:05:54.453 08:44:42 -- accel/accel.sh@20 -- # read -r var val 00:05:54.453 08:44:42 -- accel/accel.sh@21 -- # val=1 00:05:54.453 08:44:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.453 08:44:42 -- accel/accel.sh@20 -- # IFS=: 00:05:54.453 08:44:42 -- accel/accel.sh@20 -- # read -r var val 00:05:54.453 08:44:42 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:54.453 08:44:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.453 08:44:42 -- accel/accel.sh@20 -- # IFS=: 00:05:54.453 08:44:42 -- accel/accel.sh@20 -- # read -r var val 00:05:54.453 08:44:42 -- accel/accel.sh@21 -- # val=No 00:05:54.453 08:44:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.453 08:44:42 -- accel/accel.sh@20 -- # IFS=: 00:05:54.453 08:44:42 -- accel/accel.sh@20 -- # read -r var val 00:05:54.453 08:44:42 -- accel/accel.sh@21 -- # val= 00:05:54.453 08:44:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.453 08:44:42 -- accel/accel.sh@20 -- # IFS=: 00:05:54.453 08:44:42 -- accel/accel.sh@20 -- # read -r var val 00:05:54.453 08:44:42 -- accel/accel.sh@21 -- # val= 00:05:54.453 08:44:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.453 08:44:42 -- accel/accel.sh@20 -- # IFS=: 00:05:54.453 08:44:42 -- accel/accel.sh@20 -- # read -r var val 00:05:55.823 08:44:44 -- accel/accel.sh@21 -- # val= 00:05:55.823 08:44:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.823 08:44:44 -- accel/accel.sh@20 -- # IFS=: 00:05:55.823 08:44:44 -- accel/accel.sh@20 -- # read -r var val 00:05:55.823 08:44:44 -- accel/accel.sh@21 -- # val= 00:05:55.823 08:44:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.823 08:44:44 -- accel/accel.sh@20 -- # IFS=: 00:05:55.823 08:44:44 -- accel/accel.sh@20 -- # read -r var val 00:05:55.823 08:44:44 -- accel/accel.sh@21 -- # val= 00:05:55.823 08:44:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.823 08:44:44 -- accel/accel.sh@20 -- # IFS=: 00:05:55.823 08:44:44 -- accel/accel.sh@20 -- # read -r var val 00:05:55.823 08:44:44 -- accel/accel.sh@21 -- # val= 00:05:55.823 08:44:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.823 08:44:44 -- accel/accel.sh@20 -- # IFS=: 00:05:55.823 08:44:44 -- accel/accel.sh@20 -- # read -r var val 00:05:55.823 08:44:44 -- accel/accel.sh@21 -- # val= 00:05:55.823 08:44:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.823 08:44:44 -- accel/accel.sh@20 -- # IFS=: 00:05:55.823 08:44:44 -- accel/accel.sh@20 -- # read -r var val 00:05:55.823 08:44:44 -- accel/accel.sh@21 -- # val= 00:05:55.823 08:44:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.823 08:44:44 -- accel/accel.sh@20 -- # IFS=: 00:05:55.823 08:44:44 -- accel/accel.sh@20 -- # read -r var val 00:05:55.823 08:44:44 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:55.823 08:44:44 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:05:55.823 08:44:44 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:55.823 00:05:55.823 real 0m2.947s 00:05:55.823 user 0m2.651s 00:05:55.823 sys 0m0.290s 00:05:55.823 08:44:44 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:55.823 08:44:44 -- common/autotest_common.sh@10 -- # set +x 00:05:55.823 ************************************ 00:05:55.823 END TEST accel_dif_verify 00:05:55.823 ************************************ 00:05:55.823 08:44:44 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:05:55.823 08:44:44 -- common/autotest_common.sh@1077 -- # '[' 6 -le 1 ']' 00:05:55.823 08:44:44 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:55.823 08:44:44 -- common/autotest_common.sh@10 -- # set +x 00:05:55.823 ************************************ 00:05:55.823 START TEST accel_dif_generate 00:05:55.823 ************************************ 00:05:55.823 08:44:44 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w dif_generate 00:05:55.823 08:44:44 -- accel/accel.sh@16 -- # local accel_opc 00:05:55.823 08:44:44 -- accel/accel.sh@17 -- # local accel_module 00:05:55.823 08:44:44 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:05:55.823 08:44:44 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:05:55.823 08:44:44 -- accel/accel.sh@12 -- # build_accel_config 00:05:55.823 08:44:44 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:55.823 08:44:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:55.823 08:44:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:55.823 08:44:44 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:55.823 08:44:44 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:55.823 08:44:44 -- accel/accel.sh@41 -- # local IFS=, 00:05:55.823 08:44:44 -- accel/accel.sh@42 -- # jq -r . 00:05:55.824 [2024-07-15 08:44:44.154917] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:55.824 [2024-07-15 08:44:44.154998] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1391726 ] 00:05:55.824 EAL: No free 2048 kB hugepages reported on node 1 00:05:55.824 [2024-07-15 08:44:44.220616] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:55.824 [2024-07-15 08:44:44.340733] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:57.195 08:44:45 -- accel/accel.sh@18 -- # out=' 00:05:57.195 SPDK Configuration: 00:05:57.195 Core mask: 0x1 00:05:57.195 00:05:57.195 Accel Perf Configuration: 00:05:57.195 Workload Type: dif_generate 00:05:57.195 Vector size: 4096 bytes 00:05:57.195 Transfer size: 4096 bytes 00:05:57.195 Block size: 512 bytes 00:05:57.195 Metadata size: 8 bytes 00:05:57.195 Vector count 1 00:05:57.195 Module: software 00:05:57.195 Queue depth: 32 00:05:57.195 Allocate depth: 32 00:05:57.195 # threads/core: 1 00:05:57.195 Run time: 1 seconds 00:05:57.195 Verify: No 00:05:57.195 00:05:57.195 Running for 1 seconds... 00:05:57.195 00:05:57.195 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:57.195 ------------------------------------------------------------------------------------ 00:05:57.195 0,0 96416/s 382 MiB/s 0 0 00:05:57.195 ==================================================================================== 00:05:57.195 Total 96416/s 376 MiB/s 0 0' 00:05:57.195 08:44:45 -- accel/accel.sh@20 -- # IFS=: 00:05:57.195 08:44:45 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:05:57.195 08:44:45 -- accel/accel.sh@20 -- # read -r var val 00:05:57.195 08:44:45 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:05:57.195 08:44:45 -- accel/accel.sh@12 -- # build_accel_config 00:05:57.195 08:44:45 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:57.195 08:44:45 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:57.195 08:44:45 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:57.195 08:44:45 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:57.195 08:44:45 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:57.195 08:44:45 -- accel/accel.sh@41 -- # local IFS=, 00:05:57.195 08:44:45 -- accel/accel.sh@42 -- # jq -r . 00:05:57.195 [2024-07-15 08:44:45.642317] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:57.195 [2024-07-15 08:44:45.642404] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1391873 ] 00:05:57.195 EAL: No free 2048 kB hugepages reported on node 1 00:05:57.195 [2024-07-15 08:44:45.704154] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:57.453 [2024-07-15 08:44:45.824572] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:57.453 08:44:45 -- accel/accel.sh@21 -- # val= 00:05:57.453 08:44:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.453 08:44:45 -- accel/accel.sh@20 -- # IFS=: 00:05:57.453 08:44:45 -- accel/accel.sh@20 -- # read -r var val 00:05:57.453 08:44:45 -- accel/accel.sh@21 -- # val= 00:05:57.453 08:44:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.453 08:44:45 -- accel/accel.sh@20 -- # IFS=: 00:05:57.453 08:44:45 -- accel/accel.sh@20 -- # read -r var val 00:05:57.453 08:44:45 -- accel/accel.sh@21 -- # val=0x1 00:05:57.453 08:44:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.453 08:44:45 -- accel/accel.sh@20 -- # IFS=: 00:05:57.453 08:44:45 -- accel/accel.sh@20 -- # read -r var val 00:05:57.453 08:44:45 -- accel/accel.sh@21 -- # val= 00:05:57.453 08:44:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.453 08:44:45 -- accel/accel.sh@20 -- # IFS=: 00:05:57.453 08:44:45 -- accel/accel.sh@20 -- # read -r var val 00:05:57.453 08:44:45 -- accel/accel.sh@21 -- # val= 00:05:57.453 08:44:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.453 08:44:45 -- accel/accel.sh@20 -- # IFS=: 00:05:57.453 08:44:45 -- accel/accel.sh@20 -- # read -r var val 00:05:57.453 08:44:45 -- accel/accel.sh@21 -- # val=dif_generate 00:05:57.453 08:44:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.453 08:44:45 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:05:57.453 08:44:45 -- accel/accel.sh@20 -- # IFS=: 00:05:57.453 08:44:45 -- accel/accel.sh@20 -- # read -r var val 00:05:57.453 08:44:45 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:57.453 08:44:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.453 08:44:45 -- accel/accel.sh@20 -- # IFS=: 00:05:57.453 08:44:45 -- accel/accel.sh@20 -- # read -r var val 00:05:57.453 08:44:45 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:57.453 08:44:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.453 08:44:45 -- accel/accel.sh@20 -- # IFS=: 00:05:57.453 08:44:45 -- accel/accel.sh@20 -- # read -r var val 00:05:57.453 08:44:45 -- accel/accel.sh@21 -- # val='512 bytes' 00:05:57.453 08:44:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.453 08:44:45 -- accel/accel.sh@20 -- # IFS=: 00:05:57.453 08:44:45 -- accel/accel.sh@20 -- # read -r var val 00:05:57.453 08:44:45 -- accel/accel.sh@21 -- # val='8 bytes' 00:05:57.453 08:44:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.453 08:44:45 -- accel/accel.sh@20 -- # IFS=: 00:05:57.453 08:44:45 -- accel/accel.sh@20 -- # read -r var val 00:05:57.453 08:44:45 -- accel/accel.sh@21 -- # val= 00:05:57.453 08:44:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.453 08:44:45 -- accel/accel.sh@20 -- # IFS=: 00:05:57.453 08:44:45 -- accel/accel.sh@20 -- # read -r var val 00:05:57.453 08:44:45 -- accel/accel.sh@21 -- # val=software 00:05:57.453 08:44:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.453 08:44:45 -- accel/accel.sh@23 -- # accel_module=software 00:05:57.453 08:44:45 -- accel/accel.sh@20 -- # IFS=: 00:05:57.453 08:44:45 -- accel/accel.sh@20 -- # read -r var val 00:05:57.453 08:44:45 -- accel/accel.sh@21 -- # val=32 00:05:57.453 08:44:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.453 08:44:45 -- accel/accel.sh@20 -- # IFS=: 00:05:57.453 08:44:45 -- accel/accel.sh@20 -- # read -r var val 00:05:57.453 08:44:45 -- accel/accel.sh@21 -- # val=32 00:05:57.453 08:44:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.453 08:44:45 -- accel/accel.sh@20 -- # IFS=: 00:05:57.453 08:44:45 -- accel/accel.sh@20 -- # read -r var val 00:05:57.453 08:44:45 -- accel/accel.sh@21 -- # val=1 00:05:57.453 08:44:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.453 08:44:45 -- accel/accel.sh@20 -- # IFS=: 00:05:57.453 08:44:45 -- accel/accel.sh@20 -- # read -r var val 00:05:57.453 08:44:45 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:57.453 08:44:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.453 08:44:45 -- accel/accel.sh@20 -- # IFS=: 00:05:57.453 08:44:45 -- accel/accel.sh@20 -- # read -r var val 00:05:57.453 08:44:45 -- accel/accel.sh@21 -- # val=No 00:05:57.453 08:44:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.453 08:44:45 -- accel/accel.sh@20 -- # IFS=: 00:05:57.453 08:44:45 -- accel/accel.sh@20 -- # read -r var val 00:05:57.453 08:44:45 -- accel/accel.sh@21 -- # val= 00:05:57.453 08:44:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.453 08:44:45 -- accel/accel.sh@20 -- # IFS=: 00:05:57.453 08:44:45 -- accel/accel.sh@20 -- # read -r var val 00:05:57.453 08:44:45 -- accel/accel.sh@21 -- # val= 00:05:57.453 08:44:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.454 08:44:45 -- accel/accel.sh@20 -- # IFS=: 00:05:57.454 08:44:45 -- accel/accel.sh@20 -- # read -r var val 00:05:58.824 08:44:47 -- accel/accel.sh@21 -- # val= 00:05:58.824 08:44:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.824 08:44:47 -- accel/accel.sh@20 -- # IFS=: 00:05:58.824 08:44:47 -- accel/accel.sh@20 -- # read -r var val 00:05:58.824 08:44:47 -- accel/accel.sh@21 -- # val= 00:05:58.825 08:44:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.825 08:44:47 -- accel/accel.sh@20 -- # IFS=: 00:05:58.825 08:44:47 -- accel/accel.sh@20 -- # read -r var val 00:05:58.825 08:44:47 -- accel/accel.sh@21 -- # val= 00:05:58.825 08:44:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.825 08:44:47 -- accel/accel.sh@20 -- # IFS=: 00:05:58.825 08:44:47 -- accel/accel.sh@20 -- # read -r var val 00:05:58.825 08:44:47 -- accel/accel.sh@21 -- # val= 00:05:58.825 08:44:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.825 08:44:47 -- accel/accel.sh@20 -- # IFS=: 00:05:58.825 08:44:47 -- accel/accel.sh@20 -- # read -r var val 00:05:58.825 08:44:47 -- accel/accel.sh@21 -- # val= 00:05:58.825 08:44:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.825 08:44:47 -- accel/accel.sh@20 -- # IFS=: 00:05:58.825 08:44:47 -- accel/accel.sh@20 -- # read -r var val 00:05:58.825 08:44:47 -- accel/accel.sh@21 -- # val= 00:05:58.825 08:44:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.825 08:44:47 -- accel/accel.sh@20 -- # IFS=: 00:05:58.825 08:44:47 -- accel/accel.sh@20 -- # read -r var val 00:05:58.825 08:44:47 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:58.825 08:44:47 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:05:58.825 08:44:47 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:58.825 00:05:58.825 real 0m2.965s 00:05:58.825 user 0m2.664s 00:05:58.825 sys 0m0.296s 00:05:58.825 08:44:47 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:58.825 08:44:47 -- common/autotest_common.sh@10 -- # set +x 00:05:58.825 ************************************ 00:05:58.825 END TEST accel_dif_generate 00:05:58.825 ************************************ 00:05:58.825 08:44:47 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:05:58.825 08:44:47 -- common/autotest_common.sh@1077 -- # '[' 6 -le 1 ']' 00:05:58.825 08:44:47 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:58.825 08:44:47 -- common/autotest_common.sh@10 -- # set +x 00:05:58.825 ************************************ 00:05:58.825 START TEST accel_dif_generate_copy 00:05:58.825 ************************************ 00:05:58.825 08:44:47 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w dif_generate_copy 00:05:58.825 08:44:47 -- accel/accel.sh@16 -- # local accel_opc 00:05:58.825 08:44:47 -- accel/accel.sh@17 -- # local accel_module 00:05:58.825 08:44:47 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:05:58.825 08:44:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:05:58.825 08:44:47 -- accel/accel.sh@12 -- # build_accel_config 00:05:58.825 08:44:47 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:58.825 08:44:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:58.825 08:44:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:58.825 08:44:47 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:58.825 08:44:47 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:58.825 08:44:47 -- accel/accel.sh@41 -- # local IFS=, 00:05:58.825 08:44:47 -- accel/accel.sh@42 -- # jq -r . 00:05:58.825 [2024-07-15 08:44:47.147327] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:58.825 [2024-07-15 08:44:47.147415] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1392147 ] 00:05:58.825 EAL: No free 2048 kB hugepages reported on node 1 00:05:58.825 [2024-07-15 08:44:47.209380] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:58.825 [2024-07-15 08:44:47.328995] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:00.195 08:44:48 -- accel/accel.sh@18 -- # out=' 00:06:00.195 SPDK Configuration: 00:06:00.195 Core mask: 0x1 00:06:00.195 00:06:00.195 Accel Perf Configuration: 00:06:00.195 Workload Type: dif_generate_copy 00:06:00.195 Vector size: 4096 bytes 00:06:00.195 Transfer size: 4096 bytes 00:06:00.195 Vector count 1 00:06:00.195 Module: software 00:06:00.195 Queue depth: 32 00:06:00.195 Allocate depth: 32 00:06:00.195 # threads/core: 1 00:06:00.195 Run time: 1 seconds 00:06:00.195 Verify: No 00:06:00.195 00:06:00.195 Running for 1 seconds... 00:06:00.195 00:06:00.195 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:00.195 ------------------------------------------------------------------------------------ 00:06:00.195 0,0 76064/s 301 MiB/s 0 0 00:06:00.195 ==================================================================================== 00:06:00.195 Total 76064/s 297 MiB/s 0 0' 00:06:00.195 08:44:48 -- accel/accel.sh@20 -- # IFS=: 00:06:00.195 08:44:48 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:06:00.195 08:44:48 -- accel/accel.sh@20 -- # read -r var val 00:06:00.195 08:44:48 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:06:00.195 08:44:48 -- accel/accel.sh@12 -- # build_accel_config 00:06:00.195 08:44:48 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:00.195 08:44:48 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:00.195 08:44:48 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:00.195 08:44:48 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:00.195 08:44:48 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:00.195 08:44:48 -- accel/accel.sh@41 -- # local IFS=, 00:06:00.195 08:44:48 -- accel/accel.sh@42 -- # jq -r . 00:06:00.195 [2024-07-15 08:44:48.624321] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:06:00.195 [2024-07-15 08:44:48.624408] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1392297 ] 00:06:00.195 EAL: No free 2048 kB hugepages reported on node 1 00:06:00.195 [2024-07-15 08:44:48.687142] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:00.453 [2024-07-15 08:44:48.803585] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:00.453 08:44:48 -- accel/accel.sh@21 -- # val= 00:06:00.453 08:44:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.453 08:44:48 -- accel/accel.sh@20 -- # IFS=: 00:06:00.453 08:44:48 -- accel/accel.sh@20 -- # read -r var val 00:06:00.453 08:44:48 -- accel/accel.sh@21 -- # val= 00:06:00.453 08:44:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.453 08:44:48 -- accel/accel.sh@20 -- # IFS=: 00:06:00.453 08:44:48 -- accel/accel.sh@20 -- # read -r var val 00:06:00.453 08:44:48 -- accel/accel.sh@21 -- # val=0x1 00:06:00.453 08:44:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.453 08:44:48 -- accel/accel.sh@20 -- # IFS=: 00:06:00.453 08:44:48 -- accel/accel.sh@20 -- # read -r var val 00:06:00.453 08:44:48 -- accel/accel.sh@21 -- # val= 00:06:00.453 08:44:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.453 08:44:48 -- accel/accel.sh@20 -- # IFS=: 00:06:00.453 08:44:48 -- accel/accel.sh@20 -- # read -r var val 00:06:00.453 08:44:48 -- accel/accel.sh@21 -- # val= 00:06:00.453 08:44:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.453 08:44:48 -- accel/accel.sh@20 -- # IFS=: 00:06:00.453 08:44:48 -- accel/accel.sh@20 -- # read -r var val 00:06:00.453 08:44:48 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:06:00.453 08:44:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.453 08:44:48 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:06:00.453 08:44:48 -- accel/accel.sh@20 -- # IFS=: 00:06:00.453 08:44:48 -- accel/accel.sh@20 -- # read -r var val 00:06:00.453 08:44:48 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:00.453 08:44:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.453 08:44:48 -- accel/accel.sh@20 -- # IFS=: 00:06:00.453 08:44:48 -- accel/accel.sh@20 -- # read -r var val 00:06:00.453 08:44:48 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:00.453 08:44:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.453 08:44:48 -- accel/accel.sh@20 -- # IFS=: 00:06:00.453 08:44:48 -- accel/accel.sh@20 -- # read -r var val 00:06:00.453 08:44:48 -- accel/accel.sh@21 -- # val= 00:06:00.453 08:44:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.453 08:44:48 -- accel/accel.sh@20 -- # IFS=: 00:06:00.453 08:44:48 -- accel/accel.sh@20 -- # read -r var val 00:06:00.453 08:44:48 -- accel/accel.sh@21 -- # val=software 00:06:00.453 08:44:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.453 08:44:48 -- accel/accel.sh@23 -- # accel_module=software 00:06:00.453 08:44:48 -- accel/accel.sh@20 -- # IFS=: 00:06:00.453 08:44:48 -- accel/accel.sh@20 -- # read -r var val 00:06:00.453 08:44:48 -- accel/accel.sh@21 -- # val=32 00:06:00.453 08:44:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.453 08:44:48 -- accel/accel.sh@20 -- # IFS=: 00:06:00.453 08:44:48 -- accel/accel.sh@20 -- # read -r var val 00:06:00.454 08:44:48 -- accel/accel.sh@21 -- # val=32 00:06:00.454 08:44:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.454 08:44:48 -- accel/accel.sh@20 -- # IFS=: 00:06:00.454 08:44:48 -- accel/accel.sh@20 -- # read -r var val 00:06:00.454 08:44:48 -- accel/accel.sh@21 -- # val=1 00:06:00.454 08:44:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.454 08:44:48 -- accel/accel.sh@20 -- # IFS=: 00:06:00.454 08:44:48 -- accel/accel.sh@20 -- # read -r var val 00:06:00.454 08:44:48 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:00.454 08:44:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.454 08:44:48 -- accel/accel.sh@20 -- # IFS=: 00:06:00.454 08:44:48 -- accel/accel.sh@20 -- # read -r var val 00:06:00.454 08:44:48 -- accel/accel.sh@21 -- # val=No 00:06:00.454 08:44:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.454 08:44:48 -- accel/accel.sh@20 -- # IFS=: 00:06:00.454 08:44:48 -- accel/accel.sh@20 -- # read -r var val 00:06:00.454 08:44:48 -- accel/accel.sh@21 -- # val= 00:06:00.454 08:44:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.454 08:44:48 -- accel/accel.sh@20 -- # IFS=: 00:06:00.454 08:44:48 -- accel/accel.sh@20 -- # read -r var val 00:06:00.454 08:44:48 -- accel/accel.sh@21 -- # val= 00:06:00.454 08:44:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.454 08:44:48 -- accel/accel.sh@20 -- # IFS=: 00:06:00.454 08:44:48 -- accel/accel.sh@20 -- # read -r var val 00:06:01.827 08:44:50 -- accel/accel.sh@21 -- # val= 00:06:01.827 08:44:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.827 08:44:50 -- accel/accel.sh@20 -- # IFS=: 00:06:01.827 08:44:50 -- accel/accel.sh@20 -- # read -r var val 00:06:01.827 08:44:50 -- accel/accel.sh@21 -- # val= 00:06:01.827 08:44:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.827 08:44:50 -- accel/accel.sh@20 -- # IFS=: 00:06:01.827 08:44:50 -- accel/accel.sh@20 -- # read -r var val 00:06:01.827 08:44:50 -- accel/accel.sh@21 -- # val= 00:06:01.827 08:44:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.827 08:44:50 -- accel/accel.sh@20 -- # IFS=: 00:06:01.827 08:44:50 -- accel/accel.sh@20 -- # read -r var val 00:06:01.827 08:44:50 -- accel/accel.sh@21 -- # val= 00:06:01.827 08:44:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.827 08:44:50 -- accel/accel.sh@20 -- # IFS=: 00:06:01.827 08:44:50 -- accel/accel.sh@20 -- # read -r var val 00:06:01.827 08:44:50 -- accel/accel.sh@21 -- # val= 00:06:01.827 08:44:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.827 08:44:50 -- accel/accel.sh@20 -- # IFS=: 00:06:01.827 08:44:50 -- accel/accel.sh@20 -- # read -r var val 00:06:01.827 08:44:50 -- accel/accel.sh@21 -- # val= 00:06:01.827 08:44:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.827 08:44:50 -- accel/accel.sh@20 -- # IFS=: 00:06:01.827 08:44:50 -- accel/accel.sh@20 -- # read -r var val 00:06:01.827 08:44:50 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:01.827 08:44:50 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:06:01.827 08:44:50 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:01.827 00:06:01.827 real 0m2.952s 00:06:01.827 user 0m2.656s 00:06:01.827 sys 0m0.287s 00:06:01.827 08:44:50 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:01.827 08:44:50 -- common/autotest_common.sh@10 -- # set +x 00:06:01.827 ************************************ 00:06:01.827 END TEST accel_dif_generate_copy 00:06:01.827 ************************************ 00:06:01.827 08:44:50 -- accel/accel.sh@107 -- # [[ y == y ]] 00:06:01.827 08:44:50 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:01.827 08:44:50 -- common/autotest_common.sh@1077 -- # '[' 8 -le 1 ']' 00:06:01.827 08:44:50 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:01.827 08:44:50 -- common/autotest_common.sh@10 -- # set +x 00:06:01.827 ************************************ 00:06:01.827 START TEST accel_comp 00:06:01.827 ************************************ 00:06:01.827 08:44:50 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:01.827 08:44:50 -- accel/accel.sh@16 -- # local accel_opc 00:06:01.827 08:44:50 -- accel/accel.sh@17 -- # local accel_module 00:06:01.827 08:44:50 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:01.827 08:44:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:01.827 08:44:50 -- accel/accel.sh@12 -- # build_accel_config 00:06:01.827 08:44:50 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:01.827 08:44:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:01.827 08:44:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:01.827 08:44:50 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:01.827 08:44:50 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:01.827 08:44:50 -- accel/accel.sh@41 -- # local IFS=, 00:06:01.827 08:44:50 -- accel/accel.sh@42 -- # jq -r . 00:06:01.827 [2024-07-15 08:44:50.127242] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:06:01.827 [2024-07-15 08:44:50.127328] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1392456 ] 00:06:01.827 EAL: No free 2048 kB hugepages reported on node 1 00:06:01.827 [2024-07-15 08:44:50.190408] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:01.827 [2024-07-15 08:44:50.310364] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:03.235 08:44:51 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:03.235 00:06:03.235 SPDK Configuration: 00:06:03.235 Core mask: 0x1 00:06:03.235 00:06:03.235 Accel Perf Configuration: 00:06:03.235 Workload Type: compress 00:06:03.235 Transfer size: 4096 bytes 00:06:03.235 Vector count 1 00:06:03.235 Module: software 00:06:03.236 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:03.236 Queue depth: 32 00:06:03.236 Allocate depth: 32 00:06:03.236 # threads/core: 1 00:06:03.236 Run time: 1 seconds 00:06:03.236 Verify: No 00:06:03.236 00:06:03.236 Running for 1 seconds... 00:06:03.236 00:06:03.236 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:03.236 ------------------------------------------------------------------------------------ 00:06:03.236 0,0 32416/s 135 MiB/s 0 0 00:06:03.236 ==================================================================================== 00:06:03.236 Total 32416/s 126 MiB/s 0 0' 00:06:03.236 08:44:51 -- accel/accel.sh@20 -- # IFS=: 00:06:03.236 08:44:51 -- accel/accel.sh@20 -- # read -r var val 00:06:03.236 08:44:51 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:03.236 08:44:51 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:03.236 08:44:51 -- accel/accel.sh@12 -- # build_accel_config 00:06:03.236 08:44:51 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:03.236 08:44:51 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:03.236 08:44:51 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:03.236 08:44:51 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:03.236 08:44:51 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:03.236 08:44:51 -- accel/accel.sh@41 -- # local IFS=, 00:06:03.236 08:44:51 -- accel/accel.sh@42 -- # jq -r . 00:06:03.236 [2024-07-15 08:44:51.614020] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:06:03.236 [2024-07-15 08:44:51.614098] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1392680 ] 00:06:03.236 EAL: No free 2048 kB hugepages reported on node 1 00:06:03.236 [2024-07-15 08:44:51.678691] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:03.500 [2024-07-15 08:44:51.800481] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:03.500 08:44:51 -- accel/accel.sh@21 -- # val= 00:06:03.500 08:44:51 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.500 08:44:51 -- accel/accel.sh@20 -- # IFS=: 00:06:03.500 08:44:51 -- accel/accel.sh@20 -- # read -r var val 00:06:03.500 08:44:51 -- accel/accel.sh@21 -- # val= 00:06:03.500 08:44:51 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.500 08:44:51 -- accel/accel.sh@20 -- # IFS=: 00:06:03.500 08:44:51 -- accel/accel.sh@20 -- # read -r var val 00:06:03.500 08:44:51 -- accel/accel.sh@21 -- # val= 00:06:03.500 08:44:51 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.500 08:44:51 -- accel/accel.sh@20 -- # IFS=: 00:06:03.500 08:44:51 -- accel/accel.sh@20 -- # read -r var val 00:06:03.500 08:44:51 -- accel/accel.sh@21 -- # val=0x1 00:06:03.500 08:44:51 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.500 08:44:51 -- accel/accel.sh@20 -- # IFS=: 00:06:03.500 08:44:51 -- accel/accel.sh@20 -- # read -r var val 00:06:03.500 08:44:51 -- accel/accel.sh@21 -- # val= 00:06:03.500 08:44:51 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.500 08:44:51 -- accel/accel.sh@20 -- # IFS=: 00:06:03.500 08:44:51 -- accel/accel.sh@20 -- # read -r var val 00:06:03.500 08:44:51 -- accel/accel.sh@21 -- # val= 00:06:03.500 08:44:51 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.500 08:44:51 -- accel/accel.sh@20 -- # IFS=: 00:06:03.500 08:44:51 -- accel/accel.sh@20 -- # read -r var val 00:06:03.500 08:44:51 -- accel/accel.sh@21 -- # val=compress 00:06:03.500 08:44:51 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.500 08:44:51 -- accel/accel.sh@24 -- # accel_opc=compress 00:06:03.500 08:44:51 -- accel/accel.sh@20 -- # IFS=: 00:06:03.500 08:44:51 -- accel/accel.sh@20 -- # read -r var val 00:06:03.500 08:44:51 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:03.500 08:44:51 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.500 08:44:51 -- accel/accel.sh@20 -- # IFS=: 00:06:03.500 08:44:51 -- accel/accel.sh@20 -- # read -r var val 00:06:03.500 08:44:51 -- accel/accel.sh@21 -- # val= 00:06:03.500 08:44:51 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.500 08:44:51 -- accel/accel.sh@20 -- # IFS=: 00:06:03.500 08:44:51 -- accel/accel.sh@20 -- # read -r var val 00:06:03.500 08:44:51 -- accel/accel.sh@21 -- # val=software 00:06:03.500 08:44:51 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.500 08:44:51 -- accel/accel.sh@23 -- # accel_module=software 00:06:03.500 08:44:51 -- accel/accel.sh@20 -- # IFS=: 00:06:03.500 08:44:51 -- accel/accel.sh@20 -- # read -r var val 00:06:03.500 08:44:51 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:03.500 08:44:51 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.500 08:44:51 -- accel/accel.sh@20 -- # IFS=: 00:06:03.500 08:44:51 -- accel/accel.sh@20 -- # read -r var val 00:06:03.500 08:44:51 -- accel/accel.sh@21 -- # val=32 00:06:03.500 08:44:51 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.500 08:44:51 -- accel/accel.sh@20 -- # IFS=: 00:06:03.500 08:44:51 -- accel/accel.sh@20 -- # read -r var val 00:06:03.500 08:44:51 -- accel/accel.sh@21 -- # val=32 00:06:03.500 08:44:51 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.500 08:44:51 -- accel/accel.sh@20 -- # IFS=: 00:06:03.500 08:44:51 -- accel/accel.sh@20 -- # read -r var val 00:06:03.500 08:44:51 -- accel/accel.sh@21 -- # val=1 00:06:03.500 08:44:51 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.500 08:44:51 -- accel/accel.sh@20 -- # IFS=: 00:06:03.500 08:44:51 -- accel/accel.sh@20 -- # read -r var val 00:06:03.500 08:44:51 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:03.500 08:44:51 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.500 08:44:51 -- accel/accel.sh@20 -- # IFS=: 00:06:03.500 08:44:51 -- accel/accel.sh@20 -- # read -r var val 00:06:03.500 08:44:51 -- accel/accel.sh@21 -- # val=No 00:06:03.500 08:44:51 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.500 08:44:51 -- accel/accel.sh@20 -- # IFS=: 00:06:03.500 08:44:51 -- accel/accel.sh@20 -- # read -r var val 00:06:03.500 08:44:51 -- accel/accel.sh@21 -- # val= 00:06:03.500 08:44:51 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.500 08:44:51 -- accel/accel.sh@20 -- # IFS=: 00:06:03.500 08:44:51 -- accel/accel.sh@20 -- # read -r var val 00:06:03.500 08:44:51 -- accel/accel.sh@21 -- # val= 00:06:03.500 08:44:51 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.500 08:44:51 -- accel/accel.sh@20 -- # IFS=: 00:06:03.500 08:44:51 -- accel/accel.sh@20 -- # read -r var val 00:06:04.873 08:44:53 -- accel/accel.sh@21 -- # val= 00:06:04.873 08:44:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.873 08:44:53 -- accel/accel.sh@20 -- # IFS=: 00:06:04.873 08:44:53 -- accel/accel.sh@20 -- # read -r var val 00:06:04.873 08:44:53 -- accel/accel.sh@21 -- # val= 00:06:04.873 08:44:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.873 08:44:53 -- accel/accel.sh@20 -- # IFS=: 00:06:04.873 08:44:53 -- accel/accel.sh@20 -- # read -r var val 00:06:04.873 08:44:53 -- accel/accel.sh@21 -- # val= 00:06:04.873 08:44:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.873 08:44:53 -- accel/accel.sh@20 -- # IFS=: 00:06:04.873 08:44:53 -- accel/accel.sh@20 -- # read -r var val 00:06:04.873 08:44:53 -- accel/accel.sh@21 -- # val= 00:06:04.873 08:44:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.873 08:44:53 -- accel/accel.sh@20 -- # IFS=: 00:06:04.873 08:44:53 -- accel/accel.sh@20 -- # read -r var val 00:06:04.873 08:44:53 -- accel/accel.sh@21 -- # val= 00:06:04.873 08:44:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.873 08:44:53 -- accel/accel.sh@20 -- # IFS=: 00:06:04.873 08:44:53 -- accel/accel.sh@20 -- # read -r var val 00:06:04.873 08:44:53 -- accel/accel.sh@21 -- # val= 00:06:04.873 08:44:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.873 08:44:53 -- accel/accel.sh@20 -- # IFS=: 00:06:04.873 08:44:53 -- accel/accel.sh@20 -- # read -r var val 00:06:04.873 08:44:53 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:04.873 08:44:53 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:06:04.873 08:44:53 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:04.873 00:06:04.873 real 0m2.981s 00:06:04.873 user 0m2.677s 00:06:04.873 sys 0m0.297s 00:06:04.873 08:44:53 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:04.873 08:44:53 -- common/autotest_common.sh@10 -- # set +x 00:06:04.873 ************************************ 00:06:04.873 END TEST accel_comp 00:06:04.873 ************************************ 00:06:04.873 08:44:53 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:04.873 08:44:53 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:06:04.873 08:44:53 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:04.873 08:44:53 -- common/autotest_common.sh@10 -- # set +x 00:06:04.873 ************************************ 00:06:04.873 START TEST accel_decomp 00:06:04.873 ************************************ 00:06:04.873 08:44:53 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:04.873 08:44:53 -- accel/accel.sh@16 -- # local accel_opc 00:06:04.873 08:44:53 -- accel/accel.sh@17 -- # local accel_module 00:06:04.873 08:44:53 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:04.873 08:44:53 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:04.873 08:44:53 -- accel/accel.sh@12 -- # build_accel_config 00:06:04.873 08:44:53 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:04.873 08:44:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:04.873 08:44:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:04.873 08:44:53 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:04.873 08:44:53 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:04.873 08:44:53 -- accel/accel.sh@41 -- # local IFS=, 00:06:04.873 08:44:53 -- accel/accel.sh@42 -- # jq -r . 00:06:04.873 [2024-07-15 08:44:53.135309] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:06:04.873 [2024-07-15 08:44:53.135390] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1392878 ] 00:06:04.873 EAL: No free 2048 kB hugepages reported on node 1 00:06:04.873 [2024-07-15 08:44:53.200831] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:04.873 [2024-07-15 08:44:53.317960] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:06.243 08:44:54 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:06.243 00:06:06.243 SPDK Configuration: 00:06:06.243 Core mask: 0x1 00:06:06.243 00:06:06.243 Accel Perf Configuration: 00:06:06.243 Workload Type: decompress 00:06:06.243 Transfer size: 4096 bytes 00:06:06.243 Vector count 1 00:06:06.243 Module: software 00:06:06.243 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:06.243 Queue depth: 32 00:06:06.243 Allocate depth: 32 00:06:06.243 # threads/core: 1 00:06:06.243 Run time: 1 seconds 00:06:06.243 Verify: Yes 00:06:06.243 00:06:06.243 Running for 1 seconds... 00:06:06.243 00:06:06.243 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:06.243 ------------------------------------------------------------------------------------ 00:06:06.243 0,0 55552/s 102 MiB/s 0 0 00:06:06.243 ==================================================================================== 00:06:06.243 Total 55552/s 217 MiB/s 0 0' 00:06:06.243 08:44:54 -- accel/accel.sh@20 -- # IFS=: 00:06:06.243 08:44:54 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:06.243 08:44:54 -- accel/accel.sh@20 -- # read -r var val 00:06:06.243 08:44:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:06.243 08:44:54 -- accel/accel.sh@12 -- # build_accel_config 00:06:06.243 08:44:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:06.243 08:44:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:06.243 08:44:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:06.243 08:44:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:06.243 08:44:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:06.243 08:44:54 -- accel/accel.sh@41 -- # local IFS=, 00:06:06.243 08:44:54 -- accel/accel.sh@42 -- # jq -r . 00:06:06.243 [2024-07-15 08:44:54.605377] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:06:06.243 [2024-07-15 08:44:54.605463] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1393032 ] 00:06:06.243 EAL: No free 2048 kB hugepages reported on node 1 00:06:06.243 [2024-07-15 08:44:54.667558] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:06.501 [2024-07-15 08:44:54.787489] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:06.502 08:44:54 -- accel/accel.sh@21 -- # val= 00:06:06.502 08:44:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.502 08:44:54 -- accel/accel.sh@20 -- # IFS=: 00:06:06.502 08:44:54 -- accel/accel.sh@20 -- # read -r var val 00:06:06.502 08:44:54 -- accel/accel.sh@21 -- # val= 00:06:06.502 08:44:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.502 08:44:54 -- accel/accel.sh@20 -- # IFS=: 00:06:06.502 08:44:54 -- accel/accel.sh@20 -- # read -r var val 00:06:06.502 08:44:54 -- accel/accel.sh@21 -- # val= 00:06:06.502 08:44:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.502 08:44:54 -- accel/accel.sh@20 -- # IFS=: 00:06:06.502 08:44:54 -- accel/accel.sh@20 -- # read -r var val 00:06:06.502 08:44:54 -- accel/accel.sh@21 -- # val=0x1 00:06:06.502 08:44:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.502 08:44:54 -- accel/accel.sh@20 -- # IFS=: 00:06:06.502 08:44:54 -- accel/accel.sh@20 -- # read -r var val 00:06:06.502 08:44:54 -- accel/accel.sh@21 -- # val= 00:06:06.502 08:44:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.502 08:44:54 -- accel/accel.sh@20 -- # IFS=: 00:06:06.502 08:44:54 -- accel/accel.sh@20 -- # read -r var val 00:06:06.502 08:44:54 -- accel/accel.sh@21 -- # val= 00:06:06.502 08:44:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.502 08:44:54 -- accel/accel.sh@20 -- # IFS=: 00:06:06.502 08:44:54 -- accel/accel.sh@20 -- # read -r var val 00:06:06.502 08:44:54 -- accel/accel.sh@21 -- # val=decompress 00:06:06.502 08:44:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.502 08:44:54 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:06.502 08:44:54 -- accel/accel.sh@20 -- # IFS=: 00:06:06.502 08:44:54 -- accel/accel.sh@20 -- # read -r var val 00:06:06.502 08:44:54 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:06.502 08:44:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.502 08:44:54 -- accel/accel.sh@20 -- # IFS=: 00:06:06.502 08:44:54 -- accel/accel.sh@20 -- # read -r var val 00:06:06.502 08:44:54 -- accel/accel.sh@21 -- # val= 00:06:06.502 08:44:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.502 08:44:54 -- accel/accel.sh@20 -- # IFS=: 00:06:06.502 08:44:54 -- accel/accel.sh@20 -- # read -r var val 00:06:06.502 08:44:54 -- accel/accel.sh@21 -- # val=software 00:06:06.502 08:44:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.502 08:44:54 -- accel/accel.sh@23 -- # accel_module=software 00:06:06.502 08:44:54 -- accel/accel.sh@20 -- # IFS=: 00:06:06.502 08:44:54 -- accel/accel.sh@20 -- # read -r var val 00:06:06.502 08:44:54 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:06.502 08:44:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.502 08:44:54 -- accel/accel.sh@20 -- # IFS=: 00:06:06.502 08:44:54 -- accel/accel.sh@20 -- # read -r var val 00:06:06.502 08:44:54 -- accel/accel.sh@21 -- # val=32 00:06:06.502 08:44:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.502 08:44:54 -- accel/accel.sh@20 -- # IFS=: 00:06:06.502 08:44:54 -- accel/accel.sh@20 -- # read -r var val 00:06:06.502 08:44:54 -- accel/accel.sh@21 -- # val=32 00:06:06.502 08:44:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.502 08:44:54 -- accel/accel.sh@20 -- # IFS=: 00:06:06.502 08:44:54 -- accel/accel.sh@20 -- # read -r var val 00:06:06.502 08:44:54 -- accel/accel.sh@21 -- # val=1 00:06:06.502 08:44:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.502 08:44:54 -- accel/accel.sh@20 -- # IFS=: 00:06:06.502 08:44:54 -- accel/accel.sh@20 -- # read -r var val 00:06:06.502 08:44:54 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:06.502 08:44:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.502 08:44:54 -- accel/accel.sh@20 -- # IFS=: 00:06:06.502 08:44:54 -- accel/accel.sh@20 -- # read -r var val 00:06:06.502 08:44:54 -- accel/accel.sh@21 -- # val=Yes 00:06:06.502 08:44:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.502 08:44:54 -- accel/accel.sh@20 -- # IFS=: 00:06:06.502 08:44:54 -- accel/accel.sh@20 -- # read -r var val 00:06:06.502 08:44:54 -- accel/accel.sh@21 -- # val= 00:06:06.502 08:44:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.502 08:44:54 -- accel/accel.sh@20 -- # IFS=: 00:06:06.502 08:44:54 -- accel/accel.sh@20 -- # read -r var val 00:06:06.502 08:44:54 -- accel/accel.sh@21 -- # val= 00:06:06.502 08:44:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.502 08:44:54 -- accel/accel.sh@20 -- # IFS=: 00:06:06.502 08:44:54 -- accel/accel.sh@20 -- # read -r var val 00:06:07.873 08:44:56 -- accel/accel.sh@21 -- # val= 00:06:07.873 08:44:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.873 08:44:56 -- accel/accel.sh@20 -- # IFS=: 00:06:07.873 08:44:56 -- accel/accel.sh@20 -- # read -r var val 00:06:07.873 08:44:56 -- accel/accel.sh@21 -- # val= 00:06:07.873 08:44:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.873 08:44:56 -- accel/accel.sh@20 -- # IFS=: 00:06:07.873 08:44:56 -- accel/accel.sh@20 -- # read -r var val 00:06:07.873 08:44:56 -- accel/accel.sh@21 -- # val= 00:06:07.873 08:44:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.873 08:44:56 -- accel/accel.sh@20 -- # IFS=: 00:06:07.873 08:44:56 -- accel/accel.sh@20 -- # read -r var val 00:06:07.873 08:44:56 -- accel/accel.sh@21 -- # val= 00:06:07.873 08:44:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.873 08:44:56 -- accel/accel.sh@20 -- # IFS=: 00:06:07.873 08:44:56 -- accel/accel.sh@20 -- # read -r var val 00:06:07.873 08:44:56 -- accel/accel.sh@21 -- # val= 00:06:07.873 08:44:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.873 08:44:56 -- accel/accel.sh@20 -- # IFS=: 00:06:07.873 08:44:56 -- accel/accel.sh@20 -- # read -r var val 00:06:07.873 08:44:56 -- accel/accel.sh@21 -- # val= 00:06:07.873 08:44:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.873 08:44:56 -- accel/accel.sh@20 -- # IFS=: 00:06:07.873 08:44:56 -- accel/accel.sh@20 -- # read -r var val 00:06:07.873 08:44:56 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:07.873 08:44:56 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:07.873 08:44:56 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:07.873 00:06:07.873 real 0m2.958s 00:06:07.873 user 0m2.666s 00:06:07.874 sys 0m0.286s 00:06:07.874 08:44:56 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:07.874 08:44:56 -- common/autotest_common.sh@10 -- # set +x 00:06:07.874 ************************************ 00:06:07.874 END TEST accel_decomp 00:06:07.874 ************************************ 00:06:07.874 08:44:56 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:07.874 08:44:56 -- common/autotest_common.sh@1077 -- # '[' 11 -le 1 ']' 00:06:07.874 08:44:56 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:07.874 08:44:56 -- common/autotest_common.sh@10 -- # set +x 00:06:07.874 ************************************ 00:06:07.874 START TEST accel_decmop_full 00:06:07.874 ************************************ 00:06:07.874 08:44:56 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:07.874 08:44:56 -- accel/accel.sh@16 -- # local accel_opc 00:06:07.874 08:44:56 -- accel/accel.sh@17 -- # local accel_module 00:06:07.874 08:44:56 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:07.874 08:44:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:07.874 08:44:56 -- accel/accel.sh@12 -- # build_accel_config 00:06:07.874 08:44:56 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:07.874 08:44:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:07.874 08:44:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:07.874 08:44:56 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:07.874 08:44:56 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:07.874 08:44:56 -- accel/accel.sh@41 -- # local IFS=, 00:06:07.874 08:44:56 -- accel/accel.sh@42 -- # jq -r . 00:06:07.874 [2024-07-15 08:44:56.120275] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:06:07.874 [2024-07-15 08:44:56.120364] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1393214 ] 00:06:07.874 EAL: No free 2048 kB hugepages reported on node 1 00:06:07.874 [2024-07-15 08:44:56.182902] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:07.874 [2024-07-15 08:44:56.302546] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:09.245 08:44:57 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:09.245 00:06:09.245 SPDK Configuration: 00:06:09.245 Core mask: 0x1 00:06:09.245 00:06:09.245 Accel Perf Configuration: 00:06:09.245 Workload Type: decompress 00:06:09.245 Transfer size: 111250 bytes 00:06:09.245 Vector count 1 00:06:09.245 Module: software 00:06:09.245 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:09.245 Queue depth: 32 00:06:09.245 Allocate depth: 32 00:06:09.245 # threads/core: 1 00:06:09.245 Run time: 1 seconds 00:06:09.245 Verify: Yes 00:06:09.245 00:06:09.245 Running for 1 seconds... 00:06:09.245 00:06:09.245 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:09.245 ------------------------------------------------------------------------------------ 00:06:09.245 0,0 3808/s 157 MiB/s 0 0 00:06:09.245 ==================================================================================== 00:06:09.245 Total 3808/s 404 MiB/s 0 0' 00:06:09.245 08:44:57 -- accel/accel.sh@20 -- # IFS=: 00:06:09.245 08:44:57 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:09.245 08:44:57 -- accel/accel.sh@20 -- # read -r var val 00:06:09.245 08:44:57 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:09.245 08:44:57 -- accel/accel.sh@12 -- # build_accel_config 00:06:09.245 08:44:57 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:09.245 08:44:57 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:09.245 08:44:57 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:09.245 08:44:57 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:09.245 08:44:57 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:09.245 08:44:57 -- accel/accel.sh@41 -- # local IFS=, 00:06:09.245 08:44:57 -- accel/accel.sh@42 -- # jq -r . 00:06:09.245 [2024-07-15 08:44:57.620680] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:06:09.245 [2024-07-15 08:44:57.620766] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1393450 ] 00:06:09.245 EAL: No free 2048 kB hugepages reported on node 1 00:06:09.245 [2024-07-15 08:44:57.684079] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:09.504 [2024-07-15 08:44:57.803268] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:09.504 08:44:57 -- accel/accel.sh@21 -- # val= 00:06:09.504 08:44:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.504 08:44:57 -- accel/accel.sh@20 -- # IFS=: 00:06:09.504 08:44:57 -- accel/accel.sh@20 -- # read -r var val 00:06:09.504 08:44:57 -- accel/accel.sh@21 -- # val= 00:06:09.504 08:44:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.504 08:44:57 -- accel/accel.sh@20 -- # IFS=: 00:06:09.504 08:44:57 -- accel/accel.sh@20 -- # read -r var val 00:06:09.504 08:44:57 -- accel/accel.sh@21 -- # val= 00:06:09.504 08:44:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.504 08:44:57 -- accel/accel.sh@20 -- # IFS=: 00:06:09.504 08:44:57 -- accel/accel.sh@20 -- # read -r var val 00:06:09.504 08:44:57 -- accel/accel.sh@21 -- # val=0x1 00:06:09.504 08:44:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.504 08:44:57 -- accel/accel.sh@20 -- # IFS=: 00:06:09.504 08:44:57 -- accel/accel.sh@20 -- # read -r var val 00:06:09.504 08:44:57 -- accel/accel.sh@21 -- # val= 00:06:09.504 08:44:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.504 08:44:57 -- accel/accel.sh@20 -- # IFS=: 00:06:09.504 08:44:57 -- accel/accel.sh@20 -- # read -r var val 00:06:09.504 08:44:57 -- accel/accel.sh@21 -- # val= 00:06:09.504 08:44:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.504 08:44:57 -- accel/accel.sh@20 -- # IFS=: 00:06:09.504 08:44:57 -- accel/accel.sh@20 -- # read -r var val 00:06:09.504 08:44:57 -- accel/accel.sh@21 -- # val=decompress 00:06:09.504 08:44:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.504 08:44:57 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:09.504 08:44:57 -- accel/accel.sh@20 -- # IFS=: 00:06:09.504 08:44:57 -- accel/accel.sh@20 -- # read -r var val 00:06:09.504 08:44:57 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:09.504 08:44:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.504 08:44:57 -- accel/accel.sh@20 -- # IFS=: 00:06:09.504 08:44:57 -- accel/accel.sh@20 -- # read -r var val 00:06:09.504 08:44:57 -- accel/accel.sh@21 -- # val= 00:06:09.504 08:44:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.504 08:44:57 -- accel/accel.sh@20 -- # IFS=: 00:06:09.504 08:44:57 -- accel/accel.sh@20 -- # read -r var val 00:06:09.504 08:44:57 -- accel/accel.sh@21 -- # val=software 00:06:09.504 08:44:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.504 08:44:57 -- accel/accel.sh@23 -- # accel_module=software 00:06:09.504 08:44:57 -- accel/accel.sh@20 -- # IFS=: 00:06:09.504 08:44:57 -- accel/accel.sh@20 -- # read -r var val 00:06:09.504 08:44:57 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:09.504 08:44:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.504 08:44:57 -- accel/accel.sh@20 -- # IFS=: 00:06:09.504 08:44:57 -- accel/accel.sh@20 -- # read -r var val 00:06:09.504 08:44:57 -- accel/accel.sh@21 -- # val=32 00:06:09.504 08:44:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.504 08:44:57 -- accel/accel.sh@20 -- # IFS=: 00:06:09.504 08:44:57 -- accel/accel.sh@20 -- # read -r var val 00:06:09.504 08:44:57 -- accel/accel.sh@21 -- # val=32 00:06:09.504 08:44:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.504 08:44:57 -- accel/accel.sh@20 -- # IFS=: 00:06:09.504 08:44:57 -- accel/accel.sh@20 -- # read -r var val 00:06:09.504 08:44:57 -- accel/accel.sh@21 -- # val=1 00:06:09.504 08:44:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.504 08:44:57 -- accel/accel.sh@20 -- # IFS=: 00:06:09.504 08:44:57 -- accel/accel.sh@20 -- # read -r var val 00:06:09.504 08:44:57 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:09.504 08:44:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.504 08:44:57 -- accel/accel.sh@20 -- # IFS=: 00:06:09.504 08:44:57 -- accel/accel.sh@20 -- # read -r var val 00:06:09.504 08:44:57 -- accel/accel.sh@21 -- # val=Yes 00:06:09.504 08:44:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.504 08:44:57 -- accel/accel.sh@20 -- # IFS=: 00:06:09.504 08:44:57 -- accel/accel.sh@20 -- # read -r var val 00:06:09.504 08:44:57 -- accel/accel.sh@21 -- # val= 00:06:09.504 08:44:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.504 08:44:57 -- accel/accel.sh@20 -- # IFS=: 00:06:09.504 08:44:57 -- accel/accel.sh@20 -- # read -r var val 00:06:09.504 08:44:57 -- accel/accel.sh@21 -- # val= 00:06:09.504 08:44:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.504 08:44:57 -- accel/accel.sh@20 -- # IFS=: 00:06:09.504 08:44:57 -- accel/accel.sh@20 -- # read -r var val 00:06:10.877 08:44:59 -- accel/accel.sh@21 -- # val= 00:06:10.877 08:44:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.877 08:44:59 -- accel/accel.sh@20 -- # IFS=: 00:06:10.877 08:44:59 -- accel/accel.sh@20 -- # read -r var val 00:06:10.877 08:44:59 -- accel/accel.sh@21 -- # val= 00:06:10.877 08:44:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.877 08:44:59 -- accel/accel.sh@20 -- # IFS=: 00:06:10.877 08:44:59 -- accel/accel.sh@20 -- # read -r var val 00:06:10.877 08:44:59 -- accel/accel.sh@21 -- # val= 00:06:10.877 08:44:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.877 08:44:59 -- accel/accel.sh@20 -- # IFS=: 00:06:10.877 08:44:59 -- accel/accel.sh@20 -- # read -r var val 00:06:10.877 08:44:59 -- accel/accel.sh@21 -- # val= 00:06:10.877 08:44:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.877 08:44:59 -- accel/accel.sh@20 -- # IFS=: 00:06:10.877 08:44:59 -- accel/accel.sh@20 -- # read -r var val 00:06:10.877 08:44:59 -- accel/accel.sh@21 -- # val= 00:06:10.877 08:44:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.877 08:44:59 -- accel/accel.sh@20 -- # IFS=: 00:06:10.877 08:44:59 -- accel/accel.sh@20 -- # read -r var val 00:06:10.877 08:44:59 -- accel/accel.sh@21 -- # val= 00:06:10.877 08:44:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.877 08:44:59 -- accel/accel.sh@20 -- # IFS=: 00:06:10.877 08:44:59 -- accel/accel.sh@20 -- # read -r var val 00:06:10.877 08:44:59 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:10.877 08:44:59 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:10.877 08:44:59 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:10.877 00:06:10.877 real 0m2.993s 00:06:10.877 user 0m2.700s 00:06:10.877 sys 0m0.285s 00:06:10.877 08:44:59 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:10.877 08:44:59 -- common/autotest_common.sh@10 -- # set +x 00:06:10.877 ************************************ 00:06:10.877 END TEST accel_decmop_full 00:06:10.877 ************************************ 00:06:10.877 08:44:59 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:10.877 08:44:59 -- common/autotest_common.sh@1077 -- # '[' 11 -le 1 ']' 00:06:10.877 08:44:59 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:10.877 08:44:59 -- common/autotest_common.sh@10 -- # set +x 00:06:10.877 ************************************ 00:06:10.877 START TEST accel_decomp_mcore 00:06:10.877 ************************************ 00:06:10.877 08:44:59 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:10.877 08:44:59 -- accel/accel.sh@16 -- # local accel_opc 00:06:10.877 08:44:59 -- accel/accel.sh@17 -- # local accel_module 00:06:10.877 08:44:59 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:10.877 08:44:59 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:10.877 08:44:59 -- accel/accel.sh@12 -- # build_accel_config 00:06:10.877 08:44:59 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:10.877 08:44:59 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:10.877 08:44:59 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:10.877 08:44:59 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:10.877 08:44:59 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:10.877 08:44:59 -- accel/accel.sh@41 -- # local IFS=, 00:06:10.877 08:44:59 -- accel/accel.sh@42 -- # jq -r . 00:06:10.877 [2024-07-15 08:44:59.139667] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:06:10.877 [2024-07-15 08:44:59.139748] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1393612 ] 00:06:10.877 EAL: No free 2048 kB hugepages reported on node 1 00:06:10.877 [2024-07-15 08:44:59.205554] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:10.877 [2024-07-15 08:44:59.327410] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:10.877 [2024-07-15 08:44:59.327471] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:10.877 [2024-07-15 08:44:59.327527] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:10.877 [2024-07-15 08:44:59.327530] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:12.250 08:45:00 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:12.250 00:06:12.250 SPDK Configuration: 00:06:12.250 Core mask: 0xf 00:06:12.250 00:06:12.250 Accel Perf Configuration: 00:06:12.250 Workload Type: decompress 00:06:12.250 Transfer size: 4096 bytes 00:06:12.250 Vector count 1 00:06:12.250 Module: software 00:06:12.250 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:12.250 Queue depth: 32 00:06:12.250 Allocate depth: 32 00:06:12.250 # threads/core: 1 00:06:12.250 Run time: 1 seconds 00:06:12.250 Verify: Yes 00:06:12.250 00:06:12.250 Running for 1 seconds... 00:06:12.250 00:06:12.250 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:12.250 ------------------------------------------------------------------------------------ 00:06:12.250 0,0 50144/s 92 MiB/s 0 0 00:06:12.250 3,0 50688/s 93 MiB/s 0 0 00:06:12.250 2,0 50592/s 93 MiB/s 0 0 00:06:12.250 1,0 49600/s 91 MiB/s 0 0 00:06:12.250 ==================================================================================== 00:06:12.250 Total 201024/s 785 MiB/s 0 0' 00:06:12.250 08:45:00 -- accel/accel.sh@20 -- # IFS=: 00:06:12.250 08:45:00 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:12.250 08:45:00 -- accel/accel.sh@20 -- # read -r var val 00:06:12.250 08:45:00 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:12.250 08:45:00 -- accel/accel.sh@12 -- # build_accel_config 00:06:12.250 08:45:00 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:12.250 08:45:00 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:12.250 08:45:00 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:12.250 08:45:00 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:12.250 08:45:00 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:12.250 08:45:00 -- accel/accel.sh@41 -- # local IFS=, 00:06:12.250 08:45:00 -- accel/accel.sh@42 -- # jq -r . 00:06:12.250 [2024-07-15 08:45:00.633797] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:06:12.250 [2024-07-15 08:45:00.633889] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1393800 ] 00:06:12.250 EAL: No free 2048 kB hugepages reported on node 1 00:06:12.250 [2024-07-15 08:45:00.698318] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:12.508 [2024-07-15 08:45:00.821477] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:12.508 [2024-07-15 08:45:00.821528] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:12.508 [2024-07-15 08:45:00.821593] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:12.508 [2024-07-15 08:45:00.821596] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:12.508 08:45:00 -- accel/accel.sh@21 -- # val= 00:06:12.508 08:45:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.508 08:45:00 -- accel/accel.sh@20 -- # IFS=: 00:06:12.508 08:45:00 -- accel/accel.sh@20 -- # read -r var val 00:06:12.508 08:45:00 -- accel/accel.sh@21 -- # val= 00:06:12.508 08:45:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.508 08:45:00 -- accel/accel.sh@20 -- # IFS=: 00:06:12.508 08:45:00 -- accel/accel.sh@20 -- # read -r var val 00:06:12.508 08:45:00 -- accel/accel.sh@21 -- # val= 00:06:12.508 08:45:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.508 08:45:00 -- accel/accel.sh@20 -- # IFS=: 00:06:12.508 08:45:00 -- accel/accel.sh@20 -- # read -r var val 00:06:12.508 08:45:00 -- accel/accel.sh@21 -- # val=0xf 00:06:12.508 08:45:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.508 08:45:00 -- accel/accel.sh@20 -- # IFS=: 00:06:12.508 08:45:00 -- accel/accel.sh@20 -- # read -r var val 00:06:12.508 08:45:00 -- accel/accel.sh@21 -- # val= 00:06:12.508 08:45:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.508 08:45:00 -- accel/accel.sh@20 -- # IFS=: 00:06:12.508 08:45:00 -- accel/accel.sh@20 -- # read -r var val 00:06:12.508 08:45:00 -- accel/accel.sh@21 -- # val= 00:06:12.508 08:45:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.508 08:45:00 -- accel/accel.sh@20 -- # IFS=: 00:06:12.508 08:45:00 -- accel/accel.sh@20 -- # read -r var val 00:06:12.508 08:45:00 -- accel/accel.sh@21 -- # val=decompress 00:06:12.508 08:45:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.508 08:45:00 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:12.508 08:45:00 -- accel/accel.sh@20 -- # IFS=: 00:06:12.508 08:45:00 -- accel/accel.sh@20 -- # read -r var val 00:06:12.509 08:45:00 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:12.509 08:45:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.509 08:45:00 -- accel/accel.sh@20 -- # IFS=: 00:06:12.509 08:45:00 -- accel/accel.sh@20 -- # read -r var val 00:06:12.509 08:45:00 -- accel/accel.sh@21 -- # val= 00:06:12.509 08:45:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.509 08:45:00 -- accel/accel.sh@20 -- # IFS=: 00:06:12.509 08:45:00 -- accel/accel.sh@20 -- # read -r var val 00:06:12.509 08:45:00 -- accel/accel.sh@21 -- # val=software 00:06:12.509 08:45:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.509 08:45:00 -- accel/accel.sh@23 -- # accel_module=software 00:06:12.509 08:45:00 -- accel/accel.sh@20 -- # IFS=: 00:06:12.509 08:45:00 -- accel/accel.sh@20 -- # read -r var val 00:06:12.509 08:45:00 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:12.509 08:45:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.509 08:45:00 -- accel/accel.sh@20 -- # IFS=: 00:06:12.509 08:45:00 -- accel/accel.sh@20 -- # read -r var val 00:06:12.509 08:45:00 -- accel/accel.sh@21 -- # val=32 00:06:12.509 08:45:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.509 08:45:00 -- accel/accel.sh@20 -- # IFS=: 00:06:12.509 08:45:00 -- accel/accel.sh@20 -- # read -r var val 00:06:12.509 08:45:00 -- accel/accel.sh@21 -- # val=32 00:06:12.509 08:45:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.509 08:45:00 -- accel/accel.sh@20 -- # IFS=: 00:06:12.509 08:45:00 -- accel/accel.sh@20 -- # read -r var val 00:06:12.509 08:45:00 -- accel/accel.sh@21 -- # val=1 00:06:12.509 08:45:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.509 08:45:00 -- accel/accel.sh@20 -- # IFS=: 00:06:12.509 08:45:00 -- accel/accel.sh@20 -- # read -r var val 00:06:12.509 08:45:00 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:12.509 08:45:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.509 08:45:00 -- accel/accel.sh@20 -- # IFS=: 00:06:12.509 08:45:00 -- accel/accel.sh@20 -- # read -r var val 00:06:12.509 08:45:00 -- accel/accel.sh@21 -- # val=Yes 00:06:12.509 08:45:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.509 08:45:00 -- accel/accel.sh@20 -- # IFS=: 00:06:12.509 08:45:00 -- accel/accel.sh@20 -- # read -r var val 00:06:12.509 08:45:00 -- accel/accel.sh@21 -- # val= 00:06:12.509 08:45:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.509 08:45:00 -- accel/accel.sh@20 -- # IFS=: 00:06:12.509 08:45:00 -- accel/accel.sh@20 -- # read -r var val 00:06:12.509 08:45:00 -- accel/accel.sh@21 -- # val= 00:06:12.509 08:45:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.509 08:45:00 -- accel/accel.sh@20 -- # IFS=: 00:06:12.509 08:45:00 -- accel/accel.sh@20 -- # read -r var val 00:06:13.882 08:45:02 -- accel/accel.sh@21 -- # val= 00:06:13.882 08:45:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.882 08:45:02 -- accel/accel.sh@20 -- # IFS=: 00:06:13.882 08:45:02 -- accel/accel.sh@20 -- # read -r var val 00:06:13.882 08:45:02 -- accel/accel.sh@21 -- # val= 00:06:13.882 08:45:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.882 08:45:02 -- accel/accel.sh@20 -- # IFS=: 00:06:13.882 08:45:02 -- accel/accel.sh@20 -- # read -r var val 00:06:13.882 08:45:02 -- accel/accel.sh@21 -- # val= 00:06:13.882 08:45:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.882 08:45:02 -- accel/accel.sh@20 -- # IFS=: 00:06:13.882 08:45:02 -- accel/accel.sh@20 -- # read -r var val 00:06:13.882 08:45:02 -- accel/accel.sh@21 -- # val= 00:06:13.882 08:45:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.882 08:45:02 -- accel/accel.sh@20 -- # IFS=: 00:06:13.882 08:45:02 -- accel/accel.sh@20 -- # read -r var val 00:06:13.882 08:45:02 -- accel/accel.sh@21 -- # val= 00:06:13.882 08:45:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.882 08:45:02 -- accel/accel.sh@20 -- # IFS=: 00:06:13.882 08:45:02 -- accel/accel.sh@20 -- # read -r var val 00:06:13.882 08:45:02 -- accel/accel.sh@21 -- # val= 00:06:13.882 08:45:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.882 08:45:02 -- accel/accel.sh@20 -- # IFS=: 00:06:13.882 08:45:02 -- accel/accel.sh@20 -- # read -r var val 00:06:13.882 08:45:02 -- accel/accel.sh@21 -- # val= 00:06:13.882 08:45:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.882 08:45:02 -- accel/accel.sh@20 -- # IFS=: 00:06:13.882 08:45:02 -- accel/accel.sh@20 -- # read -r var val 00:06:13.882 08:45:02 -- accel/accel.sh@21 -- # val= 00:06:13.882 08:45:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.882 08:45:02 -- accel/accel.sh@20 -- # IFS=: 00:06:13.882 08:45:02 -- accel/accel.sh@20 -- # read -r var val 00:06:13.882 08:45:02 -- accel/accel.sh@21 -- # val= 00:06:13.882 08:45:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.882 08:45:02 -- accel/accel.sh@20 -- # IFS=: 00:06:13.882 08:45:02 -- accel/accel.sh@20 -- # read -r var val 00:06:13.882 08:45:02 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:13.882 08:45:02 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:13.882 08:45:02 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:13.882 00:06:13.882 real 0m2.989s 00:06:13.882 user 0m9.586s 00:06:13.882 sys 0m0.310s 00:06:13.882 08:45:02 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:13.882 08:45:02 -- common/autotest_common.sh@10 -- # set +x 00:06:13.882 ************************************ 00:06:13.882 END TEST accel_decomp_mcore 00:06:13.882 ************************************ 00:06:13.882 08:45:02 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:13.882 08:45:02 -- common/autotest_common.sh@1077 -- # '[' 13 -le 1 ']' 00:06:13.882 08:45:02 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:13.882 08:45:02 -- common/autotest_common.sh@10 -- # set +x 00:06:13.882 ************************************ 00:06:13.882 START TEST accel_decomp_full_mcore 00:06:13.882 ************************************ 00:06:13.882 08:45:02 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:13.882 08:45:02 -- accel/accel.sh@16 -- # local accel_opc 00:06:13.882 08:45:02 -- accel/accel.sh@17 -- # local accel_module 00:06:13.882 08:45:02 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:13.882 08:45:02 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:13.882 08:45:02 -- accel/accel.sh@12 -- # build_accel_config 00:06:13.882 08:45:02 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:13.882 08:45:02 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:13.882 08:45:02 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:13.882 08:45:02 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:13.882 08:45:02 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:13.882 08:45:02 -- accel/accel.sh@41 -- # local IFS=, 00:06:13.882 08:45:02 -- accel/accel.sh@42 -- # jq -r . 00:06:13.882 [2024-07-15 08:45:02.155627] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:06:13.883 [2024-07-15 08:45:02.155709] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1394150 ] 00:06:13.883 EAL: No free 2048 kB hugepages reported on node 1 00:06:13.883 [2024-07-15 08:45:02.221847] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:13.883 [2024-07-15 08:45:02.341998] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:13.883 [2024-07-15 08:45:02.342050] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:13.883 [2024-07-15 08:45:02.342101] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:13.883 [2024-07-15 08:45:02.342104] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:15.256 08:45:03 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:15.256 00:06:15.256 SPDK Configuration: 00:06:15.256 Core mask: 0xf 00:06:15.256 00:06:15.256 Accel Perf Configuration: 00:06:15.256 Workload Type: decompress 00:06:15.256 Transfer size: 111250 bytes 00:06:15.256 Vector count 1 00:06:15.256 Module: software 00:06:15.256 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:15.256 Queue depth: 32 00:06:15.256 Allocate depth: 32 00:06:15.256 # threads/core: 1 00:06:15.256 Run time: 1 seconds 00:06:15.256 Verify: Yes 00:06:15.256 00:06:15.256 Running for 1 seconds... 00:06:15.256 00:06:15.256 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:15.256 ------------------------------------------------------------------------------------ 00:06:15.256 0,0 3776/s 155 MiB/s 0 0 00:06:15.256 3,0 3776/s 155 MiB/s 0 0 00:06:15.256 2,0 3776/s 155 MiB/s 0 0 00:06:15.256 1,0 3776/s 155 MiB/s 0 0 00:06:15.256 ==================================================================================== 00:06:15.256 Total 15104/s 1602 MiB/s 0 0' 00:06:15.256 08:45:03 -- accel/accel.sh@20 -- # IFS=: 00:06:15.256 08:45:03 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:15.256 08:45:03 -- accel/accel.sh@20 -- # read -r var val 00:06:15.256 08:45:03 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:15.256 08:45:03 -- accel/accel.sh@12 -- # build_accel_config 00:06:15.256 08:45:03 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:15.256 08:45:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:15.256 08:45:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:15.256 08:45:03 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:15.256 08:45:03 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:15.256 08:45:03 -- accel/accel.sh@41 -- # local IFS=, 00:06:15.256 08:45:03 -- accel/accel.sh@42 -- # jq -r . 00:06:15.256 [2024-07-15 08:45:03.658746] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:06:15.257 [2024-07-15 08:45:03.658836] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1394295 ] 00:06:15.257 EAL: No free 2048 kB hugepages reported on node 1 00:06:15.257 [2024-07-15 08:45:03.722488] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:15.515 [2024-07-15 08:45:03.843125] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:15.515 [2024-07-15 08:45:03.843179] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:15.515 [2024-07-15 08:45:03.843230] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:15.515 [2024-07-15 08:45:03.843233] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:15.515 08:45:03 -- accel/accel.sh@21 -- # val= 00:06:15.515 08:45:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.515 08:45:03 -- accel/accel.sh@20 -- # IFS=: 00:06:15.515 08:45:03 -- accel/accel.sh@20 -- # read -r var val 00:06:15.515 08:45:03 -- accel/accel.sh@21 -- # val= 00:06:15.515 08:45:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.515 08:45:03 -- accel/accel.sh@20 -- # IFS=: 00:06:15.515 08:45:03 -- accel/accel.sh@20 -- # read -r var val 00:06:15.515 08:45:03 -- accel/accel.sh@21 -- # val= 00:06:15.515 08:45:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.515 08:45:03 -- accel/accel.sh@20 -- # IFS=: 00:06:15.515 08:45:03 -- accel/accel.sh@20 -- # read -r var val 00:06:15.515 08:45:03 -- accel/accel.sh@21 -- # val=0xf 00:06:15.515 08:45:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.515 08:45:03 -- accel/accel.sh@20 -- # IFS=: 00:06:15.515 08:45:03 -- accel/accel.sh@20 -- # read -r var val 00:06:15.515 08:45:03 -- accel/accel.sh@21 -- # val= 00:06:15.515 08:45:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.515 08:45:03 -- accel/accel.sh@20 -- # IFS=: 00:06:15.515 08:45:03 -- accel/accel.sh@20 -- # read -r var val 00:06:15.515 08:45:03 -- accel/accel.sh@21 -- # val= 00:06:15.515 08:45:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.515 08:45:03 -- accel/accel.sh@20 -- # IFS=: 00:06:15.515 08:45:03 -- accel/accel.sh@20 -- # read -r var val 00:06:15.515 08:45:03 -- accel/accel.sh@21 -- # val=decompress 00:06:15.515 08:45:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.515 08:45:03 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:15.515 08:45:03 -- accel/accel.sh@20 -- # IFS=: 00:06:15.515 08:45:03 -- accel/accel.sh@20 -- # read -r var val 00:06:15.515 08:45:03 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:15.515 08:45:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.515 08:45:03 -- accel/accel.sh@20 -- # IFS=: 00:06:15.515 08:45:03 -- accel/accel.sh@20 -- # read -r var val 00:06:15.515 08:45:03 -- accel/accel.sh@21 -- # val= 00:06:15.515 08:45:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.515 08:45:03 -- accel/accel.sh@20 -- # IFS=: 00:06:15.515 08:45:03 -- accel/accel.sh@20 -- # read -r var val 00:06:15.515 08:45:03 -- accel/accel.sh@21 -- # val=software 00:06:15.515 08:45:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.515 08:45:03 -- accel/accel.sh@23 -- # accel_module=software 00:06:15.515 08:45:03 -- accel/accel.sh@20 -- # IFS=: 00:06:15.515 08:45:03 -- accel/accel.sh@20 -- # read -r var val 00:06:15.515 08:45:03 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:15.515 08:45:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.515 08:45:03 -- accel/accel.sh@20 -- # IFS=: 00:06:15.515 08:45:03 -- accel/accel.sh@20 -- # read -r var val 00:06:15.515 08:45:03 -- accel/accel.sh@21 -- # val=32 00:06:15.515 08:45:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.515 08:45:03 -- accel/accel.sh@20 -- # IFS=: 00:06:15.515 08:45:03 -- accel/accel.sh@20 -- # read -r var val 00:06:15.515 08:45:03 -- accel/accel.sh@21 -- # val=32 00:06:15.515 08:45:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.515 08:45:03 -- accel/accel.sh@20 -- # IFS=: 00:06:15.515 08:45:03 -- accel/accel.sh@20 -- # read -r var val 00:06:15.515 08:45:03 -- accel/accel.sh@21 -- # val=1 00:06:15.515 08:45:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.515 08:45:03 -- accel/accel.sh@20 -- # IFS=: 00:06:15.515 08:45:03 -- accel/accel.sh@20 -- # read -r var val 00:06:15.515 08:45:03 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:15.515 08:45:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.515 08:45:03 -- accel/accel.sh@20 -- # IFS=: 00:06:15.515 08:45:03 -- accel/accel.sh@20 -- # read -r var val 00:06:15.515 08:45:03 -- accel/accel.sh@21 -- # val=Yes 00:06:15.515 08:45:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.515 08:45:03 -- accel/accel.sh@20 -- # IFS=: 00:06:15.515 08:45:03 -- accel/accel.sh@20 -- # read -r var val 00:06:15.515 08:45:03 -- accel/accel.sh@21 -- # val= 00:06:15.516 08:45:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.516 08:45:03 -- accel/accel.sh@20 -- # IFS=: 00:06:15.516 08:45:03 -- accel/accel.sh@20 -- # read -r var val 00:06:15.516 08:45:03 -- accel/accel.sh@21 -- # val= 00:06:15.516 08:45:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.516 08:45:03 -- accel/accel.sh@20 -- # IFS=: 00:06:15.516 08:45:03 -- accel/accel.sh@20 -- # read -r var val 00:06:16.888 08:45:05 -- accel/accel.sh@21 -- # val= 00:06:16.888 08:45:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.888 08:45:05 -- accel/accel.sh@20 -- # IFS=: 00:06:16.888 08:45:05 -- accel/accel.sh@20 -- # read -r var val 00:06:16.888 08:45:05 -- accel/accel.sh@21 -- # val= 00:06:16.888 08:45:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.888 08:45:05 -- accel/accel.sh@20 -- # IFS=: 00:06:16.888 08:45:05 -- accel/accel.sh@20 -- # read -r var val 00:06:16.888 08:45:05 -- accel/accel.sh@21 -- # val= 00:06:16.888 08:45:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.888 08:45:05 -- accel/accel.sh@20 -- # IFS=: 00:06:16.888 08:45:05 -- accel/accel.sh@20 -- # read -r var val 00:06:16.888 08:45:05 -- accel/accel.sh@21 -- # val= 00:06:16.888 08:45:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.888 08:45:05 -- accel/accel.sh@20 -- # IFS=: 00:06:16.888 08:45:05 -- accel/accel.sh@20 -- # read -r var val 00:06:16.888 08:45:05 -- accel/accel.sh@21 -- # val= 00:06:16.888 08:45:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.888 08:45:05 -- accel/accel.sh@20 -- # IFS=: 00:06:16.888 08:45:05 -- accel/accel.sh@20 -- # read -r var val 00:06:16.888 08:45:05 -- accel/accel.sh@21 -- # val= 00:06:16.888 08:45:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.888 08:45:05 -- accel/accel.sh@20 -- # IFS=: 00:06:16.888 08:45:05 -- accel/accel.sh@20 -- # read -r var val 00:06:16.888 08:45:05 -- accel/accel.sh@21 -- # val= 00:06:16.888 08:45:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.888 08:45:05 -- accel/accel.sh@20 -- # IFS=: 00:06:16.888 08:45:05 -- accel/accel.sh@20 -- # read -r var val 00:06:16.888 08:45:05 -- accel/accel.sh@21 -- # val= 00:06:16.888 08:45:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.888 08:45:05 -- accel/accel.sh@20 -- # IFS=: 00:06:16.888 08:45:05 -- accel/accel.sh@20 -- # read -r var val 00:06:16.888 08:45:05 -- accel/accel.sh@21 -- # val= 00:06:16.888 08:45:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.888 08:45:05 -- accel/accel.sh@20 -- # IFS=: 00:06:16.888 08:45:05 -- accel/accel.sh@20 -- # read -r var val 00:06:16.888 08:45:05 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:16.888 08:45:05 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:16.888 08:45:05 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:16.888 00:06:16.888 real 0m2.994s 00:06:16.888 user 0m9.656s 00:06:16.888 sys 0m0.284s 00:06:16.888 08:45:05 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:16.888 08:45:05 -- common/autotest_common.sh@10 -- # set +x 00:06:16.888 ************************************ 00:06:16.888 END TEST accel_decomp_full_mcore 00:06:16.888 ************************************ 00:06:16.888 08:45:05 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:16.888 08:45:05 -- common/autotest_common.sh@1077 -- # '[' 11 -le 1 ']' 00:06:16.888 08:45:05 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:16.888 08:45:05 -- common/autotest_common.sh@10 -- # set +x 00:06:16.888 ************************************ 00:06:16.888 START TEST accel_decomp_mthread 00:06:16.888 ************************************ 00:06:16.888 08:45:05 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:16.888 08:45:05 -- accel/accel.sh@16 -- # local accel_opc 00:06:16.888 08:45:05 -- accel/accel.sh@17 -- # local accel_module 00:06:16.888 08:45:05 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:16.888 08:45:05 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:16.888 08:45:05 -- accel/accel.sh@12 -- # build_accel_config 00:06:16.888 08:45:05 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:16.888 08:45:05 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:16.888 08:45:05 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:16.888 08:45:05 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:16.888 08:45:05 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:16.888 08:45:05 -- accel/accel.sh@41 -- # local IFS=, 00:06:16.888 08:45:05 -- accel/accel.sh@42 -- # jq -r . 00:06:16.888 [2024-07-15 08:45:05.176077] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:06:16.888 [2024-07-15 08:45:05.176171] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1394470 ] 00:06:16.888 EAL: No free 2048 kB hugepages reported on node 1 00:06:16.888 [2024-07-15 08:45:05.238089] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:16.888 [2024-07-15 08:45:05.357815] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:18.261 08:45:06 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:18.261 00:06:18.261 SPDK Configuration: 00:06:18.261 Core mask: 0x1 00:06:18.261 00:06:18.261 Accel Perf Configuration: 00:06:18.261 Workload Type: decompress 00:06:18.261 Transfer size: 4096 bytes 00:06:18.261 Vector count 1 00:06:18.261 Module: software 00:06:18.261 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:18.261 Queue depth: 32 00:06:18.261 Allocate depth: 32 00:06:18.261 # threads/core: 2 00:06:18.261 Run time: 1 seconds 00:06:18.261 Verify: Yes 00:06:18.261 00:06:18.261 Running for 1 seconds... 00:06:18.261 00:06:18.261 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:18.261 ------------------------------------------------------------------------------------ 00:06:18.261 0,1 28096/s 51 MiB/s 0 0 00:06:18.261 0,0 28000/s 51 MiB/s 0 0 00:06:18.261 ==================================================================================== 00:06:18.261 Total 56096/s 219 MiB/s 0 0' 00:06:18.261 08:45:06 -- accel/accel.sh@20 -- # IFS=: 00:06:18.261 08:45:06 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:18.261 08:45:06 -- accel/accel.sh@20 -- # read -r var val 00:06:18.261 08:45:06 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:18.261 08:45:06 -- accel/accel.sh@12 -- # build_accel_config 00:06:18.261 08:45:06 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:18.261 08:45:06 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:18.261 08:45:06 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:18.261 08:45:06 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:18.261 08:45:06 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:18.261 08:45:06 -- accel/accel.sh@41 -- # local IFS=, 00:06:18.261 08:45:06 -- accel/accel.sh@42 -- # jq -r . 00:06:18.261 [2024-07-15 08:45:06.650943] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:06:18.261 [2024-07-15 08:45:06.651028] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1394724 ] 00:06:18.261 EAL: No free 2048 kB hugepages reported on node 1 00:06:18.261 [2024-07-15 08:45:06.712474] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:18.519 [2024-07-15 08:45:06.833412] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:18.519 08:45:06 -- accel/accel.sh@21 -- # val= 00:06:18.519 08:45:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.520 08:45:06 -- accel/accel.sh@20 -- # IFS=: 00:06:18.520 08:45:06 -- accel/accel.sh@20 -- # read -r var val 00:06:18.520 08:45:06 -- accel/accel.sh@21 -- # val= 00:06:18.520 08:45:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.520 08:45:06 -- accel/accel.sh@20 -- # IFS=: 00:06:18.520 08:45:06 -- accel/accel.sh@20 -- # read -r var val 00:06:18.520 08:45:06 -- accel/accel.sh@21 -- # val= 00:06:18.520 08:45:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.520 08:45:06 -- accel/accel.sh@20 -- # IFS=: 00:06:18.520 08:45:06 -- accel/accel.sh@20 -- # read -r var val 00:06:18.520 08:45:06 -- accel/accel.sh@21 -- # val=0x1 00:06:18.520 08:45:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.520 08:45:06 -- accel/accel.sh@20 -- # IFS=: 00:06:18.520 08:45:06 -- accel/accel.sh@20 -- # read -r var val 00:06:18.520 08:45:06 -- accel/accel.sh@21 -- # val= 00:06:18.520 08:45:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.520 08:45:06 -- accel/accel.sh@20 -- # IFS=: 00:06:18.520 08:45:06 -- accel/accel.sh@20 -- # read -r var val 00:06:18.520 08:45:06 -- accel/accel.sh@21 -- # val= 00:06:18.520 08:45:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.520 08:45:06 -- accel/accel.sh@20 -- # IFS=: 00:06:18.520 08:45:06 -- accel/accel.sh@20 -- # read -r var val 00:06:18.520 08:45:06 -- accel/accel.sh@21 -- # val=decompress 00:06:18.520 08:45:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.520 08:45:06 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:18.520 08:45:06 -- accel/accel.sh@20 -- # IFS=: 00:06:18.520 08:45:06 -- accel/accel.sh@20 -- # read -r var val 00:06:18.520 08:45:06 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:18.520 08:45:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.520 08:45:06 -- accel/accel.sh@20 -- # IFS=: 00:06:18.520 08:45:06 -- accel/accel.sh@20 -- # read -r var val 00:06:18.520 08:45:06 -- accel/accel.sh@21 -- # val= 00:06:18.520 08:45:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.520 08:45:06 -- accel/accel.sh@20 -- # IFS=: 00:06:18.520 08:45:06 -- accel/accel.sh@20 -- # read -r var val 00:06:18.520 08:45:06 -- accel/accel.sh@21 -- # val=software 00:06:18.520 08:45:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.520 08:45:06 -- accel/accel.sh@23 -- # accel_module=software 00:06:18.520 08:45:06 -- accel/accel.sh@20 -- # IFS=: 00:06:18.520 08:45:06 -- accel/accel.sh@20 -- # read -r var val 00:06:18.520 08:45:06 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:18.520 08:45:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.520 08:45:06 -- accel/accel.sh@20 -- # IFS=: 00:06:18.520 08:45:06 -- accel/accel.sh@20 -- # read -r var val 00:06:18.520 08:45:06 -- accel/accel.sh@21 -- # val=32 00:06:18.520 08:45:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.520 08:45:06 -- accel/accel.sh@20 -- # IFS=: 00:06:18.520 08:45:06 -- accel/accel.sh@20 -- # read -r var val 00:06:18.520 08:45:06 -- accel/accel.sh@21 -- # val=32 00:06:18.520 08:45:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.520 08:45:06 -- accel/accel.sh@20 -- # IFS=: 00:06:18.520 08:45:06 -- accel/accel.sh@20 -- # read -r var val 00:06:18.520 08:45:06 -- accel/accel.sh@21 -- # val=2 00:06:18.520 08:45:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.520 08:45:06 -- accel/accel.sh@20 -- # IFS=: 00:06:18.520 08:45:06 -- accel/accel.sh@20 -- # read -r var val 00:06:18.520 08:45:06 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:18.520 08:45:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.520 08:45:06 -- accel/accel.sh@20 -- # IFS=: 00:06:18.520 08:45:06 -- accel/accel.sh@20 -- # read -r var val 00:06:18.520 08:45:06 -- accel/accel.sh@21 -- # val=Yes 00:06:18.520 08:45:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.520 08:45:06 -- accel/accel.sh@20 -- # IFS=: 00:06:18.520 08:45:06 -- accel/accel.sh@20 -- # read -r var val 00:06:18.520 08:45:06 -- accel/accel.sh@21 -- # val= 00:06:18.520 08:45:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.520 08:45:06 -- accel/accel.sh@20 -- # IFS=: 00:06:18.520 08:45:06 -- accel/accel.sh@20 -- # read -r var val 00:06:18.520 08:45:06 -- accel/accel.sh@21 -- # val= 00:06:18.520 08:45:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.520 08:45:06 -- accel/accel.sh@20 -- # IFS=: 00:06:18.520 08:45:06 -- accel/accel.sh@20 -- # read -r var val 00:06:19.913 08:45:08 -- accel/accel.sh@21 -- # val= 00:06:19.913 08:45:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.913 08:45:08 -- accel/accel.sh@20 -- # IFS=: 00:06:19.913 08:45:08 -- accel/accel.sh@20 -- # read -r var val 00:06:19.913 08:45:08 -- accel/accel.sh@21 -- # val= 00:06:19.913 08:45:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.913 08:45:08 -- accel/accel.sh@20 -- # IFS=: 00:06:19.913 08:45:08 -- accel/accel.sh@20 -- # read -r var val 00:06:19.913 08:45:08 -- accel/accel.sh@21 -- # val= 00:06:19.913 08:45:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.913 08:45:08 -- accel/accel.sh@20 -- # IFS=: 00:06:19.913 08:45:08 -- accel/accel.sh@20 -- # read -r var val 00:06:19.913 08:45:08 -- accel/accel.sh@21 -- # val= 00:06:19.913 08:45:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.913 08:45:08 -- accel/accel.sh@20 -- # IFS=: 00:06:19.913 08:45:08 -- accel/accel.sh@20 -- # read -r var val 00:06:19.913 08:45:08 -- accel/accel.sh@21 -- # val= 00:06:19.913 08:45:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.913 08:45:08 -- accel/accel.sh@20 -- # IFS=: 00:06:19.913 08:45:08 -- accel/accel.sh@20 -- # read -r var val 00:06:19.913 08:45:08 -- accel/accel.sh@21 -- # val= 00:06:19.913 08:45:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.913 08:45:08 -- accel/accel.sh@20 -- # IFS=: 00:06:19.913 08:45:08 -- accel/accel.sh@20 -- # read -r var val 00:06:19.913 08:45:08 -- accel/accel.sh@21 -- # val= 00:06:19.913 08:45:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.913 08:45:08 -- accel/accel.sh@20 -- # IFS=: 00:06:19.913 08:45:08 -- accel/accel.sh@20 -- # read -r var val 00:06:19.913 08:45:08 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:19.913 08:45:08 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:19.913 08:45:08 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:19.913 00:06:19.913 real 0m2.966s 00:06:19.913 user 0m2.653s 00:06:19.913 sys 0m0.304s 00:06:19.913 08:45:08 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:19.913 08:45:08 -- common/autotest_common.sh@10 -- # set +x 00:06:19.913 ************************************ 00:06:19.913 END TEST accel_decomp_mthread 00:06:19.913 ************************************ 00:06:19.913 08:45:08 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:19.913 08:45:08 -- common/autotest_common.sh@1077 -- # '[' 13 -le 1 ']' 00:06:19.913 08:45:08 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:19.913 08:45:08 -- common/autotest_common.sh@10 -- # set +x 00:06:19.913 ************************************ 00:06:19.913 START TEST accel_deomp_full_mthread 00:06:19.913 ************************************ 00:06:19.913 08:45:08 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:19.913 08:45:08 -- accel/accel.sh@16 -- # local accel_opc 00:06:19.913 08:45:08 -- accel/accel.sh@17 -- # local accel_module 00:06:19.913 08:45:08 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:19.913 08:45:08 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:19.913 08:45:08 -- accel/accel.sh@12 -- # build_accel_config 00:06:19.913 08:45:08 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:19.913 08:45:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:19.913 08:45:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:19.913 08:45:08 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:19.913 08:45:08 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:19.913 08:45:08 -- accel/accel.sh@41 -- # local IFS=, 00:06:19.913 08:45:08 -- accel/accel.sh@42 -- # jq -r . 00:06:19.913 [2024-07-15 08:45:08.166458] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:06:19.913 [2024-07-15 08:45:08.166542] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1395200 ] 00:06:19.913 EAL: No free 2048 kB hugepages reported on node 1 00:06:19.913 [2024-07-15 08:45:08.234416] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:19.913 [2024-07-15 08:45:08.353802] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:21.295 08:45:09 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:21.295 00:06:21.295 SPDK Configuration: 00:06:21.295 Core mask: 0x1 00:06:21.295 00:06:21.295 Accel Perf Configuration: 00:06:21.295 Workload Type: decompress 00:06:21.295 Transfer size: 111250 bytes 00:06:21.295 Vector count 1 00:06:21.295 Module: software 00:06:21.295 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:21.295 Queue depth: 32 00:06:21.295 Allocate depth: 32 00:06:21.295 # threads/core: 2 00:06:21.295 Run time: 1 seconds 00:06:21.295 Verify: Yes 00:06:21.295 00:06:21.295 Running for 1 seconds... 00:06:21.295 00:06:21.295 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:21.295 ------------------------------------------------------------------------------------ 00:06:21.295 0,1 1952/s 80 MiB/s 0 0 00:06:21.295 0,0 1920/s 79 MiB/s 0 0 00:06:21.295 ==================================================================================== 00:06:21.295 Total 3872/s 410 MiB/s 0 0' 00:06:21.295 08:45:09 -- accel/accel.sh@20 -- # IFS=: 00:06:21.295 08:45:09 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:21.295 08:45:09 -- accel/accel.sh@20 -- # read -r var val 00:06:21.295 08:45:09 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:21.295 08:45:09 -- accel/accel.sh@12 -- # build_accel_config 00:06:21.295 08:45:09 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:21.295 08:45:09 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:21.295 08:45:09 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:21.295 08:45:09 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:21.295 08:45:09 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:21.295 08:45:09 -- accel/accel.sh@41 -- # local IFS=, 00:06:21.295 08:45:09 -- accel/accel.sh@42 -- # jq -r . 00:06:21.295 [2024-07-15 08:45:09.676441] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:06:21.295 [2024-07-15 08:45:09.676527] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1395545 ] 00:06:21.295 EAL: No free 2048 kB hugepages reported on node 1 00:06:21.295 [2024-07-15 08:45:09.740528] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:21.553 [2024-07-15 08:45:09.861321] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:21.553 08:45:09 -- accel/accel.sh@21 -- # val= 00:06:21.553 08:45:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.553 08:45:09 -- accel/accel.sh@20 -- # IFS=: 00:06:21.553 08:45:09 -- accel/accel.sh@20 -- # read -r var val 00:06:21.553 08:45:09 -- accel/accel.sh@21 -- # val= 00:06:21.553 08:45:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.553 08:45:09 -- accel/accel.sh@20 -- # IFS=: 00:06:21.553 08:45:09 -- accel/accel.sh@20 -- # read -r var val 00:06:21.553 08:45:09 -- accel/accel.sh@21 -- # val= 00:06:21.553 08:45:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.553 08:45:09 -- accel/accel.sh@20 -- # IFS=: 00:06:21.553 08:45:09 -- accel/accel.sh@20 -- # read -r var val 00:06:21.553 08:45:09 -- accel/accel.sh@21 -- # val=0x1 00:06:21.553 08:45:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.553 08:45:09 -- accel/accel.sh@20 -- # IFS=: 00:06:21.553 08:45:09 -- accel/accel.sh@20 -- # read -r var val 00:06:21.553 08:45:09 -- accel/accel.sh@21 -- # val= 00:06:21.553 08:45:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.553 08:45:09 -- accel/accel.sh@20 -- # IFS=: 00:06:21.553 08:45:09 -- accel/accel.sh@20 -- # read -r var val 00:06:21.553 08:45:09 -- accel/accel.sh@21 -- # val= 00:06:21.553 08:45:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.553 08:45:09 -- accel/accel.sh@20 -- # IFS=: 00:06:21.553 08:45:09 -- accel/accel.sh@20 -- # read -r var val 00:06:21.553 08:45:09 -- accel/accel.sh@21 -- # val=decompress 00:06:21.553 08:45:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.553 08:45:09 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:21.553 08:45:09 -- accel/accel.sh@20 -- # IFS=: 00:06:21.553 08:45:09 -- accel/accel.sh@20 -- # read -r var val 00:06:21.553 08:45:09 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:21.553 08:45:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.553 08:45:09 -- accel/accel.sh@20 -- # IFS=: 00:06:21.553 08:45:09 -- accel/accel.sh@20 -- # read -r var val 00:06:21.553 08:45:09 -- accel/accel.sh@21 -- # val= 00:06:21.553 08:45:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.553 08:45:09 -- accel/accel.sh@20 -- # IFS=: 00:06:21.553 08:45:09 -- accel/accel.sh@20 -- # read -r var val 00:06:21.553 08:45:09 -- accel/accel.sh@21 -- # val=software 00:06:21.553 08:45:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.553 08:45:09 -- accel/accel.sh@23 -- # accel_module=software 00:06:21.553 08:45:09 -- accel/accel.sh@20 -- # IFS=: 00:06:21.553 08:45:09 -- accel/accel.sh@20 -- # read -r var val 00:06:21.553 08:45:09 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:21.553 08:45:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.553 08:45:09 -- accel/accel.sh@20 -- # IFS=: 00:06:21.553 08:45:09 -- accel/accel.sh@20 -- # read -r var val 00:06:21.553 08:45:09 -- accel/accel.sh@21 -- # val=32 00:06:21.553 08:45:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.553 08:45:09 -- accel/accel.sh@20 -- # IFS=: 00:06:21.553 08:45:09 -- accel/accel.sh@20 -- # read -r var val 00:06:21.553 08:45:09 -- accel/accel.sh@21 -- # val=32 00:06:21.553 08:45:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.553 08:45:09 -- accel/accel.sh@20 -- # IFS=: 00:06:21.553 08:45:09 -- accel/accel.sh@20 -- # read -r var val 00:06:21.553 08:45:09 -- accel/accel.sh@21 -- # val=2 00:06:21.553 08:45:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.553 08:45:09 -- accel/accel.sh@20 -- # IFS=: 00:06:21.553 08:45:09 -- accel/accel.sh@20 -- # read -r var val 00:06:21.553 08:45:09 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:21.553 08:45:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.553 08:45:09 -- accel/accel.sh@20 -- # IFS=: 00:06:21.553 08:45:09 -- accel/accel.sh@20 -- # read -r var val 00:06:21.553 08:45:09 -- accel/accel.sh@21 -- # val=Yes 00:06:21.553 08:45:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.553 08:45:09 -- accel/accel.sh@20 -- # IFS=: 00:06:21.553 08:45:09 -- accel/accel.sh@20 -- # read -r var val 00:06:21.553 08:45:09 -- accel/accel.sh@21 -- # val= 00:06:21.553 08:45:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.553 08:45:09 -- accel/accel.sh@20 -- # IFS=: 00:06:21.553 08:45:09 -- accel/accel.sh@20 -- # read -r var val 00:06:21.553 08:45:09 -- accel/accel.sh@21 -- # val= 00:06:21.553 08:45:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.553 08:45:09 -- accel/accel.sh@20 -- # IFS=: 00:06:21.553 08:45:09 -- accel/accel.sh@20 -- # read -r var val 00:06:22.922 08:45:11 -- accel/accel.sh@21 -- # val= 00:06:22.922 08:45:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.922 08:45:11 -- accel/accel.sh@20 -- # IFS=: 00:06:22.922 08:45:11 -- accel/accel.sh@20 -- # read -r var val 00:06:22.922 08:45:11 -- accel/accel.sh@21 -- # val= 00:06:22.922 08:45:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.922 08:45:11 -- accel/accel.sh@20 -- # IFS=: 00:06:22.922 08:45:11 -- accel/accel.sh@20 -- # read -r var val 00:06:22.922 08:45:11 -- accel/accel.sh@21 -- # val= 00:06:22.922 08:45:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.922 08:45:11 -- accel/accel.sh@20 -- # IFS=: 00:06:22.922 08:45:11 -- accel/accel.sh@20 -- # read -r var val 00:06:22.922 08:45:11 -- accel/accel.sh@21 -- # val= 00:06:22.922 08:45:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.922 08:45:11 -- accel/accel.sh@20 -- # IFS=: 00:06:22.922 08:45:11 -- accel/accel.sh@20 -- # read -r var val 00:06:22.922 08:45:11 -- accel/accel.sh@21 -- # val= 00:06:22.922 08:45:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.922 08:45:11 -- accel/accel.sh@20 -- # IFS=: 00:06:22.922 08:45:11 -- accel/accel.sh@20 -- # read -r var val 00:06:22.922 08:45:11 -- accel/accel.sh@21 -- # val= 00:06:22.922 08:45:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.922 08:45:11 -- accel/accel.sh@20 -- # IFS=: 00:06:22.922 08:45:11 -- accel/accel.sh@20 -- # read -r var val 00:06:22.922 08:45:11 -- accel/accel.sh@21 -- # val= 00:06:22.922 08:45:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.922 08:45:11 -- accel/accel.sh@20 -- # IFS=: 00:06:22.922 08:45:11 -- accel/accel.sh@20 -- # read -r var val 00:06:22.922 08:45:11 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:22.922 08:45:11 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:22.922 08:45:11 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:22.922 00:06:22.922 real 0m3.038s 00:06:22.922 user 0m2.723s 00:06:22.922 sys 0m0.307s 00:06:22.922 08:45:11 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:22.922 08:45:11 -- common/autotest_common.sh@10 -- # set +x 00:06:22.922 ************************************ 00:06:22.922 END TEST accel_deomp_full_mthread 00:06:22.922 ************************************ 00:06:22.922 08:45:11 -- accel/accel.sh@116 -- # [[ n == y ]] 00:06:22.922 08:45:11 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:22.922 08:45:11 -- accel/accel.sh@129 -- # build_accel_config 00:06:22.922 08:45:11 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:22.922 08:45:11 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:06:22.923 08:45:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:22.923 08:45:11 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:22.923 08:45:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:22.923 08:45:11 -- common/autotest_common.sh@10 -- # set +x 00:06:22.923 08:45:11 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:22.923 08:45:11 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:22.923 08:45:11 -- accel/accel.sh@41 -- # local IFS=, 00:06:22.923 08:45:11 -- accel/accel.sh@42 -- # jq -r . 00:06:22.923 ************************************ 00:06:22.923 START TEST accel_dif_functional_tests 00:06:22.923 ************************************ 00:06:22.923 08:45:11 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:22.923 [2024-07-15 08:45:11.250584] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:06:22.923 [2024-07-15 08:45:11.250676] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1395820 ] 00:06:22.923 EAL: No free 2048 kB hugepages reported on node 1 00:06:22.923 [2024-07-15 08:45:11.318070] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:22.923 [2024-07-15 08:45:11.440185] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:22.923 [2024-07-15 08:45:11.440241] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:22.923 [2024-07-15 08:45:11.440245] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:23.181 00:06:23.181 00:06:23.181 CUnit - A unit testing framework for C - Version 2.1-3 00:06:23.181 http://cunit.sourceforge.net/ 00:06:23.181 00:06:23.181 00:06:23.181 Suite: accel_dif 00:06:23.181 Test: verify: DIF generated, GUARD check ...passed 00:06:23.181 Test: verify: DIF generated, APPTAG check ...passed 00:06:23.181 Test: verify: DIF generated, REFTAG check ...passed 00:06:23.181 Test: verify: DIF not generated, GUARD check ...[2024-07-15 08:45:11.541964] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:23.181 [2024-07-15 08:45:11.542034] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:23.181 passed 00:06:23.181 Test: verify: DIF not generated, APPTAG check ...[2024-07-15 08:45:11.542080] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:23.181 [2024-07-15 08:45:11.542111] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:23.181 passed 00:06:23.181 Test: verify: DIF not generated, REFTAG check ...[2024-07-15 08:45:11.542148] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:23.181 [2024-07-15 08:45:11.542176] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:23.181 passed 00:06:23.181 Test: verify: APPTAG correct, APPTAG check ...passed 00:06:23.181 Test: verify: APPTAG incorrect, APPTAG check ...[2024-07-15 08:45:11.542244] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:06:23.181 passed 00:06:23.181 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:06:23.181 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:06:23.181 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:06:23.181 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-07-15 08:45:11.542399] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:06:23.181 passed 00:06:23.181 Test: generate copy: DIF generated, GUARD check ...passed 00:06:23.181 Test: generate copy: DIF generated, APTTAG check ...passed 00:06:23.181 Test: generate copy: DIF generated, REFTAG check ...passed 00:06:23.181 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:06:23.181 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:06:23.181 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:06:23.181 Test: generate copy: iovecs-len validate ...[2024-07-15 08:45:11.542653] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:06:23.181 passed 00:06:23.181 Test: generate copy: buffer alignment validate ...passed 00:06:23.181 00:06:23.181 Run Summary: Type Total Ran Passed Failed Inactive 00:06:23.181 suites 1 1 n/a 0 0 00:06:23.181 tests 20 20 20 0 0 00:06:23.181 asserts 204 204 204 0 n/a 00:06:23.181 00:06:23.181 Elapsed time = 0.003 seconds 00:06:23.439 00:06:23.439 real 0m0.601s 00:06:23.439 user 0m0.917s 00:06:23.439 sys 0m0.181s 00:06:23.439 08:45:11 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:23.439 08:45:11 -- common/autotest_common.sh@10 -- # set +x 00:06:23.439 ************************************ 00:06:23.439 END TEST accel_dif_functional_tests 00:06:23.439 ************************************ 00:06:23.439 00:06:23.439 real 1m3.156s 00:06:23.439 user 1m10.902s 00:06:23.439 sys 0m7.289s 00:06:23.439 08:45:11 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:23.439 08:45:11 -- common/autotest_common.sh@10 -- # set +x 00:06:23.439 ************************************ 00:06:23.439 END TEST accel 00:06:23.439 ************************************ 00:06:23.439 08:45:11 -- spdk/autotest.sh@190 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:23.439 08:45:11 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:23.439 08:45:11 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:23.439 08:45:11 -- common/autotest_common.sh@10 -- # set +x 00:06:23.439 ************************************ 00:06:23.439 START TEST accel_rpc 00:06:23.439 ************************************ 00:06:23.439 08:45:11 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:23.439 * Looking for test storage... 00:06:23.439 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:06:23.439 08:45:11 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:23.439 08:45:11 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=1395906 00:06:23.439 08:45:11 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:06:23.439 08:45:11 -- accel/accel_rpc.sh@15 -- # waitforlisten 1395906 00:06:23.439 08:45:11 -- common/autotest_common.sh@819 -- # '[' -z 1395906 ']' 00:06:23.439 08:45:11 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:23.439 08:45:11 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:23.439 08:45:11 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:23.439 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:23.439 08:45:11 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:23.439 08:45:11 -- common/autotest_common.sh@10 -- # set +x 00:06:23.439 [2024-07-15 08:45:11.960341] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:06:23.439 [2024-07-15 08:45:11.960421] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1395906 ] 00:06:23.697 EAL: No free 2048 kB hugepages reported on node 1 00:06:23.697 [2024-07-15 08:45:12.024982] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:23.697 [2024-07-15 08:45:12.133729] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:23.697 [2024-07-15 08:45:12.133913] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:24.628 08:45:12 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:24.628 08:45:12 -- common/autotest_common.sh@852 -- # return 0 00:06:24.628 08:45:12 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:06:24.628 08:45:12 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:06:24.628 08:45:12 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:06:24.628 08:45:12 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:06:24.628 08:45:12 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:06:24.628 08:45:12 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:24.628 08:45:12 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:24.628 08:45:12 -- common/autotest_common.sh@10 -- # set +x 00:06:24.628 ************************************ 00:06:24.628 START TEST accel_assign_opcode 00:06:24.628 ************************************ 00:06:24.628 08:45:12 -- common/autotest_common.sh@1104 -- # accel_assign_opcode_test_suite 00:06:24.628 08:45:12 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:06:24.628 08:45:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:24.628 08:45:12 -- common/autotest_common.sh@10 -- # set +x 00:06:24.628 [2024-07-15 08:45:12.944383] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:06:24.629 08:45:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:24.629 08:45:12 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:06:24.629 08:45:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:24.629 08:45:12 -- common/autotest_common.sh@10 -- # set +x 00:06:24.629 [2024-07-15 08:45:12.952393] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:06:24.629 08:45:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:24.629 08:45:12 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:06:24.629 08:45:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:24.629 08:45:12 -- common/autotest_common.sh@10 -- # set +x 00:06:24.885 08:45:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:24.885 08:45:13 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:06:24.885 08:45:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:24.885 08:45:13 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:06:24.885 08:45:13 -- common/autotest_common.sh@10 -- # set +x 00:06:24.885 08:45:13 -- accel/accel_rpc.sh@42 -- # grep software 00:06:24.885 08:45:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:24.885 software 00:06:24.885 00:06:24.885 real 0m0.298s 00:06:24.885 user 0m0.037s 00:06:24.885 sys 0m0.005s 00:06:24.885 08:45:13 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:24.885 08:45:13 -- common/autotest_common.sh@10 -- # set +x 00:06:24.885 ************************************ 00:06:24.885 END TEST accel_assign_opcode 00:06:24.885 ************************************ 00:06:24.885 08:45:13 -- accel/accel_rpc.sh@55 -- # killprocess 1395906 00:06:24.886 08:45:13 -- common/autotest_common.sh@926 -- # '[' -z 1395906 ']' 00:06:24.886 08:45:13 -- common/autotest_common.sh@930 -- # kill -0 1395906 00:06:24.886 08:45:13 -- common/autotest_common.sh@931 -- # uname 00:06:24.886 08:45:13 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:24.886 08:45:13 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1395906 00:06:24.886 08:45:13 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:24.886 08:45:13 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:24.886 08:45:13 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1395906' 00:06:24.886 killing process with pid 1395906 00:06:24.886 08:45:13 -- common/autotest_common.sh@945 -- # kill 1395906 00:06:24.886 08:45:13 -- common/autotest_common.sh@950 -- # wait 1395906 00:06:25.449 00:06:25.449 real 0m1.897s 00:06:25.449 user 0m2.041s 00:06:25.449 sys 0m0.439s 00:06:25.449 08:45:13 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:25.449 08:45:13 -- common/autotest_common.sh@10 -- # set +x 00:06:25.449 ************************************ 00:06:25.449 END TEST accel_rpc 00:06:25.449 ************************************ 00:06:25.449 08:45:13 -- spdk/autotest.sh@191 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:25.449 08:45:13 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:25.449 08:45:13 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:25.449 08:45:13 -- common/autotest_common.sh@10 -- # set +x 00:06:25.449 ************************************ 00:06:25.449 START TEST app_cmdline 00:06:25.449 ************************************ 00:06:25.449 08:45:13 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:25.449 * Looking for test storage... 00:06:25.449 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:25.449 08:45:13 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:06:25.449 08:45:13 -- app/cmdline.sh@17 -- # spdk_tgt_pid=1396228 00:06:25.449 08:45:13 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:06:25.449 08:45:13 -- app/cmdline.sh@18 -- # waitforlisten 1396228 00:06:25.449 08:45:13 -- common/autotest_common.sh@819 -- # '[' -z 1396228 ']' 00:06:25.449 08:45:13 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:25.449 08:45:13 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:25.449 08:45:13 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:25.449 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:25.449 08:45:13 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:25.449 08:45:13 -- common/autotest_common.sh@10 -- # set +x 00:06:25.449 [2024-07-15 08:45:13.890204] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:06:25.449 [2024-07-15 08:45:13.890285] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1396228 ] 00:06:25.449 EAL: No free 2048 kB hugepages reported on node 1 00:06:25.449 [2024-07-15 08:45:13.951450] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:25.707 [2024-07-15 08:45:14.069942] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:25.707 [2024-07-15 08:45:14.070112] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:26.664 08:45:14 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:26.664 08:45:14 -- common/autotest_common.sh@852 -- # return 0 00:06:26.664 08:45:14 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:06:26.664 { 00:06:26.664 "version": "SPDK v24.01.1-pre git sha1 4b94202c6", 00:06:26.664 "fields": { 00:06:26.664 "major": 24, 00:06:26.664 "minor": 1, 00:06:26.664 "patch": 1, 00:06:26.664 "suffix": "-pre", 00:06:26.664 "commit": "4b94202c6" 00:06:26.664 } 00:06:26.664 } 00:06:26.664 08:45:15 -- app/cmdline.sh@22 -- # expected_methods=() 00:06:26.664 08:45:15 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:06:26.664 08:45:15 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:06:26.664 08:45:15 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:06:26.664 08:45:15 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:06:26.664 08:45:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:26.664 08:45:15 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:06:26.664 08:45:15 -- common/autotest_common.sh@10 -- # set +x 00:06:26.664 08:45:15 -- app/cmdline.sh@26 -- # sort 00:06:26.664 08:45:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:26.664 08:45:15 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:06:26.664 08:45:15 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:06:26.664 08:45:15 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:26.664 08:45:15 -- common/autotest_common.sh@640 -- # local es=0 00:06:26.664 08:45:15 -- common/autotest_common.sh@642 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:26.664 08:45:15 -- common/autotest_common.sh@628 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:26.664 08:45:15 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:26.664 08:45:15 -- common/autotest_common.sh@632 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:26.664 08:45:15 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:26.664 08:45:15 -- common/autotest_common.sh@634 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:26.664 08:45:15 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:26.664 08:45:15 -- common/autotest_common.sh@634 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:26.664 08:45:15 -- common/autotest_common.sh@634 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:06:26.664 08:45:15 -- common/autotest_common.sh@643 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:26.922 request: 00:06:26.922 { 00:06:26.922 "method": "env_dpdk_get_mem_stats", 00:06:26.922 "req_id": 1 00:06:26.922 } 00:06:26.922 Got JSON-RPC error response 00:06:26.922 response: 00:06:26.922 { 00:06:26.922 "code": -32601, 00:06:26.922 "message": "Method not found" 00:06:26.922 } 00:06:26.922 08:45:15 -- common/autotest_common.sh@643 -- # es=1 00:06:26.922 08:45:15 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:06:26.922 08:45:15 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:06:26.922 08:45:15 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:06:26.922 08:45:15 -- app/cmdline.sh@1 -- # killprocess 1396228 00:06:26.922 08:45:15 -- common/autotest_common.sh@926 -- # '[' -z 1396228 ']' 00:06:26.922 08:45:15 -- common/autotest_common.sh@930 -- # kill -0 1396228 00:06:26.922 08:45:15 -- common/autotest_common.sh@931 -- # uname 00:06:26.922 08:45:15 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:26.922 08:45:15 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1396228 00:06:27.179 08:45:15 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:27.179 08:45:15 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:27.179 08:45:15 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1396228' 00:06:27.179 killing process with pid 1396228 00:06:27.179 08:45:15 -- common/autotest_common.sh@945 -- # kill 1396228 00:06:27.179 08:45:15 -- common/autotest_common.sh@950 -- # wait 1396228 00:06:27.438 00:06:27.438 real 0m2.148s 00:06:27.438 user 0m2.722s 00:06:27.438 sys 0m0.512s 00:06:27.438 08:45:15 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:27.438 08:45:15 -- common/autotest_common.sh@10 -- # set +x 00:06:27.438 ************************************ 00:06:27.438 END TEST app_cmdline 00:06:27.438 ************************************ 00:06:27.438 08:45:15 -- spdk/autotest.sh@192 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:27.438 08:45:15 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:27.438 08:45:15 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:27.438 08:45:15 -- common/autotest_common.sh@10 -- # set +x 00:06:27.438 ************************************ 00:06:27.438 START TEST version 00:06:27.438 ************************************ 00:06:27.438 08:45:15 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:27.697 * Looking for test storage... 00:06:27.697 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:27.697 08:45:16 -- app/version.sh@17 -- # get_header_version major 00:06:27.697 08:45:16 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:27.697 08:45:16 -- app/version.sh@14 -- # cut -f2 00:06:27.697 08:45:16 -- app/version.sh@14 -- # tr -d '"' 00:06:27.697 08:45:16 -- app/version.sh@17 -- # major=24 00:06:27.697 08:45:16 -- app/version.sh@18 -- # get_header_version minor 00:06:27.697 08:45:16 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:27.697 08:45:16 -- app/version.sh@14 -- # cut -f2 00:06:27.697 08:45:16 -- app/version.sh@14 -- # tr -d '"' 00:06:27.697 08:45:16 -- app/version.sh@18 -- # minor=1 00:06:27.697 08:45:16 -- app/version.sh@19 -- # get_header_version patch 00:06:27.697 08:45:16 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:27.697 08:45:16 -- app/version.sh@14 -- # cut -f2 00:06:27.697 08:45:16 -- app/version.sh@14 -- # tr -d '"' 00:06:27.697 08:45:16 -- app/version.sh@19 -- # patch=1 00:06:27.697 08:45:16 -- app/version.sh@20 -- # get_header_version suffix 00:06:27.697 08:45:16 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:27.697 08:45:16 -- app/version.sh@14 -- # cut -f2 00:06:27.697 08:45:16 -- app/version.sh@14 -- # tr -d '"' 00:06:27.697 08:45:16 -- app/version.sh@20 -- # suffix=-pre 00:06:27.697 08:45:16 -- app/version.sh@22 -- # version=24.1 00:06:27.697 08:45:16 -- app/version.sh@25 -- # (( patch != 0 )) 00:06:27.697 08:45:16 -- app/version.sh@25 -- # version=24.1.1 00:06:27.697 08:45:16 -- app/version.sh@28 -- # version=24.1.1rc0 00:06:27.697 08:45:16 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:27.697 08:45:16 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:06:27.697 08:45:16 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:06:27.697 08:45:16 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:06:27.697 00:06:27.697 real 0m0.104s 00:06:27.697 user 0m0.063s 00:06:27.697 sys 0m0.064s 00:06:27.697 08:45:16 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:27.697 08:45:16 -- common/autotest_common.sh@10 -- # set +x 00:06:27.697 ************************************ 00:06:27.697 END TEST version 00:06:27.697 ************************************ 00:06:27.697 08:45:16 -- spdk/autotest.sh@194 -- # '[' 0 -eq 1 ']' 00:06:27.697 08:45:16 -- spdk/autotest.sh@204 -- # uname -s 00:06:27.697 08:45:16 -- spdk/autotest.sh@204 -- # [[ Linux == Linux ]] 00:06:27.697 08:45:16 -- spdk/autotest.sh@205 -- # [[ 0 -eq 1 ]] 00:06:27.697 08:45:16 -- spdk/autotest.sh@205 -- # [[ 0 -eq 1 ]] 00:06:27.697 08:45:16 -- spdk/autotest.sh@217 -- # '[' 0 -eq 1 ']' 00:06:27.697 08:45:16 -- spdk/autotest.sh@264 -- # '[' 0 -eq 1 ']' 00:06:27.697 08:45:16 -- spdk/autotest.sh@268 -- # timing_exit lib 00:06:27.698 08:45:16 -- common/autotest_common.sh@718 -- # xtrace_disable 00:06:27.698 08:45:16 -- common/autotest_common.sh@10 -- # set +x 00:06:27.698 08:45:16 -- spdk/autotest.sh@270 -- # '[' 0 -eq 1 ']' 00:06:27.698 08:45:16 -- spdk/autotest.sh@278 -- # '[' 0 -eq 1 ']' 00:06:27.698 08:45:16 -- spdk/autotest.sh@287 -- # '[' 1 -eq 1 ']' 00:06:27.698 08:45:16 -- spdk/autotest.sh@288 -- # export NET_TYPE 00:06:27.698 08:45:16 -- spdk/autotest.sh@291 -- # '[' tcp = rdma ']' 00:06:27.698 08:45:16 -- spdk/autotest.sh@294 -- # '[' tcp = tcp ']' 00:06:27.698 08:45:16 -- spdk/autotest.sh@295 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:27.698 08:45:16 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:06:27.698 08:45:16 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:27.698 08:45:16 -- common/autotest_common.sh@10 -- # set +x 00:06:27.698 ************************************ 00:06:27.698 START TEST nvmf_tcp 00:06:27.698 ************************************ 00:06:27.698 08:45:16 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:27.698 * Looking for test storage... 00:06:27.698 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:06:27.698 08:45:16 -- nvmf/nvmf.sh@10 -- # uname -s 00:06:27.698 08:45:16 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:06:27.698 08:45:16 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:27.698 08:45:16 -- nvmf/common.sh@7 -- # uname -s 00:06:27.698 08:45:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:27.698 08:45:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:27.698 08:45:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:27.698 08:45:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:27.698 08:45:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:27.698 08:45:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:27.698 08:45:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:27.698 08:45:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:27.698 08:45:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:27.698 08:45:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:27.698 08:45:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:27.698 08:45:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:27.698 08:45:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:27.698 08:45:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:27.698 08:45:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:27.698 08:45:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:27.698 08:45:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:27.698 08:45:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:27.698 08:45:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:27.698 08:45:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:27.698 08:45:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:27.698 08:45:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:27.698 08:45:16 -- paths/export.sh@5 -- # export PATH 00:06:27.698 08:45:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:27.698 08:45:16 -- nvmf/common.sh@46 -- # : 0 00:06:27.698 08:45:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:27.698 08:45:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:27.698 08:45:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:27.698 08:45:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:27.698 08:45:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:27.698 08:45:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:27.698 08:45:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:27.698 08:45:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:27.698 08:45:16 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:06:27.698 08:45:16 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:06:27.698 08:45:16 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:06:27.698 08:45:16 -- common/autotest_common.sh@712 -- # xtrace_disable 00:06:27.698 08:45:16 -- common/autotest_common.sh@10 -- # set +x 00:06:27.698 08:45:16 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:06:27.698 08:45:16 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:27.698 08:45:16 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:06:27.698 08:45:16 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:27.698 08:45:16 -- common/autotest_common.sh@10 -- # set +x 00:06:27.698 ************************************ 00:06:27.698 START TEST nvmf_example 00:06:27.698 ************************************ 00:06:27.698 08:45:16 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:27.698 * Looking for test storage... 00:06:27.698 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:27.698 08:45:16 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:27.698 08:45:16 -- nvmf/common.sh@7 -- # uname -s 00:06:27.698 08:45:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:27.698 08:45:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:27.698 08:45:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:27.698 08:45:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:27.698 08:45:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:27.698 08:45:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:27.698 08:45:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:27.698 08:45:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:27.698 08:45:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:27.698 08:45:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:27.698 08:45:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:27.957 08:45:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:27.957 08:45:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:27.957 08:45:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:27.957 08:45:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:27.957 08:45:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:27.957 08:45:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:27.957 08:45:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:27.957 08:45:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:27.957 08:45:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:27.957 08:45:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:27.957 08:45:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:27.957 08:45:16 -- paths/export.sh@5 -- # export PATH 00:06:27.958 08:45:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:27.958 08:45:16 -- nvmf/common.sh@46 -- # : 0 00:06:27.958 08:45:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:27.958 08:45:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:27.958 08:45:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:27.958 08:45:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:27.958 08:45:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:27.958 08:45:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:27.958 08:45:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:27.958 08:45:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:27.958 08:45:16 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:06:27.958 08:45:16 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:06:27.958 08:45:16 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:06:27.958 08:45:16 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:06:27.958 08:45:16 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:06:27.958 08:45:16 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:06:27.958 08:45:16 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:06:27.958 08:45:16 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:06:27.958 08:45:16 -- common/autotest_common.sh@712 -- # xtrace_disable 00:06:27.958 08:45:16 -- common/autotest_common.sh@10 -- # set +x 00:06:27.958 08:45:16 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:06:27.958 08:45:16 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:27.958 08:45:16 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:27.958 08:45:16 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:27.958 08:45:16 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:27.958 08:45:16 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:27.958 08:45:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:27.958 08:45:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:27.958 08:45:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:27.958 08:45:16 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:27.958 08:45:16 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:27.958 08:45:16 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:27.958 08:45:16 -- common/autotest_common.sh@10 -- # set +x 00:06:29.861 08:45:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:29.861 08:45:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:29.861 08:45:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:29.861 08:45:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:29.861 08:45:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:29.861 08:45:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:29.861 08:45:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:29.861 08:45:18 -- nvmf/common.sh@294 -- # net_devs=() 00:06:29.861 08:45:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:29.861 08:45:18 -- nvmf/common.sh@295 -- # e810=() 00:06:29.861 08:45:18 -- nvmf/common.sh@295 -- # local -ga e810 00:06:29.861 08:45:18 -- nvmf/common.sh@296 -- # x722=() 00:06:29.861 08:45:18 -- nvmf/common.sh@296 -- # local -ga x722 00:06:29.861 08:45:18 -- nvmf/common.sh@297 -- # mlx=() 00:06:29.861 08:45:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:29.861 08:45:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:29.861 08:45:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:29.861 08:45:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:29.861 08:45:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:29.861 08:45:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:29.861 08:45:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:29.861 08:45:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:29.861 08:45:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:29.861 08:45:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:29.861 08:45:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:29.861 08:45:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:29.861 08:45:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:29.861 08:45:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:29.861 08:45:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:29.861 08:45:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:29.861 08:45:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:29.861 08:45:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:29.861 08:45:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:29.861 08:45:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:29.861 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:29.861 08:45:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:29.861 08:45:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:29.861 08:45:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:29.861 08:45:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:29.861 08:45:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:29.861 08:45:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:29.861 08:45:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:29.861 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:29.861 08:45:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:29.861 08:45:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:29.861 08:45:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:29.861 08:45:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:29.861 08:45:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:29.861 08:45:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:29.861 08:45:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:29.861 08:45:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:29.861 08:45:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:29.861 08:45:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:29.861 08:45:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:29.861 08:45:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:29.861 08:45:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:29.861 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:29.861 08:45:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:29.861 08:45:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:29.861 08:45:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:29.861 08:45:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:29.861 08:45:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:29.861 08:45:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:29.861 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:29.861 08:45:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:29.861 08:45:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:29.861 08:45:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:29.861 08:45:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:29.861 08:45:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:29.861 08:45:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:29.861 08:45:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:29.861 08:45:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:29.861 08:45:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:29.861 08:45:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:29.861 08:45:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:29.861 08:45:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:29.861 08:45:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:29.861 08:45:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:29.861 08:45:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:29.861 08:45:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:29.861 08:45:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:29.861 08:45:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:29.861 08:45:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:29.861 08:45:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:29.861 08:45:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:29.861 08:45:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:29.861 08:45:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:29.861 08:45:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:29.861 08:45:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:29.861 08:45:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:29.861 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:29.861 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.181 ms 00:06:29.861 00:06:29.861 --- 10.0.0.2 ping statistics --- 00:06:29.861 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:29.861 rtt min/avg/max/mdev = 0.181/0.181/0.181/0.000 ms 00:06:29.861 08:45:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:29.861 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:29.861 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.111 ms 00:06:29.861 00:06:29.861 --- 10.0.0.1 ping statistics --- 00:06:29.861 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:29.861 rtt min/avg/max/mdev = 0.111/0.111/0.111/0.000 ms 00:06:29.861 08:45:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:29.861 08:45:18 -- nvmf/common.sh@410 -- # return 0 00:06:29.861 08:45:18 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:29.861 08:45:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:29.861 08:45:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:29.861 08:45:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:29.861 08:45:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:29.861 08:45:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:29.861 08:45:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:29.861 08:45:18 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:06:29.861 08:45:18 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:06:29.861 08:45:18 -- common/autotest_common.sh@712 -- # xtrace_disable 00:06:29.861 08:45:18 -- common/autotest_common.sh@10 -- # set +x 00:06:29.861 08:45:18 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:06:29.861 08:45:18 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:06:29.861 08:45:18 -- target/nvmf_example.sh@34 -- # nvmfpid=1398259 00:06:29.861 08:45:18 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:06:29.861 08:45:18 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:06:29.861 08:45:18 -- target/nvmf_example.sh@36 -- # waitforlisten 1398259 00:06:29.861 08:45:18 -- common/autotest_common.sh@819 -- # '[' -z 1398259 ']' 00:06:29.861 08:45:18 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:29.861 08:45:18 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:29.861 08:45:18 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:29.862 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:29.862 08:45:18 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:29.862 08:45:18 -- common/autotest_common.sh@10 -- # set +x 00:06:29.862 EAL: No free 2048 kB hugepages reported on node 1 00:06:30.119 08:45:18 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:30.119 08:45:18 -- common/autotest_common.sh@852 -- # return 0 00:06:30.119 08:45:18 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:06:30.119 08:45:18 -- common/autotest_common.sh@718 -- # xtrace_disable 00:06:30.119 08:45:18 -- common/autotest_common.sh@10 -- # set +x 00:06:30.119 08:45:18 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:06:30.119 08:45:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:30.119 08:45:18 -- common/autotest_common.sh@10 -- # set +x 00:06:30.119 08:45:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:30.119 08:45:18 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:06:30.119 08:45:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:30.119 08:45:18 -- common/autotest_common.sh@10 -- # set +x 00:06:30.119 08:45:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:30.119 08:45:18 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:06:30.119 08:45:18 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:30.119 08:45:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:30.119 08:45:18 -- common/autotest_common.sh@10 -- # set +x 00:06:30.119 08:45:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:30.119 08:45:18 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:06:30.119 08:45:18 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:06:30.119 08:45:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:30.120 08:45:18 -- common/autotest_common.sh@10 -- # set +x 00:06:30.120 08:45:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:30.120 08:45:18 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:30.120 08:45:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:30.120 08:45:18 -- common/autotest_common.sh@10 -- # set +x 00:06:30.120 08:45:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:30.120 08:45:18 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:06:30.120 08:45:18 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:06:30.376 EAL: No free 2048 kB hugepages reported on node 1 00:06:40.418 Initializing NVMe Controllers 00:06:40.418 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:06:40.419 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:06:40.419 Initialization complete. Launching workers. 00:06:40.419 ======================================================== 00:06:40.419 Latency(us) 00:06:40.419 Device Information : IOPS MiB/s Average min max 00:06:40.419 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 14772.16 57.70 4333.43 899.87 19301.15 00:06:40.419 ======================================================== 00:06:40.419 Total : 14772.16 57.70 4333.43 899.87 19301.15 00:06:40.419 00:06:40.419 08:45:28 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:06:40.419 08:45:28 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:06:40.419 08:45:28 -- nvmf/common.sh@476 -- # nvmfcleanup 00:06:40.419 08:45:28 -- nvmf/common.sh@116 -- # sync 00:06:40.419 08:45:28 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:06:40.419 08:45:28 -- nvmf/common.sh@119 -- # set +e 00:06:40.419 08:45:28 -- nvmf/common.sh@120 -- # for i in {1..20} 00:06:40.419 08:45:28 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:06:40.419 rmmod nvme_tcp 00:06:40.419 rmmod nvme_fabrics 00:06:40.676 rmmod nvme_keyring 00:06:40.676 08:45:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:06:40.676 08:45:28 -- nvmf/common.sh@123 -- # set -e 00:06:40.676 08:45:28 -- nvmf/common.sh@124 -- # return 0 00:06:40.676 08:45:28 -- nvmf/common.sh@477 -- # '[' -n 1398259 ']' 00:06:40.676 08:45:28 -- nvmf/common.sh@478 -- # killprocess 1398259 00:06:40.676 08:45:28 -- common/autotest_common.sh@926 -- # '[' -z 1398259 ']' 00:06:40.676 08:45:28 -- common/autotest_common.sh@930 -- # kill -0 1398259 00:06:40.676 08:45:28 -- common/autotest_common.sh@931 -- # uname 00:06:40.676 08:45:28 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:40.676 08:45:28 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1398259 00:06:40.676 08:45:29 -- common/autotest_common.sh@932 -- # process_name=nvmf 00:06:40.676 08:45:29 -- common/autotest_common.sh@936 -- # '[' nvmf = sudo ']' 00:06:40.676 08:45:29 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1398259' 00:06:40.676 killing process with pid 1398259 00:06:40.676 08:45:29 -- common/autotest_common.sh@945 -- # kill 1398259 00:06:40.676 08:45:29 -- common/autotest_common.sh@950 -- # wait 1398259 00:06:40.935 nvmf threads initialize successfully 00:06:40.935 bdev subsystem init successfully 00:06:40.935 created a nvmf target service 00:06:40.935 create targets's poll groups done 00:06:40.935 all subsystems of target started 00:06:40.935 nvmf target is running 00:06:40.935 all subsystems of target stopped 00:06:40.935 destroy targets's poll groups done 00:06:40.935 destroyed the nvmf target service 00:06:40.935 bdev subsystem finish successfully 00:06:40.935 nvmf threads destroy successfully 00:06:40.935 08:45:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:06:40.935 08:45:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:06:40.935 08:45:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:06:40.935 08:45:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:06:40.935 08:45:29 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:06:40.935 08:45:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:40.935 08:45:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:40.935 08:45:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:42.839 08:45:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:06:42.839 08:45:31 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:06:42.839 08:45:31 -- common/autotest_common.sh@718 -- # xtrace_disable 00:06:42.839 08:45:31 -- common/autotest_common.sh@10 -- # set +x 00:06:42.839 00:06:42.839 real 0m15.141s 00:06:42.839 user 0m42.291s 00:06:42.839 sys 0m3.173s 00:06:42.839 08:45:31 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:42.839 08:45:31 -- common/autotest_common.sh@10 -- # set +x 00:06:42.839 ************************************ 00:06:42.839 END TEST nvmf_example 00:06:42.839 ************************************ 00:06:42.839 08:45:31 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:42.839 08:45:31 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:06:42.839 08:45:31 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:42.839 08:45:31 -- common/autotest_common.sh@10 -- # set +x 00:06:42.839 ************************************ 00:06:42.839 START TEST nvmf_filesystem 00:06:42.839 ************************************ 00:06:42.839 08:45:31 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:43.100 * Looking for test storage... 00:06:43.101 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:43.101 08:45:31 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:06:43.101 08:45:31 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:06:43.101 08:45:31 -- common/autotest_common.sh@34 -- # set -e 00:06:43.101 08:45:31 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:06:43.101 08:45:31 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:06:43.101 08:45:31 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:06:43.101 08:45:31 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:06:43.101 08:45:31 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:06:43.101 08:45:31 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:06:43.101 08:45:31 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:06:43.101 08:45:31 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:06:43.101 08:45:31 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:06:43.101 08:45:31 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:06:43.101 08:45:31 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:06:43.101 08:45:31 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:06:43.101 08:45:31 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:06:43.101 08:45:31 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:06:43.101 08:45:31 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:06:43.101 08:45:31 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:06:43.101 08:45:31 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:06:43.101 08:45:31 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:06:43.101 08:45:31 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:06:43.101 08:45:31 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:06:43.101 08:45:31 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:06:43.101 08:45:31 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:06:43.101 08:45:31 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:43.101 08:45:31 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:06:43.101 08:45:31 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:06:43.101 08:45:31 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:06:43.101 08:45:31 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:06:43.101 08:45:31 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:06:43.101 08:45:31 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:06:43.101 08:45:31 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:06:43.101 08:45:31 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:06:43.101 08:45:31 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:06:43.101 08:45:31 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:06:43.101 08:45:31 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:06:43.101 08:45:31 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:06:43.101 08:45:31 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:06:43.101 08:45:31 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:06:43.101 08:45:31 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:06:43.101 08:45:31 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:06:43.101 08:45:31 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:43.101 08:45:31 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:06:43.101 08:45:31 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:06:43.101 08:45:31 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:06:43.101 08:45:31 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:06:43.101 08:45:31 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:06:43.101 08:45:31 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:06:43.101 08:45:31 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:06:43.101 08:45:31 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:06:43.101 08:45:31 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:06:43.101 08:45:31 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:06:43.101 08:45:31 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:06:43.101 08:45:31 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:06:43.101 08:45:31 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:06:43.101 08:45:31 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:06:43.101 08:45:31 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:06:43.101 08:45:31 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:06:43.101 08:45:31 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:06:43.101 08:45:31 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:06:43.101 08:45:31 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:06:43.101 08:45:31 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:06:43.101 08:45:31 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:06:43.101 08:45:31 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:06:43.101 08:45:31 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:06:43.101 08:45:31 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:06:43.101 08:45:31 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR= 00:06:43.101 08:45:31 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:06:43.101 08:45:31 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:06:43.101 08:45:31 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:06:43.101 08:45:31 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:06:43.101 08:45:31 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:06:43.101 08:45:31 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:06:43.101 08:45:31 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:06:43.101 08:45:31 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:06:43.101 08:45:31 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:06:43.101 08:45:31 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:06:43.101 08:45:31 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:06:43.101 08:45:31 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:06:43.101 08:45:31 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:06:43.101 08:45:31 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:06:43.101 08:45:31 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:06:43.101 08:45:31 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:06:43.101 08:45:31 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:06:43.101 08:45:31 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:06:43.101 08:45:31 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:43.101 08:45:31 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:43.101 08:45:31 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:43.101 08:45:31 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:43.101 08:45:31 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:43.101 08:45:31 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:43.101 08:45:31 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:43.101 08:45:31 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:43.101 08:45:31 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:06:43.101 08:45:31 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:06:43.101 08:45:31 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:06:43.101 08:45:31 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:06:43.101 08:45:31 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:06:43.101 08:45:31 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:06:43.101 08:45:31 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:06:43.101 08:45:31 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:06:43.101 #define SPDK_CONFIG_H 00:06:43.101 #define SPDK_CONFIG_APPS 1 00:06:43.101 #define SPDK_CONFIG_ARCH native 00:06:43.101 #undef SPDK_CONFIG_ASAN 00:06:43.101 #undef SPDK_CONFIG_AVAHI 00:06:43.101 #undef SPDK_CONFIG_CET 00:06:43.101 #define SPDK_CONFIG_COVERAGE 1 00:06:43.101 #define SPDK_CONFIG_CROSS_PREFIX 00:06:43.101 #undef SPDK_CONFIG_CRYPTO 00:06:43.101 #undef SPDK_CONFIG_CRYPTO_MLX5 00:06:43.101 #undef SPDK_CONFIG_CUSTOMOCF 00:06:43.101 #undef SPDK_CONFIG_DAOS 00:06:43.101 #define SPDK_CONFIG_DAOS_DIR 00:06:43.101 #define SPDK_CONFIG_DEBUG 1 00:06:43.101 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:06:43.101 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:43.101 #define SPDK_CONFIG_DPDK_INC_DIR 00:06:43.101 #define SPDK_CONFIG_DPDK_LIB_DIR 00:06:43.101 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:06:43.101 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:43.101 #define SPDK_CONFIG_EXAMPLES 1 00:06:43.101 #undef SPDK_CONFIG_FC 00:06:43.101 #define SPDK_CONFIG_FC_PATH 00:06:43.101 #define SPDK_CONFIG_FIO_PLUGIN 1 00:06:43.101 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:06:43.101 #undef SPDK_CONFIG_FUSE 00:06:43.101 #undef SPDK_CONFIG_FUZZER 00:06:43.101 #define SPDK_CONFIG_FUZZER_LIB 00:06:43.101 #undef SPDK_CONFIG_GOLANG 00:06:43.101 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:06:43.101 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:06:43.101 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:06:43.101 #undef SPDK_CONFIG_HAVE_LIBBSD 00:06:43.101 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:06:43.101 #define SPDK_CONFIG_IDXD 1 00:06:43.101 #define SPDK_CONFIG_IDXD_KERNEL 1 00:06:43.101 #undef SPDK_CONFIG_IPSEC_MB 00:06:43.101 #define SPDK_CONFIG_IPSEC_MB_DIR 00:06:43.101 #define SPDK_CONFIG_ISAL 1 00:06:43.101 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:06:43.101 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:06:43.101 #define SPDK_CONFIG_LIBDIR 00:06:43.101 #undef SPDK_CONFIG_LTO 00:06:43.101 #define SPDK_CONFIG_MAX_LCORES 00:06:43.101 #define SPDK_CONFIG_NVME_CUSE 1 00:06:43.101 #undef SPDK_CONFIG_OCF 00:06:43.101 #define SPDK_CONFIG_OCF_PATH 00:06:43.101 #define SPDK_CONFIG_OPENSSL_PATH 00:06:43.101 #undef SPDK_CONFIG_PGO_CAPTURE 00:06:43.101 #undef SPDK_CONFIG_PGO_USE 00:06:43.101 #define SPDK_CONFIG_PREFIX /usr/local 00:06:43.101 #undef SPDK_CONFIG_RAID5F 00:06:43.101 #undef SPDK_CONFIG_RBD 00:06:43.101 #define SPDK_CONFIG_RDMA 1 00:06:43.101 #define SPDK_CONFIG_RDMA_PROV verbs 00:06:43.101 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:06:43.101 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:06:43.101 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:06:43.101 #define SPDK_CONFIG_SHARED 1 00:06:43.101 #undef SPDK_CONFIG_SMA 00:06:43.101 #define SPDK_CONFIG_TESTS 1 00:06:43.101 #undef SPDK_CONFIG_TSAN 00:06:43.101 #define SPDK_CONFIG_UBLK 1 00:06:43.101 #define SPDK_CONFIG_UBSAN 1 00:06:43.101 #undef SPDK_CONFIG_UNIT_TESTS 00:06:43.101 #undef SPDK_CONFIG_URING 00:06:43.101 #define SPDK_CONFIG_URING_PATH 00:06:43.101 #undef SPDK_CONFIG_URING_ZNS 00:06:43.101 #undef SPDK_CONFIG_USDT 00:06:43.101 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:06:43.102 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:06:43.102 #undef SPDK_CONFIG_VFIO_USER 00:06:43.102 #define SPDK_CONFIG_VFIO_USER_DIR 00:06:43.102 #define SPDK_CONFIG_VHOST 1 00:06:43.102 #define SPDK_CONFIG_VIRTIO 1 00:06:43.102 #undef SPDK_CONFIG_VTUNE 00:06:43.102 #define SPDK_CONFIG_VTUNE_DIR 00:06:43.102 #define SPDK_CONFIG_WERROR 1 00:06:43.102 #define SPDK_CONFIG_WPDK_DIR 00:06:43.102 #undef SPDK_CONFIG_XNVME 00:06:43.102 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:06:43.102 08:45:31 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:06:43.102 08:45:31 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:43.102 08:45:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:43.102 08:45:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:43.102 08:45:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:43.102 08:45:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:43.102 08:45:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:43.102 08:45:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:43.102 08:45:31 -- paths/export.sh@5 -- # export PATH 00:06:43.102 08:45:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:43.102 08:45:31 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:43.102 08:45:31 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:43.102 08:45:31 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:43.102 08:45:31 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:43.102 08:45:31 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:06:43.102 08:45:31 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:43.102 08:45:31 -- pm/common@16 -- # TEST_TAG=N/A 00:06:43.102 08:45:31 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:06:43.102 08:45:31 -- common/autotest_common.sh@52 -- # : 1 00:06:43.102 08:45:31 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:06:43.102 08:45:31 -- common/autotest_common.sh@56 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:06:43.102 08:45:31 -- common/autotest_common.sh@58 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:06:43.102 08:45:31 -- common/autotest_common.sh@60 -- # : 1 00:06:43.102 08:45:31 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:06:43.102 08:45:31 -- common/autotest_common.sh@62 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:06:43.102 08:45:31 -- common/autotest_common.sh@64 -- # : 00:06:43.102 08:45:31 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:06:43.102 08:45:31 -- common/autotest_common.sh@66 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:06:43.102 08:45:31 -- common/autotest_common.sh@68 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:06:43.102 08:45:31 -- common/autotest_common.sh@70 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:06:43.102 08:45:31 -- common/autotest_common.sh@72 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:06:43.102 08:45:31 -- common/autotest_common.sh@74 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:06:43.102 08:45:31 -- common/autotest_common.sh@76 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:06:43.102 08:45:31 -- common/autotest_common.sh@78 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:06:43.102 08:45:31 -- common/autotest_common.sh@80 -- # : 1 00:06:43.102 08:45:31 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:06:43.102 08:45:31 -- common/autotest_common.sh@82 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:06:43.102 08:45:31 -- common/autotest_common.sh@84 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:06:43.102 08:45:31 -- common/autotest_common.sh@86 -- # : 1 00:06:43.102 08:45:31 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:06:43.102 08:45:31 -- common/autotest_common.sh@88 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:06:43.102 08:45:31 -- common/autotest_common.sh@90 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:06:43.102 08:45:31 -- common/autotest_common.sh@92 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:06:43.102 08:45:31 -- common/autotest_common.sh@94 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:06:43.102 08:45:31 -- common/autotest_common.sh@96 -- # : tcp 00:06:43.102 08:45:31 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:06:43.102 08:45:31 -- common/autotest_common.sh@98 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:06:43.102 08:45:31 -- common/autotest_common.sh@100 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:06:43.102 08:45:31 -- common/autotest_common.sh@102 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:06:43.102 08:45:31 -- common/autotest_common.sh@104 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:06:43.102 08:45:31 -- common/autotest_common.sh@106 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:06:43.102 08:45:31 -- common/autotest_common.sh@108 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:06:43.102 08:45:31 -- common/autotest_common.sh@110 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:06:43.102 08:45:31 -- common/autotest_common.sh@112 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:06:43.102 08:45:31 -- common/autotest_common.sh@114 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:06:43.102 08:45:31 -- common/autotest_common.sh@116 -- # : 1 00:06:43.102 08:45:31 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:06:43.102 08:45:31 -- common/autotest_common.sh@118 -- # : 00:06:43.102 08:45:31 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:06:43.102 08:45:31 -- common/autotest_common.sh@120 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:06:43.102 08:45:31 -- common/autotest_common.sh@122 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:06:43.102 08:45:31 -- common/autotest_common.sh@124 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:06:43.102 08:45:31 -- common/autotest_common.sh@126 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:06:43.102 08:45:31 -- common/autotest_common.sh@128 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:06:43.102 08:45:31 -- common/autotest_common.sh@130 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:06:43.102 08:45:31 -- common/autotest_common.sh@132 -- # : 00:06:43.102 08:45:31 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:06:43.102 08:45:31 -- common/autotest_common.sh@134 -- # : true 00:06:43.102 08:45:31 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:06:43.102 08:45:31 -- common/autotest_common.sh@136 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:06:43.102 08:45:31 -- common/autotest_common.sh@138 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:06:43.102 08:45:31 -- common/autotest_common.sh@140 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:06:43.102 08:45:31 -- common/autotest_common.sh@142 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:06:43.102 08:45:31 -- common/autotest_common.sh@144 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:06:43.102 08:45:31 -- common/autotest_common.sh@146 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:06:43.102 08:45:31 -- common/autotest_common.sh@148 -- # : e810 00:06:43.102 08:45:31 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:06:43.102 08:45:31 -- common/autotest_common.sh@150 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:06:43.102 08:45:31 -- common/autotest_common.sh@152 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:06:43.102 08:45:31 -- common/autotest_common.sh@154 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:06:43.102 08:45:31 -- common/autotest_common.sh@156 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:06:43.102 08:45:31 -- common/autotest_common.sh@158 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:06:43.102 08:45:31 -- common/autotest_common.sh@160 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:06:43.102 08:45:31 -- common/autotest_common.sh@163 -- # : 00:06:43.102 08:45:31 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:06:43.102 08:45:31 -- common/autotest_common.sh@165 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:06:43.102 08:45:31 -- common/autotest_common.sh@167 -- # : 0 00:06:43.102 08:45:31 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:06:43.103 08:45:31 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:43.103 08:45:31 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:43.103 08:45:31 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:43.103 08:45:31 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:43.103 08:45:31 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:43.103 08:45:31 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:43.103 08:45:31 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:43.103 08:45:31 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:43.103 08:45:31 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:06:43.103 08:45:31 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:06:43.103 08:45:31 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:43.103 08:45:31 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:43.103 08:45:31 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:06:43.103 08:45:31 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:06:43.103 08:45:31 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:43.103 08:45:31 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:43.103 08:45:31 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:43.103 08:45:31 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:43.103 08:45:31 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:06:43.103 08:45:31 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:06:43.103 08:45:31 -- common/autotest_common.sh@196 -- # cat 00:06:43.103 08:45:31 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:06:43.103 08:45:31 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:43.103 08:45:31 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:43.103 08:45:31 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:43.103 08:45:31 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:43.103 08:45:31 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:06:43.103 08:45:31 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:06:43.103 08:45:31 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:43.103 08:45:31 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:43.103 08:45:31 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:43.103 08:45:31 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:43.103 08:45:31 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:43.103 08:45:31 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:43.103 08:45:31 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:43.103 08:45:31 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:43.103 08:45:31 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:43.103 08:45:31 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:43.103 08:45:31 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:43.103 08:45:31 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:43.103 08:45:31 -- common/autotest_common.sh@248 -- # '[' 0 -eq 0 ']' 00:06:43.103 08:45:31 -- common/autotest_common.sh@249 -- # export valgrind= 00:06:43.103 08:45:31 -- common/autotest_common.sh@249 -- # valgrind= 00:06:43.103 08:45:31 -- common/autotest_common.sh@255 -- # uname -s 00:06:43.103 08:45:31 -- common/autotest_common.sh@255 -- # '[' Linux = Linux ']' 00:06:43.103 08:45:31 -- common/autotest_common.sh@256 -- # HUGEMEM=4096 00:06:43.103 08:45:31 -- common/autotest_common.sh@257 -- # export CLEAR_HUGE=yes 00:06:43.103 08:45:31 -- common/autotest_common.sh@257 -- # CLEAR_HUGE=yes 00:06:43.103 08:45:31 -- common/autotest_common.sh@258 -- # [[ 0 -eq 1 ]] 00:06:43.103 08:45:31 -- common/autotest_common.sh@258 -- # [[ 0 -eq 1 ]] 00:06:43.103 08:45:31 -- common/autotest_common.sh@265 -- # MAKE=make 00:06:43.103 08:45:31 -- common/autotest_common.sh@266 -- # MAKEFLAGS=-j48 00:06:43.103 08:45:31 -- common/autotest_common.sh@282 -- # export HUGEMEM=4096 00:06:43.103 08:45:31 -- common/autotest_common.sh@282 -- # HUGEMEM=4096 00:06:43.103 08:45:31 -- common/autotest_common.sh@284 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:06:43.103 08:45:31 -- common/autotest_common.sh@289 -- # NO_HUGE=() 00:06:43.103 08:45:31 -- common/autotest_common.sh@290 -- # TEST_MODE= 00:06:43.103 08:45:31 -- common/autotest_common.sh@291 -- # for i in "$@" 00:06:43.103 08:45:31 -- common/autotest_common.sh@292 -- # case "$i" in 00:06:43.103 08:45:31 -- common/autotest_common.sh@297 -- # TEST_TRANSPORT=tcp 00:06:43.103 08:45:31 -- common/autotest_common.sh@309 -- # [[ -z 1400000 ]] 00:06:43.103 08:45:31 -- common/autotest_common.sh@309 -- # kill -0 1400000 00:06:43.103 08:45:31 -- common/autotest_common.sh@1665 -- # set_test_storage 2147483648 00:06:43.103 08:45:31 -- common/autotest_common.sh@319 -- # [[ -v testdir ]] 00:06:43.103 08:45:31 -- common/autotest_common.sh@321 -- # local requested_size=2147483648 00:06:43.103 08:45:31 -- common/autotest_common.sh@322 -- # local mount target_dir 00:06:43.103 08:45:31 -- common/autotest_common.sh@324 -- # local -A mounts fss sizes avails uses 00:06:43.103 08:45:31 -- common/autotest_common.sh@325 -- # local source fs size avail mount use 00:06:43.103 08:45:31 -- common/autotest_common.sh@327 -- # local storage_fallback storage_candidates 00:06:43.103 08:45:31 -- common/autotest_common.sh@329 -- # mktemp -udt spdk.XXXXXX 00:06:43.103 08:45:31 -- common/autotest_common.sh@329 -- # storage_fallback=/tmp/spdk.gHhs3t 00:06:43.103 08:45:31 -- common/autotest_common.sh@334 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:06:43.103 08:45:31 -- common/autotest_common.sh@336 -- # [[ -n '' ]] 00:06:43.103 08:45:31 -- common/autotest_common.sh@341 -- # [[ -n '' ]] 00:06:43.103 08:45:31 -- common/autotest_common.sh@346 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.gHhs3t/tests/target /tmp/spdk.gHhs3t 00:06:43.103 08:45:31 -- common/autotest_common.sh@349 -- # requested_size=2214592512 00:06:43.103 08:45:31 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:43.103 08:45:31 -- common/autotest_common.sh@318 -- # df -T 00:06:43.103 08:45:31 -- common/autotest_common.sh@318 -- # grep -v Filesystem 00:06:43.103 08:45:31 -- common/autotest_common.sh@352 -- # mounts["$mount"]=spdk_devtmpfs 00:06:43.103 08:45:31 -- common/autotest_common.sh@352 -- # fss["$mount"]=devtmpfs 00:06:43.103 08:45:31 -- common/autotest_common.sh@353 -- # avails["$mount"]=67108864 00:06:43.103 08:45:31 -- common/autotest_common.sh@353 -- # sizes["$mount"]=67108864 00:06:43.103 08:45:31 -- common/autotest_common.sh@354 -- # uses["$mount"]=0 00:06:43.103 08:45:31 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:43.103 08:45:31 -- common/autotest_common.sh@352 -- # mounts["$mount"]=/dev/pmem0 00:06:43.103 08:45:31 -- common/autotest_common.sh@352 -- # fss["$mount"]=ext2 00:06:43.103 08:45:31 -- common/autotest_common.sh@353 -- # avails["$mount"]=953643008 00:06:43.103 08:45:31 -- common/autotest_common.sh@353 -- # sizes["$mount"]=5284429824 00:06:43.103 08:45:31 -- common/autotest_common.sh@354 -- # uses["$mount"]=4330786816 00:06:43.103 08:45:31 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:43.103 08:45:31 -- common/autotest_common.sh@352 -- # mounts["$mount"]=spdk_root 00:06:43.103 08:45:31 -- common/autotest_common.sh@352 -- # fss["$mount"]=overlay 00:06:43.103 08:45:31 -- common/autotest_common.sh@353 -- # avails["$mount"]=55621742592 00:06:43.103 08:45:31 -- common/autotest_common.sh@353 -- # sizes["$mount"]=61994692608 00:06:43.103 08:45:31 -- common/autotest_common.sh@354 -- # uses["$mount"]=6372950016 00:06:43.103 08:45:31 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:43.103 08:45:31 -- common/autotest_common.sh@352 -- # mounts["$mount"]=tmpfs 00:06:43.103 08:45:31 -- common/autotest_common.sh@352 -- # fss["$mount"]=tmpfs 00:06:43.103 08:45:31 -- common/autotest_common.sh@353 -- # avails["$mount"]=30943825920 00:06:43.103 08:45:31 -- common/autotest_common.sh@353 -- # sizes["$mount"]=30997344256 00:06:43.103 08:45:31 -- common/autotest_common.sh@354 -- # uses["$mount"]=53518336 00:06:43.103 08:45:31 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:43.103 08:45:31 -- common/autotest_common.sh@352 -- # mounts["$mount"]=tmpfs 00:06:43.103 08:45:31 -- common/autotest_common.sh@352 -- # fss["$mount"]=tmpfs 00:06:43.103 08:45:31 -- common/autotest_common.sh@353 -- # avails["$mount"]=12390178816 00:06:43.103 08:45:31 -- common/autotest_common.sh@353 -- # sizes["$mount"]=12398940160 00:06:43.103 08:45:31 -- common/autotest_common.sh@354 -- # uses["$mount"]=8761344 00:06:43.103 08:45:31 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:43.103 08:45:31 -- common/autotest_common.sh@352 -- # mounts["$mount"]=tmpfs 00:06:43.103 08:45:31 -- common/autotest_common.sh@352 -- # fss["$mount"]=tmpfs 00:06:43.103 08:45:31 -- common/autotest_common.sh@353 -- # avails["$mount"]=30996500480 00:06:43.103 08:45:31 -- common/autotest_common.sh@353 -- # sizes["$mount"]=30997348352 00:06:43.103 08:45:31 -- common/autotest_common.sh@354 -- # uses["$mount"]=847872 00:06:43.103 08:45:31 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:43.103 08:45:31 -- common/autotest_common.sh@352 -- # mounts["$mount"]=tmpfs 00:06:43.104 08:45:31 -- common/autotest_common.sh@352 -- # fss["$mount"]=tmpfs 00:06:43.104 08:45:31 -- common/autotest_common.sh@353 -- # avails["$mount"]=6199463936 00:06:43.104 08:45:31 -- common/autotest_common.sh@353 -- # sizes["$mount"]=6199468032 00:06:43.104 08:45:31 -- common/autotest_common.sh@354 -- # uses["$mount"]=4096 00:06:43.104 08:45:31 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:43.104 08:45:31 -- common/autotest_common.sh@357 -- # printf '* Looking for test storage...\n' 00:06:43.104 * Looking for test storage... 00:06:43.104 08:45:31 -- common/autotest_common.sh@359 -- # local target_space new_size 00:06:43.104 08:45:31 -- common/autotest_common.sh@360 -- # for target_dir in "${storage_candidates[@]}" 00:06:43.104 08:45:31 -- common/autotest_common.sh@363 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:43.104 08:45:31 -- common/autotest_common.sh@363 -- # awk '$1 !~ /Filesystem/{print $6}' 00:06:43.104 08:45:31 -- common/autotest_common.sh@363 -- # mount=/ 00:06:43.104 08:45:31 -- common/autotest_common.sh@365 -- # target_space=55621742592 00:06:43.104 08:45:31 -- common/autotest_common.sh@366 -- # (( target_space == 0 || target_space < requested_size )) 00:06:43.104 08:45:31 -- common/autotest_common.sh@369 -- # (( target_space >= requested_size )) 00:06:43.104 08:45:31 -- common/autotest_common.sh@371 -- # [[ overlay == tmpfs ]] 00:06:43.104 08:45:31 -- common/autotest_common.sh@371 -- # [[ overlay == ramfs ]] 00:06:43.104 08:45:31 -- common/autotest_common.sh@371 -- # [[ / == / ]] 00:06:43.104 08:45:31 -- common/autotest_common.sh@372 -- # new_size=8587542528 00:06:43.104 08:45:31 -- common/autotest_common.sh@373 -- # (( new_size * 100 / sizes[/] > 95 )) 00:06:43.104 08:45:31 -- common/autotest_common.sh@378 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:43.104 08:45:31 -- common/autotest_common.sh@378 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:43.104 08:45:31 -- common/autotest_common.sh@379 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:43.104 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:43.104 08:45:31 -- common/autotest_common.sh@380 -- # return 0 00:06:43.104 08:45:31 -- common/autotest_common.sh@1667 -- # set -o errtrace 00:06:43.104 08:45:31 -- common/autotest_common.sh@1668 -- # shopt -s extdebug 00:06:43.104 08:45:31 -- common/autotest_common.sh@1669 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:06:43.104 08:45:31 -- common/autotest_common.sh@1671 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:06:43.104 08:45:31 -- common/autotest_common.sh@1672 -- # true 00:06:43.104 08:45:31 -- common/autotest_common.sh@1674 -- # xtrace_fd 00:06:43.104 08:45:31 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:06:43.104 08:45:31 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:06:43.104 08:45:31 -- common/autotest_common.sh@27 -- # exec 00:06:43.104 08:45:31 -- common/autotest_common.sh@29 -- # exec 00:06:43.104 08:45:31 -- common/autotest_common.sh@31 -- # xtrace_restore 00:06:43.104 08:45:31 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:06:43.104 08:45:31 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:06:43.104 08:45:31 -- common/autotest_common.sh@18 -- # set -x 00:06:43.104 08:45:31 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:43.104 08:45:31 -- nvmf/common.sh@7 -- # uname -s 00:06:43.104 08:45:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:43.104 08:45:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:43.104 08:45:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:43.104 08:45:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:43.104 08:45:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:43.104 08:45:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:43.104 08:45:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:43.104 08:45:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:43.104 08:45:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:43.104 08:45:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:43.104 08:45:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:43.104 08:45:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:43.104 08:45:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:43.104 08:45:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:43.104 08:45:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:43.104 08:45:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:43.104 08:45:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:43.104 08:45:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:43.104 08:45:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:43.104 08:45:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:43.104 08:45:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:43.104 08:45:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:43.104 08:45:31 -- paths/export.sh@5 -- # export PATH 00:06:43.104 08:45:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:43.104 08:45:31 -- nvmf/common.sh@46 -- # : 0 00:06:43.104 08:45:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:43.104 08:45:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:43.104 08:45:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:43.104 08:45:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:43.104 08:45:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:43.104 08:45:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:43.104 08:45:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:43.104 08:45:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:43.104 08:45:31 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:06:43.104 08:45:31 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:06:43.104 08:45:31 -- target/filesystem.sh@15 -- # nvmftestinit 00:06:43.104 08:45:31 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:43.104 08:45:31 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:43.104 08:45:31 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:43.104 08:45:31 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:43.104 08:45:31 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:43.104 08:45:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:43.104 08:45:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:43.104 08:45:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:43.104 08:45:31 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:43.104 08:45:31 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:43.104 08:45:31 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:43.104 08:45:31 -- common/autotest_common.sh@10 -- # set +x 00:06:45.009 08:45:33 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:45.009 08:45:33 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:45.009 08:45:33 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:45.009 08:45:33 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:45.009 08:45:33 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:45.009 08:45:33 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:45.009 08:45:33 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:45.009 08:45:33 -- nvmf/common.sh@294 -- # net_devs=() 00:06:45.009 08:45:33 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:45.009 08:45:33 -- nvmf/common.sh@295 -- # e810=() 00:06:45.009 08:45:33 -- nvmf/common.sh@295 -- # local -ga e810 00:06:45.009 08:45:33 -- nvmf/common.sh@296 -- # x722=() 00:06:45.009 08:45:33 -- nvmf/common.sh@296 -- # local -ga x722 00:06:45.009 08:45:33 -- nvmf/common.sh@297 -- # mlx=() 00:06:45.009 08:45:33 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:45.009 08:45:33 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:45.009 08:45:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:45.009 08:45:33 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:45.009 08:45:33 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:45.009 08:45:33 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:45.009 08:45:33 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:45.009 08:45:33 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:45.009 08:45:33 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:45.009 08:45:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:45.009 08:45:33 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:45.009 08:45:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:45.009 08:45:33 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:45.009 08:45:33 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:45.009 08:45:33 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:45.009 08:45:33 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:45.009 08:45:33 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:45.009 08:45:33 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:45.009 08:45:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:45.009 08:45:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:45.009 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:45.009 08:45:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:45.009 08:45:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:45.009 08:45:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:45.009 08:45:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:45.009 08:45:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:45.009 08:45:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:45.009 08:45:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:45.009 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:45.009 08:45:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:45.009 08:45:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:45.009 08:45:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:45.009 08:45:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:45.009 08:45:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:45.009 08:45:33 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:45.009 08:45:33 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:45.009 08:45:33 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:45.009 08:45:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:45.009 08:45:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:45.009 08:45:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:45.009 08:45:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:45.009 08:45:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:45.009 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:45.009 08:45:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:45.009 08:45:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:45.009 08:45:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:45.009 08:45:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:45.009 08:45:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:45.009 08:45:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:45.009 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:45.009 08:45:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:45.009 08:45:33 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:45.009 08:45:33 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:45.009 08:45:33 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:45.009 08:45:33 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:45.009 08:45:33 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:45.009 08:45:33 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:45.009 08:45:33 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:45.009 08:45:33 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:45.009 08:45:33 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:45.009 08:45:33 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:45.009 08:45:33 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:45.009 08:45:33 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:45.009 08:45:33 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:45.009 08:45:33 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:45.009 08:45:33 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:45.009 08:45:33 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:45.009 08:45:33 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:45.009 08:45:33 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:45.009 08:45:33 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:45.009 08:45:33 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:45.009 08:45:33 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:45.266 08:45:33 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:45.266 08:45:33 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:45.266 08:45:33 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:45.266 08:45:33 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:45.266 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:45.266 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.197 ms 00:06:45.266 00:06:45.266 --- 10.0.0.2 ping statistics --- 00:06:45.266 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:45.266 rtt min/avg/max/mdev = 0.197/0.197/0.197/0.000 ms 00:06:45.266 08:45:33 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:45.266 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:45.266 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.110 ms 00:06:45.266 00:06:45.266 --- 10.0.0.1 ping statistics --- 00:06:45.266 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:45.266 rtt min/avg/max/mdev = 0.110/0.110/0.110/0.000 ms 00:06:45.266 08:45:33 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:45.266 08:45:33 -- nvmf/common.sh@410 -- # return 0 00:06:45.266 08:45:33 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:45.266 08:45:33 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:45.266 08:45:33 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:45.266 08:45:33 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:45.266 08:45:33 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:45.266 08:45:33 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:45.266 08:45:33 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:45.266 08:45:33 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:06:45.266 08:45:33 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:06:45.266 08:45:33 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:45.266 08:45:33 -- common/autotest_common.sh@10 -- # set +x 00:06:45.266 ************************************ 00:06:45.266 START TEST nvmf_filesystem_no_in_capsule 00:06:45.266 ************************************ 00:06:45.266 08:45:33 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_part 0 00:06:45.266 08:45:33 -- target/filesystem.sh@47 -- # in_capsule=0 00:06:45.266 08:45:33 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:06:45.266 08:45:33 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:06:45.266 08:45:33 -- common/autotest_common.sh@712 -- # xtrace_disable 00:06:45.266 08:45:33 -- common/autotest_common.sh@10 -- # set +x 00:06:45.266 08:45:33 -- nvmf/common.sh@469 -- # nvmfpid=1401630 00:06:45.266 08:45:33 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:06:45.266 08:45:33 -- nvmf/common.sh@470 -- # waitforlisten 1401630 00:06:45.266 08:45:33 -- common/autotest_common.sh@819 -- # '[' -z 1401630 ']' 00:06:45.266 08:45:33 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:45.266 08:45:33 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:45.266 08:45:33 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:45.266 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:45.266 08:45:33 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:45.266 08:45:33 -- common/autotest_common.sh@10 -- # set +x 00:06:45.266 [2024-07-15 08:45:33.686431] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:06:45.266 [2024-07-15 08:45:33.686524] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:06:45.266 EAL: No free 2048 kB hugepages reported on node 1 00:06:45.266 [2024-07-15 08:45:33.751497] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:45.524 [2024-07-15 08:45:33.862345] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:45.524 [2024-07-15 08:45:33.862492] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:06:45.524 [2024-07-15 08:45:33.862510] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:06:45.524 [2024-07-15 08:45:33.862523] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:06:45.524 [2024-07-15 08:45:33.862574] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:45.524 [2024-07-15 08:45:33.862624] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:45.524 [2024-07-15 08:45:33.862671] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:45.524 [2024-07-15 08:45:33.862674] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:46.456 08:45:34 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:46.456 08:45:34 -- common/autotest_common.sh@852 -- # return 0 00:06:46.456 08:45:34 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:06:46.456 08:45:34 -- common/autotest_common.sh@718 -- # xtrace_disable 00:06:46.456 08:45:34 -- common/autotest_common.sh@10 -- # set +x 00:06:46.456 08:45:34 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:06:46.456 08:45:34 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:06:46.456 08:45:34 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:06:46.456 08:45:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:46.456 08:45:34 -- common/autotest_common.sh@10 -- # set +x 00:06:46.456 [2024-07-15 08:45:34.708514] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:46.456 08:45:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:46.456 08:45:34 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:06:46.456 08:45:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:46.456 08:45:34 -- common/autotest_common.sh@10 -- # set +x 00:06:46.456 Malloc1 00:06:46.456 08:45:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:46.456 08:45:34 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:06:46.456 08:45:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:46.456 08:45:34 -- common/autotest_common.sh@10 -- # set +x 00:06:46.456 08:45:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:46.456 08:45:34 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:06:46.456 08:45:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:46.456 08:45:34 -- common/autotest_common.sh@10 -- # set +x 00:06:46.456 08:45:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:46.456 08:45:34 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:46.456 08:45:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:46.456 08:45:34 -- common/autotest_common.sh@10 -- # set +x 00:06:46.456 [2024-07-15 08:45:34.884355] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:06:46.456 08:45:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:46.456 08:45:34 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:06:46.456 08:45:34 -- common/autotest_common.sh@1357 -- # local bdev_name=Malloc1 00:06:46.456 08:45:34 -- common/autotest_common.sh@1358 -- # local bdev_info 00:06:46.456 08:45:34 -- common/autotest_common.sh@1359 -- # local bs 00:06:46.456 08:45:34 -- common/autotest_common.sh@1360 -- # local nb 00:06:46.456 08:45:34 -- common/autotest_common.sh@1361 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:06:46.456 08:45:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:46.456 08:45:34 -- common/autotest_common.sh@10 -- # set +x 00:06:46.456 08:45:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:46.456 08:45:34 -- common/autotest_common.sh@1361 -- # bdev_info='[ 00:06:46.456 { 00:06:46.456 "name": "Malloc1", 00:06:46.456 "aliases": [ 00:06:46.456 "1e708c3b-5cba-4ca9-b4d9-692a4aa137d6" 00:06:46.456 ], 00:06:46.456 "product_name": "Malloc disk", 00:06:46.456 "block_size": 512, 00:06:46.456 "num_blocks": 1048576, 00:06:46.456 "uuid": "1e708c3b-5cba-4ca9-b4d9-692a4aa137d6", 00:06:46.456 "assigned_rate_limits": { 00:06:46.456 "rw_ios_per_sec": 0, 00:06:46.456 "rw_mbytes_per_sec": 0, 00:06:46.456 "r_mbytes_per_sec": 0, 00:06:46.456 "w_mbytes_per_sec": 0 00:06:46.456 }, 00:06:46.456 "claimed": true, 00:06:46.456 "claim_type": "exclusive_write", 00:06:46.456 "zoned": false, 00:06:46.456 "supported_io_types": { 00:06:46.456 "read": true, 00:06:46.456 "write": true, 00:06:46.456 "unmap": true, 00:06:46.456 "write_zeroes": true, 00:06:46.456 "flush": true, 00:06:46.456 "reset": true, 00:06:46.456 "compare": false, 00:06:46.456 "compare_and_write": false, 00:06:46.456 "abort": true, 00:06:46.456 "nvme_admin": false, 00:06:46.456 "nvme_io": false 00:06:46.456 }, 00:06:46.456 "memory_domains": [ 00:06:46.456 { 00:06:46.456 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:46.456 "dma_device_type": 2 00:06:46.456 } 00:06:46.456 ], 00:06:46.456 "driver_specific": {} 00:06:46.456 } 00:06:46.456 ]' 00:06:46.456 08:45:34 -- common/autotest_common.sh@1362 -- # jq '.[] .block_size' 00:06:46.456 08:45:34 -- common/autotest_common.sh@1362 -- # bs=512 00:06:46.456 08:45:34 -- common/autotest_common.sh@1363 -- # jq '.[] .num_blocks' 00:06:46.456 08:45:34 -- common/autotest_common.sh@1363 -- # nb=1048576 00:06:46.456 08:45:34 -- common/autotest_common.sh@1366 -- # bdev_size=512 00:06:46.456 08:45:34 -- common/autotest_common.sh@1367 -- # echo 512 00:06:46.456 08:45:34 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:06:46.456 08:45:34 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:06:47.388 08:45:35 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:06:47.388 08:45:35 -- common/autotest_common.sh@1177 -- # local i=0 00:06:47.388 08:45:35 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:06:47.388 08:45:35 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:06:47.388 08:45:35 -- common/autotest_common.sh@1184 -- # sleep 2 00:06:49.283 08:45:37 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:06:49.283 08:45:37 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:06:49.283 08:45:37 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:06:49.283 08:45:37 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:06:49.283 08:45:37 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:06:49.283 08:45:37 -- common/autotest_common.sh@1187 -- # return 0 00:06:49.283 08:45:37 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:06:49.283 08:45:37 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:06:49.283 08:45:37 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:06:49.283 08:45:37 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:06:49.283 08:45:37 -- setup/common.sh@76 -- # local dev=nvme0n1 00:06:49.283 08:45:37 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:06:49.283 08:45:37 -- setup/common.sh@80 -- # echo 536870912 00:06:49.283 08:45:37 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:06:49.283 08:45:37 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:06:49.283 08:45:37 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:06:49.283 08:45:37 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:06:49.541 08:45:37 -- target/filesystem.sh@69 -- # partprobe 00:06:50.106 08:45:38 -- target/filesystem.sh@70 -- # sleep 1 00:06:51.039 08:45:39 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:06:51.039 08:45:39 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:06:51.039 08:45:39 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:06:51.039 08:45:39 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:51.039 08:45:39 -- common/autotest_common.sh@10 -- # set +x 00:06:51.039 ************************************ 00:06:51.039 START TEST filesystem_ext4 00:06:51.039 ************************************ 00:06:51.039 08:45:39 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create ext4 nvme0n1 00:06:51.039 08:45:39 -- target/filesystem.sh@18 -- # fstype=ext4 00:06:51.039 08:45:39 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:51.039 08:45:39 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:06:51.039 08:45:39 -- common/autotest_common.sh@902 -- # local fstype=ext4 00:06:51.039 08:45:39 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:06:51.039 08:45:39 -- common/autotest_common.sh@904 -- # local i=0 00:06:51.039 08:45:39 -- common/autotest_common.sh@905 -- # local force 00:06:51.039 08:45:39 -- common/autotest_common.sh@907 -- # '[' ext4 = ext4 ']' 00:06:51.039 08:45:39 -- common/autotest_common.sh@908 -- # force=-F 00:06:51.039 08:45:39 -- common/autotest_common.sh@913 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:06:51.039 mke2fs 1.46.5 (30-Dec-2021) 00:06:51.039 Discarding device blocks: 0/522240 done 00:06:51.039 Creating filesystem with 522240 1k blocks and 130560 inodes 00:06:51.039 Filesystem UUID: d2d68f32-245e-4144-906d-b98f72d6a82b 00:06:51.039 Superblock backups stored on blocks: 00:06:51.039 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:06:51.039 00:06:51.039 Allocating group tables: 0/64 done 00:06:51.039 Writing inode tables: 0/64 done 00:06:51.297 Creating journal (8192 blocks): done 00:06:52.375 Writing superblocks and filesystem accounting information: 0/64 2/64 done 00:06:52.375 00:06:52.375 08:45:40 -- common/autotest_common.sh@921 -- # return 0 00:06:52.375 08:45:40 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:52.633 08:45:40 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:52.633 08:45:41 -- target/filesystem.sh@25 -- # sync 00:06:52.633 08:45:41 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:52.633 08:45:41 -- target/filesystem.sh@27 -- # sync 00:06:52.633 08:45:41 -- target/filesystem.sh@29 -- # i=0 00:06:52.633 08:45:41 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:52.633 08:45:41 -- target/filesystem.sh@37 -- # kill -0 1401630 00:06:52.633 08:45:41 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:52.633 08:45:41 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:52.633 08:45:41 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:52.633 08:45:41 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:52.633 00:06:52.633 real 0m1.627s 00:06:52.633 user 0m0.018s 00:06:52.633 sys 0m0.059s 00:06:52.633 08:45:41 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:52.633 08:45:41 -- common/autotest_common.sh@10 -- # set +x 00:06:52.633 ************************************ 00:06:52.633 END TEST filesystem_ext4 00:06:52.633 ************************************ 00:06:52.633 08:45:41 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:06:52.633 08:45:41 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:06:52.633 08:45:41 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:52.633 08:45:41 -- common/autotest_common.sh@10 -- # set +x 00:06:52.633 ************************************ 00:06:52.633 START TEST filesystem_btrfs 00:06:52.633 ************************************ 00:06:52.633 08:45:41 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create btrfs nvme0n1 00:06:52.633 08:45:41 -- target/filesystem.sh@18 -- # fstype=btrfs 00:06:52.633 08:45:41 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:52.633 08:45:41 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:06:52.633 08:45:41 -- common/autotest_common.sh@902 -- # local fstype=btrfs 00:06:52.633 08:45:41 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:06:52.633 08:45:41 -- common/autotest_common.sh@904 -- # local i=0 00:06:52.633 08:45:41 -- common/autotest_common.sh@905 -- # local force 00:06:52.633 08:45:41 -- common/autotest_common.sh@907 -- # '[' btrfs = ext4 ']' 00:06:52.633 08:45:41 -- common/autotest_common.sh@910 -- # force=-f 00:06:52.633 08:45:41 -- common/autotest_common.sh@913 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:06:52.890 btrfs-progs v6.6.2 00:06:52.890 See https://btrfs.readthedocs.io for more information. 00:06:52.890 00:06:52.890 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:06:52.890 NOTE: several default settings have changed in version 5.15, please make sure 00:06:52.890 this does not affect your deployments: 00:06:52.890 - DUP for metadata (-m dup) 00:06:52.890 - enabled no-holes (-O no-holes) 00:06:52.890 - enabled free-space-tree (-R free-space-tree) 00:06:52.890 00:06:52.890 Label: (null) 00:06:52.890 UUID: bc2b1463-0a6f-402e-a4a2-58be4f455e3f 00:06:52.890 Node size: 16384 00:06:52.890 Sector size: 4096 00:06:52.890 Filesystem size: 510.00MiB 00:06:52.890 Block group profiles: 00:06:52.890 Data: single 8.00MiB 00:06:52.890 Metadata: DUP 32.00MiB 00:06:52.890 System: DUP 8.00MiB 00:06:52.890 SSD detected: yes 00:06:52.890 Zoned device: no 00:06:52.890 Incompat features: extref, skinny-metadata, no-holes, free-space-tree 00:06:52.890 Runtime features: free-space-tree 00:06:52.890 Checksum: crc32c 00:06:52.890 Number of devices: 1 00:06:52.890 Devices: 00:06:52.890 ID SIZE PATH 00:06:52.890 1 510.00MiB /dev/nvme0n1p1 00:06:52.890 00:06:52.890 08:45:41 -- common/autotest_common.sh@921 -- # return 0 00:06:52.890 08:45:41 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:53.822 08:45:42 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:53.822 08:45:42 -- target/filesystem.sh@25 -- # sync 00:06:53.822 08:45:42 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:53.822 08:45:42 -- target/filesystem.sh@27 -- # sync 00:06:53.822 08:45:42 -- target/filesystem.sh@29 -- # i=0 00:06:53.822 08:45:42 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:53.822 08:45:42 -- target/filesystem.sh@37 -- # kill -0 1401630 00:06:53.822 08:45:42 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:53.822 08:45:42 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:53.822 08:45:42 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:53.822 08:45:42 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:53.822 00:06:53.822 real 0m0.991s 00:06:53.822 user 0m0.018s 00:06:53.822 sys 0m0.115s 00:06:53.822 08:45:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:53.823 08:45:42 -- common/autotest_common.sh@10 -- # set +x 00:06:53.823 ************************************ 00:06:53.823 END TEST filesystem_btrfs 00:06:53.823 ************************************ 00:06:53.823 08:45:42 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:06:53.823 08:45:42 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:06:53.823 08:45:42 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:53.823 08:45:42 -- common/autotest_common.sh@10 -- # set +x 00:06:53.823 ************************************ 00:06:53.823 START TEST filesystem_xfs 00:06:53.823 ************************************ 00:06:53.823 08:45:42 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create xfs nvme0n1 00:06:53.823 08:45:42 -- target/filesystem.sh@18 -- # fstype=xfs 00:06:53.823 08:45:42 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:53.823 08:45:42 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:06:53.823 08:45:42 -- common/autotest_common.sh@902 -- # local fstype=xfs 00:06:53.823 08:45:42 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:06:53.823 08:45:42 -- common/autotest_common.sh@904 -- # local i=0 00:06:53.823 08:45:42 -- common/autotest_common.sh@905 -- # local force 00:06:53.823 08:45:42 -- common/autotest_common.sh@907 -- # '[' xfs = ext4 ']' 00:06:53.823 08:45:42 -- common/autotest_common.sh@910 -- # force=-f 00:06:53.823 08:45:42 -- common/autotest_common.sh@913 -- # mkfs.xfs -f /dev/nvme0n1p1 00:06:53.823 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:06:53.823 = sectsz=512 attr=2, projid32bit=1 00:06:53.823 = crc=1 finobt=1, sparse=1, rmapbt=0 00:06:53.823 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:06:53.823 data = bsize=4096 blocks=130560, imaxpct=25 00:06:53.823 = sunit=0 swidth=0 blks 00:06:53.823 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:06:53.823 log =internal log bsize=4096 blocks=16384, version=2 00:06:53.823 = sectsz=512 sunit=0 blks, lazy-count=1 00:06:53.823 realtime =none extsz=4096 blocks=0, rtextents=0 00:06:54.752 Discarding blocks...Done. 00:06:54.752 08:45:43 -- common/autotest_common.sh@921 -- # return 0 00:06:54.752 08:45:43 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:57.303 08:45:45 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:57.303 08:45:45 -- target/filesystem.sh@25 -- # sync 00:06:57.303 08:45:45 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:57.303 08:45:45 -- target/filesystem.sh@27 -- # sync 00:06:57.303 08:45:45 -- target/filesystem.sh@29 -- # i=0 00:06:57.303 08:45:45 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:57.303 08:45:45 -- target/filesystem.sh@37 -- # kill -0 1401630 00:06:57.303 08:45:45 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:57.303 08:45:45 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:57.303 08:45:45 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:57.303 08:45:45 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:57.303 00:06:57.303 real 0m3.662s 00:06:57.303 user 0m0.021s 00:06:57.303 sys 0m0.058s 00:06:57.303 08:45:45 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:57.303 08:45:45 -- common/autotest_common.sh@10 -- # set +x 00:06:57.303 ************************************ 00:06:57.303 END TEST filesystem_xfs 00:06:57.303 ************************************ 00:06:57.303 08:45:45 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:06:57.868 08:45:46 -- target/filesystem.sh@93 -- # sync 00:06:57.868 08:45:46 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:06:57.868 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:06:57.868 08:45:46 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:06:57.868 08:45:46 -- common/autotest_common.sh@1198 -- # local i=0 00:06:57.868 08:45:46 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:06:57.868 08:45:46 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:06:57.868 08:45:46 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:06:57.868 08:45:46 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:06:57.868 08:45:46 -- common/autotest_common.sh@1210 -- # return 0 00:06:57.868 08:45:46 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:06:57.868 08:45:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:57.868 08:45:46 -- common/autotest_common.sh@10 -- # set +x 00:06:57.868 08:45:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:57.868 08:45:46 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:06:57.868 08:45:46 -- target/filesystem.sh@101 -- # killprocess 1401630 00:06:57.868 08:45:46 -- common/autotest_common.sh@926 -- # '[' -z 1401630 ']' 00:06:57.868 08:45:46 -- common/autotest_common.sh@930 -- # kill -0 1401630 00:06:57.868 08:45:46 -- common/autotest_common.sh@931 -- # uname 00:06:57.868 08:45:46 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:57.868 08:45:46 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1401630 00:06:57.868 08:45:46 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:57.868 08:45:46 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:57.868 08:45:46 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1401630' 00:06:57.868 killing process with pid 1401630 00:06:57.868 08:45:46 -- common/autotest_common.sh@945 -- # kill 1401630 00:06:57.868 08:45:46 -- common/autotest_common.sh@950 -- # wait 1401630 00:06:58.433 08:45:46 -- target/filesystem.sh@102 -- # nvmfpid= 00:06:58.433 00:06:58.433 real 0m13.085s 00:06:58.433 user 0m50.407s 00:06:58.433 sys 0m1.838s 00:06:58.433 08:45:46 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:58.433 08:45:46 -- common/autotest_common.sh@10 -- # set +x 00:06:58.433 ************************************ 00:06:58.434 END TEST nvmf_filesystem_no_in_capsule 00:06:58.434 ************************************ 00:06:58.434 08:45:46 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:06:58.434 08:45:46 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:06:58.434 08:45:46 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:58.434 08:45:46 -- common/autotest_common.sh@10 -- # set +x 00:06:58.434 ************************************ 00:06:58.434 START TEST nvmf_filesystem_in_capsule 00:06:58.434 ************************************ 00:06:58.434 08:45:46 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_part 4096 00:06:58.434 08:45:46 -- target/filesystem.sh@47 -- # in_capsule=4096 00:06:58.434 08:45:46 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:06:58.434 08:45:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:06:58.434 08:45:46 -- common/autotest_common.sh@712 -- # xtrace_disable 00:06:58.434 08:45:46 -- common/autotest_common.sh@10 -- # set +x 00:06:58.434 08:45:46 -- nvmf/common.sh@469 -- # nvmfpid=1403371 00:06:58.434 08:45:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:06:58.434 08:45:46 -- nvmf/common.sh@470 -- # waitforlisten 1403371 00:06:58.434 08:45:46 -- common/autotest_common.sh@819 -- # '[' -z 1403371 ']' 00:06:58.434 08:45:46 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:58.434 08:45:46 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:58.434 08:45:46 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:58.434 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:58.434 08:45:46 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:58.434 08:45:46 -- common/autotest_common.sh@10 -- # set +x 00:06:58.434 [2024-07-15 08:45:46.802089] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:06:58.434 [2024-07-15 08:45:46.802163] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:06:58.434 EAL: No free 2048 kB hugepages reported on node 1 00:06:58.434 [2024-07-15 08:45:46.869244] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:58.691 [2024-07-15 08:45:46.982242] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:58.691 [2024-07-15 08:45:46.982394] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:06:58.691 [2024-07-15 08:45:46.982414] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:06:58.691 [2024-07-15 08:45:46.982428] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:06:58.691 [2024-07-15 08:45:46.982486] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:58.691 [2024-07-15 08:45:46.982539] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:58.691 [2024-07-15 08:45:46.982653] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:58.691 [2024-07-15 08:45:46.982656] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:59.256 08:45:47 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:59.256 08:45:47 -- common/autotest_common.sh@852 -- # return 0 00:06:59.256 08:45:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:06:59.256 08:45:47 -- common/autotest_common.sh@718 -- # xtrace_disable 00:06:59.256 08:45:47 -- common/autotest_common.sh@10 -- # set +x 00:06:59.256 08:45:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:06:59.256 08:45:47 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:06:59.256 08:45:47 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:06:59.256 08:45:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:59.256 08:45:47 -- common/autotest_common.sh@10 -- # set +x 00:06:59.256 [2024-07-15 08:45:47.754341] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:59.256 08:45:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:59.256 08:45:47 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:06:59.256 08:45:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:59.256 08:45:47 -- common/autotest_common.sh@10 -- # set +x 00:06:59.513 Malloc1 00:06:59.513 08:45:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:59.513 08:45:47 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:06:59.513 08:45:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:59.513 08:45:47 -- common/autotest_common.sh@10 -- # set +x 00:06:59.513 08:45:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:59.513 08:45:47 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:06:59.513 08:45:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:59.513 08:45:47 -- common/autotest_common.sh@10 -- # set +x 00:06:59.513 08:45:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:59.513 08:45:47 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:59.513 08:45:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:59.513 08:45:47 -- common/autotest_common.sh@10 -- # set +x 00:06:59.513 [2024-07-15 08:45:47.934408] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:06:59.513 08:45:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:59.513 08:45:47 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:06:59.513 08:45:47 -- common/autotest_common.sh@1357 -- # local bdev_name=Malloc1 00:06:59.513 08:45:47 -- common/autotest_common.sh@1358 -- # local bdev_info 00:06:59.513 08:45:47 -- common/autotest_common.sh@1359 -- # local bs 00:06:59.513 08:45:47 -- common/autotest_common.sh@1360 -- # local nb 00:06:59.514 08:45:47 -- common/autotest_common.sh@1361 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:06:59.514 08:45:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:59.514 08:45:47 -- common/autotest_common.sh@10 -- # set +x 00:06:59.514 08:45:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:59.514 08:45:47 -- common/autotest_common.sh@1361 -- # bdev_info='[ 00:06:59.514 { 00:06:59.514 "name": "Malloc1", 00:06:59.514 "aliases": [ 00:06:59.514 "480fddf7-9aba-49d6-b248-ef20c771032f" 00:06:59.514 ], 00:06:59.514 "product_name": "Malloc disk", 00:06:59.514 "block_size": 512, 00:06:59.514 "num_blocks": 1048576, 00:06:59.514 "uuid": "480fddf7-9aba-49d6-b248-ef20c771032f", 00:06:59.514 "assigned_rate_limits": { 00:06:59.514 "rw_ios_per_sec": 0, 00:06:59.514 "rw_mbytes_per_sec": 0, 00:06:59.514 "r_mbytes_per_sec": 0, 00:06:59.514 "w_mbytes_per_sec": 0 00:06:59.514 }, 00:06:59.514 "claimed": true, 00:06:59.514 "claim_type": "exclusive_write", 00:06:59.514 "zoned": false, 00:06:59.514 "supported_io_types": { 00:06:59.514 "read": true, 00:06:59.514 "write": true, 00:06:59.514 "unmap": true, 00:06:59.514 "write_zeroes": true, 00:06:59.514 "flush": true, 00:06:59.514 "reset": true, 00:06:59.514 "compare": false, 00:06:59.514 "compare_and_write": false, 00:06:59.514 "abort": true, 00:06:59.514 "nvme_admin": false, 00:06:59.514 "nvme_io": false 00:06:59.514 }, 00:06:59.514 "memory_domains": [ 00:06:59.514 { 00:06:59.514 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:59.514 "dma_device_type": 2 00:06:59.514 } 00:06:59.514 ], 00:06:59.514 "driver_specific": {} 00:06:59.514 } 00:06:59.514 ]' 00:06:59.514 08:45:47 -- common/autotest_common.sh@1362 -- # jq '.[] .block_size' 00:06:59.514 08:45:47 -- common/autotest_common.sh@1362 -- # bs=512 00:06:59.514 08:45:47 -- common/autotest_common.sh@1363 -- # jq '.[] .num_blocks' 00:06:59.514 08:45:48 -- common/autotest_common.sh@1363 -- # nb=1048576 00:06:59.514 08:45:48 -- common/autotest_common.sh@1366 -- # bdev_size=512 00:06:59.514 08:45:48 -- common/autotest_common.sh@1367 -- # echo 512 00:06:59.514 08:45:48 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:06:59.514 08:45:48 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:00.446 08:45:48 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:07:00.446 08:45:48 -- common/autotest_common.sh@1177 -- # local i=0 00:07:00.446 08:45:48 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:07:00.446 08:45:48 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:07:00.446 08:45:48 -- common/autotest_common.sh@1184 -- # sleep 2 00:07:02.341 08:45:50 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:07:02.341 08:45:50 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:07:02.341 08:45:50 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:07:02.341 08:45:50 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:07:02.341 08:45:50 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:07:02.341 08:45:50 -- common/autotest_common.sh@1187 -- # return 0 00:07:02.341 08:45:50 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:07:02.341 08:45:50 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:07:02.341 08:45:50 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:07:02.341 08:45:50 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:07:02.341 08:45:50 -- setup/common.sh@76 -- # local dev=nvme0n1 00:07:02.341 08:45:50 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:07:02.341 08:45:50 -- setup/common.sh@80 -- # echo 536870912 00:07:02.341 08:45:50 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:07:02.341 08:45:50 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:07:02.341 08:45:50 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:07:02.341 08:45:50 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:07:02.600 08:45:50 -- target/filesystem.sh@69 -- # partprobe 00:07:02.857 08:45:51 -- target/filesystem.sh@70 -- # sleep 1 00:07:03.787 08:45:52 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:07:03.787 08:45:52 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:07:03.787 08:45:52 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:07:03.787 08:45:52 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:03.787 08:45:52 -- common/autotest_common.sh@10 -- # set +x 00:07:03.787 ************************************ 00:07:03.787 START TEST filesystem_in_capsule_ext4 00:07:03.787 ************************************ 00:07:03.787 08:45:52 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create ext4 nvme0n1 00:07:03.787 08:45:52 -- target/filesystem.sh@18 -- # fstype=ext4 00:07:03.787 08:45:52 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:03.787 08:45:52 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:07:03.787 08:45:52 -- common/autotest_common.sh@902 -- # local fstype=ext4 00:07:03.787 08:45:52 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:07:03.787 08:45:52 -- common/autotest_common.sh@904 -- # local i=0 00:07:03.787 08:45:52 -- common/autotest_common.sh@905 -- # local force 00:07:03.787 08:45:52 -- common/autotest_common.sh@907 -- # '[' ext4 = ext4 ']' 00:07:03.787 08:45:52 -- common/autotest_common.sh@908 -- # force=-F 00:07:03.787 08:45:52 -- common/autotest_common.sh@913 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:07:03.787 mke2fs 1.46.5 (30-Dec-2021) 00:07:04.045 Discarding device blocks: 0/522240 done 00:07:04.045 Creating filesystem with 522240 1k blocks and 130560 inodes 00:07:04.045 Filesystem UUID: 3e852331-3d79-4f6b-bea1-9299ca81af01 00:07:04.045 Superblock backups stored on blocks: 00:07:04.045 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:07:04.045 00:07:04.045 Allocating group tables: 0/64 done 00:07:04.045 Writing inode tables: 0/64 done 00:07:07.323 Creating journal (8192 blocks): done 00:07:07.838 Writing superblocks and filesystem accounting information: 0/6426/64 done 00:07:07.838 00:07:07.838 08:45:56 -- common/autotest_common.sh@921 -- # return 0 00:07:07.838 08:45:56 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:08.401 08:45:56 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:08.658 08:45:56 -- target/filesystem.sh@25 -- # sync 00:07:08.658 08:45:56 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:08.658 08:45:56 -- target/filesystem.sh@27 -- # sync 00:07:08.658 08:45:56 -- target/filesystem.sh@29 -- # i=0 00:07:08.658 08:45:56 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:08.658 08:45:57 -- target/filesystem.sh@37 -- # kill -0 1403371 00:07:08.658 08:45:57 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:08.658 08:45:57 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:08.658 08:45:57 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:08.658 08:45:57 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:08.658 00:07:08.658 real 0m4.776s 00:07:08.658 user 0m0.020s 00:07:08.658 sys 0m0.060s 00:07:08.658 08:45:57 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:08.658 08:45:57 -- common/autotest_common.sh@10 -- # set +x 00:07:08.658 ************************************ 00:07:08.658 END TEST filesystem_in_capsule_ext4 00:07:08.658 ************************************ 00:07:08.658 08:45:57 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:08.658 08:45:57 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:07:08.658 08:45:57 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:08.658 08:45:57 -- common/autotest_common.sh@10 -- # set +x 00:07:08.658 ************************************ 00:07:08.658 START TEST filesystem_in_capsule_btrfs 00:07:08.658 ************************************ 00:07:08.658 08:45:57 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:08.658 08:45:57 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:08.658 08:45:57 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:08.658 08:45:57 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:08.658 08:45:57 -- common/autotest_common.sh@902 -- # local fstype=btrfs 00:07:08.658 08:45:57 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:07:08.658 08:45:57 -- common/autotest_common.sh@904 -- # local i=0 00:07:08.658 08:45:57 -- common/autotest_common.sh@905 -- # local force 00:07:08.658 08:45:57 -- common/autotest_common.sh@907 -- # '[' btrfs = ext4 ']' 00:07:08.658 08:45:57 -- common/autotest_common.sh@910 -- # force=-f 00:07:08.658 08:45:57 -- common/autotest_common.sh@913 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:08.915 btrfs-progs v6.6.2 00:07:08.915 See https://btrfs.readthedocs.io for more information. 00:07:08.915 00:07:08.915 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:08.915 NOTE: several default settings have changed in version 5.15, please make sure 00:07:08.915 this does not affect your deployments: 00:07:08.915 - DUP for metadata (-m dup) 00:07:08.915 - enabled no-holes (-O no-holes) 00:07:08.915 - enabled free-space-tree (-R free-space-tree) 00:07:08.915 00:07:08.915 Label: (null) 00:07:08.915 UUID: 874a2be4-2435-4c30-85fc-70d14df5caab 00:07:08.915 Node size: 16384 00:07:08.915 Sector size: 4096 00:07:08.915 Filesystem size: 510.00MiB 00:07:08.915 Block group profiles: 00:07:08.915 Data: single 8.00MiB 00:07:08.915 Metadata: DUP 32.00MiB 00:07:08.915 System: DUP 8.00MiB 00:07:08.915 SSD detected: yes 00:07:08.915 Zoned device: no 00:07:08.915 Incompat features: extref, skinny-metadata, no-holes, free-space-tree 00:07:08.915 Runtime features: free-space-tree 00:07:08.915 Checksum: crc32c 00:07:08.916 Number of devices: 1 00:07:08.916 Devices: 00:07:08.916 ID SIZE PATH 00:07:08.916 1 510.00MiB /dev/nvme0n1p1 00:07:08.916 00:07:08.916 08:45:57 -- common/autotest_common.sh@921 -- # return 0 00:07:08.916 08:45:57 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:09.849 08:45:58 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:09.849 08:45:58 -- target/filesystem.sh@25 -- # sync 00:07:09.849 08:45:58 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:09.849 08:45:58 -- target/filesystem.sh@27 -- # sync 00:07:09.849 08:45:58 -- target/filesystem.sh@29 -- # i=0 00:07:09.849 08:45:58 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:09.849 08:45:58 -- target/filesystem.sh@37 -- # kill -0 1403371 00:07:09.849 08:45:58 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:09.849 08:45:58 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:09.849 08:45:58 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:09.849 08:45:58 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:09.849 00:07:09.849 real 0m1.158s 00:07:09.849 user 0m0.014s 00:07:09.849 sys 0m0.123s 00:07:09.849 08:45:58 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:09.849 08:45:58 -- common/autotest_common.sh@10 -- # set +x 00:07:09.849 ************************************ 00:07:09.849 END TEST filesystem_in_capsule_btrfs 00:07:09.849 ************************************ 00:07:09.849 08:45:58 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:07:09.849 08:45:58 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:07:09.849 08:45:58 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:09.849 08:45:58 -- common/autotest_common.sh@10 -- # set +x 00:07:09.849 ************************************ 00:07:09.849 START TEST filesystem_in_capsule_xfs 00:07:09.849 ************************************ 00:07:09.849 08:45:58 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create xfs nvme0n1 00:07:09.849 08:45:58 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:09.849 08:45:58 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:09.850 08:45:58 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:09.850 08:45:58 -- common/autotest_common.sh@902 -- # local fstype=xfs 00:07:09.850 08:45:58 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:07:09.850 08:45:58 -- common/autotest_common.sh@904 -- # local i=0 00:07:09.850 08:45:58 -- common/autotest_common.sh@905 -- # local force 00:07:09.850 08:45:58 -- common/autotest_common.sh@907 -- # '[' xfs = ext4 ']' 00:07:09.850 08:45:58 -- common/autotest_common.sh@910 -- # force=-f 00:07:09.850 08:45:58 -- common/autotest_common.sh@913 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:09.850 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:09.850 = sectsz=512 attr=2, projid32bit=1 00:07:09.850 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:09.850 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:09.850 data = bsize=4096 blocks=130560, imaxpct=25 00:07:09.850 = sunit=0 swidth=0 blks 00:07:09.850 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:09.850 log =internal log bsize=4096 blocks=16384, version=2 00:07:09.850 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:09.850 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:11.223 Discarding blocks...Done. 00:07:11.223 08:45:59 -- common/autotest_common.sh@921 -- # return 0 00:07:11.223 08:45:59 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:13.154 08:46:01 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:13.410 08:46:01 -- target/filesystem.sh@25 -- # sync 00:07:13.410 08:46:01 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:13.411 08:46:01 -- target/filesystem.sh@27 -- # sync 00:07:13.411 08:46:01 -- target/filesystem.sh@29 -- # i=0 00:07:13.411 08:46:01 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:13.411 08:46:01 -- target/filesystem.sh@37 -- # kill -0 1403371 00:07:13.411 08:46:01 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:13.411 08:46:01 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:13.411 08:46:01 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:13.411 08:46:01 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:13.411 00:07:13.411 real 0m3.507s 00:07:13.411 user 0m0.011s 00:07:13.411 sys 0m0.068s 00:07:13.411 08:46:01 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:13.411 08:46:01 -- common/autotest_common.sh@10 -- # set +x 00:07:13.411 ************************************ 00:07:13.411 END TEST filesystem_in_capsule_xfs 00:07:13.411 ************************************ 00:07:13.411 08:46:01 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:13.411 08:46:01 -- target/filesystem.sh@93 -- # sync 00:07:13.411 08:46:01 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:13.668 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:13.668 08:46:01 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:13.668 08:46:01 -- common/autotest_common.sh@1198 -- # local i=0 00:07:13.668 08:46:01 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:07:13.668 08:46:01 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:13.668 08:46:01 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:07:13.668 08:46:01 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:13.668 08:46:01 -- common/autotest_common.sh@1210 -- # return 0 00:07:13.668 08:46:01 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:13.668 08:46:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:13.668 08:46:01 -- common/autotest_common.sh@10 -- # set +x 00:07:13.668 08:46:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:13.668 08:46:02 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:13.668 08:46:02 -- target/filesystem.sh@101 -- # killprocess 1403371 00:07:13.668 08:46:02 -- common/autotest_common.sh@926 -- # '[' -z 1403371 ']' 00:07:13.668 08:46:02 -- common/autotest_common.sh@930 -- # kill -0 1403371 00:07:13.668 08:46:02 -- common/autotest_common.sh@931 -- # uname 00:07:13.668 08:46:02 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:07:13.668 08:46:02 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1403371 00:07:13.668 08:46:02 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:07:13.668 08:46:02 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:07:13.668 08:46:02 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1403371' 00:07:13.668 killing process with pid 1403371 00:07:13.668 08:46:02 -- common/autotest_common.sh@945 -- # kill 1403371 00:07:13.668 08:46:02 -- common/autotest_common.sh@950 -- # wait 1403371 00:07:14.234 08:46:02 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:14.234 00:07:14.234 real 0m15.764s 00:07:14.234 user 1m0.737s 00:07:14.234 sys 0m2.121s 00:07:14.234 08:46:02 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:14.234 08:46:02 -- common/autotest_common.sh@10 -- # set +x 00:07:14.234 ************************************ 00:07:14.234 END TEST nvmf_filesystem_in_capsule 00:07:14.234 ************************************ 00:07:14.234 08:46:02 -- target/filesystem.sh@108 -- # nvmftestfini 00:07:14.234 08:46:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:14.234 08:46:02 -- nvmf/common.sh@116 -- # sync 00:07:14.234 08:46:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:14.234 08:46:02 -- nvmf/common.sh@119 -- # set +e 00:07:14.234 08:46:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:14.234 08:46:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:14.234 rmmod nvme_tcp 00:07:14.234 rmmod nvme_fabrics 00:07:14.234 rmmod nvme_keyring 00:07:14.234 08:46:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:14.234 08:46:02 -- nvmf/common.sh@123 -- # set -e 00:07:14.234 08:46:02 -- nvmf/common.sh@124 -- # return 0 00:07:14.234 08:46:02 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:07:14.234 08:46:02 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:14.234 08:46:02 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:14.234 08:46:02 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:14.234 08:46:02 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:14.234 08:46:02 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:14.234 08:46:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:14.234 08:46:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:14.234 08:46:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:16.137 08:46:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:16.137 00:07:16.137 real 0m33.281s 00:07:16.137 user 1m51.998s 00:07:16.137 sys 0m5.535s 00:07:16.137 08:46:04 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:16.137 08:46:04 -- common/autotest_common.sh@10 -- # set +x 00:07:16.137 ************************************ 00:07:16.137 END TEST nvmf_filesystem 00:07:16.137 ************************************ 00:07:16.137 08:46:04 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:16.137 08:46:04 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:07:16.137 08:46:04 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:16.137 08:46:04 -- common/autotest_common.sh@10 -- # set +x 00:07:16.137 ************************************ 00:07:16.137 START TEST nvmf_discovery 00:07:16.137 ************************************ 00:07:16.137 08:46:04 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:16.395 * Looking for test storage... 00:07:16.395 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:16.395 08:46:04 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:16.395 08:46:04 -- nvmf/common.sh@7 -- # uname -s 00:07:16.395 08:46:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:16.395 08:46:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:16.395 08:46:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:16.395 08:46:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:16.395 08:46:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:16.395 08:46:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:16.395 08:46:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:16.395 08:46:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:16.395 08:46:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:16.395 08:46:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:16.395 08:46:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:16.395 08:46:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:16.395 08:46:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:16.395 08:46:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:16.395 08:46:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:16.395 08:46:04 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:16.395 08:46:04 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:16.395 08:46:04 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:16.395 08:46:04 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:16.395 08:46:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:16.395 08:46:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:16.395 08:46:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:16.395 08:46:04 -- paths/export.sh@5 -- # export PATH 00:07:16.395 08:46:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:16.395 08:46:04 -- nvmf/common.sh@46 -- # : 0 00:07:16.395 08:46:04 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:16.395 08:46:04 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:16.395 08:46:04 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:16.395 08:46:04 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:16.395 08:46:04 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:16.395 08:46:04 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:16.395 08:46:04 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:16.395 08:46:04 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:16.395 08:46:04 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:07:16.395 08:46:04 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:07:16.395 08:46:04 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:07:16.395 08:46:04 -- target/discovery.sh@15 -- # hash nvme 00:07:16.395 08:46:04 -- target/discovery.sh@20 -- # nvmftestinit 00:07:16.395 08:46:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:16.395 08:46:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:16.395 08:46:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:16.395 08:46:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:16.395 08:46:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:16.395 08:46:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:16.395 08:46:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:16.395 08:46:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:16.395 08:46:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:16.395 08:46:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:16.395 08:46:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:16.395 08:46:04 -- common/autotest_common.sh@10 -- # set +x 00:07:18.300 08:46:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:18.300 08:46:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:18.300 08:46:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:18.300 08:46:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:18.300 08:46:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:18.300 08:46:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:18.300 08:46:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:18.300 08:46:06 -- nvmf/common.sh@294 -- # net_devs=() 00:07:18.300 08:46:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:18.300 08:46:06 -- nvmf/common.sh@295 -- # e810=() 00:07:18.300 08:46:06 -- nvmf/common.sh@295 -- # local -ga e810 00:07:18.300 08:46:06 -- nvmf/common.sh@296 -- # x722=() 00:07:18.300 08:46:06 -- nvmf/common.sh@296 -- # local -ga x722 00:07:18.300 08:46:06 -- nvmf/common.sh@297 -- # mlx=() 00:07:18.300 08:46:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:18.300 08:46:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:18.300 08:46:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:18.300 08:46:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:18.300 08:46:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:18.300 08:46:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:18.300 08:46:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:18.300 08:46:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:18.300 08:46:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:18.300 08:46:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:18.300 08:46:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:18.300 08:46:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:18.300 08:46:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:18.300 08:46:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:18.300 08:46:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:18.300 08:46:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:18.300 08:46:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:18.300 08:46:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:18.300 08:46:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:18.300 08:46:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:18.300 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:18.300 08:46:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:18.300 08:46:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:18.300 08:46:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:18.300 08:46:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:18.300 08:46:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:18.300 08:46:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:18.300 08:46:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:18.300 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:18.300 08:46:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:18.300 08:46:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:18.300 08:46:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:18.300 08:46:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:18.300 08:46:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:18.300 08:46:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:18.300 08:46:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:18.300 08:46:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:18.300 08:46:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:18.300 08:46:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:18.300 08:46:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:18.300 08:46:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:18.300 08:46:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:18.300 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:18.300 08:46:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:18.300 08:46:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:18.300 08:46:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:18.300 08:46:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:18.300 08:46:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:18.300 08:46:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:18.300 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:18.300 08:46:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:18.300 08:46:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:18.300 08:46:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:18.300 08:46:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:18.300 08:46:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:18.300 08:46:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:18.300 08:46:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:18.300 08:46:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:18.300 08:46:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:18.300 08:46:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:18.300 08:46:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:18.300 08:46:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:18.300 08:46:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:18.300 08:46:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:18.300 08:46:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:18.300 08:46:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:18.300 08:46:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:18.300 08:46:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:18.300 08:46:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:18.300 08:46:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:18.300 08:46:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:18.300 08:46:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:18.300 08:46:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:18.559 08:46:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:18.559 08:46:06 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:18.559 08:46:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:18.559 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:18.559 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.204 ms 00:07:18.559 00:07:18.559 --- 10.0.0.2 ping statistics --- 00:07:18.559 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:18.559 rtt min/avg/max/mdev = 0.204/0.204/0.204/0.000 ms 00:07:18.559 08:46:06 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:18.559 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:18.559 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.120 ms 00:07:18.559 00:07:18.559 --- 10.0.0.1 ping statistics --- 00:07:18.559 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:18.559 rtt min/avg/max/mdev = 0.120/0.120/0.120/0.000 ms 00:07:18.559 08:46:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:18.559 08:46:06 -- nvmf/common.sh@410 -- # return 0 00:07:18.559 08:46:06 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:18.559 08:46:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:18.559 08:46:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:18.559 08:46:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:18.559 08:46:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:18.559 08:46:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:18.559 08:46:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:18.559 08:46:06 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:07:18.559 08:46:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:18.559 08:46:06 -- common/autotest_common.sh@712 -- # xtrace_disable 00:07:18.559 08:46:06 -- common/autotest_common.sh@10 -- # set +x 00:07:18.559 08:46:06 -- nvmf/common.sh@469 -- # nvmfpid=1407447 00:07:18.559 08:46:06 -- nvmf/common.sh@470 -- # waitforlisten 1407447 00:07:18.559 08:46:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:18.559 08:46:06 -- common/autotest_common.sh@819 -- # '[' -z 1407447 ']' 00:07:18.559 08:46:06 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:18.559 08:46:06 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:18.559 08:46:06 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:18.559 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:18.559 08:46:06 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:18.559 08:46:06 -- common/autotest_common.sh@10 -- # set +x 00:07:18.559 [2024-07-15 08:46:06.935834] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:07:18.559 [2024-07-15 08:46:06.935947] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:18.559 EAL: No free 2048 kB hugepages reported on node 1 00:07:18.559 [2024-07-15 08:46:06.999615] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:18.817 [2024-07-15 08:46:07.106767] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:18.817 [2024-07-15 08:46:07.106920] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:18.817 [2024-07-15 08:46:07.106939] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:18.817 [2024-07-15 08:46:07.106952] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:18.817 [2024-07-15 08:46:07.107007] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:18.817 [2024-07-15 08:46:07.107059] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:18.817 [2024-07-15 08:46:07.107085] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:18.817 [2024-07-15 08:46:07.107088] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:19.382 08:46:07 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:19.382 08:46:07 -- common/autotest_common.sh@852 -- # return 0 00:07:19.382 08:46:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:19.382 08:46:07 -- common/autotest_common.sh@718 -- # xtrace_disable 00:07:19.382 08:46:07 -- common/autotest_common.sh@10 -- # set +x 00:07:19.641 08:46:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:19.641 08:46:07 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:19.641 08:46:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:19.641 08:46:07 -- common/autotest_common.sh@10 -- # set +x 00:07:19.641 [2024-07-15 08:46:07.938491] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:19.641 08:46:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:19.641 08:46:07 -- target/discovery.sh@26 -- # seq 1 4 00:07:19.641 08:46:07 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:19.641 08:46:07 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:07:19.641 08:46:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:19.641 08:46:07 -- common/autotest_common.sh@10 -- # set +x 00:07:19.641 Null1 00:07:19.641 08:46:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:19.641 08:46:07 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:19.641 08:46:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:19.641 08:46:07 -- common/autotest_common.sh@10 -- # set +x 00:07:19.641 08:46:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:19.641 08:46:07 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:07:19.641 08:46:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:19.641 08:46:07 -- common/autotest_common.sh@10 -- # set +x 00:07:19.641 08:46:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:19.641 08:46:07 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:19.641 08:46:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:19.641 08:46:07 -- common/autotest_common.sh@10 -- # set +x 00:07:19.641 [2024-07-15 08:46:07.978765] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:19.641 08:46:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:19.641 08:46:07 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:19.641 08:46:07 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:07:19.641 08:46:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:19.641 08:46:07 -- common/autotest_common.sh@10 -- # set +x 00:07:19.641 Null2 00:07:19.641 08:46:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:19.641 08:46:07 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:07:19.641 08:46:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:19.641 08:46:07 -- common/autotest_common.sh@10 -- # set +x 00:07:19.641 08:46:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:19.641 08:46:07 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:07:19.641 08:46:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:19.641 08:46:07 -- common/autotest_common.sh@10 -- # set +x 00:07:19.641 08:46:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:19.641 08:46:08 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:07:19.641 08:46:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:19.641 08:46:08 -- common/autotest_common.sh@10 -- # set +x 00:07:19.641 08:46:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:19.641 08:46:08 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:19.641 08:46:08 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:07:19.641 08:46:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:19.641 08:46:08 -- common/autotest_common.sh@10 -- # set +x 00:07:19.641 Null3 00:07:19.641 08:46:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:19.641 08:46:08 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:07:19.641 08:46:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:19.641 08:46:08 -- common/autotest_common.sh@10 -- # set +x 00:07:19.641 08:46:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:19.641 08:46:08 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:07:19.641 08:46:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:19.641 08:46:08 -- common/autotest_common.sh@10 -- # set +x 00:07:19.641 08:46:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:19.641 08:46:08 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:07:19.641 08:46:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:19.641 08:46:08 -- common/autotest_common.sh@10 -- # set +x 00:07:19.641 08:46:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:19.641 08:46:08 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:19.641 08:46:08 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:07:19.641 08:46:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:19.641 08:46:08 -- common/autotest_common.sh@10 -- # set +x 00:07:19.641 Null4 00:07:19.641 08:46:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:19.641 08:46:08 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:07:19.641 08:46:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:19.641 08:46:08 -- common/autotest_common.sh@10 -- # set +x 00:07:19.641 08:46:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:19.641 08:46:08 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:07:19.641 08:46:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:19.641 08:46:08 -- common/autotest_common.sh@10 -- # set +x 00:07:19.641 08:46:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:19.641 08:46:08 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:07:19.641 08:46:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:19.641 08:46:08 -- common/autotest_common.sh@10 -- # set +x 00:07:19.641 08:46:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:19.641 08:46:08 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:07:19.641 08:46:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:19.641 08:46:08 -- common/autotest_common.sh@10 -- # set +x 00:07:19.641 08:46:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:19.641 08:46:08 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:07:19.641 08:46:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:19.641 08:46:08 -- common/autotest_common.sh@10 -- # set +x 00:07:19.641 08:46:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:19.641 08:46:08 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:07:19.900 00:07:19.900 Discovery Log Number of Records 6, Generation counter 6 00:07:19.900 =====Discovery Log Entry 0====== 00:07:19.900 trtype: tcp 00:07:19.900 adrfam: ipv4 00:07:19.900 subtype: current discovery subsystem 00:07:19.900 treq: not required 00:07:19.900 portid: 0 00:07:19.900 trsvcid: 4420 00:07:19.900 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:19.900 traddr: 10.0.0.2 00:07:19.900 eflags: explicit discovery connections, duplicate discovery information 00:07:19.900 sectype: none 00:07:19.900 =====Discovery Log Entry 1====== 00:07:19.900 trtype: tcp 00:07:19.900 adrfam: ipv4 00:07:19.900 subtype: nvme subsystem 00:07:19.900 treq: not required 00:07:19.900 portid: 0 00:07:19.900 trsvcid: 4420 00:07:19.900 subnqn: nqn.2016-06.io.spdk:cnode1 00:07:19.900 traddr: 10.0.0.2 00:07:19.900 eflags: none 00:07:19.900 sectype: none 00:07:19.900 =====Discovery Log Entry 2====== 00:07:19.900 trtype: tcp 00:07:19.900 adrfam: ipv4 00:07:19.900 subtype: nvme subsystem 00:07:19.900 treq: not required 00:07:19.900 portid: 0 00:07:19.900 trsvcid: 4420 00:07:19.900 subnqn: nqn.2016-06.io.spdk:cnode2 00:07:19.900 traddr: 10.0.0.2 00:07:19.900 eflags: none 00:07:19.900 sectype: none 00:07:19.900 =====Discovery Log Entry 3====== 00:07:19.900 trtype: tcp 00:07:19.900 adrfam: ipv4 00:07:19.900 subtype: nvme subsystem 00:07:19.900 treq: not required 00:07:19.900 portid: 0 00:07:19.900 trsvcid: 4420 00:07:19.900 subnqn: nqn.2016-06.io.spdk:cnode3 00:07:19.900 traddr: 10.0.0.2 00:07:19.900 eflags: none 00:07:19.900 sectype: none 00:07:19.900 =====Discovery Log Entry 4====== 00:07:19.900 trtype: tcp 00:07:19.900 adrfam: ipv4 00:07:19.900 subtype: nvme subsystem 00:07:19.900 treq: not required 00:07:19.900 portid: 0 00:07:19.900 trsvcid: 4420 00:07:19.900 subnqn: nqn.2016-06.io.spdk:cnode4 00:07:19.900 traddr: 10.0.0.2 00:07:19.900 eflags: none 00:07:19.900 sectype: none 00:07:19.900 =====Discovery Log Entry 5====== 00:07:19.900 trtype: tcp 00:07:19.900 adrfam: ipv4 00:07:19.900 subtype: discovery subsystem referral 00:07:19.900 treq: not required 00:07:19.900 portid: 0 00:07:19.900 trsvcid: 4430 00:07:19.900 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:19.900 traddr: 10.0.0.2 00:07:19.900 eflags: none 00:07:19.900 sectype: none 00:07:19.900 08:46:08 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:07:19.900 Perform nvmf subsystem discovery via RPC 00:07:19.900 08:46:08 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:07:19.900 08:46:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:19.900 08:46:08 -- common/autotest_common.sh@10 -- # set +x 00:07:19.900 [2024-07-15 08:46:08.311740] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:07:19.900 [ 00:07:19.900 { 00:07:19.900 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:07:19.900 "subtype": "Discovery", 00:07:19.900 "listen_addresses": [ 00:07:19.900 { 00:07:19.900 "transport": "TCP", 00:07:19.900 "trtype": "TCP", 00:07:19.900 "adrfam": "IPv4", 00:07:19.900 "traddr": "10.0.0.2", 00:07:19.900 "trsvcid": "4420" 00:07:19.900 } 00:07:19.900 ], 00:07:19.900 "allow_any_host": true, 00:07:19.900 "hosts": [] 00:07:19.900 }, 00:07:19.900 { 00:07:19.900 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:07:19.900 "subtype": "NVMe", 00:07:19.900 "listen_addresses": [ 00:07:19.900 { 00:07:19.900 "transport": "TCP", 00:07:19.900 "trtype": "TCP", 00:07:19.900 "adrfam": "IPv4", 00:07:19.900 "traddr": "10.0.0.2", 00:07:19.900 "trsvcid": "4420" 00:07:19.900 } 00:07:19.900 ], 00:07:19.900 "allow_any_host": true, 00:07:19.900 "hosts": [], 00:07:19.900 "serial_number": "SPDK00000000000001", 00:07:19.900 "model_number": "SPDK bdev Controller", 00:07:19.900 "max_namespaces": 32, 00:07:19.900 "min_cntlid": 1, 00:07:19.900 "max_cntlid": 65519, 00:07:19.900 "namespaces": [ 00:07:19.900 { 00:07:19.900 "nsid": 1, 00:07:19.900 "bdev_name": "Null1", 00:07:19.900 "name": "Null1", 00:07:19.900 "nguid": "D1F62A12327D402ABF7137ADD1F381E3", 00:07:19.900 "uuid": "d1f62a12-327d-402a-bf71-37add1f381e3" 00:07:19.900 } 00:07:19.900 ] 00:07:19.900 }, 00:07:19.900 { 00:07:19.900 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:07:19.900 "subtype": "NVMe", 00:07:19.900 "listen_addresses": [ 00:07:19.900 { 00:07:19.900 "transport": "TCP", 00:07:19.900 "trtype": "TCP", 00:07:19.900 "adrfam": "IPv4", 00:07:19.900 "traddr": "10.0.0.2", 00:07:19.900 "trsvcid": "4420" 00:07:19.900 } 00:07:19.900 ], 00:07:19.900 "allow_any_host": true, 00:07:19.900 "hosts": [], 00:07:19.900 "serial_number": "SPDK00000000000002", 00:07:19.900 "model_number": "SPDK bdev Controller", 00:07:19.900 "max_namespaces": 32, 00:07:19.900 "min_cntlid": 1, 00:07:19.900 "max_cntlid": 65519, 00:07:19.900 "namespaces": [ 00:07:19.900 { 00:07:19.900 "nsid": 1, 00:07:19.900 "bdev_name": "Null2", 00:07:19.900 "name": "Null2", 00:07:19.900 "nguid": "1964E719EC1A49A6ABFFB7FEA4272B07", 00:07:19.900 "uuid": "1964e719-ec1a-49a6-abff-b7fea4272b07" 00:07:19.900 } 00:07:19.900 ] 00:07:19.900 }, 00:07:19.900 { 00:07:19.900 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:07:19.900 "subtype": "NVMe", 00:07:19.900 "listen_addresses": [ 00:07:19.900 { 00:07:19.900 "transport": "TCP", 00:07:19.900 "trtype": "TCP", 00:07:19.900 "adrfam": "IPv4", 00:07:19.900 "traddr": "10.0.0.2", 00:07:19.900 "trsvcid": "4420" 00:07:19.900 } 00:07:19.900 ], 00:07:19.900 "allow_any_host": true, 00:07:19.900 "hosts": [], 00:07:19.900 "serial_number": "SPDK00000000000003", 00:07:19.900 "model_number": "SPDK bdev Controller", 00:07:19.900 "max_namespaces": 32, 00:07:19.900 "min_cntlid": 1, 00:07:19.900 "max_cntlid": 65519, 00:07:19.900 "namespaces": [ 00:07:19.900 { 00:07:19.900 "nsid": 1, 00:07:19.900 "bdev_name": "Null3", 00:07:19.900 "name": "Null3", 00:07:19.900 "nguid": "D272F07801EB439FB0B852A7CEA2A8D1", 00:07:19.900 "uuid": "d272f078-01eb-439f-b0b8-52a7cea2a8d1" 00:07:19.900 } 00:07:19.900 ] 00:07:19.900 }, 00:07:19.900 { 00:07:19.900 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:07:19.900 "subtype": "NVMe", 00:07:19.900 "listen_addresses": [ 00:07:19.900 { 00:07:19.900 "transport": "TCP", 00:07:19.900 "trtype": "TCP", 00:07:19.900 "adrfam": "IPv4", 00:07:19.900 "traddr": "10.0.0.2", 00:07:19.900 "trsvcid": "4420" 00:07:19.900 } 00:07:19.900 ], 00:07:19.900 "allow_any_host": true, 00:07:19.900 "hosts": [], 00:07:19.900 "serial_number": "SPDK00000000000004", 00:07:19.900 "model_number": "SPDK bdev Controller", 00:07:19.900 "max_namespaces": 32, 00:07:19.900 "min_cntlid": 1, 00:07:19.900 "max_cntlid": 65519, 00:07:19.900 "namespaces": [ 00:07:19.900 { 00:07:19.900 "nsid": 1, 00:07:19.900 "bdev_name": "Null4", 00:07:19.900 "name": "Null4", 00:07:19.900 "nguid": "9B6E6EFD266D4F3A8F0E0468FE743E0D", 00:07:19.900 "uuid": "9b6e6efd-266d-4f3a-8f0e-0468fe743e0d" 00:07:19.900 } 00:07:19.900 ] 00:07:19.900 } 00:07:19.900 ] 00:07:19.900 08:46:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:19.900 08:46:08 -- target/discovery.sh@42 -- # seq 1 4 00:07:19.900 08:46:08 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:19.900 08:46:08 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:19.900 08:46:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:19.900 08:46:08 -- common/autotest_common.sh@10 -- # set +x 00:07:19.900 08:46:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:19.900 08:46:08 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:07:19.900 08:46:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:19.900 08:46:08 -- common/autotest_common.sh@10 -- # set +x 00:07:19.900 08:46:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:19.900 08:46:08 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:19.900 08:46:08 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:07:19.900 08:46:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:19.900 08:46:08 -- common/autotest_common.sh@10 -- # set +x 00:07:19.900 08:46:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:19.901 08:46:08 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:07:19.901 08:46:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:19.901 08:46:08 -- common/autotest_common.sh@10 -- # set +x 00:07:19.901 08:46:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:19.901 08:46:08 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:19.901 08:46:08 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:07:19.901 08:46:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:19.901 08:46:08 -- common/autotest_common.sh@10 -- # set +x 00:07:19.901 08:46:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:19.901 08:46:08 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:07:19.901 08:46:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:19.901 08:46:08 -- common/autotest_common.sh@10 -- # set +x 00:07:19.901 08:46:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:19.901 08:46:08 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:19.901 08:46:08 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:07:19.901 08:46:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:19.901 08:46:08 -- common/autotest_common.sh@10 -- # set +x 00:07:19.901 08:46:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:19.901 08:46:08 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:07:19.901 08:46:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:19.901 08:46:08 -- common/autotest_common.sh@10 -- # set +x 00:07:19.901 08:46:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:19.901 08:46:08 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:07:19.901 08:46:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:19.901 08:46:08 -- common/autotest_common.sh@10 -- # set +x 00:07:19.901 08:46:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:19.901 08:46:08 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:07:19.901 08:46:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:19.901 08:46:08 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:07:19.901 08:46:08 -- common/autotest_common.sh@10 -- # set +x 00:07:19.901 08:46:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:19.901 08:46:08 -- target/discovery.sh@49 -- # check_bdevs= 00:07:19.901 08:46:08 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:07:19.901 08:46:08 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:07:19.901 08:46:08 -- target/discovery.sh@57 -- # nvmftestfini 00:07:19.901 08:46:08 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:19.901 08:46:08 -- nvmf/common.sh@116 -- # sync 00:07:19.901 08:46:08 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:19.901 08:46:08 -- nvmf/common.sh@119 -- # set +e 00:07:19.901 08:46:08 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:19.901 08:46:08 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:20.159 rmmod nvme_tcp 00:07:20.159 rmmod nvme_fabrics 00:07:20.159 rmmod nvme_keyring 00:07:20.159 08:46:08 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:20.159 08:46:08 -- nvmf/common.sh@123 -- # set -e 00:07:20.159 08:46:08 -- nvmf/common.sh@124 -- # return 0 00:07:20.159 08:46:08 -- nvmf/common.sh@477 -- # '[' -n 1407447 ']' 00:07:20.159 08:46:08 -- nvmf/common.sh@478 -- # killprocess 1407447 00:07:20.159 08:46:08 -- common/autotest_common.sh@926 -- # '[' -z 1407447 ']' 00:07:20.159 08:46:08 -- common/autotest_common.sh@930 -- # kill -0 1407447 00:07:20.159 08:46:08 -- common/autotest_common.sh@931 -- # uname 00:07:20.159 08:46:08 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:07:20.159 08:46:08 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1407447 00:07:20.159 08:46:08 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:07:20.159 08:46:08 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:07:20.159 08:46:08 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1407447' 00:07:20.159 killing process with pid 1407447 00:07:20.159 08:46:08 -- common/autotest_common.sh@945 -- # kill 1407447 00:07:20.159 [2024-07-15 08:46:08.518014] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:07:20.159 08:46:08 -- common/autotest_common.sh@950 -- # wait 1407447 00:07:20.419 08:46:08 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:20.419 08:46:08 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:20.419 08:46:08 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:20.419 08:46:08 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:20.419 08:46:08 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:20.419 08:46:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:20.419 08:46:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:20.419 08:46:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:22.328 08:46:10 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:22.328 00:07:22.328 real 0m6.175s 00:07:22.328 user 0m7.598s 00:07:22.328 sys 0m1.859s 00:07:22.328 08:46:10 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:22.328 08:46:10 -- common/autotest_common.sh@10 -- # set +x 00:07:22.328 ************************************ 00:07:22.328 END TEST nvmf_discovery 00:07:22.328 ************************************ 00:07:22.328 08:46:10 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:22.328 08:46:10 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:07:22.328 08:46:10 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:22.328 08:46:10 -- common/autotest_common.sh@10 -- # set +x 00:07:22.587 ************************************ 00:07:22.587 START TEST nvmf_referrals 00:07:22.587 ************************************ 00:07:22.587 08:46:10 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:22.587 * Looking for test storage... 00:07:22.587 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:22.587 08:46:10 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:22.587 08:46:10 -- nvmf/common.sh@7 -- # uname -s 00:07:22.587 08:46:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:22.587 08:46:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:22.587 08:46:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:22.587 08:46:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:22.587 08:46:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:22.587 08:46:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:22.587 08:46:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:22.587 08:46:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:22.587 08:46:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:22.587 08:46:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:22.587 08:46:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:22.587 08:46:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:22.587 08:46:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:22.587 08:46:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:22.587 08:46:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:22.588 08:46:10 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:22.588 08:46:10 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:22.588 08:46:10 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:22.588 08:46:10 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:22.588 08:46:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:22.588 08:46:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:22.588 08:46:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:22.588 08:46:10 -- paths/export.sh@5 -- # export PATH 00:07:22.588 08:46:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:22.588 08:46:10 -- nvmf/common.sh@46 -- # : 0 00:07:22.588 08:46:10 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:22.588 08:46:10 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:22.588 08:46:10 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:22.588 08:46:10 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:22.588 08:46:10 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:22.588 08:46:10 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:22.588 08:46:10 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:22.588 08:46:10 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:22.588 08:46:10 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:07:22.588 08:46:10 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:07:22.588 08:46:10 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:07:22.588 08:46:10 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:07:22.588 08:46:10 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:07:22.588 08:46:10 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:07:22.588 08:46:10 -- target/referrals.sh@37 -- # nvmftestinit 00:07:22.588 08:46:10 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:22.588 08:46:10 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:22.588 08:46:10 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:22.588 08:46:10 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:22.588 08:46:10 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:22.588 08:46:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:22.588 08:46:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:22.588 08:46:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:22.588 08:46:10 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:22.588 08:46:10 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:22.588 08:46:10 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:22.588 08:46:10 -- common/autotest_common.sh@10 -- # set +x 00:07:24.493 08:46:12 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:24.493 08:46:12 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:24.493 08:46:12 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:24.493 08:46:12 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:24.493 08:46:12 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:24.493 08:46:12 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:24.493 08:46:12 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:24.493 08:46:12 -- nvmf/common.sh@294 -- # net_devs=() 00:07:24.493 08:46:12 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:24.493 08:46:12 -- nvmf/common.sh@295 -- # e810=() 00:07:24.493 08:46:12 -- nvmf/common.sh@295 -- # local -ga e810 00:07:24.493 08:46:12 -- nvmf/common.sh@296 -- # x722=() 00:07:24.493 08:46:12 -- nvmf/common.sh@296 -- # local -ga x722 00:07:24.493 08:46:12 -- nvmf/common.sh@297 -- # mlx=() 00:07:24.493 08:46:12 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:24.493 08:46:12 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:24.494 08:46:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:24.494 08:46:12 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:24.494 08:46:12 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:24.494 08:46:12 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:24.494 08:46:12 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:24.494 08:46:12 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:24.494 08:46:12 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:24.494 08:46:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:24.494 08:46:12 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:24.494 08:46:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:24.494 08:46:12 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:24.494 08:46:12 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:24.494 08:46:12 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:24.494 08:46:12 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:24.494 08:46:12 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:24.494 08:46:12 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:24.494 08:46:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:24.494 08:46:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:24.494 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:24.494 08:46:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:24.494 08:46:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:24.494 08:46:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:24.494 08:46:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:24.494 08:46:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:24.494 08:46:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:24.494 08:46:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:24.494 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:24.494 08:46:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:24.494 08:46:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:24.494 08:46:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:24.494 08:46:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:24.494 08:46:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:24.494 08:46:12 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:24.494 08:46:12 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:24.494 08:46:12 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:24.494 08:46:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:24.494 08:46:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:24.494 08:46:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:24.494 08:46:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:24.494 08:46:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:24.494 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:24.494 08:46:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:24.494 08:46:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:24.494 08:46:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:24.494 08:46:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:24.494 08:46:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:24.494 08:46:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:24.494 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:24.494 08:46:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:24.494 08:46:12 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:24.494 08:46:12 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:24.494 08:46:12 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:24.494 08:46:12 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:24.494 08:46:12 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:24.494 08:46:12 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:24.494 08:46:12 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:24.494 08:46:12 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:24.494 08:46:12 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:24.494 08:46:12 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:24.494 08:46:12 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:24.494 08:46:12 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:24.494 08:46:12 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:24.494 08:46:12 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:24.494 08:46:12 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:24.494 08:46:12 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:24.494 08:46:12 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:24.494 08:46:12 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:24.494 08:46:13 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:24.494 08:46:13 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:24.494 08:46:13 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:24.494 08:46:13 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:24.753 08:46:13 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:24.753 08:46:13 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:24.753 08:46:13 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:24.753 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:24.753 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.125 ms 00:07:24.753 00:07:24.753 --- 10.0.0.2 ping statistics --- 00:07:24.753 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:24.753 rtt min/avg/max/mdev = 0.125/0.125/0.125/0.000 ms 00:07:24.753 08:46:13 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:24.753 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:24.753 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.119 ms 00:07:24.753 00:07:24.753 --- 10.0.0.1 ping statistics --- 00:07:24.753 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:24.753 rtt min/avg/max/mdev = 0.119/0.119/0.119/0.000 ms 00:07:24.753 08:46:13 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:24.753 08:46:13 -- nvmf/common.sh@410 -- # return 0 00:07:24.753 08:46:13 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:24.753 08:46:13 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:24.753 08:46:13 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:24.753 08:46:13 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:24.753 08:46:13 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:24.753 08:46:13 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:24.753 08:46:13 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:24.753 08:46:13 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:07:24.753 08:46:13 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:24.753 08:46:13 -- common/autotest_common.sh@712 -- # xtrace_disable 00:07:24.753 08:46:13 -- common/autotest_common.sh@10 -- # set +x 00:07:24.753 08:46:13 -- nvmf/common.sh@469 -- # nvmfpid=1409568 00:07:24.753 08:46:13 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:24.753 08:46:13 -- nvmf/common.sh@470 -- # waitforlisten 1409568 00:07:24.753 08:46:13 -- common/autotest_common.sh@819 -- # '[' -z 1409568 ']' 00:07:24.753 08:46:13 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:24.753 08:46:13 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:24.753 08:46:13 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:24.753 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:24.753 08:46:13 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:24.753 08:46:13 -- common/autotest_common.sh@10 -- # set +x 00:07:24.753 [2024-07-15 08:46:13.155946] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:07:24.753 [2024-07-15 08:46:13.156012] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:24.753 EAL: No free 2048 kB hugepages reported on node 1 00:07:24.753 [2024-07-15 08:46:13.225673] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:25.011 [2024-07-15 08:46:13.349231] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:25.011 [2024-07-15 08:46:13.349393] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:25.011 [2024-07-15 08:46:13.349413] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:25.011 [2024-07-15 08:46:13.349428] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:25.011 [2024-07-15 08:46:13.349516] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:25.011 [2024-07-15 08:46:13.349570] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:25.011 [2024-07-15 08:46:13.349621] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:25.011 [2024-07-15 08:46:13.349624] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:25.943 08:46:14 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:25.943 08:46:14 -- common/autotest_common.sh@852 -- # return 0 00:07:25.943 08:46:14 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:25.943 08:46:14 -- common/autotest_common.sh@718 -- # xtrace_disable 00:07:25.943 08:46:14 -- common/autotest_common.sh@10 -- # set +x 00:07:25.943 08:46:14 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:25.943 08:46:14 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:25.943 08:46:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:25.943 08:46:14 -- common/autotest_common.sh@10 -- # set +x 00:07:25.943 [2024-07-15 08:46:14.180514] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:25.943 08:46:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:25.943 08:46:14 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:07:25.943 08:46:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:25.943 08:46:14 -- common/autotest_common.sh@10 -- # set +x 00:07:25.943 [2024-07-15 08:46:14.192699] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:07:25.943 08:46:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:25.943 08:46:14 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:07:25.943 08:46:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:25.943 08:46:14 -- common/autotest_common.sh@10 -- # set +x 00:07:25.943 08:46:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:25.943 08:46:14 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:07:25.943 08:46:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:25.943 08:46:14 -- common/autotest_common.sh@10 -- # set +x 00:07:25.943 08:46:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:25.943 08:46:14 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:07:25.943 08:46:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:25.943 08:46:14 -- common/autotest_common.sh@10 -- # set +x 00:07:25.943 08:46:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:25.943 08:46:14 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:25.943 08:46:14 -- target/referrals.sh@48 -- # jq length 00:07:25.943 08:46:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:25.943 08:46:14 -- common/autotest_common.sh@10 -- # set +x 00:07:25.943 08:46:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:25.943 08:46:14 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:07:25.944 08:46:14 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:07:25.944 08:46:14 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:25.944 08:46:14 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:25.944 08:46:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:25.944 08:46:14 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:25.944 08:46:14 -- common/autotest_common.sh@10 -- # set +x 00:07:25.944 08:46:14 -- target/referrals.sh@21 -- # sort 00:07:25.944 08:46:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:25.944 08:46:14 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:25.944 08:46:14 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:25.944 08:46:14 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:07:25.944 08:46:14 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:25.944 08:46:14 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:25.944 08:46:14 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:25.944 08:46:14 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:25.944 08:46:14 -- target/referrals.sh@26 -- # sort 00:07:26.202 08:46:14 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:26.202 08:46:14 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:26.202 08:46:14 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:07:26.202 08:46:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:26.202 08:46:14 -- common/autotest_common.sh@10 -- # set +x 00:07:26.202 08:46:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:26.202 08:46:14 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:07:26.202 08:46:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:26.202 08:46:14 -- common/autotest_common.sh@10 -- # set +x 00:07:26.202 08:46:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:26.202 08:46:14 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:07:26.202 08:46:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:26.202 08:46:14 -- common/autotest_common.sh@10 -- # set +x 00:07:26.202 08:46:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:26.202 08:46:14 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:26.202 08:46:14 -- target/referrals.sh@56 -- # jq length 00:07:26.202 08:46:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:26.202 08:46:14 -- common/autotest_common.sh@10 -- # set +x 00:07:26.202 08:46:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:26.202 08:46:14 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:07:26.202 08:46:14 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:07:26.202 08:46:14 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:26.202 08:46:14 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:26.202 08:46:14 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:26.202 08:46:14 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:26.202 08:46:14 -- target/referrals.sh@26 -- # sort 00:07:26.202 08:46:14 -- target/referrals.sh@26 -- # echo 00:07:26.202 08:46:14 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:07:26.202 08:46:14 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:07:26.202 08:46:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:26.202 08:46:14 -- common/autotest_common.sh@10 -- # set +x 00:07:26.202 08:46:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:26.202 08:46:14 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:26.202 08:46:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:26.202 08:46:14 -- common/autotest_common.sh@10 -- # set +x 00:07:26.202 08:46:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:26.202 08:46:14 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:07:26.202 08:46:14 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:26.202 08:46:14 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:26.202 08:46:14 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:26.202 08:46:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:26.202 08:46:14 -- common/autotest_common.sh@10 -- # set +x 00:07:26.202 08:46:14 -- target/referrals.sh@21 -- # sort 00:07:26.202 08:46:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:26.202 08:46:14 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:07:26.202 08:46:14 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:26.202 08:46:14 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:07:26.202 08:46:14 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:26.202 08:46:14 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:26.202 08:46:14 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:26.202 08:46:14 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:26.202 08:46:14 -- target/referrals.sh@26 -- # sort 00:07:26.459 08:46:14 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:07:26.459 08:46:14 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:26.459 08:46:14 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:07:26.459 08:46:14 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:26.459 08:46:14 -- target/referrals.sh@67 -- # jq -r .subnqn 00:07:26.459 08:46:14 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:26.459 08:46:14 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:26.717 08:46:15 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:07:26.717 08:46:15 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:07:26.717 08:46:15 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:26.717 08:46:15 -- target/referrals.sh@68 -- # jq -r .subnqn 00:07:26.717 08:46:15 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:26.717 08:46:15 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:26.717 08:46:15 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:26.717 08:46:15 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:26.717 08:46:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:26.717 08:46:15 -- common/autotest_common.sh@10 -- # set +x 00:07:26.717 08:46:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:26.717 08:46:15 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:07:26.717 08:46:15 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:26.717 08:46:15 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:26.717 08:46:15 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:26.717 08:46:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:26.717 08:46:15 -- common/autotest_common.sh@10 -- # set +x 00:07:26.717 08:46:15 -- target/referrals.sh@21 -- # sort 00:07:26.717 08:46:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:26.717 08:46:15 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:07:26.717 08:46:15 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:26.974 08:46:15 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:07:26.974 08:46:15 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:26.974 08:46:15 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:26.974 08:46:15 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:26.974 08:46:15 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:26.974 08:46:15 -- target/referrals.sh@26 -- # sort 00:07:26.974 08:46:15 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:07:26.974 08:46:15 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:26.974 08:46:15 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:07:26.974 08:46:15 -- target/referrals.sh@75 -- # jq -r .subnqn 00:07:26.974 08:46:15 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:26.975 08:46:15 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:26.975 08:46:15 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:27.232 08:46:15 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:07:27.232 08:46:15 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:07:27.232 08:46:15 -- target/referrals.sh@76 -- # jq -r .subnqn 00:07:27.232 08:46:15 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:27.232 08:46:15 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:27.232 08:46:15 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:27.232 08:46:15 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:27.232 08:46:15 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:07:27.232 08:46:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:27.232 08:46:15 -- common/autotest_common.sh@10 -- # set +x 00:07:27.232 08:46:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:27.232 08:46:15 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:27.232 08:46:15 -- target/referrals.sh@82 -- # jq length 00:07:27.232 08:46:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:27.232 08:46:15 -- common/autotest_common.sh@10 -- # set +x 00:07:27.232 08:46:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:27.232 08:46:15 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:07:27.232 08:46:15 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:07:27.232 08:46:15 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:27.232 08:46:15 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:27.232 08:46:15 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:27.232 08:46:15 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:27.232 08:46:15 -- target/referrals.sh@26 -- # sort 00:07:27.232 08:46:15 -- target/referrals.sh@26 -- # echo 00:07:27.232 08:46:15 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:07:27.232 08:46:15 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:07:27.232 08:46:15 -- target/referrals.sh@86 -- # nvmftestfini 00:07:27.232 08:46:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:27.232 08:46:15 -- nvmf/common.sh@116 -- # sync 00:07:27.490 08:46:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:27.490 08:46:15 -- nvmf/common.sh@119 -- # set +e 00:07:27.490 08:46:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:27.490 08:46:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:27.490 rmmod nvme_tcp 00:07:27.490 rmmod nvme_fabrics 00:07:27.490 rmmod nvme_keyring 00:07:27.490 08:46:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:27.490 08:46:15 -- nvmf/common.sh@123 -- # set -e 00:07:27.490 08:46:15 -- nvmf/common.sh@124 -- # return 0 00:07:27.490 08:46:15 -- nvmf/common.sh@477 -- # '[' -n 1409568 ']' 00:07:27.490 08:46:15 -- nvmf/common.sh@478 -- # killprocess 1409568 00:07:27.490 08:46:15 -- common/autotest_common.sh@926 -- # '[' -z 1409568 ']' 00:07:27.490 08:46:15 -- common/autotest_common.sh@930 -- # kill -0 1409568 00:07:27.490 08:46:15 -- common/autotest_common.sh@931 -- # uname 00:07:27.490 08:46:15 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:07:27.490 08:46:15 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1409568 00:07:27.490 08:46:15 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:07:27.490 08:46:15 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:07:27.490 08:46:15 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1409568' 00:07:27.490 killing process with pid 1409568 00:07:27.490 08:46:15 -- common/autotest_common.sh@945 -- # kill 1409568 00:07:27.490 08:46:15 -- common/autotest_common.sh@950 -- # wait 1409568 00:07:27.749 08:46:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:27.749 08:46:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:27.749 08:46:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:27.749 08:46:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:27.749 08:46:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:27.749 08:46:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:27.750 08:46:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:27.750 08:46:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:29.719 08:46:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:29.719 00:07:29.719 real 0m7.313s 00:07:29.719 user 0m12.614s 00:07:29.719 sys 0m2.166s 00:07:29.719 08:46:18 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:29.719 08:46:18 -- common/autotest_common.sh@10 -- # set +x 00:07:29.719 ************************************ 00:07:29.719 END TEST nvmf_referrals 00:07:29.719 ************************************ 00:07:29.719 08:46:18 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:29.719 08:46:18 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:07:29.719 08:46:18 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:29.719 08:46:18 -- common/autotest_common.sh@10 -- # set +x 00:07:29.719 ************************************ 00:07:29.719 START TEST nvmf_connect_disconnect 00:07:29.719 ************************************ 00:07:29.719 08:46:18 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:29.978 * Looking for test storage... 00:07:29.978 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:29.978 08:46:18 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:29.978 08:46:18 -- nvmf/common.sh@7 -- # uname -s 00:07:29.978 08:46:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:29.978 08:46:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:29.978 08:46:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:29.978 08:46:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:29.978 08:46:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:29.978 08:46:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:29.978 08:46:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:29.978 08:46:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:29.978 08:46:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:29.978 08:46:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:29.978 08:46:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:29.978 08:46:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:29.978 08:46:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:29.978 08:46:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:29.978 08:46:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:29.978 08:46:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:29.978 08:46:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:29.978 08:46:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:29.978 08:46:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:29.978 08:46:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:29.978 08:46:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:29.978 08:46:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:29.978 08:46:18 -- paths/export.sh@5 -- # export PATH 00:07:29.978 08:46:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:29.978 08:46:18 -- nvmf/common.sh@46 -- # : 0 00:07:29.978 08:46:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:29.978 08:46:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:29.978 08:46:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:29.978 08:46:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:29.978 08:46:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:29.978 08:46:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:29.978 08:46:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:29.978 08:46:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:29.978 08:46:18 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:07:29.978 08:46:18 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:07:29.978 08:46:18 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:07:29.978 08:46:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:29.978 08:46:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:29.978 08:46:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:29.978 08:46:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:29.978 08:46:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:29.978 08:46:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:29.978 08:46:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:29.978 08:46:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:29.978 08:46:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:29.978 08:46:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:29.978 08:46:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:29.978 08:46:18 -- common/autotest_common.sh@10 -- # set +x 00:07:31.879 08:46:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:31.879 08:46:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:31.879 08:46:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:31.879 08:46:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:31.879 08:46:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:31.879 08:46:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:31.879 08:46:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:31.879 08:46:20 -- nvmf/common.sh@294 -- # net_devs=() 00:07:31.879 08:46:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:31.879 08:46:20 -- nvmf/common.sh@295 -- # e810=() 00:07:31.879 08:46:20 -- nvmf/common.sh@295 -- # local -ga e810 00:07:31.880 08:46:20 -- nvmf/common.sh@296 -- # x722=() 00:07:31.880 08:46:20 -- nvmf/common.sh@296 -- # local -ga x722 00:07:31.880 08:46:20 -- nvmf/common.sh@297 -- # mlx=() 00:07:31.880 08:46:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:31.880 08:46:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:31.880 08:46:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:31.880 08:46:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:31.880 08:46:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:31.880 08:46:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:31.880 08:46:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:31.880 08:46:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:31.880 08:46:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:31.880 08:46:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:31.880 08:46:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:31.880 08:46:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:31.880 08:46:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:31.880 08:46:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:31.880 08:46:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:31.880 08:46:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:31.880 08:46:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:31.880 08:46:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:31.880 08:46:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:31.880 08:46:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:31.880 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:31.880 08:46:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:31.880 08:46:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:31.880 08:46:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:31.880 08:46:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:31.880 08:46:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:31.880 08:46:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:31.880 08:46:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:31.880 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:31.880 08:46:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:31.880 08:46:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:31.880 08:46:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:31.880 08:46:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:31.880 08:46:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:31.880 08:46:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:31.880 08:46:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:31.880 08:46:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:31.880 08:46:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:31.880 08:46:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:31.880 08:46:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:31.880 08:46:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:31.880 08:46:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:31.880 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:31.880 08:46:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:31.880 08:46:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:31.880 08:46:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:31.880 08:46:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:31.880 08:46:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:31.880 08:46:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:31.880 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:31.880 08:46:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:31.880 08:46:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:31.880 08:46:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:31.880 08:46:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:31.880 08:46:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:31.880 08:46:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:31.880 08:46:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:31.880 08:46:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:31.880 08:46:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:31.880 08:46:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:31.880 08:46:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:31.880 08:46:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:31.880 08:46:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:31.880 08:46:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:31.880 08:46:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:31.880 08:46:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:31.880 08:46:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:31.880 08:46:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:31.880 08:46:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:31.880 08:46:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:31.880 08:46:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:31.880 08:46:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:31.880 08:46:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:32.138 08:46:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:32.138 08:46:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:32.138 08:46:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:32.138 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:32.138 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.259 ms 00:07:32.138 00:07:32.138 --- 10.0.0.2 ping statistics --- 00:07:32.138 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:32.138 rtt min/avg/max/mdev = 0.259/0.259/0.259/0.000 ms 00:07:32.138 08:46:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:32.138 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:32.138 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.137 ms 00:07:32.138 00:07:32.138 --- 10.0.0.1 ping statistics --- 00:07:32.138 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:32.138 rtt min/avg/max/mdev = 0.137/0.137/0.137/0.000 ms 00:07:32.138 08:46:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:32.138 08:46:20 -- nvmf/common.sh@410 -- # return 0 00:07:32.138 08:46:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:32.138 08:46:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:32.138 08:46:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:32.138 08:46:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:32.138 08:46:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:32.138 08:46:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:32.138 08:46:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:32.138 08:46:20 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:07:32.138 08:46:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:32.138 08:46:20 -- common/autotest_common.sh@712 -- # xtrace_disable 00:07:32.138 08:46:20 -- common/autotest_common.sh@10 -- # set +x 00:07:32.138 08:46:20 -- nvmf/common.sh@469 -- # nvmfpid=1412008 00:07:32.138 08:46:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:32.138 08:46:20 -- nvmf/common.sh@470 -- # waitforlisten 1412008 00:07:32.138 08:46:20 -- common/autotest_common.sh@819 -- # '[' -z 1412008 ']' 00:07:32.138 08:46:20 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:32.138 08:46:20 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:32.138 08:46:20 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:32.138 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:32.138 08:46:20 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:32.138 08:46:20 -- common/autotest_common.sh@10 -- # set +x 00:07:32.138 [2024-07-15 08:46:20.533764] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:07:32.138 [2024-07-15 08:46:20.533855] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:32.138 EAL: No free 2048 kB hugepages reported on node 1 00:07:32.138 [2024-07-15 08:46:20.599056] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:32.397 [2024-07-15 08:46:20.710353] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:32.397 [2024-07-15 08:46:20.710503] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:32.397 [2024-07-15 08:46:20.710534] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:32.397 [2024-07-15 08:46:20.710547] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:32.397 [2024-07-15 08:46:20.710631] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:32.397 [2024-07-15 08:46:20.710698] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:32.397 [2024-07-15 08:46:20.710746] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:32.397 [2024-07-15 08:46:20.710748] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:33.326 08:46:21 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:33.326 08:46:21 -- common/autotest_common.sh@852 -- # return 0 00:07:33.326 08:46:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:33.326 08:46:21 -- common/autotest_common.sh@718 -- # xtrace_disable 00:07:33.326 08:46:21 -- common/autotest_common.sh@10 -- # set +x 00:07:33.326 08:46:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:33.326 08:46:21 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:07:33.326 08:46:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:33.326 08:46:21 -- common/autotest_common.sh@10 -- # set +x 00:07:33.326 [2024-07-15 08:46:21.527460] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:33.326 08:46:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:33.326 08:46:21 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:07:33.326 08:46:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:33.326 08:46:21 -- common/autotest_common.sh@10 -- # set +x 00:07:33.326 08:46:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:33.326 08:46:21 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:07:33.326 08:46:21 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:33.326 08:46:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:33.326 08:46:21 -- common/autotest_common.sh@10 -- # set +x 00:07:33.326 08:46:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:33.326 08:46:21 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:33.326 08:46:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:33.326 08:46:21 -- common/autotest_common.sh@10 -- # set +x 00:07:33.326 08:46:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:33.326 08:46:21 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:33.326 08:46:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:33.326 08:46:21 -- common/autotest_common.sh@10 -- # set +x 00:07:33.326 [2024-07-15 08:46:21.578487] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:33.326 08:46:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:33.326 08:46:21 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:07:33.326 08:46:21 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:07:33.326 08:46:21 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:07:33.326 08:46:21 -- target/connect_disconnect.sh@34 -- # set +x 00:07:35.851 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:37.742 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:40.264 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:42.789 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:45.312 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:47.209 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:49.787 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:51.683 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:54.209 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:56.731 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:58.626 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:01.153 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:03.676 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:06.205 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:08.162 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:10.741 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:12.639 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:15.188 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:17.711 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:19.607 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:22.131 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:24.030 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:26.553 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:29.115 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:31.010 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:33.533 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:36.058 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:38.593 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:40.485 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:43.012 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:44.909 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:47.431 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:50.013 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:52.534 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:54.426 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:56.949 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:59.474 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:01.371 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:03.898 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:05.794 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:08.320 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:10.877 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:12.774 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:15.294 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:17.813 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:19.707 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:22.242 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:24.765 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:26.661 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:29.189 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:31.753 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:33.650 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:36.175 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:38.701 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:40.598 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:43.122 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:45.645 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:47.540 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:50.112 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:52.634 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:54.529 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:57.052 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:59.581 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:01.482 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:04.009 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:06.532 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:08.429 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:10.984 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:13.506 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:15.409 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:17.930 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:20.453 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:22.351 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:24.874 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:26.763 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:29.284 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:31.211 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:33.737 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:36.263 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:38.787 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:40.680 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:43.202 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:45.726 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:48.252 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:50.778 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:52.711 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:55.237 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:57.134 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:59.659 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:02.187 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:04.084 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:06.606 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:09.124 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:11.668 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:13.567 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:16.089 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:18.616 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:20.513 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:23.038 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:25.562 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:25.562 08:50:13 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:11:25.562 08:50:13 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:11:25.562 08:50:13 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:25.562 08:50:13 -- nvmf/common.sh@116 -- # sync 00:11:25.562 08:50:13 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:25.562 08:50:13 -- nvmf/common.sh@119 -- # set +e 00:11:25.562 08:50:13 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:25.562 08:50:13 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:25.562 rmmod nvme_tcp 00:11:25.562 rmmod nvme_fabrics 00:11:25.562 rmmod nvme_keyring 00:11:25.562 08:50:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:25.562 08:50:13 -- nvmf/common.sh@123 -- # set -e 00:11:25.562 08:50:13 -- nvmf/common.sh@124 -- # return 0 00:11:25.562 08:50:13 -- nvmf/common.sh@477 -- # '[' -n 1412008 ']' 00:11:25.562 08:50:13 -- nvmf/common.sh@478 -- # killprocess 1412008 00:11:25.562 08:50:13 -- common/autotest_common.sh@926 -- # '[' -z 1412008 ']' 00:11:25.562 08:50:13 -- common/autotest_common.sh@930 -- # kill -0 1412008 00:11:25.562 08:50:13 -- common/autotest_common.sh@931 -- # uname 00:11:25.562 08:50:13 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:11:25.562 08:50:13 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1412008 00:11:25.562 08:50:13 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:11:25.562 08:50:13 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:11:25.562 08:50:13 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1412008' 00:11:25.562 killing process with pid 1412008 00:11:25.562 08:50:13 -- common/autotest_common.sh@945 -- # kill 1412008 00:11:25.562 08:50:13 -- common/autotest_common.sh@950 -- # wait 1412008 00:11:25.562 08:50:14 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:25.562 08:50:14 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:25.562 08:50:14 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:25.562 08:50:14 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:25.562 08:50:14 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:25.562 08:50:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:25.562 08:50:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:25.562 08:50:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:28.095 08:50:16 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:28.095 00:11:28.095 real 3m57.885s 00:11:28.095 user 15m6.133s 00:11:28.095 sys 0m34.712s 00:11:28.095 08:50:16 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:11:28.095 08:50:16 -- common/autotest_common.sh@10 -- # set +x 00:11:28.095 ************************************ 00:11:28.095 END TEST nvmf_connect_disconnect 00:11:28.095 ************************************ 00:11:28.095 08:50:16 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:28.095 08:50:16 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:11:28.095 08:50:16 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:11:28.095 08:50:16 -- common/autotest_common.sh@10 -- # set +x 00:11:28.095 ************************************ 00:11:28.095 START TEST nvmf_multitarget 00:11:28.095 ************************************ 00:11:28.095 08:50:16 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:28.095 * Looking for test storage... 00:11:28.095 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:28.095 08:50:16 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:28.095 08:50:16 -- nvmf/common.sh@7 -- # uname -s 00:11:28.095 08:50:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:28.095 08:50:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:28.095 08:50:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:28.095 08:50:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:28.095 08:50:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:28.095 08:50:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:28.095 08:50:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:28.095 08:50:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:28.095 08:50:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:28.095 08:50:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:28.095 08:50:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:28.095 08:50:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:28.095 08:50:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:28.095 08:50:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:28.095 08:50:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:28.095 08:50:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:28.095 08:50:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:28.095 08:50:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:28.095 08:50:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:28.095 08:50:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:28.095 08:50:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:28.095 08:50:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:28.095 08:50:16 -- paths/export.sh@5 -- # export PATH 00:11:28.095 08:50:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:28.095 08:50:16 -- nvmf/common.sh@46 -- # : 0 00:11:28.095 08:50:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:28.095 08:50:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:28.095 08:50:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:28.095 08:50:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:28.095 08:50:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:28.095 08:50:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:28.095 08:50:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:28.095 08:50:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:28.095 08:50:16 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:11:28.095 08:50:16 -- target/multitarget.sh@15 -- # nvmftestinit 00:11:28.095 08:50:16 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:28.095 08:50:16 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:28.095 08:50:16 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:28.095 08:50:16 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:28.095 08:50:16 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:28.095 08:50:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:28.095 08:50:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:28.095 08:50:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:28.095 08:50:16 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:28.095 08:50:16 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:28.095 08:50:16 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:28.095 08:50:16 -- common/autotest_common.sh@10 -- # set +x 00:11:29.998 08:50:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:29.998 08:50:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:29.998 08:50:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:29.999 08:50:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:29.999 08:50:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:29.999 08:50:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:29.999 08:50:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:29.999 08:50:18 -- nvmf/common.sh@294 -- # net_devs=() 00:11:29.999 08:50:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:29.999 08:50:18 -- nvmf/common.sh@295 -- # e810=() 00:11:29.999 08:50:18 -- nvmf/common.sh@295 -- # local -ga e810 00:11:29.999 08:50:18 -- nvmf/common.sh@296 -- # x722=() 00:11:29.999 08:50:18 -- nvmf/common.sh@296 -- # local -ga x722 00:11:29.999 08:50:18 -- nvmf/common.sh@297 -- # mlx=() 00:11:29.999 08:50:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:29.999 08:50:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:29.999 08:50:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:29.999 08:50:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:29.999 08:50:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:29.999 08:50:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:29.999 08:50:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:29.999 08:50:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:29.999 08:50:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:29.999 08:50:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:29.999 08:50:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:29.999 08:50:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:29.999 08:50:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:29.999 08:50:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:29.999 08:50:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:29.999 08:50:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:29.999 08:50:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:29.999 08:50:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:29.999 08:50:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:29.999 08:50:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:29.999 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:29.999 08:50:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:29.999 08:50:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:29.999 08:50:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:29.999 08:50:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:29.999 08:50:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:29.999 08:50:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:29.999 08:50:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:29.999 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:29.999 08:50:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:29.999 08:50:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:29.999 08:50:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:29.999 08:50:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:29.999 08:50:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:29.999 08:50:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:29.999 08:50:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:29.999 08:50:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:29.999 08:50:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:29.999 08:50:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:29.999 08:50:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:29.999 08:50:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:29.999 08:50:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:29.999 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:29.999 08:50:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:29.999 08:50:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:29.999 08:50:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:29.999 08:50:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:29.999 08:50:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:29.999 08:50:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:29.999 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:29.999 08:50:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:29.999 08:50:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:29.999 08:50:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:29.999 08:50:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:29.999 08:50:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:29.999 08:50:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:29.999 08:50:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:29.999 08:50:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:29.999 08:50:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:29.999 08:50:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:29.999 08:50:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:29.999 08:50:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:29.999 08:50:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:29.999 08:50:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:29.999 08:50:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:29.999 08:50:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:29.999 08:50:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:29.999 08:50:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:29.999 08:50:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:29.999 08:50:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:29.999 08:50:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:29.999 08:50:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:29.999 08:50:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:29.999 08:50:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:29.999 08:50:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:29.999 08:50:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:29.999 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:29.999 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.190 ms 00:11:29.999 00:11:29.999 --- 10.0.0.2 ping statistics --- 00:11:29.999 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:29.999 rtt min/avg/max/mdev = 0.190/0.190/0.190/0.000 ms 00:11:29.999 08:50:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:29.999 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:29.999 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.111 ms 00:11:29.999 00:11:29.999 --- 10.0.0.1 ping statistics --- 00:11:29.999 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:29.999 rtt min/avg/max/mdev = 0.111/0.111/0.111/0.000 ms 00:11:29.999 08:50:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:29.999 08:50:18 -- nvmf/common.sh@410 -- # return 0 00:11:29.999 08:50:18 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:29.999 08:50:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:29.999 08:50:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:29.999 08:50:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:29.999 08:50:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:29.999 08:50:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:29.999 08:50:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:29.999 08:50:18 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:11:29.999 08:50:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:29.999 08:50:18 -- common/autotest_common.sh@712 -- # xtrace_disable 00:11:29.999 08:50:18 -- common/autotest_common.sh@10 -- # set +x 00:11:29.999 08:50:18 -- nvmf/common.sh@469 -- # nvmfpid=1444162 00:11:29.999 08:50:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:29.999 08:50:18 -- nvmf/common.sh@470 -- # waitforlisten 1444162 00:11:29.999 08:50:18 -- common/autotest_common.sh@819 -- # '[' -z 1444162 ']' 00:11:29.999 08:50:18 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:29.999 08:50:18 -- common/autotest_common.sh@824 -- # local max_retries=100 00:11:29.999 08:50:18 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:29.999 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:29.999 08:50:18 -- common/autotest_common.sh@828 -- # xtrace_disable 00:11:29.999 08:50:18 -- common/autotest_common.sh@10 -- # set +x 00:11:29.999 [2024-07-15 08:50:18.400194] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:11:29.999 [2024-07-15 08:50:18.400272] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:29.999 EAL: No free 2048 kB hugepages reported on node 1 00:11:29.999 [2024-07-15 08:50:18.469670] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:30.259 [2024-07-15 08:50:18.589700] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:30.259 [2024-07-15 08:50:18.589865] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:30.259 [2024-07-15 08:50:18.589895] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:30.259 [2024-07-15 08:50:18.589910] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:30.259 [2024-07-15 08:50:18.589984] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:30.259 [2024-07-15 08:50:18.590013] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:30.259 [2024-07-15 08:50:18.590073] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:30.259 [2024-07-15 08:50:18.590077] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:30.825 08:50:19 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:11:30.825 08:50:19 -- common/autotest_common.sh@852 -- # return 0 00:11:30.825 08:50:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:30.825 08:50:19 -- common/autotest_common.sh@718 -- # xtrace_disable 00:11:30.825 08:50:19 -- common/autotest_common.sh@10 -- # set +x 00:11:31.093 08:50:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:31.093 08:50:19 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:11:31.093 08:50:19 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:31.093 08:50:19 -- target/multitarget.sh@21 -- # jq length 00:11:31.093 08:50:19 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:11:31.093 08:50:19 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:11:31.093 "nvmf_tgt_1" 00:11:31.093 08:50:19 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:11:31.357 "nvmf_tgt_2" 00:11:31.357 08:50:19 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:31.357 08:50:19 -- target/multitarget.sh@28 -- # jq length 00:11:31.357 08:50:19 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:11:31.357 08:50:19 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:11:31.614 true 00:11:31.614 08:50:19 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:11:31.614 true 00:11:31.614 08:50:20 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:31.614 08:50:20 -- target/multitarget.sh@35 -- # jq length 00:11:31.871 08:50:20 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:11:31.871 08:50:20 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:11:31.871 08:50:20 -- target/multitarget.sh@41 -- # nvmftestfini 00:11:31.871 08:50:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:31.871 08:50:20 -- nvmf/common.sh@116 -- # sync 00:11:31.871 08:50:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:31.871 08:50:20 -- nvmf/common.sh@119 -- # set +e 00:11:31.871 08:50:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:31.871 08:50:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:31.871 rmmod nvme_tcp 00:11:31.871 rmmod nvme_fabrics 00:11:31.871 rmmod nvme_keyring 00:11:31.871 08:50:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:31.871 08:50:20 -- nvmf/common.sh@123 -- # set -e 00:11:31.871 08:50:20 -- nvmf/common.sh@124 -- # return 0 00:11:31.871 08:50:20 -- nvmf/common.sh@477 -- # '[' -n 1444162 ']' 00:11:31.871 08:50:20 -- nvmf/common.sh@478 -- # killprocess 1444162 00:11:31.871 08:50:20 -- common/autotest_common.sh@926 -- # '[' -z 1444162 ']' 00:11:31.871 08:50:20 -- common/autotest_common.sh@930 -- # kill -0 1444162 00:11:31.871 08:50:20 -- common/autotest_common.sh@931 -- # uname 00:11:31.871 08:50:20 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:11:31.871 08:50:20 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1444162 00:11:31.871 08:50:20 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:11:31.871 08:50:20 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:11:31.871 08:50:20 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1444162' 00:11:31.871 killing process with pid 1444162 00:11:31.871 08:50:20 -- common/autotest_common.sh@945 -- # kill 1444162 00:11:31.871 08:50:20 -- common/autotest_common.sh@950 -- # wait 1444162 00:11:32.130 08:50:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:32.130 08:50:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:32.130 08:50:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:32.130 08:50:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:32.130 08:50:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:32.130 08:50:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:32.130 08:50:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:32.130 08:50:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:34.663 08:50:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:34.663 00:11:34.663 real 0m6.514s 00:11:34.663 user 0m9.550s 00:11:34.663 sys 0m2.015s 00:11:34.663 08:50:22 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:11:34.663 08:50:22 -- common/autotest_common.sh@10 -- # set +x 00:11:34.663 ************************************ 00:11:34.663 END TEST nvmf_multitarget 00:11:34.663 ************************************ 00:11:34.663 08:50:22 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:34.663 08:50:22 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:11:34.663 08:50:22 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:11:34.663 08:50:22 -- common/autotest_common.sh@10 -- # set +x 00:11:34.663 ************************************ 00:11:34.663 START TEST nvmf_rpc 00:11:34.663 ************************************ 00:11:34.663 08:50:22 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:34.663 * Looking for test storage... 00:11:34.663 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:34.663 08:50:22 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:34.663 08:50:22 -- nvmf/common.sh@7 -- # uname -s 00:11:34.663 08:50:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:34.663 08:50:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:34.663 08:50:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:34.663 08:50:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:34.663 08:50:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:34.663 08:50:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:34.663 08:50:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:34.663 08:50:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:34.663 08:50:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:34.663 08:50:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:34.663 08:50:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:34.663 08:50:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:34.663 08:50:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:34.663 08:50:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:34.663 08:50:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:34.663 08:50:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:34.663 08:50:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:34.663 08:50:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:34.663 08:50:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:34.663 08:50:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:34.663 08:50:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:34.663 08:50:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:34.663 08:50:22 -- paths/export.sh@5 -- # export PATH 00:11:34.663 08:50:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:34.663 08:50:22 -- nvmf/common.sh@46 -- # : 0 00:11:34.663 08:50:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:34.663 08:50:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:34.663 08:50:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:34.663 08:50:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:34.663 08:50:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:34.663 08:50:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:34.663 08:50:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:34.663 08:50:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:34.663 08:50:22 -- target/rpc.sh@11 -- # loops=5 00:11:34.663 08:50:22 -- target/rpc.sh@23 -- # nvmftestinit 00:11:34.663 08:50:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:34.663 08:50:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:34.663 08:50:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:34.663 08:50:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:34.663 08:50:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:34.663 08:50:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:34.663 08:50:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:34.663 08:50:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:34.663 08:50:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:34.663 08:50:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:34.663 08:50:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:34.663 08:50:22 -- common/autotest_common.sh@10 -- # set +x 00:11:36.559 08:50:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:36.559 08:50:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:36.559 08:50:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:36.559 08:50:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:36.559 08:50:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:36.559 08:50:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:36.559 08:50:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:36.559 08:50:24 -- nvmf/common.sh@294 -- # net_devs=() 00:11:36.559 08:50:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:36.559 08:50:24 -- nvmf/common.sh@295 -- # e810=() 00:11:36.559 08:50:24 -- nvmf/common.sh@295 -- # local -ga e810 00:11:36.559 08:50:24 -- nvmf/common.sh@296 -- # x722=() 00:11:36.559 08:50:24 -- nvmf/common.sh@296 -- # local -ga x722 00:11:36.559 08:50:24 -- nvmf/common.sh@297 -- # mlx=() 00:11:36.559 08:50:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:36.559 08:50:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:36.559 08:50:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:36.559 08:50:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:36.559 08:50:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:36.559 08:50:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:36.559 08:50:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:36.559 08:50:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:36.559 08:50:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:36.559 08:50:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:36.559 08:50:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:36.559 08:50:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:36.559 08:50:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:36.559 08:50:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:36.559 08:50:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:36.559 08:50:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:36.559 08:50:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:36.559 08:50:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:36.559 08:50:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:36.559 08:50:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:36.559 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:36.559 08:50:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:36.559 08:50:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:36.559 08:50:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:36.559 08:50:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:36.559 08:50:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:36.559 08:50:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:36.559 08:50:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:36.559 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:36.559 08:50:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:36.559 08:50:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:36.559 08:50:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:36.559 08:50:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:36.559 08:50:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:36.559 08:50:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:36.559 08:50:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:36.559 08:50:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:36.559 08:50:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:36.559 08:50:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:36.559 08:50:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:36.559 08:50:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:36.559 08:50:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:36.559 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:36.559 08:50:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:36.559 08:50:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:36.559 08:50:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:36.559 08:50:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:36.559 08:50:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:36.559 08:50:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:36.559 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:36.559 08:50:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:36.559 08:50:24 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:36.559 08:50:24 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:36.559 08:50:24 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:36.559 08:50:24 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:36.559 08:50:24 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:36.559 08:50:24 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:36.559 08:50:24 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:36.559 08:50:24 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:36.559 08:50:24 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:36.559 08:50:24 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:36.559 08:50:24 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:36.559 08:50:24 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:36.559 08:50:24 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:36.559 08:50:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:36.559 08:50:24 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:36.559 08:50:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:36.559 08:50:24 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:36.559 08:50:24 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:36.559 08:50:24 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:36.559 08:50:24 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:36.559 08:50:24 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:36.559 08:50:24 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:36.559 08:50:24 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:36.559 08:50:24 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:36.559 08:50:24 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:36.559 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:36.559 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.207 ms 00:11:36.559 00:11:36.559 --- 10.0.0.2 ping statistics --- 00:11:36.559 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:36.559 rtt min/avg/max/mdev = 0.207/0.207/0.207/0.000 ms 00:11:36.559 08:50:24 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:36.559 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:36.559 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.091 ms 00:11:36.559 00:11:36.559 --- 10.0.0.1 ping statistics --- 00:11:36.559 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:36.559 rtt min/avg/max/mdev = 0.091/0.091/0.091/0.000 ms 00:11:36.559 08:50:24 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:36.559 08:50:24 -- nvmf/common.sh@410 -- # return 0 00:11:36.559 08:50:24 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:36.559 08:50:24 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:36.559 08:50:24 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:36.559 08:50:24 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:36.559 08:50:24 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:36.559 08:50:24 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:36.559 08:50:24 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:36.559 08:50:24 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:11:36.559 08:50:24 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:36.559 08:50:24 -- common/autotest_common.sh@712 -- # xtrace_disable 00:11:36.559 08:50:24 -- common/autotest_common.sh@10 -- # set +x 00:11:36.559 08:50:24 -- nvmf/common.sh@469 -- # nvmfpid=1446413 00:11:36.559 08:50:24 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:36.559 08:50:24 -- nvmf/common.sh@470 -- # waitforlisten 1446413 00:11:36.559 08:50:24 -- common/autotest_common.sh@819 -- # '[' -z 1446413 ']' 00:11:36.559 08:50:24 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:36.559 08:50:24 -- common/autotest_common.sh@824 -- # local max_retries=100 00:11:36.559 08:50:24 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:36.559 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:36.559 08:50:24 -- common/autotest_common.sh@828 -- # xtrace_disable 00:11:36.559 08:50:24 -- common/autotest_common.sh@10 -- # set +x 00:11:36.559 [2024-07-15 08:50:24.793342] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:11:36.559 [2024-07-15 08:50:24.793436] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:36.559 EAL: No free 2048 kB hugepages reported on node 1 00:11:36.559 [2024-07-15 08:50:24.864498] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:36.559 [2024-07-15 08:50:24.983648] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:36.559 [2024-07-15 08:50:24.983826] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:36.559 [2024-07-15 08:50:24.983846] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:36.560 [2024-07-15 08:50:24.983860] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:36.560 [2024-07-15 08:50:24.983952] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:36.560 [2024-07-15 08:50:24.984007] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:36.560 [2024-07-15 08:50:24.984063] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:36.560 [2024-07-15 08:50:24.984066] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:37.492 08:50:25 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:11:37.492 08:50:25 -- common/autotest_common.sh@852 -- # return 0 00:11:37.492 08:50:25 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:37.492 08:50:25 -- common/autotest_common.sh@718 -- # xtrace_disable 00:11:37.492 08:50:25 -- common/autotest_common.sh@10 -- # set +x 00:11:37.492 08:50:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:37.492 08:50:25 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:11:37.492 08:50:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:37.492 08:50:25 -- common/autotest_common.sh@10 -- # set +x 00:11:37.492 08:50:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:37.492 08:50:25 -- target/rpc.sh@26 -- # stats='{ 00:11:37.492 "tick_rate": 2700000000, 00:11:37.492 "poll_groups": [ 00:11:37.492 { 00:11:37.492 "name": "nvmf_tgt_poll_group_0", 00:11:37.492 "admin_qpairs": 0, 00:11:37.492 "io_qpairs": 0, 00:11:37.492 "current_admin_qpairs": 0, 00:11:37.492 "current_io_qpairs": 0, 00:11:37.492 "pending_bdev_io": 0, 00:11:37.492 "completed_nvme_io": 0, 00:11:37.492 "transports": [] 00:11:37.492 }, 00:11:37.492 { 00:11:37.492 "name": "nvmf_tgt_poll_group_1", 00:11:37.492 "admin_qpairs": 0, 00:11:37.492 "io_qpairs": 0, 00:11:37.492 "current_admin_qpairs": 0, 00:11:37.492 "current_io_qpairs": 0, 00:11:37.492 "pending_bdev_io": 0, 00:11:37.492 "completed_nvme_io": 0, 00:11:37.492 "transports": [] 00:11:37.492 }, 00:11:37.492 { 00:11:37.492 "name": "nvmf_tgt_poll_group_2", 00:11:37.492 "admin_qpairs": 0, 00:11:37.492 "io_qpairs": 0, 00:11:37.492 "current_admin_qpairs": 0, 00:11:37.492 "current_io_qpairs": 0, 00:11:37.492 "pending_bdev_io": 0, 00:11:37.492 "completed_nvme_io": 0, 00:11:37.492 "transports": [] 00:11:37.492 }, 00:11:37.492 { 00:11:37.492 "name": "nvmf_tgt_poll_group_3", 00:11:37.492 "admin_qpairs": 0, 00:11:37.492 "io_qpairs": 0, 00:11:37.492 "current_admin_qpairs": 0, 00:11:37.492 "current_io_qpairs": 0, 00:11:37.492 "pending_bdev_io": 0, 00:11:37.492 "completed_nvme_io": 0, 00:11:37.492 "transports": [] 00:11:37.492 } 00:11:37.492 ] 00:11:37.492 }' 00:11:37.492 08:50:25 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:11:37.492 08:50:25 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:11:37.493 08:50:25 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:11:37.493 08:50:25 -- target/rpc.sh@15 -- # wc -l 00:11:37.493 08:50:25 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:11:37.493 08:50:25 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:11:37.493 08:50:25 -- target/rpc.sh@29 -- # [[ null == null ]] 00:11:37.493 08:50:25 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:11:37.493 08:50:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:37.493 08:50:25 -- common/autotest_common.sh@10 -- # set +x 00:11:37.493 [2024-07-15 08:50:25.824519] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:11:37.493 08:50:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:37.493 08:50:25 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:11:37.493 08:50:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:37.493 08:50:25 -- common/autotest_common.sh@10 -- # set +x 00:11:37.493 08:50:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:37.493 08:50:25 -- target/rpc.sh@33 -- # stats='{ 00:11:37.493 "tick_rate": 2700000000, 00:11:37.493 "poll_groups": [ 00:11:37.493 { 00:11:37.493 "name": "nvmf_tgt_poll_group_0", 00:11:37.493 "admin_qpairs": 0, 00:11:37.493 "io_qpairs": 0, 00:11:37.493 "current_admin_qpairs": 0, 00:11:37.493 "current_io_qpairs": 0, 00:11:37.493 "pending_bdev_io": 0, 00:11:37.493 "completed_nvme_io": 0, 00:11:37.493 "transports": [ 00:11:37.493 { 00:11:37.493 "trtype": "TCP" 00:11:37.493 } 00:11:37.493 ] 00:11:37.493 }, 00:11:37.493 { 00:11:37.493 "name": "nvmf_tgt_poll_group_1", 00:11:37.493 "admin_qpairs": 0, 00:11:37.493 "io_qpairs": 0, 00:11:37.493 "current_admin_qpairs": 0, 00:11:37.493 "current_io_qpairs": 0, 00:11:37.493 "pending_bdev_io": 0, 00:11:37.493 "completed_nvme_io": 0, 00:11:37.493 "transports": [ 00:11:37.493 { 00:11:37.493 "trtype": "TCP" 00:11:37.493 } 00:11:37.493 ] 00:11:37.493 }, 00:11:37.493 { 00:11:37.493 "name": "nvmf_tgt_poll_group_2", 00:11:37.493 "admin_qpairs": 0, 00:11:37.493 "io_qpairs": 0, 00:11:37.493 "current_admin_qpairs": 0, 00:11:37.493 "current_io_qpairs": 0, 00:11:37.493 "pending_bdev_io": 0, 00:11:37.493 "completed_nvme_io": 0, 00:11:37.493 "transports": [ 00:11:37.493 { 00:11:37.493 "trtype": "TCP" 00:11:37.493 } 00:11:37.493 ] 00:11:37.493 }, 00:11:37.493 { 00:11:37.493 "name": "nvmf_tgt_poll_group_3", 00:11:37.493 "admin_qpairs": 0, 00:11:37.493 "io_qpairs": 0, 00:11:37.493 "current_admin_qpairs": 0, 00:11:37.493 "current_io_qpairs": 0, 00:11:37.493 "pending_bdev_io": 0, 00:11:37.493 "completed_nvme_io": 0, 00:11:37.493 "transports": [ 00:11:37.493 { 00:11:37.493 "trtype": "TCP" 00:11:37.493 } 00:11:37.493 ] 00:11:37.493 } 00:11:37.493 ] 00:11:37.493 }' 00:11:37.493 08:50:25 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:11:37.493 08:50:25 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:11:37.493 08:50:25 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:11:37.493 08:50:25 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:37.493 08:50:25 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:11:37.493 08:50:25 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:11:37.493 08:50:25 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:11:37.493 08:50:25 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:11:37.493 08:50:25 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:37.493 08:50:25 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:11:37.493 08:50:25 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:11:37.493 08:50:25 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:11:37.493 08:50:25 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:11:37.493 08:50:25 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:11:37.493 08:50:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:37.493 08:50:25 -- common/autotest_common.sh@10 -- # set +x 00:11:37.493 Malloc1 00:11:37.493 08:50:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:37.493 08:50:25 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:11:37.493 08:50:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:37.493 08:50:25 -- common/autotest_common.sh@10 -- # set +x 00:11:37.493 08:50:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:37.493 08:50:25 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:37.493 08:50:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:37.493 08:50:25 -- common/autotest_common.sh@10 -- # set +x 00:11:37.493 08:50:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:37.493 08:50:25 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:11:37.493 08:50:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:37.493 08:50:25 -- common/autotest_common.sh@10 -- # set +x 00:11:37.493 08:50:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:37.493 08:50:25 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:37.493 08:50:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:37.493 08:50:25 -- common/autotest_common.sh@10 -- # set +x 00:11:37.493 [2024-07-15 08:50:25.977764] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:37.493 08:50:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:37.493 08:50:25 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:37.493 08:50:25 -- common/autotest_common.sh@640 -- # local es=0 00:11:37.493 08:50:25 -- common/autotest_common.sh@642 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:37.493 08:50:25 -- common/autotest_common.sh@628 -- # local arg=nvme 00:11:37.493 08:50:25 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:11:37.493 08:50:25 -- common/autotest_common.sh@632 -- # type -t nvme 00:11:37.493 08:50:25 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:11:37.493 08:50:25 -- common/autotest_common.sh@634 -- # type -P nvme 00:11:37.493 08:50:25 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:11:37.493 08:50:25 -- common/autotest_common.sh@634 -- # arg=/usr/sbin/nvme 00:11:37.493 08:50:25 -- common/autotest_common.sh@634 -- # [[ -x /usr/sbin/nvme ]] 00:11:37.493 08:50:25 -- common/autotest_common.sh@643 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:37.493 [2024-07-15 08:50:26.000315] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:11:37.493 Failed to write to /dev/nvme-fabrics: Input/output error 00:11:37.493 could not add new controller: failed to write to nvme-fabrics device 00:11:37.493 08:50:26 -- common/autotest_common.sh@643 -- # es=1 00:11:37.493 08:50:26 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:11:37.493 08:50:26 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:11:37.493 08:50:26 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:11:37.493 08:50:26 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:37.493 08:50:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:37.493 08:50:26 -- common/autotest_common.sh@10 -- # set +x 00:11:37.493 08:50:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:37.493 08:50:26 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:38.426 08:50:26 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:11:38.426 08:50:26 -- common/autotest_common.sh@1177 -- # local i=0 00:11:38.426 08:50:26 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:11:38.426 08:50:26 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:11:38.426 08:50:26 -- common/autotest_common.sh@1184 -- # sleep 2 00:11:40.330 08:50:28 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:11:40.330 08:50:28 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:11:40.330 08:50:28 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:11:40.330 08:50:28 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:11:40.330 08:50:28 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:11:40.330 08:50:28 -- common/autotest_common.sh@1187 -- # return 0 00:11:40.330 08:50:28 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:40.330 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:40.330 08:50:28 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:40.330 08:50:28 -- common/autotest_common.sh@1198 -- # local i=0 00:11:40.330 08:50:28 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:11:40.330 08:50:28 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:40.330 08:50:28 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:11:40.330 08:50:28 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:40.330 08:50:28 -- common/autotest_common.sh@1210 -- # return 0 00:11:40.330 08:50:28 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:40.330 08:50:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:40.330 08:50:28 -- common/autotest_common.sh@10 -- # set +x 00:11:40.330 08:50:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:40.330 08:50:28 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:40.330 08:50:28 -- common/autotest_common.sh@640 -- # local es=0 00:11:40.330 08:50:28 -- common/autotest_common.sh@642 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:40.330 08:50:28 -- common/autotest_common.sh@628 -- # local arg=nvme 00:11:40.330 08:50:28 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:11:40.330 08:50:28 -- common/autotest_common.sh@632 -- # type -t nvme 00:11:40.330 08:50:28 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:11:40.330 08:50:28 -- common/autotest_common.sh@634 -- # type -P nvme 00:11:40.330 08:50:28 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:11:40.330 08:50:28 -- common/autotest_common.sh@634 -- # arg=/usr/sbin/nvme 00:11:40.330 08:50:28 -- common/autotest_common.sh@634 -- # [[ -x /usr/sbin/nvme ]] 00:11:40.330 08:50:28 -- common/autotest_common.sh@643 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:40.330 [2024-07-15 08:50:28.839165] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:11:40.330 Failed to write to /dev/nvme-fabrics: Input/output error 00:11:40.330 could not add new controller: failed to write to nvme-fabrics device 00:11:40.330 08:50:28 -- common/autotest_common.sh@643 -- # es=1 00:11:40.330 08:50:28 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:11:40.330 08:50:28 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:11:40.330 08:50:28 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:11:40.330 08:50:28 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:11:40.330 08:50:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:40.330 08:50:28 -- common/autotest_common.sh@10 -- # set +x 00:11:40.330 08:50:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:40.330 08:50:28 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:41.296 08:50:29 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:11:41.296 08:50:29 -- common/autotest_common.sh@1177 -- # local i=0 00:11:41.296 08:50:29 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:11:41.296 08:50:29 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:11:41.296 08:50:29 -- common/autotest_common.sh@1184 -- # sleep 2 00:11:43.196 08:50:31 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:11:43.196 08:50:31 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:11:43.196 08:50:31 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:11:43.196 08:50:31 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:11:43.196 08:50:31 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:11:43.196 08:50:31 -- common/autotest_common.sh@1187 -- # return 0 00:11:43.196 08:50:31 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:43.196 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:43.196 08:50:31 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:43.196 08:50:31 -- common/autotest_common.sh@1198 -- # local i=0 00:11:43.196 08:50:31 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:11:43.196 08:50:31 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:43.196 08:50:31 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:11:43.196 08:50:31 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:43.196 08:50:31 -- common/autotest_common.sh@1210 -- # return 0 00:11:43.197 08:50:31 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:43.197 08:50:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:43.197 08:50:31 -- common/autotest_common.sh@10 -- # set +x 00:11:43.197 08:50:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:43.197 08:50:31 -- target/rpc.sh@81 -- # seq 1 5 00:11:43.197 08:50:31 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:43.197 08:50:31 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:43.197 08:50:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:43.197 08:50:31 -- common/autotest_common.sh@10 -- # set +x 00:11:43.197 08:50:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:43.197 08:50:31 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:43.197 08:50:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:43.197 08:50:31 -- common/autotest_common.sh@10 -- # set +x 00:11:43.197 [2024-07-15 08:50:31.650074] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:43.197 08:50:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:43.197 08:50:31 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:43.197 08:50:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:43.197 08:50:31 -- common/autotest_common.sh@10 -- # set +x 00:11:43.197 08:50:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:43.197 08:50:31 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:43.197 08:50:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:43.197 08:50:31 -- common/autotest_common.sh@10 -- # set +x 00:11:43.197 08:50:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:43.197 08:50:31 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:44.131 08:50:32 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:44.131 08:50:32 -- common/autotest_common.sh@1177 -- # local i=0 00:11:44.131 08:50:32 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:11:44.131 08:50:32 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:11:44.131 08:50:32 -- common/autotest_common.sh@1184 -- # sleep 2 00:11:46.036 08:50:34 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:11:46.036 08:50:34 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:11:46.036 08:50:34 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:11:46.036 08:50:34 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:11:46.036 08:50:34 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:11:46.036 08:50:34 -- common/autotest_common.sh@1187 -- # return 0 00:11:46.036 08:50:34 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:46.036 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:46.036 08:50:34 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:46.036 08:50:34 -- common/autotest_common.sh@1198 -- # local i=0 00:11:46.036 08:50:34 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:11:46.036 08:50:34 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:46.036 08:50:34 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:11:46.036 08:50:34 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:46.036 08:50:34 -- common/autotest_common.sh@1210 -- # return 0 00:11:46.036 08:50:34 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:46.036 08:50:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:46.036 08:50:34 -- common/autotest_common.sh@10 -- # set +x 00:11:46.036 08:50:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:46.036 08:50:34 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:46.036 08:50:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:46.036 08:50:34 -- common/autotest_common.sh@10 -- # set +x 00:11:46.036 08:50:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:46.036 08:50:34 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:46.036 08:50:34 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:46.036 08:50:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:46.036 08:50:34 -- common/autotest_common.sh@10 -- # set +x 00:11:46.036 08:50:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:46.036 08:50:34 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:46.036 08:50:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:46.036 08:50:34 -- common/autotest_common.sh@10 -- # set +x 00:11:46.036 [2024-07-15 08:50:34.453671] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:46.036 08:50:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:46.036 08:50:34 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:46.036 08:50:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:46.036 08:50:34 -- common/autotest_common.sh@10 -- # set +x 00:11:46.036 08:50:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:46.036 08:50:34 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:46.036 08:50:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:46.036 08:50:34 -- common/autotest_common.sh@10 -- # set +x 00:11:46.036 08:50:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:46.036 08:50:34 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:46.604 08:50:35 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:46.604 08:50:35 -- common/autotest_common.sh@1177 -- # local i=0 00:11:46.604 08:50:35 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:11:46.604 08:50:35 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:11:46.604 08:50:35 -- common/autotest_common.sh@1184 -- # sleep 2 00:11:49.172 08:50:37 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:11:49.172 08:50:37 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:11:49.172 08:50:37 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:11:49.172 08:50:37 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:11:49.172 08:50:37 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:11:49.172 08:50:37 -- common/autotest_common.sh@1187 -- # return 0 00:11:49.172 08:50:37 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:49.172 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:49.172 08:50:37 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:49.172 08:50:37 -- common/autotest_common.sh@1198 -- # local i=0 00:11:49.172 08:50:37 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:11:49.172 08:50:37 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:49.172 08:50:37 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:11:49.172 08:50:37 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:49.172 08:50:37 -- common/autotest_common.sh@1210 -- # return 0 00:11:49.172 08:50:37 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:49.172 08:50:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:49.172 08:50:37 -- common/autotest_common.sh@10 -- # set +x 00:11:49.172 08:50:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:49.172 08:50:37 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:49.172 08:50:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:49.172 08:50:37 -- common/autotest_common.sh@10 -- # set +x 00:11:49.172 08:50:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:49.172 08:50:37 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:49.172 08:50:37 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:49.172 08:50:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:49.172 08:50:37 -- common/autotest_common.sh@10 -- # set +x 00:11:49.172 08:50:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:49.172 08:50:37 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:49.172 08:50:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:49.172 08:50:37 -- common/autotest_common.sh@10 -- # set +x 00:11:49.172 [2024-07-15 08:50:37.213406] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:49.172 08:50:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:49.172 08:50:37 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:49.172 08:50:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:49.172 08:50:37 -- common/autotest_common.sh@10 -- # set +x 00:11:49.172 08:50:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:49.172 08:50:37 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:49.172 08:50:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:49.172 08:50:37 -- common/autotest_common.sh@10 -- # set +x 00:11:49.172 08:50:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:49.172 08:50:37 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:49.433 08:50:37 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:49.433 08:50:37 -- common/autotest_common.sh@1177 -- # local i=0 00:11:49.433 08:50:37 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:11:49.433 08:50:37 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:11:49.433 08:50:37 -- common/autotest_common.sh@1184 -- # sleep 2 00:11:51.338 08:50:39 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:11:51.338 08:50:39 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:11:51.338 08:50:39 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:11:51.338 08:50:39 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:11:51.338 08:50:39 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:11:51.338 08:50:39 -- common/autotest_common.sh@1187 -- # return 0 00:11:51.338 08:50:39 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:51.596 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:51.596 08:50:39 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:51.596 08:50:39 -- common/autotest_common.sh@1198 -- # local i=0 00:11:51.596 08:50:39 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:11:51.596 08:50:39 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:51.596 08:50:39 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:11:51.596 08:50:39 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:51.596 08:50:39 -- common/autotest_common.sh@1210 -- # return 0 00:11:51.596 08:50:39 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:51.596 08:50:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:51.596 08:50:39 -- common/autotest_common.sh@10 -- # set +x 00:11:51.596 08:50:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:51.596 08:50:39 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:51.596 08:50:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:51.596 08:50:39 -- common/autotest_common.sh@10 -- # set +x 00:11:51.596 08:50:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:51.596 08:50:39 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:51.597 08:50:39 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:51.597 08:50:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:51.597 08:50:39 -- common/autotest_common.sh@10 -- # set +x 00:11:51.597 08:50:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:51.597 08:50:39 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:51.597 08:50:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:51.597 08:50:39 -- common/autotest_common.sh@10 -- # set +x 00:11:51.597 [2024-07-15 08:50:39.987500] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:51.597 08:50:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:51.597 08:50:39 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:51.597 08:50:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:51.597 08:50:39 -- common/autotest_common.sh@10 -- # set +x 00:11:51.597 08:50:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:51.597 08:50:39 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:51.597 08:50:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:51.597 08:50:39 -- common/autotest_common.sh@10 -- # set +x 00:11:51.597 08:50:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:51.597 08:50:40 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:52.165 08:50:40 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:52.165 08:50:40 -- common/autotest_common.sh@1177 -- # local i=0 00:11:52.165 08:50:40 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:11:52.165 08:50:40 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:11:52.165 08:50:40 -- common/autotest_common.sh@1184 -- # sleep 2 00:11:54.698 08:50:42 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:11:54.698 08:50:42 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:11:54.698 08:50:42 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:11:54.698 08:50:42 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:11:54.698 08:50:42 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:11:54.698 08:50:42 -- common/autotest_common.sh@1187 -- # return 0 00:11:54.698 08:50:42 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:54.698 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:54.698 08:50:42 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:54.698 08:50:42 -- common/autotest_common.sh@1198 -- # local i=0 00:11:54.698 08:50:42 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:11:54.698 08:50:42 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:54.698 08:50:42 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:11:54.698 08:50:42 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:54.698 08:50:42 -- common/autotest_common.sh@1210 -- # return 0 00:11:54.698 08:50:42 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:54.698 08:50:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:54.698 08:50:42 -- common/autotest_common.sh@10 -- # set +x 00:11:54.698 08:50:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:54.698 08:50:42 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:54.698 08:50:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:54.698 08:50:42 -- common/autotest_common.sh@10 -- # set +x 00:11:54.699 08:50:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:54.699 08:50:42 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:54.699 08:50:42 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:54.699 08:50:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:54.699 08:50:42 -- common/autotest_common.sh@10 -- # set +x 00:11:54.699 08:50:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:54.699 08:50:42 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:54.699 08:50:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:54.699 08:50:42 -- common/autotest_common.sh@10 -- # set +x 00:11:54.699 [2024-07-15 08:50:42.802088] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:54.699 08:50:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:54.699 08:50:42 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:54.699 08:50:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:54.699 08:50:42 -- common/autotest_common.sh@10 -- # set +x 00:11:54.699 08:50:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:54.699 08:50:42 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:54.699 08:50:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:54.699 08:50:42 -- common/autotest_common.sh@10 -- # set +x 00:11:54.699 08:50:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:54.699 08:50:42 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:54.957 08:50:43 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:54.957 08:50:43 -- common/autotest_common.sh@1177 -- # local i=0 00:11:54.957 08:50:43 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:11:54.957 08:50:43 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:11:54.957 08:50:43 -- common/autotest_common.sh@1184 -- # sleep 2 00:11:57.487 08:50:45 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:11:57.487 08:50:45 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:11:57.487 08:50:45 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:11:57.487 08:50:45 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:11:57.487 08:50:45 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:11:57.487 08:50:45 -- common/autotest_common.sh@1187 -- # return 0 00:11:57.487 08:50:45 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:57.487 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:57.487 08:50:45 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:57.487 08:50:45 -- common/autotest_common.sh@1198 -- # local i=0 00:11:57.487 08:50:45 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:11:57.487 08:50:45 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:57.487 08:50:45 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:11:57.487 08:50:45 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:57.487 08:50:45 -- common/autotest_common.sh@1210 -- # return 0 00:11:57.487 08:50:45 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:57.487 08:50:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:57.487 08:50:45 -- common/autotest_common.sh@10 -- # set +x 00:11:57.487 08:50:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:57.487 08:50:45 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:57.487 08:50:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:57.487 08:50:45 -- common/autotest_common.sh@10 -- # set +x 00:11:57.487 08:50:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:57.487 08:50:45 -- target/rpc.sh@99 -- # seq 1 5 00:11:57.487 08:50:45 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:57.487 08:50:45 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:57.487 08:50:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:57.487 08:50:45 -- common/autotest_common.sh@10 -- # set +x 00:11:57.487 08:50:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:57.487 08:50:45 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:57.487 08:50:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:57.487 08:50:45 -- common/autotest_common.sh@10 -- # set +x 00:11:57.487 [2024-07-15 08:50:45.582529] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:57.487 08:50:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:57.487 08:50:45 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:57.487 08:50:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:57.487 08:50:45 -- common/autotest_common.sh@10 -- # set +x 00:11:57.487 08:50:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:57.487 08:50:45 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:57.487 08:50:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:57.487 08:50:45 -- common/autotest_common.sh@10 -- # set +x 00:11:57.487 08:50:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:57.487 08:50:45 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:57.487 08:50:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:57.487 08:50:45 -- common/autotest_common.sh@10 -- # set +x 00:11:57.487 08:50:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:57.487 08:50:45 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:57.487 08:50:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:57.487 08:50:45 -- common/autotest_common.sh@10 -- # set +x 00:11:57.487 08:50:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:57.488 08:50:45 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:57.488 08:50:45 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:57.488 08:50:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:57.488 08:50:45 -- common/autotest_common.sh@10 -- # set +x 00:11:57.488 08:50:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:57.488 08:50:45 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:57.488 08:50:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:57.488 08:50:45 -- common/autotest_common.sh@10 -- # set +x 00:11:57.488 [2024-07-15 08:50:45.630584] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:57.488 08:50:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:57.488 08:50:45 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:57.488 08:50:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:57.488 08:50:45 -- common/autotest_common.sh@10 -- # set +x 00:11:57.488 08:50:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:57.488 08:50:45 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:57.488 08:50:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:57.488 08:50:45 -- common/autotest_common.sh@10 -- # set +x 00:11:57.488 08:50:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:57.488 08:50:45 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:57.488 08:50:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:57.488 08:50:45 -- common/autotest_common.sh@10 -- # set +x 00:11:57.488 08:50:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:57.488 08:50:45 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:57.488 08:50:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:57.488 08:50:45 -- common/autotest_common.sh@10 -- # set +x 00:11:57.488 08:50:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:57.488 08:50:45 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:57.488 08:50:45 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:57.488 08:50:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:57.488 08:50:45 -- common/autotest_common.sh@10 -- # set +x 00:11:57.488 08:50:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:57.488 08:50:45 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:57.488 08:50:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:57.488 08:50:45 -- common/autotest_common.sh@10 -- # set +x 00:11:57.488 [2024-07-15 08:50:45.678745] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:57.488 08:50:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:57.488 08:50:45 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:57.488 08:50:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:57.488 08:50:45 -- common/autotest_common.sh@10 -- # set +x 00:11:57.488 08:50:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:57.488 08:50:45 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:57.488 08:50:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:57.488 08:50:45 -- common/autotest_common.sh@10 -- # set +x 00:11:57.488 08:50:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:57.488 08:50:45 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:57.488 08:50:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:57.488 08:50:45 -- common/autotest_common.sh@10 -- # set +x 00:11:57.488 08:50:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:57.488 08:50:45 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:57.488 08:50:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:57.488 08:50:45 -- common/autotest_common.sh@10 -- # set +x 00:11:57.488 08:50:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:57.488 08:50:45 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:57.488 08:50:45 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:57.488 08:50:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:57.488 08:50:45 -- common/autotest_common.sh@10 -- # set +x 00:11:57.488 08:50:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:57.488 08:50:45 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:57.488 08:50:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:57.488 08:50:45 -- common/autotest_common.sh@10 -- # set +x 00:11:57.488 [2024-07-15 08:50:45.726912] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:57.488 08:50:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:57.488 08:50:45 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:57.488 08:50:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:57.488 08:50:45 -- common/autotest_common.sh@10 -- # set +x 00:11:57.488 08:50:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:57.488 08:50:45 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:57.488 08:50:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:57.488 08:50:45 -- common/autotest_common.sh@10 -- # set +x 00:11:57.488 08:50:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:57.488 08:50:45 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:57.488 08:50:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:57.488 08:50:45 -- common/autotest_common.sh@10 -- # set +x 00:11:57.488 08:50:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:57.488 08:50:45 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:57.488 08:50:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:57.488 08:50:45 -- common/autotest_common.sh@10 -- # set +x 00:11:57.488 08:50:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:57.488 08:50:45 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:57.488 08:50:45 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:57.488 08:50:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:57.488 08:50:45 -- common/autotest_common.sh@10 -- # set +x 00:11:57.488 08:50:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:57.488 08:50:45 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:57.488 08:50:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:57.488 08:50:45 -- common/autotest_common.sh@10 -- # set +x 00:11:57.488 [2024-07-15 08:50:45.775107] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:57.488 08:50:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:57.488 08:50:45 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:57.488 08:50:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:57.488 08:50:45 -- common/autotest_common.sh@10 -- # set +x 00:11:57.488 08:50:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:57.488 08:50:45 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:57.488 08:50:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:57.488 08:50:45 -- common/autotest_common.sh@10 -- # set +x 00:11:57.488 08:50:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:57.488 08:50:45 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:57.488 08:50:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:57.488 08:50:45 -- common/autotest_common.sh@10 -- # set +x 00:11:57.488 08:50:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:57.488 08:50:45 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:57.488 08:50:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:57.488 08:50:45 -- common/autotest_common.sh@10 -- # set +x 00:11:57.488 08:50:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:57.488 08:50:45 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:11:57.488 08:50:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:57.488 08:50:45 -- common/autotest_common.sh@10 -- # set +x 00:11:57.488 08:50:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:57.488 08:50:45 -- target/rpc.sh@110 -- # stats='{ 00:11:57.488 "tick_rate": 2700000000, 00:11:57.488 "poll_groups": [ 00:11:57.488 { 00:11:57.488 "name": "nvmf_tgt_poll_group_0", 00:11:57.488 "admin_qpairs": 2, 00:11:57.488 "io_qpairs": 84, 00:11:57.488 "current_admin_qpairs": 0, 00:11:57.488 "current_io_qpairs": 0, 00:11:57.488 "pending_bdev_io": 0, 00:11:57.488 "completed_nvme_io": 135, 00:11:57.488 "transports": [ 00:11:57.488 { 00:11:57.488 "trtype": "TCP" 00:11:57.488 } 00:11:57.488 ] 00:11:57.488 }, 00:11:57.488 { 00:11:57.488 "name": "nvmf_tgt_poll_group_1", 00:11:57.488 "admin_qpairs": 2, 00:11:57.488 "io_qpairs": 84, 00:11:57.488 "current_admin_qpairs": 0, 00:11:57.488 "current_io_qpairs": 0, 00:11:57.488 "pending_bdev_io": 0, 00:11:57.488 "completed_nvme_io": 184, 00:11:57.488 "transports": [ 00:11:57.488 { 00:11:57.488 "trtype": "TCP" 00:11:57.488 } 00:11:57.488 ] 00:11:57.488 }, 00:11:57.488 { 00:11:57.488 "name": "nvmf_tgt_poll_group_2", 00:11:57.488 "admin_qpairs": 1, 00:11:57.488 "io_qpairs": 84, 00:11:57.488 "current_admin_qpairs": 0, 00:11:57.488 "current_io_qpairs": 0, 00:11:57.488 "pending_bdev_io": 0, 00:11:57.488 "completed_nvme_io": 184, 00:11:57.488 "transports": [ 00:11:57.488 { 00:11:57.488 "trtype": "TCP" 00:11:57.488 } 00:11:57.488 ] 00:11:57.488 }, 00:11:57.488 { 00:11:57.488 "name": "nvmf_tgt_poll_group_3", 00:11:57.488 "admin_qpairs": 2, 00:11:57.488 "io_qpairs": 84, 00:11:57.488 "current_admin_qpairs": 0, 00:11:57.488 "current_io_qpairs": 0, 00:11:57.488 "pending_bdev_io": 0, 00:11:57.488 "completed_nvme_io": 183, 00:11:57.488 "transports": [ 00:11:57.488 { 00:11:57.488 "trtype": "TCP" 00:11:57.488 } 00:11:57.488 ] 00:11:57.488 } 00:11:57.488 ] 00:11:57.488 }' 00:11:57.488 08:50:45 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:11:57.488 08:50:45 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:11:57.488 08:50:45 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:11:57.488 08:50:45 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:57.488 08:50:45 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:11:57.488 08:50:45 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:11:57.488 08:50:45 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:11:57.488 08:50:45 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:11:57.488 08:50:45 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:57.488 08:50:45 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:11:57.488 08:50:45 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:11:57.488 08:50:45 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:11:57.488 08:50:45 -- target/rpc.sh@123 -- # nvmftestfini 00:11:57.488 08:50:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:57.489 08:50:45 -- nvmf/common.sh@116 -- # sync 00:11:57.489 08:50:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:57.489 08:50:45 -- nvmf/common.sh@119 -- # set +e 00:11:57.489 08:50:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:57.489 08:50:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:57.489 rmmod nvme_tcp 00:11:57.489 rmmod nvme_fabrics 00:11:57.489 rmmod nvme_keyring 00:11:57.489 08:50:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:57.489 08:50:45 -- nvmf/common.sh@123 -- # set -e 00:11:57.489 08:50:45 -- nvmf/common.sh@124 -- # return 0 00:11:57.489 08:50:45 -- nvmf/common.sh@477 -- # '[' -n 1446413 ']' 00:11:57.489 08:50:45 -- nvmf/common.sh@478 -- # killprocess 1446413 00:11:57.489 08:50:45 -- common/autotest_common.sh@926 -- # '[' -z 1446413 ']' 00:11:57.489 08:50:45 -- common/autotest_common.sh@930 -- # kill -0 1446413 00:11:57.489 08:50:45 -- common/autotest_common.sh@931 -- # uname 00:11:57.489 08:50:45 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:11:57.489 08:50:45 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1446413 00:11:57.489 08:50:45 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:11:57.489 08:50:45 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:11:57.489 08:50:45 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1446413' 00:11:57.489 killing process with pid 1446413 00:11:57.489 08:50:45 -- common/autotest_common.sh@945 -- # kill 1446413 00:11:57.489 08:50:45 -- common/autotest_common.sh@950 -- # wait 1446413 00:11:57.747 08:50:46 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:57.747 08:50:46 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:57.747 08:50:46 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:57.747 08:50:46 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:57.747 08:50:46 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:57.747 08:50:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:57.747 08:50:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:57.747 08:50:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:00.282 08:50:48 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:00.282 00:12:00.282 real 0m25.638s 00:12:00.282 user 1m24.304s 00:12:00.282 sys 0m3.999s 00:12:00.282 08:50:48 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:12:00.282 08:50:48 -- common/autotest_common.sh@10 -- # set +x 00:12:00.282 ************************************ 00:12:00.282 END TEST nvmf_rpc 00:12:00.282 ************************************ 00:12:00.282 08:50:48 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:12:00.282 08:50:48 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:12:00.282 08:50:48 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:12:00.282 08:50:48 -- common/autotest_common.sh@10 -- # set +x 00:12:00.282 ************************************ 00:12:00.282 START TEST nvmf_invalid 00:12:00.282 ************************************ 00:12:00.282 08:50:48 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:12:00.282 * Looking for test storage... 00:12:00.282 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:00.283 08:50:48 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:00.283 08:50:48 -- nvmf/common.sh@7 -- # uname -s 00:12:00.283 08:50:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:00.283 08:50:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:00.283 08:50:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:00.283 08:50:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:00.283 08:50:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:00.283 08:50:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:00.283 08:50:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:00.283 08:50:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:00.283 08:50:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:00.283 08:50:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:00.283 08:50:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:00.283 08:50:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:00.283 08:50:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:00.283 08:50:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:00.283 08:50:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:00.283 08:50:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:00.283 08:50:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:00.283 08:50:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:00.283 08:50:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:00.283 08:50:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:00.283 08:50:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:00.283 08:50:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:00.283 08:50:48 -- paths/export.sh@5 -- # export PATH 00:12:00.283 08:50:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:00.283 08:50:48 -- nvmf/common.sh@46 -- # : 0 00:12:00.283 08:50:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:00.283 08:50:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:00.283 08:50:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:00.283 08:50:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:00.283 08:50:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:00.283 08:50:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:00.283 08:50:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:00.283 08:50:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:00.283 08:50:48 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:12:00.283 08:50:48 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:00.283 08:50:48 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:12:00.283 08:50:48 -- target/invalid.sh@14 -- # target=foobar 00:12:00.283 08:50:48 -- target/invalid.sh@16 -- # RANDOM=0 00:12:00.283 08:50:48 -- target/invalid.sh@34 -- # nvmftestinit 00:12:00.283 08:50:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:00.283 08:50:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:00.283 08:50:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:00.283 08:50:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:00.283 08:50:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:00.283 08:50:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:00.283 08:50:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:00.283 08:50:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:00.283 08:50:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:00.283 08:50:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:00.283 08:50:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:00.283 08:50:48 -- common/autotest_common.sh@10 -- # set +x 00:12:02.189 08:50:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:02.189 08:50:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:02.189 08:50:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:02.189 08:50:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:02.189 08:50:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:02.190 08:50:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:02.190 08:50:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:02.190 08:50:50 -- nvmf/common.sh@294 -- # net_devs=() 00:12:02.190 08:50:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:02.190 08:50:50 -- nvmf/common.sh@295 -- # e810=() 00:12:02.190 08:50:50 -- nvmf/common.sh@295 -- # local -ga e810 00:12:02.190 08:50:50 -- nvmf/common.sh@296 -- # x722=() 00:12:02.190 08:50:50 -- nvmf/common.sh@296 -- # local -ga x722 00:12:02.190 08:50:50 -- nvmf/common.sh@297 -- # mlx=() 00:12:02.190 08:50:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:02.190 08:50:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:02.190 08:50:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:02.190 08:50:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:02.190 08:50:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:02.190 08:50:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:02.190 08:50:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:02.190 08:50:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:02.190 08:50:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:02.190 08:50:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:02.190 08:50:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:02.190 08:50:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:02.190 08:50:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:02.190 08:50:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:02.190 08:50:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:02.190 08:50:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:02.190 08:50:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:02.190 08:50:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:02.190 08:50:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:02.190 08:50:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:02.190 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:02.190 08:50:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:02.190 08:50:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:02.190 08:50:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:02.190 08:50:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:02.190 08:50:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:02.190 08:50:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:02.190 08:50:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:02.190 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:02.190 08:50:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:02.190 08:50:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:02.190 08:50:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:02.190 08:50:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:02.190 08:50:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:02.190 08:50:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:02.190 08:50:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:02.190 08:50:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:02.190 08:50:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:02.190 08:50:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:02.190 08:50:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:02.190 08:50:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:02.190 08:50:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:02.190 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:02.190 08:50:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:02.190 08:50:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:02.190 08:50:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:02.190 08:50:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:02.190 08:50:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:02.190 08:50:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:02.190 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:02.190 08:50:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:02.190 08:50:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:02.190 08:50:50 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:02.190 08:50:50 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:02.190 08:50:50 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:02.190 08:50:50 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:02.190 08:50:50 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:02.190 08:50:50 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:02.190 08:50:50 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:02.190 08:50:50 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:02.190 08:50:50 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:02.190 08:50:50 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:02.190 08:50:50 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:02.190 08:50:50 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:02.190 08:50:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:02.190 08:50:50 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:02.190 08:50:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:02.190 08:50:50 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:02.190 08:50:50 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:02.190 08:50:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:02.190 08:50:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:02.190 08:50:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:02.190 08:50:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:02.190 08:50:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:02.190 08:50:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:02.190 08:50:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:02.190 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:02.190 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.154 ms 00:12:02.190 00:12:02.190 --- 10.0.0.2 ping statistics --- 00:12:02.190 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:02.190 rtt min/avg/max/mdev = 0.154/0.154/0.154/0.000 ms 00:12:02.190 08:50:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:02.190 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:02.190 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.108 ms 00:12:02.190 00:12:02.190 --- 10.0.0.1 ping statistics --- 00:12:02.190 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:02.190 rtt min/avg/max/mdev = 0.108/0.108/0.108/0.000 ms 00:12:02.190 08:50:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:02.190 08:50:50 -- nvmf/common.sh@410 -- # return 0 00:12:02.190 08:50:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:02.190 08:50:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:02.190 08:50:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:02.190 08:50:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:02.190 08:50:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:02.190 08:50:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:02.190 08:50:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:02.190 08:50:50 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:12:02.190 08:50:50 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:02.190 08:50:50 -- common/autotest_common.sh@712 -- # xtrace_disable 00:12:02.190 08:50:50 -- common/autotest_common.sh@10 -- # set +x 00:12:02.190 08:50:50 -- nvmf/common.sh@469 -- # nvmfpid=1451113 00:12:02.190 08:50:50 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:02.190 08:50:50 -- nvmf/common.sh@470 -- # waitforlisten 1451113 00:12:02.190 08:50:50 -- common/autotest_common.sh@819 -- # '[' -z 1451113 ']' 00:12:02.190 08:50:50 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:02.190 08:50:50 -- common/autotest_common.sh@824 -- # local max_retries=100 00:12:02.190 08:50:50 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:02.190 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:02.190 08:50:50 -- common/autotest_common.sh@828 -- # xtrace_disable 00:12:02.190 08:50:50 -- common/autotest_common.sh@10 -- # set +x 00:12:02.190 [2024-07-15 08:50:50.607947] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:12:02.190 [2024-07-15 08:50:50.608027] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:02.190 EAL: No free 2048 kB hugepages reported on node 1 00:12:02.190 [2024-07-15 08:50:50.671374] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:02.450 [2024-07-15 08:50:50.780832] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:02.450 [2024-07-15 08:50:50.780983] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:02.450 [2024-07-15 08:50:50.781001] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:02.450 [2024-07-15 08:50:50.781014] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:02.450 [2024-07-15 08:50:50.781067] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:02.450 [2024-07-15 08:50:50.781127] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:02.450 [2024-07-15 08:50:50.781191] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:02.450 [2024-07-15 08:50:50.781194] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:03.387 08:50:51 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:12:03.387 08:50:51 -- common/autotest_common.sh@852 -- # return 0 00:12:03.387 08:50:51 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:03.387 08:50:51 -- common/autotest_common.sh@718 -- # xtrace_disable 00:12:03.387 08:50:51 -- common/autotest_common.sh@10 -- # set +x 00:12:03.387 08:50:51 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:03.387 08:50:51 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:12:03.387 08:50:51 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode15550 00:12:03.387 [2024-07-15 08:50:51.835179] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:12:03.387 08:50:51 -- target/invalid.sh@40 -- # out='request: 00:12:03.387 { 00:12:03.387 "nqn": "nqn.2016-06.io.spdk:cnode15550", 00:12:03.387 "tgt_name": "foobar", 00:12:03.387 "method": "nvmf_create_subsystem", 00:12:03.387 "req_id": 1 00:12:03.387 } 00:12:03.387 Got JSON-RPC error response 00:12:03.387 response: 00:12:03.387 { 00:12:03.387 "code": -32603, 00:12:03.387 "message": "Unable to find target foobar" 00:12:03.387 }' 00:12:03.387 08:50:51 -- target/invalid.sh@41 -- # [[ request: 00:12:03.387 { 00:12:03.387 "nqn": "nqn.2016-06.io.spdk:cnode15550", 00:12:03.387 "tgt_name": "foobar", 00:12:03.387 "method": "nvmf_create_subsystem", 00:12:03.387 "req_id": 1 00:12:03.387 } 00:12:03.387 Got JSON-RPC error response 00:12:03.387 response: 00:12:03.387 { 00:12:03.387 "code": -32603, 00:12:03.387 "message": "Unable to find target foobar" 00:12:03.387 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:12:03.387 08:50:51 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:12:03.388 08:50:51 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode18192 00:12:03.646 [2024-07-15 08:50:52.063952] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode18192: invalid serial number 'SPDKISFASTANDAWESOME' 00:12:03.646 08:50:52 -- target/invalid.sh@45 -- # out='request: 00:12:03.646 { 00:12:03.646 "nqn": "nqn.2016-06.io.spdk:cnode18192", 00:12:03.646 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:12:03.646 "method": "nvmf_create_subsystem", 00:12:03.646 "req_id": 1 00:12:03.646 } 00:12:03.646 Got JSON-RPC error response 00:12:03.646 response: 00:12:03.646 { 00:12:03.646 "code": -32602, 00:12:03.646 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:12:03.646 }' 00:12:03.646 08:50:52 -- target/invalid.sh@46 -- # [[ request: 00:12:03.646 { 00:12:03.646 "nqn": "nqn.2016-06.io.spdk:cnode18192", 00:12:03.646 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:12:03.646 "method": "nvmf_create_subsystem", 00:12:03.646 "req_id": 1 00:12:03.646 } 00:12:03.646 Got JSON-RPC error response 00:12:03.646 response: 00:12:03.646 { 00:12:03.646 "code": -32602, 00:12:03.646 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:12:03.646 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:12:03.646 08:50:52 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:12:03.646 08:50:52 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode24044 00:12:03.904 [2024-07-15 08:50:52.304717] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode24044: invalid model number 'SPDK_Controller' 00:12:03.904 08:50:52 -- target/invalid.sh@50 -- # out='request: 00:12:03.904 { 00:12:03.904 "nqn": "nqn.2016-06.io.spdk:cnode24044", 00:12:03.904 "model_number": "SPDK_Controller\u001f", 00:12:03.904 "method": "nvmf_create_subsystem", 00:12:03.904 "req_id": 1 00:12:03.904 } 00:12:03.904 Got JSON-RPC error response 00:12:03.904 response: 00:12:03.904 { 00:12:03.904 "code": -32602, 00:12:03.904 "message": "Invalid MN SPDK_Controller\u001f" 00:12:03.904 }' 00:12:03.904 08:50:52 -- target/invalid.sh@51 -- # [[ request: 00:12:03.904 { 00:12:03.904 "nqn": "nqn.2016-06.io.spdk:cnode24044", 00:12:03.904 "model_number": "SPDK_Controller\u001f", 00:12:03.904 "method": "nvmf_create_subsystem", 00:12:03.904 "req_id": 1 00:12:03.904 } 00:12:03.904 Got JSON-RPC error response 00:12:03.904 response: 00:12:03.904 { 00:12:03.904 "code": -32602, 00:12:03.904 "message": "Invalid MN SPDK_Controller\u001f" 00:12:03.904 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:12:03.904 08:50:52 -- target/invalid.sh@54 -- # gen_random_s 21 00:12:03.904 08:50:52 -- target/invalid.sh@19 -- # local length=21 ll 00:12:03.905 08:50:52 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:12:03.905 08:50:52 -- target/invalid.sh@21 -- # local chars 00:12:03.905 08:50:52 -- target/invalid.sh@22 -- # local string 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # printf %x 37 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x25' 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # string+=% 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # printf %x 80 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x50' 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # string+=P 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # printf %x 77 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x4d' 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # string+=M 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # printf %x 66 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x42' 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # string+=B 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # printf %x 86 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x56' 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # string+=V 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # printf %x 89 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x59' 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # string+=Y 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # printf %x 117 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x75' 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # string+=u 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # printf %x 78 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x4e' 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # string+=N 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # printf %x 116 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x74' 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # string+=t 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # printf %x 96 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x60' 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # string+='`' 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # printf %x 127 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x7f' 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # string+=$'\177' 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # printf %x 117 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x75' 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # string+=u 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # printf %x 87 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x57' 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # string+=W 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # printf %x 36 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x24' 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # string+='$' 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # printf %x 83 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x53' 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # string+=S 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # printf %x 53 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x35' 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # string+=5 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # printf %x 81 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x51' 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # string+=Q 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # printf %x 33 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x21' 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # string+='!' 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # printf %x 75 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x4b' 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # string+=K 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # printf %x 111 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # string+=o 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # printf %x 37 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x25' 00:12:03.905 08:50:52 -- target/invalid.sh@25 -- # string+=% 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:03.905 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:03.905 08:50:52 -- target/invalid.sh@28 -- # [[ % == \- ]] 00:12:03.905 08:50:52 -- target/invalid.sh@31 -- # echo '%PMBVYuNt`uW$S5Q!Ko%' 00:12:03.905 08:50:52 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s '%PMBVYuNt`uW$S5Q!Ko%' nqn.2016-06.io.spdk:cnode3545 00:12:04.164 [2024-07-15 08:50:52.633785] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode3545: invalid serial number '%PMBVYuNt`uW$S5Q!Ko%' 00:12:04.164 08:50:52 -- target/invalid.sh@54 -- # out='request: 00:12:04.164 { 00:12:04.164 "nqn": "nqn.2016-06.io.spdk:cnode3545", 00:12:04.164 "serial_number": "%PMBVYuNt`\u007fuW$S5Q!Ko%", 00:12:04.164 "method": "nvmf_create_subsystem", 00:12:04.164 "req_id": 1 00:12:04.164 } 00:12:04.164 Got JSON-RPC error response 00:12:04.164 response: 00:12:04.164 { 00:12:04.164 "code": -32602, 00:12:04.164 "message": "Invalid SN %PMBVYuNt`\u007fuW$S5Q!Ko%" 00:12:04.164 }' 00:12:04.164 08:50:52 -- target/invalid.sh@55 -- # [[ request: 00:12:04.164 { 00:12:04.164 "nqn": "nqn.2016-06.io.spdk:cnode3545", 00:12:04.164 "serial_number": "%PMBVYuNt`\u007fuW$S5Q!Ko%", 00:12:04.164 "method": "nvmf_create_subsystem", 00:12:04.164 "req_id": 1 00:12:04.164 } 00:12:04.164 Got JSON-RPC error response 00:12:04.164 response: 00:12:04.164 { 00:12:04.164 "code": -32602, 00:12:04.164 "message": "Invalid SN %PMBVYuNt`\u007fuW$S5Q!Ko%" 00:12:04.164 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:12:04.164 08:50:52 -- target/invalid.sh@58 -- # gen_random_s 41 00:12:04.164 08:50:52 -- target/invalid.sh@19 -- # local length=41 ll 00:12:04.164 08:50:52 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:12:04.164 08:50:52 -- target/invalid.sh@21 -- # local chars 00:12:04.164 08:50:52 -- target/invalid.sh@22 -- # local string 00:12:04.164 08:50:52 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:12:04.164 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:04.164 08:50:52 -- target/invalid.sh@25 -- # printf %x 57 00:12:04.164 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x39' 00:12:04.164 08:50:52 -- target/invalid.sh@25 -- # string+=9 00:12:04.164 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:04.164 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:04.164 08:50:52 -- target/invalid.sh@25 -- # printf %x 74 00:12:04.164 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x4a' 00:12:04.164 08:50:52 -- target/invalid.sh@25 -- # string+=J 00:12:04.164 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:04.164 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:04.164 08:50:52 -- target/invalid.sh@25 -- # printf %x 49 00:12:04.164 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x31' 00:12:04.164 08:50:52 -- target/invalid.sh@25 -- # string+=1 00:12:04.164 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:04.164 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:04.164 08:50:52 -- target/invalid.sh@25 -- # printf %x 89 00:12:04.164 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x59' 00:12:04.164 08:50:52 -- target/invalid.sh@25 -- # string+=Y 00:12:04.164 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:04.164 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:04.164 08:50:52 -- target/invalid.sh@25 -- # printf %x 40 00:12:04.164 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x28' 00:12:04.164 08:50:52 -- target/invalid.sh@25 -- # string+='(' 00:12:04.164 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:04.164 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:04.164 08:50:52 -- target/invalid.sh@25 -- # printf %x 100 00:12:04.164 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x64' 00:12:04.164 08:50:52 -- target/invalid.sh@25 -- # string+=d 00:12:04.164 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:04.164 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:04.164 08:50:52 -- target/invalid.sh@25 -- # printf %x 107 00:12:04.164 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x6b' 00:12:04.164 08:50:52 -- target/invalid.sh@25 -- # string+=k 00:12:04.164 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:04.164 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:04.164 08:50:52 -- target/invalid.sh@25 -- # printf %x 92 00:12:04.164 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x5c' 00:12:04.164 08:50:52 -- target/invalid.sh@25 -- # string+='\' 00:12:04.164 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:04.164 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:04.164 08:50:52 -- target/invalid.sh@25 -- # printf %x 47 00:12:04.164 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x2f' 00:12:04.164 08:50:52 -- target/invalid.sh@25 -- # string+=/ 00:12:04.164 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:04.164 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:04.165 08:50:52 -- target/invalid.sh@25 -- # printf %x 90 00:12:04.165 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x5a' 00:12:04.165 08:50:52 -- target/invalid.sh@25 -- # string+=Z 00:12:04.165 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:04.165 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:04.165 08:50:52 -- target/invalid.sh@25 -- # printf %x 51 00:12:04.165 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x33' 00:12:04.165 08:50:52 -- target/invalid.sh@25 -- # string+=3 00:12:04.165 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:04.165 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:04.165 08:50:52 -- target/invalid.sh@25 -- # printf %x 52 00:12:04.165 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x34' 00:12:04.165 08:50:52 -- target/invalid.sh@25 -- # string+=4 00:12:04.165 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:04.165 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:04.165 08:50:52 -- target/invalid.sh@25 -- # printf %x 61 00:12:04.165 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x3d' 00:12:04.165 08:50:52 -- target/invalid.sh@25 -- # string+== 00:12:04.165 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:04.165 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:04.165 08:50:52 -- target/invalid.sh@25 -- # printf %x 55 00:12:04.165 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x37' 00:12:04.165 08:50:52 -- target/invalid.sh@25 -- # string+=7 00:12:04.165 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:04.165 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:04.165 08:50:52 -- target/invalid.sh@25 -- # printf %x 41 00:12:04.165 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x29' 00:12:04.165 08:50:52 -- target/invalid.sh@25 -- # string+=')' 00:12:04.165 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:04.165 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:04.165 08:50:52 -- target/invalid.sh@25 -- # printf %x 111 00:12:04.165 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:12:04.165 08:50:52 -- target/invalid.sh@25 -- # string+=o 00:12:04.165 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:04.165 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # printf %x 42 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x2a' 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # string+='*' 00:12:04.424 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:04.424 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # printf %x 104 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x68' 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # string+=h 00:12:04.424 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:04.424 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # printf %x 74 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x4a' 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # string+=J 00:12:04.424 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:04.424 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # printf %x 46 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x2e' 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # string+=. 00:12:04.424 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:04.424 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # printf %x 68 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x44' 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # string+=D 00:12:04.424 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:04.424 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # printf %x 108 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # string+=l 00:12:04.424 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:04.424 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # printf %x 104 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x68' 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # string+=h 00:12:04.424 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:04.424 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # printf %x 66 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x42' 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # string+=B 00:12:04.424 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:04.424 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # printf %x 118 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x76' 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # string+=v 00:12:04.424 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:04.424 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # printf %x 58 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x3a' 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # string+=: 00:12:04.424 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:04.424 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # printf %x 57 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x39' 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # string+=9 00:12:04.424 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:04.424 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # printf %x 59 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x3b' 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # string+=';' 00:12:04.424 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:04.424 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # printf %x 60 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x3c' 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # string+='<' 00:12:04.424 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:04.424 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # printf %x 49 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x31' 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # string+=1 00:12:04.424 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:04.424 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # printf %x 51 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x33' 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # string+=3 00:12:04.424 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:04.424 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # printf %x 84 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x54' 00:12:04.424 08:50:52 -- target/invalid.sh@25 -- # string+=T 00:12:04.425 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:04.425 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:04.425 08:50:52 -- target/invalid.sh@25 -- # printf %x 68 00:12:04.425 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x44' 00:12:04.425 08:50:52 -- target/invalid.sh@25 -- # string+=D 00:12:04.425 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:04.425 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:04.425 08:50:52 -- target/invalid.sh@25 -- # printf %x 46 00:12:04.425 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x2e' 00:12:04.425 08:50:52 -- target/invalid.sh@25 -- # string+=. 00:12:04.425 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:04.425 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:04.425 08:50:52 -- target/invalid.sh@25 -- # printf %x 62 00:12:04.425 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x3e' 00:12:04.425 08:50:52 -- target/invalid.sh@25 -- # string+='>' 00:12:04.425 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:04.425 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:04.425 08:50:52 -- target/invalid.sh@25 -- # printf %x 36 00:12:04.425 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x24' 00:12:04.425 08:50:52 -- target/invalid.sh@25 -- # string+='$' 00:12:04.425 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:04.425 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:04.425 08:50:52 -- target/invalid.sh@25 -- # printf %x 97 00:12:04.425 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x61' 00:12:04.425 08:50:52 -- target/invalid.sh@25 -- # string+=a 00:12:04.425 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:04.425 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:04.425 08:50:52 -- target/invalid.sh@25 -- # printf %x 84 00:12:04.425 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x54' 00:12:04.425 08:50:52 -- target/invalid.sh@25 -- # string+=T 00:12:04.425 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:04.425 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:04.425 08:50:52 -- target/invalid.sh@25 -- # printf %x 53 00:12:04.425 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x35' 00:12:04.425 08:50:52 -- target/invalid.sh@25 -- # string+=5 00:12:04.425 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:04.425 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:04.425 08:50:52 -- target/invalid.sh@25 -- # printf %x 112 00:12:04.425 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x70' 00:12:04.425 08:50:52 -- target/invalid.sh@25 -- # string+=p 00:12:04.425 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:04.425 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:04.425 08:50:52 -- target/invalid.sh@25 -- # printf %x 79 00:12:04.425 08:50:52 -- target/invalid.sh@25 -- # echo -e '\x4f' 00:12:04.425 08:50:52 -- target/invalid.sh@25 -- # string+=O 00:12:04.425 08:50:52 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:04.425 08:50:52 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:04.425 08:50:52 -- target/invalid.sh@28 -- # [[ 9 == \- ]] 00:12:04.425 08:50:52 -- target/invalid.sh@31 -- # echo '9J1Y(dk\/Z34=7)o*hJ.DlhBv:9;<13TD.>$aT5pO' 00:12:04.425 08:50:52 -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d '9J1Y(dk\/Z34=7)o*hJ.DlhBv:9;<13TD.>$aT5pO' nqn.2016-06.io.spdk:cnode25419 00:12:04.684 [2024-07-15 08:50:53.003041] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode25419: invalid model number '9J1Y(dk\/Z34=7)o*hJ.DlhBv:9;<13TD.>$aT5pO' 00:12:04.684 08:50:53 -- target/invalid.sh@58 -- # out='request: 00:12:04.684 { 00:12:04.684 "nqn": "nqn.2016-06.io.spdk:cnode25419", 00:12:04.684 "model_number": "9J1Y(dk\\/Z34=7)o*hJ.DlhBv:9;<13TD.>$aT5pO", 00:12:04.684 "method": "nvmf_create_subsystem", 00:12:04.684 "req_id": 1 00:12:04.684 } 00:12:04.684 Got JSON-RPC error response 00:12:04.684 response: 00:12:04.684 { 00:12:04.684 "code": -32602, 00:12:04.684 "message": "Invalid MN 9J1Y(dk\\/Z34=7)o*hJ.DlhBv:9;<13TD.>$aT5pO" 00:12:04.684 }' 00:12:04.684 08:50:53 -- target/invalid.sh@59 -- # [[ request: 00:12:04.684 { 00:12:04.684 "nqn": "nqn.2016-06.io.spdk:cnode25419", 00:12:04.684 "model_number": "9J1Y(dk\\/Z34=7)o*hJ.DlhBv:9;<13TD.>$aT5pO", 00:12:04.684 "method": "nvmf_create_subsystem", 00:12:04.684 "req_id": 1 00:12:04.684 } 00:12:04.684 Got JSON-RPC error response 00:12:04.684 response: 00:12:04.684 { 00:12:04.684 "code": -32602, 00:12:04.684 "message": "Invalid MN 9J1Y(dk\\/Z34=7)o*hJ.DlhBv:9;<13TD.>$aT5pO" 00:12:04.684 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:12:04.684 08:50:53 -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype tcp 00:12:04.944 [2024-07-15 08:50:53.235895] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:04.944 08:50:53 -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:12:05.202 08:50:53 -- target/invalid.sh@64 -- # [[ tcp == \T\C\P ]] 00:12:05.202 08:50:53 -- target/invalid.sh@67 -- # echo '' 00:12:05.202 08:50:53 -- target/invalid.sh@67 -- # head -n 1 00:12:05.202 08:50:53 -- target/invalid.sh@67 -- # IP= 00:12:05.202 08:50:53 -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t tcp -a '' -s 4421 00:12:05.202 [2024-07-15 08:50:53.721507] nvmf_rpc.c: 783:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:12:05.202 08:50:53 -- target/invalid.sh@69 -- # out='request: 00:12:05.202 { 00:12:05.202 "nqn": "nqn.2016-06.io.spdk:cnode", 00:12:05.202 "listen_address": { 00:12:05.202 "trtype": "tcp", 00:12:05.202 "traddr": "", 00:12:05.202 "trsvcid": "4421" 00:12:05.202 }, 00:12:05.202 "method": "nvmf_subsystem_remove_listener", 00:12:05.202 "req_id": 1 00:12:05.202 } 00:12:05.202 Got JSON-RPC error response 00:12:05.202 response: 00:12:05.202 { 00:12:05.202 "code": -32602, 00:12:05.202 "message": "Invalid parameters" 00:12:05.202 }' 00:12:05.202 08:50:53 -- target/invalid.sh@70 -- # [[ request: 00:12:05.202 { 00:12:05.202 "nqn": "nqn.2016-06.io.spdk:cnode", 00:12:05.202 "listen_address": { 00:12:05.202 "trtype": "tcp", 00:12:05.202 "traddr": "", 00:12:05.202 "trsvcid": "4421" 00:12:05.202 }, 00:12:05.202 "method": "nvmf_subsystem_remove_listener", 00:12:05.202 "req_id": 1 00:12:05.202 } 00:12:05.202 Got JSON-RPC error response 00:12:05.202 response: 00:12:05.202 { 00:12:05.202 "code": -32602, 00:12:05.202 "message": "Invalid parameters" 00:12:05.202 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:12:05.202 08:50:53 -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3683 -i 0 00:12:05.459 [2024-07-15 08:50:53.966362] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode3683: invalid cntlid range [0-65519] 00:12:05.459 08:50:53 -- target/invalid.sh@73 -- # out='request: 00:12:05.459 { 00:12:05.459 "nqn": "nqn.2016-06.io.spdk:cnode3683", 00:12:05.459 "min_cntlid": 0, 00:12:05.459 "method": "nvmf_create_subsystem", 00:12:05.459 "req_id": 1 00:12:05.459 } 00:12:05.459 Got JSON-RPC error response 00:12:05.459 response: 00:12:05.459 { 00:12:05.459 "code": -32602, 00:12:05.459 "message": "Invalid cntlid range [0-65519]" 00:12:05.459 }' 00:12:05.459 08:50:53 -- target/invalid.sh@74 -- # [[ request: 00:12:05.459 { 00:12:05.460 "nqn": "nqn.2016-06.io.spdk:cnode3683", 00:12:05.460 "min_cntlid": 0, 00:12:05.460 "method": "nvmf_create_subsystem", 00:12:05.460 "req_id": 1 00:12:05.460 } 00:12:05.460 Got JSON-RPC error response 00:12:05.460 response: 00:12:05.460 { 00:12:05.460 "code": -32602, 00:12:05.460 "message": "Invalid cntlid range [0-65519]" 00:12:05.460 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:05.460 08:50:53 -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode27664 -i 65520 00:12:05.717 [2024-07-15 08:50:54.207121] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode27664: invalid cntlid range [65520-65519] 00:12:05.717 08:50:54 -- target/invalid.sh@75 -- # out='request: 00:12:05.717 { 00:12:05.717 "nqn": "nqn.2016-06.io.spdk:cnode27664", 00:12:05.717 "min_cntlid": 65520, 00:12:05.717 "method": "nvmf_create_subsystem", 00:12:05.717 "req_id": 1 00:12:05.717 } 00:12:05.717 Got JSON-RPC error response 00:12:05.717 response: 00:12:05.717 { 00:12:05.717 "code": -32602, 00:12:05.717 "message": "Invalid cntlid range [65520-65519]" 00:12:05.717 }' 00:12:05.717 08:50:54 -- target/invalid.sh@76 -- # [[ request: 00:12:05.717 { 00:12:05.717 "nqn": "nqn.2016-06.io.spdk:cnode27664", 00:12:05.717 "min_cntlid": 65520, 00:12:05.717 "method": "nvmf_create_subsystem", 00:12:05.717 "req_id": 1 00:12:05.717 } 00:12:05.717 Got JSON-RPC error response 00:12:05.717 response: 00:12:05.717 { 00:12:05.717 "code": -32602, 00:12:05.717 "message": "Invalid cntlid range [65520-65519]" 00:12:05.717 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:05.717 08:50:54 -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5656 -I 0 00:12:05.976 [2024-07-15 08:50:54.447925] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode5656: invalid cntlid range [1-0] 00:12:05.976 08:50:54 -- target/invalid.sh@77 -- # out='request: 00:12:05.976 { 00:12:05.976 "nqn": "nqn.2016-06.io.spdk:cnode5656", 00:12:05.976 "max_cntlid": 0, 00:12:05.976 "method": "nvmf_create_subsystem", 00:12:05.976 "req_id": 1 00:12:05.976 } 00:12:05.976 Got JSON-RPC error response 00:12:05.976 response: 00:12:05.976 { 00:12:05.976 "code": -32602, 00:12:05.976 "message": "Invalid cntlid range [1-0]" 00:12:05.976 }' 00:12:05.976 08:50:54 -- target/invalid.sh@78 -- # [[ request: 00:12:05.976 { 00:12:05.976 "nqn": "nqn.2016-06.io.spdk:cnode5656", 00:12:05.976 "max_cntlid": 0, 00:12:05.976 "method": "nvmf_create_subsystem", 00:12:05.976 "req_id": 1 00:12:05.976 } 00:12:05.976 Got JSON-RPC error response 00:12:05.976 response: 00:12:05.976 { 00:12:05.976 "code": -32602, 00:12:05.976 "message": "Invalid cntlid range [1-0]" 00:12:05.976 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:05.976 08:50:54 -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode24953 -I 65520 00:12:06.271 [2024-07-15 08:50:54.680713] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode24953: invalid cntlid range [1-65520] 00:12:06.271 08:50:54 -- target/invalid.sh@79 -- # out='request: 00:12:06.271 { 00:12:06.271 "nqn": "nqn.2016-06.io.spdk:cnode24953", 00:12:06.271 "max_cntlid": 65520, 00:12:06.271 "method": "nvmf_create_subsystem", 00:12:06.271 "req_id": 1 00:12:06.271 } 00:12:06.271 Got JSON-RPC error response 00:12:06.271 response: 00:12:06.271 { 00:12:06.271 "code": -32602, 00:12:06.271 "message": "Invalid cntlid range [1-65520]" 00:12:06.271 }' 00:12:06.271 08:50:54 -- target/invalid.sh@80 -- # [[ request: 00:12:06.271 { 00:12:06.271 "nqn": "nqn.2016-06.io.spdk:cnode24953", 00:12:06.271 "max_cntlid": 65520, 00:12:06.271 "method": "nvmf_create_subsystem", 00:12:06.271 "req_id": 1 00:12:06.271 } 00:12:06.271 Got JSON-RPC error response 00:12:06.271 response: 00:12:06.271 { 00:12:06.271 "code": -32602, 00:12:06.271 "message": "Invalid cntlid range [1-65520]" 00:12:06.271 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:06.271 08:50:54 -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8193 -i 6 -I 5 00:12:06.529 [2024-07-15 08:50:54.941631] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode8193: invalid cntlid range [6-5] 00:12:06.529 08:50:54 -- target/invalid.sh@83 -- # out='request: 00:12:06.529 { 00:12:06.529 "nqn": "nqn.2016-06.io.spdk:cnode8193", 00:12:06.529 "min_cntlid": 6, 00:12:06.529 "max_cntlid": 5, 00:12:06.529 "method": "nvmf_create_subsystem", 00:12:06.529 "req_id": 1 00:12:06.529 } 00:12:06.529 Got JSON-RPC error response 00:12:06.529 response: 00:12:06.529 { 00:12:06.529 "code": -32602, 00:12:06.529 "message": "Invalid cntlid range [6-5]" 00:12:06.529 }' 00:12:06.529 08:50:54 -- target/invalid.sh@84 -- # [[ request: 00:12:06.529 { 00:12:06.529 "nqn": "nqn.2016-06.io.spdk:cnode8193", 00:12:06.529 "min_cntlid": 6, 00:12:06.529 "max_cntlid": 5, 00:12:06.529 "method": "nvmf_create_subsystem", 00:12:06.529 "req_id": 1 00:12:06.529 } 00:12:06.529 Got JSON-RPC error response 00:12:06.529 response: 00:12:06.529 { 00:12:06.529 "code": -32602, 00:12:06.529 "message": "Invalid cntlid range [6-5]" 00:12:06.529 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:06.529 08:50:54 -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:12:06.789 08:50:55 -- target/invalid.sh@87 -- # out='request: 00:12:06.789 { 00:12:06.789 "name": "foobar", 00:12:06.789 "method": "nvmf_delete_target", 00:12:06.789 "req_id": 1 00:12:06.789 } 00:12:06.789 Got JSON-RPC error response 00:12:06.789 response: 00:12:06.789 { 00:12:06.789 "code": -32602, 00:12:06.789 "message": "The specified target doesn'\''t exist, cannot delete it." 00:12:06.789 }' 00:12:06.789 08:50:55 -- target/invalid.sh@88 -- # [[ request: 00:12:06.789 { 00:12:06.789 "name": "foobar", 00:12:06.789 "method": "nvmf_delete_target", 00:12:06.789 "req_id": 1 00:12:06.789 } 00:12:06.789 Got JSON-RPC error response 00:12:06.789 response: 00:12:06.789 { 00:12:06.789 "code": -32602, 00:12:06.789 "message": "The specified target doesn't exist, cannot delete it." 00:12:06.789 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:12:06.789 08:50:55 -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:12:06.789 08:50:55 -- target/invalid.sh@91 -- # nvmftestfini 00:12:06.789 08:50:55 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:06.789 08:50:55 -- nvmf/common.sh@116 -- # sync 00:12:06.789 08:50:55 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:06.789 08:50:55 -- nvmf/common.sh@119 -- # set +e 00:12:06.789 08:50:55 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:06.789 08:50:55 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:06.789 rmmod nvme_tcp 00:12:06.789 rmmod nvme_fabrics 00:12:06.789 rmmod nvme_keyring 00:12:06.789 08:50:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:06.789 08:50:55 -- nvmf/common.sh@123 -- # set -e 00:12:06.789 08:50:55 -- nvmf/common.sh@124 -- # return 0 00:12:06.789 08:50:55 -- nvmf/common.sh@477 -- # '[' -n 1451113 ']' 00:12:06.789 08:50:55 -- nvmf/common.sh@478 -- # killprocess 1451113 00:12:06.789 08:50:55 -- common/autotest_common.sh@926 -- # '[' -z 1451113 ']' 00:12:06.789 08:50:55 -- common/autotest_common.sh@930 -- # kill -0 1451113 00:12:06.789 08:50:55 -- common/autotest_common.sh@931 -- # uname 00:12:06.789 08:50:55 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:12:06.789 08:50:55 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1451113 00:12:06.789 08:50:55 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:12:06.789 08:50:55 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:12:06.789 08:50:55 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1451113' 00:12:06.789 killing process with pid 1451113 00:12:06.789 08:50:55 -- common/autotest_common.sh@945 -- # kill 1451113 00:12:06.789 08:50:55 -- common/autotest_common.sh@950 -- # wait 1451113 00:12:07.050 08:50:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:07.050 08:50:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:07.050 08:50:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:07.050 08:50:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:07.050 08:50:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:07.050 08:50:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:07.050 08:50:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:07.050 08:50:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:08.956 08:50:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:08.956 00:12:08.956 real 0m9.147s 00:12:08.956 user 0m22.113s 00:12:08.956 sys 0m2.464s 00:12:08.956 08:50:57 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:12:08.956 08:50:57 -- common/autotest_common.sh@10 -- # set +x 00:12:08.956 ************************************ 00:12:08.956 END TEST nvmf_invalid 00:12:08.956 ************************************ 00:12:09.215 08:50:57 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:12:09.215 08:50:57 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:12:09.215 08:50:57 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:12:09.215 08:50:57 -- common/autotest_common.sh@10 -- # set +x 00:12:09.215 ************************************ 00:12:09.215 START TEST nvmf_abort 00:12:09.215 ************************************ 00:12:09.215 08:50:57 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:12:09.215 * Looking for test storage... 00:12:09.215 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:09.215 08:50:57 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:09.215 08:50:57 -- nvmf/common.sh@7 -- # uname -s 00:12:09.215 08:50:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:09.215 08:50:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:09.215 08:50:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:09.215 08:50:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:09.215 08:50:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:09.215 08:50:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:09.215 08:50:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:09.215 08:50:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:09.215 08:50:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:09.215 08:50:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:09.215 08:50:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:09.215 08:50:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:09.215 08:50:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:09.215 08:50:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:09.215 08:50:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:09.215 08:50:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:09.215 08:50:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:09.215 08:50:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:09.215 08:50:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:09.215 08:50:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:09.216 08:50:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:09.216 08:50:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:09.216 08:50:57 -- paths/export.sh@5 -- # export PATH 00:12:09.216 08:50:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:09.216 08:50:57 -- nvmf/common.sh@46 -- # : 0 00:12:09.216 08:50:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:09.216 08:50:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:09.216 08:50:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:09.216 08:50:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:09.216 08:50:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:09.216 08:50:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:09.216 08:50:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:09.216 08:50:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:09.216 08:50:57 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:12:09.216 08:50:57 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:12:09.216 08:50:57 -- target/abort.sh@14 -- # nvmftestinit 00:12:09.216 08:50:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:09.216 08:50:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:09.216 08:50:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:09.216 08:50:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:09.216 08:50:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:09.216 08:50:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:09.216 08:50:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:09.216 08:50:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:09.216 08:50:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:09.216 08:50:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:09.216 08:50:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:09.216 08:50:57 -- common/autotest_common.sh@10 -- # set +x 00:12:11.121 08:50:59 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:11.121 08:50:59 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:11.121 08:50:59 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:11.121 08:50:59 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:11.121 08:50:59 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:11.121 08:50:59 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:11.121 08:50:59 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:11.121 08:50:59 -- nvmf/common.sh@294 -- # net_devs=() 00:12:11.121 08:50:59 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:11.121 08:50:59 -- nvmf/common.sh@295 -- # e810=() 00:12:11.121 08:50:59 -- nvmf/common.sh@295 -- # local -ga e810 00:12:11.121 08:50:59 -- nvmf/common.sh@296 -- # x722=() 00:12:11.121 08:50:59 -- nvmf/common.sh@296 -- # local -ga x722 00:12:11.121 08:50:59 -- nvmf/common.sh@297 -- # mlx=() 00:12:11.121 08:50:59 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:11.121 08:50:59 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:11.121 08:50:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:11.121 08:50:59 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:11.121 08:50:59 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:11.121 08:50:59 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:11.121 08:50:59 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:11.121 08:50:59 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:11.121 08:50:59 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:11.121 08:50:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:11.121 08:50:59 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:11.121 08:50:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:11.121 08:50:59 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:11.121 08:50:59 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:11.121 08:50:59 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:11.121 08:50:59 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:11.121 08:50:59 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:11.121 08:50:59 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:11.121 08:50:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:11.121 08:50:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:11.121 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:11.121 08:50:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:11.121 08:50:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:11.121 08:50:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:11.121 08:50:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:11.121 08:50:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:11.121 08:50:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:11.121 08:50:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:11.121 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:11.121 08:50:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:11.121 08:50:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:11.121 08:50:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:11.121 08:50:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:11.121 08:50:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:11.121 08:50:59 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:11.121 08:50:59 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:11.121 08:50:59 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:11.121 08:50:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:11.121 08:50:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:11.121 08:50:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:11.121 08:50:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:11.121 08:50:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:11.121 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:11.121 08:50:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:11.121 08:50:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:11.121 08:50:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:11.121 08:50:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:11.121 08:50:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:11.121 08:50:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:11.121 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:11.121 08:50:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:11.121 08:50:59 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:11.121 08:50:59 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:11.121 08:50:59 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:11.121 08:50:59 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:11.122 08:50:59 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:11.122 08:50:59 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:11.122 08:50:59 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:11.122 08:50:59 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:11.122 08:50:59 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:11.122 08:50:59 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:11.122 08:50:59 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:11.122 08:50:59 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:11.122 08:50:59 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:11.122 08:50:59 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:11.122 08:50:59 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:11.122 08:50:59 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:11.122 08:50:59 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:11.122 08:50:59 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:11.122 08:50:59 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:11.122 08:50:59 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:11.122 08:50:59 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:11.122 08:50:59 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:11.380 08:50:59 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:11.380 08:50:59 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:11.380 08:50:59 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:11.380 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:11.380 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.193 ms 00:12:11.380 00:12:11.380 --- 10.0.0.2 ping statistics --- 00:12:11.380 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:11.380 rtt min/avg/max/mdev = 0.193/0.193/0.193/0.000 ms 00:12:11.380 08:50:59 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:11.380 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:11.380 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.118 ms 00:12:11.380 00:12:11.380 --- 10.0.0.1 ping statistics --- 00:12:11.380 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:11.380 rtt min/avg/max/mdev = 0.118/0.118/0.118/0.000 ms 00:12:11.380 08:50:59 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:11.380 08:50:59 -- nvmf/common.sh@410 -- # return 0 00:12:11.380 08:50:59 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:11.380 08:50:59 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:11.380 08:50:59 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:11.380 08:50:59 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:11.380 08:50:59 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:11.380 08:50:59 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:11.380 08:50:59 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:11.380 08:50:59 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:12:11.380 08:50:59 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:11.380 08:50:59 -- common/autotest_common.sh@712 -- # xtrace_disable 00:12:11.380 08:50:59 -- common/autotest_common.sh@10 -- # set +x 00:12:11.380 08:50:59 -- nvmf/common.sh@469 -- # nvmfpid=1453779 00:12:11.380 08:50:59 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:11.380 08:50:59 -- nvmf/common.sh@470 -- # waitforlisten 1453779 00:12:11.380 08:50:59 -- common/autotest_common.sh@819 -- # '[' -z 1453779 ']' 00:12:11.380 08:50:59 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:11.380 08:50:59 -- common/autotest_common.sh@824 -- # local max_retries=100 00:12:11.380 08:50:59 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:11.380 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:11.380 08:50:59 -- common/autotest_common.sh@828 -- # xtrace_disable 00:12:11.380 08:50:59 -- common/autotest_common.sh@10 -- # set +x 00:12:11.380 [2024-07-15 08:50:59.782363] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:12:11.380 [2024-07-15 08:50:59.782457] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:11.380 EAL: No free 2048 kB hugepages reported on node 1 00:12:11.380 [2024-07-15 08:50:59.855888] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:11.639 [2024-07-15 08:50:59.976020] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:11.639 [2024-07-15 08:50:59.976200] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:11.639 [2024-07-15 08:50:59.976220] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:11.639 [2024-07-15 08:50:59.976234] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:11.639 [2024-07-15 08:50:59.976300] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:11.639 [2024-07-15 08:50:59.976357] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:11.639 [2024-07-15 08:50:59.976362] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:12.206 08:51:00 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:12:12.206 08:51:00 -- common/autotest_common.sh@852 -- # return 0 00:12:12.206 08:51:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:12.206 08:51:00 -- common/autotest_common.sh@718 -- # xtrace_disable 00:12:12.206 08:51:00 -- common/autotest_common.sh@10 -- # set +x 00:12:12.206 08:51:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:12.206 08:51:00 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:12:12.206 08:51:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:12.206 08:51:00 -- common/autotest_common.sh@10 -- # set +x 00:12:12.206 [2024-07-15 08:51:00.748035] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:12.464 08:51:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:12.464 08:51:00 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:12:12.464 08:51:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:12.464 08:51:00 -- common/autotest_common.sh@10 -- # set +x 00:12:12.464 Malloc0 00:12:12.464 08:51:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:12.464 08:51:00 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:12.464 08:51:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:12.464 08:51:00 -- common/autotest_common.sh@10 -- # set +x 00:12:12.464 Delay0 00:12:12.465 08:51:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:12.465 08:51:00 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:12:12.465 08:51:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:12.465 08:51:00 -- common/autotest_common.sh@10 -- # set +x 00:12:12.465 08:51:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:12.465 08:51:00 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:12:12.465 08:51:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:12.465 08:51:00 -- common/autotest_common.sh@10 -- # set +x 00:12:12.465 08:51:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:12.465 08:51:00 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:12:12.465 08:51:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:12.465 08:51:00 -- common/autotest_common.sh@10 -- # set +x 00:12:12.465 [2024-07-15 08:51:00.814689] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:12.465 08:51:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:12.465 08:51:00 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:12.465 08:51:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:12.465 08:51:00 -- common/autotest_common.sh@10 -- # set +x 00:12:12.465 08:51:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:12.465 08:51:00 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:12:12.465 EAL: No free 2048 kB hugepages reported on node 1 00:12:12.465 [2024-07-15 08:51:00.879938] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:12:14.999 Initializing NVMe Controllers 00:12:14.999 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:12:14.999 controller IO queue size 128 less than required 00:12:14.999 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:12:14.999 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:12:14.999 Initialization complete. Launching workers. 00:12:14.999 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 127, failed: 33004 00:12:14.999 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 33069, failed to submit 62 00:12:14.999 success 33004, unsuccess 65, failed 0 00:12:14.999 08:51:02 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:12:14.999 08:51:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:14.999 08:51:02 -- common/autotest_common.sh@10 -- # set +x 00:12:14.999 08:51:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:14.999 08:51:02 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:12:14.999 08:51:02 -- target/abort.sh@38 -- # nvmftestfini 00:12:14.999 08:51:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:14.999 08:51:02 -- nvmf/common.sh@116 -- # sync 00:12:14.999 08:51:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:14.999 08:51:02 -- nvmf/common.sh@119 -- # set +e 00:12:14.999 08:51:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:14.999 08:51:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:14.999 rmmod nvme_tcp 00:12:14.999 rmmod nvme_fabrics 00:12:14.999 rmmod nvme_keyring 00:12:14.999 08:51:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:14.999 08:51:02 -- nvmf/common.sh@123 -- # set -e 00:12:14.999 08:51:02 -- nvmf/common.sh@124 -- # return 0 00:12:14.999 08:51:02 -- nvmf/common.sh@477 -- # '[' -n 1453779 ']' 00:12:14.999 08:51:02 -- nvmf/common.sh@478 -- # killprocess 1453779 00:12:14.999 08:51:02 -- common/autotest_common.sh@926 -- # '[' -z 1453779 ']' 00:12:14.999 08:51:02 -- common/autotest_common.sh@930 -- # kill -0 1453779 00:12:14.999 08:51:02 -- common/autotest_common.sh@931 -- # uname 00:12:14.999 08:51:02 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:12:14.999 08:51:02 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1453779 00:12:14.999 08:51:03 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:12:14.999 08:51:03 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:12:14.999 08:51:03 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1453779' 00:12:14.999 killing process with pid 1453779 00:12:14.999 08:51:03 -- common/autotest_common.sh@945 -- # kill 1453779 00:12:14.999 08:51:03 -- common/autotest_common.sh@950 -- # wait 1453779 00:12:14.999 08:51:03 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:14.999 08:51:03 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:14.999 08:51:03 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:14.999 08:51:03 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:14.999 08:51:03 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:14.999 08:51:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:14.999 08:51:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:14.999 08:51:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:16.900 08:51:05 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:16.900 00:12:16.900 real 0m7.848s 00:12:16.900 user 0m12.338s 00:12:16.900 sys 0m2.477s 00:12:16.900 08:51:05 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:12:16.900 08:51:05 -- common/autotest_common.sh@10 -- # set +x 00:12:16.900 ************************************ 00:12:16.900 END TEST nvmf_abort 00:12:16.900 ************************************ 00:12:16.900 08:51:05 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:16.900 08:51:05 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:12:16.900 08:51:05 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:12:16.900 08:51:05 -- common/autotest_common.sh@10 -- # set +x 00:12:16.900 ************************************ 00:12:16.900 START TEST nvmf_ns_hotplug_stress 00:12:16.900 ************************************ 00:12:16.900 08:51:05 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:16.900 * Looking for test storage... 00:12:16.900 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:16.900 08:51:05 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:16.900 08:51:05 -- nvmf/common.sh@7 -- # uname -s 00:12:16.900 08:51:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:16.900 08:51:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:16.900 08:51:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:16.900 08:51:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:16.900 08:51:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:16.900 08:51:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:16.900 08:51:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:16.900 08:51:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:16.900 08:51:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:16.900 08:51:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:17.159 08:51:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:17.159 08:51:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:17.159 08:51:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:17.159 08:51:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:17.159 08:51:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:17.159 08:51:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:17.159 08:51:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:17.159 08:51:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:17.159 08:51:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:17.159 08:51:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:17.159 08:51:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:17.159 08:51:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:17.159 08:51:05 -- paths/export.sh@5 -- # export PATH 00:12:17.159 08:51:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:17.159 08:51:05 -- nvmf/common.sh@46 -- # : 0 00:12:17.159 08:51:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:17.159 08:51:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:17.159 08:51:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:17.159 08:51:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:17.159 08:51:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:17.159 08:51:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:17.159 08:51:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:17.159 08:51:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:17.159 08:51:05 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:17.159 08:51:05 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:12:17.159 08:51:05 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:17.159 08:51:05 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:17.159 08:51:05 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:17.159 08:51:05 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:17.159 08:51:05 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:17.159 08:51:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:17.159 08:51:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:17.159 08:51:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:17.159 08:51:05 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:17.159 08:51:05 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:17.159 08:51:05 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:17.159 08:51:05 -- common/autotest_common.sh@10 -- # set +x 00:12:19.057 08:51:07 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:19.057 08:51:07 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:19.057 08:51:07 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:19.057 08:51:07 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:19.057 08:51:07 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:19.057 08:51:07 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:19.057 08:51:07 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:19.057 08:51:07 -- nvmf/common.sh@294 -- # net_devs=() 00:12:19.057 08:51:07 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:19.057 08:51:07 -- nvmf/common.sh@295 -- # e810=() 00:12:19.057 08:51:07 -- nvmf/common.sh@295 -- # local -ga e810 00:12:19.057 08:51:07 -- nvmf/common.sh@296 -- # x722=() 00:12:19.057 08:51:07 -- nvmf/common.sh@296 -- # local -ga x722 00:12:19.057 08:51:07 -- nvmf/common.sh@297 -- # mlx=() 00:12:19.057 08:51:07 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:19.057 08:51:07 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:19.057 08:51:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:19.057 08:51:07 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:19.057 08:51:07 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:19.057 08:51:07 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:19.057 08:51:07 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:19.057 08:51:07 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:19.057 08:51:07 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:19.057 08:51:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:19.057 08:51:07 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:19.057 08:51:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:19.057 08:51:07 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:19.057 08:51:07 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:19.057 08:51:07 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:19.057 08:51:07 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:19.057 08:51:07 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:19.057 08:51:07 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:19.057 08:51:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:19.057 08:51:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:19.057 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:19.057 08:51:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:19.057 08:51:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:19.057 08:51:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:19.057 08:51:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:19.057 08:51:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:19.057 08:51:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:19.057 08:51:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:19.057 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:19.057 08:51:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:19.057 08:51:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:19.057 08:51:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:19.057 08:51:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:19.057 08:51:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:19.057 08:51:07 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:19.057 08:51:07 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:19.057 08:51:07 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:19.057 08:51:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:19.057 08:51:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:19.057 08:51:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:19.057 08:51:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:19.057 08:51:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:19.057 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:19.057 08:51:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:19.057 08:51:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:19.057 08:51:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:19.057 08:51:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:19.057 08:51:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:19.057 08:51:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:19.057 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:19.057 08:51:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:19.057 08:51:07 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:19.057 08:51:07 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:19.057 08:51:07 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:19.057 08:51:07 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:19.057 08:51:07 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:19.057 08:51:07 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:19.057 08:51:07 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:19.057 08:51:07 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:19.057 08:51:07 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:19.057 08:51:07 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:19.057 08:51:07 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:19.057 08:51:07 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:19.057 08:51:07 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:19.057 08:51:07 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:19.057 08:51:07 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:19.057 08:51:07 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:19.057 08:51:07 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:19.057 08:51:07 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:19.058 08:51:07 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:19.058 08:51:07 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:19.058 08:51:07 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:19.058 08:51:07 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:19.058 08:51:07 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:19.058 08:51:07 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:19.058 08:51:07 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:19.058 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:19.058 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.223 ms 00:12:19.058 00:12:19.058 --- 10.0.0.2 ping statistics --- 00:12:19.058 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:19.058 rtt min/avg/max/mdev = 0.223/0.223/0.223/0.000 ms 00:12:19.058 08:51:07 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:19.058 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:19.058 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.116 ms 00:12:19.058 00:12:19.058 --- 10.0.0.1 ping statistics --- 00:12:19.058 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:19.058 rtt min/avg/max/mdev = 0.116/0.116/0.116/0.000 ms 00:12:19.058 08:51:07 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:19.058 08:51:07 -- nvmf/common.sh@410 -- # return 0 00:12:19.058 08:51:07 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:19.058 08:51:07 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:19.058 08:51:07 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:19.058 08:51:07 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:19.058 08:51:07 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:19.058 08:51:07 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:19.058 08:51:07 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:19.058 08:51:07 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:12:19.058 08:51:07 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:19.058 08:51:07 -- common/autotest_common.sh@712 -- # xtrace_disable 00:12:19.058 08:51:07 -- common/autotest_common.sh@10 -- # set +x 00:12:19.058 08:51:07 -- nvmf/common.sh@469 -- # nvmfpid=1456423 00:12:19.058 08:51:07 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:19.058 08:51:07 -- nvmf/common.sh@470 -- # waitforlisten 1456423 00:12:19.058 08:51:07 -- common/autotest_common.sh@819 -- # '[' -z 1456423 ']' 00:12:19.058 08:51:07 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:19.058 08:51:07 -- common/autotest_common.sh@824 -- # local max_retries=100 00:12:19.058 08:51:07 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:19.058 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:19.058 08:51:07 -- common/autotest_common.sh@828 -- # xtrace_disable 00:12:19.058 08:51:07 -- common/autotest_common.sh@10 -- # set +x 00:12:19.058 [2024-07-15 08:51:07.548587] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:12:19.058 [2024-07-15 08:51:07.548666] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:19.058 EAL: No free 2048 kB hugepages reported on node 1 00:12:19.316 [2024-07-15 08:51:07.619369] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:19.316 [2024-07-15 08:51:07.737833] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:19.316 [2024-07-15 08:51:07.738025] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:19.316 [2024-07-15 08:51:07.738045] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:19.316 [2024-07-15 08:51:07.738060] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:19.316 [2024-07-15 08:51:07.738148] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:19.316 [2024-07-15 08:51:07.738216] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:19.316 [2024-07-15 08:51:07.738219] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:20.251 08:51:08 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:12:20.251 08:51:08 -- common/autotest_common.sh@852 -- # return 0 00:12:20.251 08:51:08 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:20.251 08:51:08 -- common/autotest_common.sh@718 -- # xtrace_disable 00:12:20.251 08:51:08 -- common/autotest_common.sh@10 -- # set +x 00:12:20.251 08:51:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:20.251 08:51:08 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:12:20.251 08:51:08 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:12:20.251 [2024-07-15 08:51:08.732067] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:20.251 08:51:08 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:12:20.508 08:51:09 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:20.766 [2024-07-15 08:51:09.235112] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:20.766 08:51:09 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:21.024 08:51:09 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:12:21.281 Malloc0 00:12:21.282 08:51:09 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:21.539 Delay0 00:12:21.539 08:51:09 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:21.796 08:51:10 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:12:22.053 NULL1 00:12:22.053 08:51:10 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:12:22.310 08:51:10 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=1457207 00:12:22.310 08:51:10 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:12:22.310 08:51:10 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1457207 00:12:22.310 08:51:10 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:22.310 EAL: No free 2048 kB hugepages reported on node 1 00:12:22.582 08:51:10 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:22.840 08:51:11 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:12:22.840 08:51:11 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:12:23.097 true 00:12:23.097 08:51:11 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1457207 00:12:23.097 08:51:11 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:23.355 08:51:11 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:23.613 08:51:11 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:12:23.613 08:51:11 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:12:23.613 true 00:12:23.872 08:51:12 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1457207 00:12:23.872 08:51:12 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:24.806 Read completed with error (sct=0, sc=11) 00:12:24.807 08:51:13 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:25.063 08:51:13 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:12:25.063 08:51:13 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:12:25.320 true 00:12:25.320 08:51:13 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1457207 00:12:25.320 08:51:13 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:25.578 08:51:13 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:25.578 08:51:14 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:12:25.578 08:51:14 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:12:25.835 true 00:12:25.835 08:51:14 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1457207 00:12:25.835 08:51:14 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:26.772 08:51:15 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:26.772 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:27.030 08:51:15 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:12:27.030 08:51:15 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:12:27.288 true 00:12:27.288 08:51:15 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1457207 00:12:27.288 08:51:15 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:27.547 08:51:15 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:27.805 08:51:16 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:12:27.805 08:51:16 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:12:28.063 true 00:12:28.063 08:51:16 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1457207 00:12:28.063 08:51:16 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:29.002 08:51:17 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:29.002 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:29.260 08:51:17 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:12:29.260 08:51:17 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:12:29.518 true 00:12:29.518 08:51:17 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1457207 00:12:29.518 08:51:17 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:29.777 08:51:18 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:29.777 08:51:18 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:12:29.777 08:51:18 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:12:30.035 true 00:12:30.035 08:51:18 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1457207 00:12:30.035 08:51:18 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:30.975 08:51:19 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:31.233 08:51:19 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:12:31.233 08:51:19 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:12:31.490 true 00:12:31.490 08:51:19 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1457207 00:12:31.490 08:51:19 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:31.748 08:51:20 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:32.006 08:51:20 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:12:32.006 08:51:20 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:12:32.263 true 00:12:32.263 08:51:20 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1457207 00:12:32.263 08:51:20 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:33.199 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:33.199 08:51:21 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:33.199 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:33.457 08:51:21 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:12:33.457 08:51:21 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:12:33.715 true 00:12:33.715 08:51:22 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1457207 00:12:33.715 08:51:22 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:33.973 08:51:22 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:34.232 08:51:22 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:12:34.232 08:51:22 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:12:34.232 true 00:12:34.492 08:51:22 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1457207 00:12:34.492 08:51:22 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:35.426 08:51:23 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:35.426 08:51:23 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:12:35.426 08:51:23 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:12:35.683 true 00:12:35.683 08:51:24 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1457207 00:12:35.683 08:51:24 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:35.962 08:51:24 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:36.232 08:51:24 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:12:36.232 08:51:24 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:12:36.489 true 00:12:36.489 08:51:24 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1457207 00:12:36.489 08:51:24 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:37.423 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:37.423 08:51:25 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:37.423 08:51:25 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:12:37.423 08:51:25 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:12:37.680 true 00:12:37.680 08:51:26 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1457207 00:12:37.680 08:51:26 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:37.938 08:51:26 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:38.195 08:51:26 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:12:38.195 08:51:26 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:12:38.453 true 00:12:38.453 08:51:26 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1457207 00:12:38.453 08:51:26 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:39.385 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:39.385 08:51:27 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:39.385 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:39.642 08:51:27 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:12:39.642 08:51:27 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:12:39.899 true 00:12:39.899 08:51:28 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1457207 00:12:39.899 08:51:28 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:40.157 08:51:28 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:40.414 08:51:28 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:12:40.414 08:51:28 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:12:40.697 true 00:12:40.697 08:51:29 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1457207 00:12:40.697 08:51:29 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:41.629 08:51:29 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:41.629 08:51:30 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:12:41.629 08:51:30 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:12:41.887 true 00:12:41.887 08:51:30 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1457207 00:12:41.887 08:51:30 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:42.452 08:51:30 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:42.452 08:51:30 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:12:42.452 08:51:30 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:12:42.709 true 00:12:42.709 08:51:31 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1457207 00:12:42.709 08:51:31 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:42.966 08:51:31 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:43.224 08:51:31 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:12:43.224 08:51:31 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:12:43.482 true 00:12:43.482 08:51:31 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1457207 00:12:43.482 08:51:31 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:44.413 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:44.671 08:51:32 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:44.671 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:44.671 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:44.671 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:44.671 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:44.671 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:44.671 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:44.671 08:51:33 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:12:44.671 08:51:33 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:12:44.927 true 00:12:44.927 08:51:33 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1457207 00:12:44.927 08:51:33 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:45.858 08:51:34 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:46.116 08:51:34 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:12:46.116 08:51:34 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:12:46.373 true 00:12:46.373 08:51:34 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1457207 00:12:46.373 08:51:34 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:46.631 08:51:34 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:46.631 08:51:35 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:12:46.631 08:51:35 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:12:46.890 true 00:12:46.890 08:51:35 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1457207 00:12:46.890 08:51:35 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:47.823 08:51:36 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:47.823 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:48.081 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:48.081 08:51:36 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:12:48.081 08:51:36 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:12:48.339 true 00:12:48.339 08:51:36 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1457207 00:12:48.339 08:51:36 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:48.597 08:51:37 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:48.855 08:51:37 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:12:48.855 08:51:37 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:12:49.113 true 00:12:49.113 08:51:37 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1457207 00:12:49.113 08:51:37 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:50.054 08:51:38 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:50.313 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:50.313 08:51:38 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:12:50.313 08:51:38 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:12:50.571 true 00:12:50.571 08:51:39 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1457207 00:12:50.571 08:51:39 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:50.829 08:51:39 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:51.087 08:51:39 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:12:51.087 08:51:39 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:12:51.344 true 00:12:51.344 08:51:39 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1457207 00:12:51.344 08:51:39 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:52.278 08:51:40 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:52.278 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:52.278 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:52.535 08:51:40 -- target/ns_hotplug_stress.sh@49 -- # null_size=1029 00:12:52.535 08:51:40 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:12:52.793 true 00:12:52.793 08:51:41 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1457207 00:12:52.793 08:51:41 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:52.793 Initializing NVMe Controllers 00:12:52.793 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:12:52.793 Controller IO queue size 128, less than required. 00:12:52.793 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:12:52.793 Controller IO queue size 128, less than required. 00:12:52.793 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:12:52.793 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:12:52.793 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:12:52.793 Initialization complete. Launching workers. 00:12:52.793 ======================================================== 00:12:52.793 Latency(us) 00:12:52.793 Device Information : IOPS MiB/s Average min max 00:12:52.793 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 720.92 0.35 92288.35 2440.18 1013360.69 00:12:52.793 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 11876.86 5.80 10746.40 1851.79 450373.79 00:12:52.793 ======================================================== 00:12:52.793 Total : 12597.78 6.15 15412.75 1851.79 1013360.69 00:12:52.793 00:12:53.051 08:51:41 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:53.051 08:51:41 -- target/ns_hotplug_stress.sh@49 -- # null_size=1030 00:12:53.051 08:51:41 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1030 00:12:53.309 true 00:12:53.309 08:51:41 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1457207 00:12:53.309 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (1457207) - No such process 00:12:53.309 08:51:41 -- target/ns_hotplug_stress.sh@53 -- # wait 1457207 00:12:53.309 08:51:41 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:53.567 08:51:42 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:53.825 08:51:42 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:12:53.825 08:51:42 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:12:53.825 08:51:42 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:12:53.825 08:51:42 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:53.825 08:51:42 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:12:54.083 null0 00:12:54.083 08:51:42 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:54.083 08:51:42 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:54.083 08:51:42 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:12:54.340 null1 00:12:54.340 08:51:42 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:54.340 08:51:42 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:54.340 08:51:42 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:12:54.598 null2 00:12:54.598 08:51:42 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:54.598 08:51:42 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:54.598 08:51:42 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:12:54.855 null3 00:12:54.855 08:51:43 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:54.855 08:51:43 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:54.855 08:51:43 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:12:55.111 null4 00:12:55.111 08:51:43 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:55.111 08:51:43 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:55.111 08:51:43 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:12:55.368 null5 00:12:55.368 08:51:43 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:55.368 08:51:43 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:55.368 08:51:43 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:12:55.624 null6 00:12:55.625 08:51:43 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:55.625 08:51:43 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:55.625 08:51:43 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:12:55.625 null7 00:12:55.625 08:51:44 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:55.625 08:51:44 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:55.625 08:51:44 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:12:55.625 08:51:44 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@66 -- # wait 1461353 1461356 1461359 1461362 1461365 1461369 1461372 1461375 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:55.883 08:51:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:56.141 08:51:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:56.141 08:51:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:56.141 08:51:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:56.141 08:51:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:56.141 08:51:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:56.141 08:51:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:56.141 08:51:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:56.141 08:51:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:56.399 08:51:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:56.399 08:51:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:56.399 08:51:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:56.399 08:51:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:56.399 08:51:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:56.399 08:51:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:56.399 08:51:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:56.399 08:51:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:56.399 08:51:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:56.399 08:51:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:56.399 08:51:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:56.399 08:51:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:56.399 08:51:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:56.399 08:51:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:56.399 08:51:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:56.399 08:51:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:56.399 08:51:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:56.399 08:51:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:56.399 08:51:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:56.399 08:51:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:56.399 08:51:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:56.399 08:51:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:56.399 08:51:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:56.399 08:51:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:56.657 08:51:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:56.657 08:51:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:56.657 08:51:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:56.657 08:51:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:56.657 08:51:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:56.657 08:51:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:56.657 08:51:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:56.657 08:51:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:56.915 08:51:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:56.915 08:51:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:56.915 08:51:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:56.915 08:51:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:56.915 08:51:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:56.915 08:51:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:56.915 08:51:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:56.915 08:51:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:56.915 08:51:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:56.915 08:51:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:56.915 08:51:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:56.915 08:51:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:56.915 08:51:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:56.915 08:51:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:56.915 08:51:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:56.915 08:51:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:56.915 08:51:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:56.915 08:51:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:56.915 08:51:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:56.915 08:51:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:56.915 08:51:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:56.915 08:51:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:56.915 08:51:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:56.915 08:51:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:57.173 08:51:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:57.173 08:51:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:57.173 08:51:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:57.173 08:51:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:57.173 08:51:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:57.173 08:51:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:57.173 08:51:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:57.173 08:51:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:57.431 08:51:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:57.431 08:51:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:57.431 08:51:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:57.431 08:51:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:57.431 08:51:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:57.431 08:51:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:57.431 08:51:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:57.431 08:51:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:57.431 08:51:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:57.431 08:51:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:57.431 08:51:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:57.431 08:51:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:57.431 08:51:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:57.431 08:51:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:57.431 08:51:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:57.431 08:51:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:57.431 08:51:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:57.431 08:51:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:57.431 08:51:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:57.431 08:51:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:57.431 08:51:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:57.431 08:51:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:57.431 08:51:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:57.431 08:51:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:57.688 08:51:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:57.688 08:51:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:57.688 08:51:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:57.688 08:51:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:57.688 08:51:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:57.688 08:51:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:57.688 08:51:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:57.688 08:51:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:57.945 08:51:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:57.945 08:51:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:57.945 08:51:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:57.945 08:51:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:57.945 08:51:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:57.945 08:51:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:57.945 08:51:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:57.945 08:51:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:57.945 08:51:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:57.945 08:51:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:57.945 08:51:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:57.945 08:51:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:57.945 08:51:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:57.945 08:51:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:57.945 08:51:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:57.945 08:51:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:57.945 08:51:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:57.945 08:51:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:57.945 08:51:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:57.945 08:51:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:57.945 08:51:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:57.945 08:51:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:57.945 08:51:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:57.945 08:51:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:58.202 08:51:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:58.202 08:51:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:58.202 08:51:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:58.202 08:51:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:58.202 08:51:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:58.202 08:51:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:58.202 08:51:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:58.202 08:51:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:58.486 08:51:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:58.486 08:51:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:58.487 08:51:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:58.487 08:51:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:58.487 08:51:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:58.487 08:51:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:58.487 08:51:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:58.487 08:51:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:58.487 08:51:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:58.487 08:51:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:58.487 08:51:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:58.487 08:51:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:58.487 08:51:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:58.487 08:51:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:58.487 08:51:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:58.487 08:51:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:58.487 08:51:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:58.487 08:51:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:58.487 08:51:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:58.487 08:51:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:58.487 08:51:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:58.487 08:51:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:58.487 08:51:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:58.487 08:51:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:58.744 08:51:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:58.744 08:51:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:58.744 08:51:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:58.744 08:51:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:58.744 08:51:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:58.744 08:51:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:58.745 08:51:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:58.745 08:51:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:59.001 08:51:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:59.001 08:51:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:59.001 08:51:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:59.001 08:51:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:59.001 08:51:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:59.001 08:51:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:59.001 08:51:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:59.001 08:51:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:59.001 08:51:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:59.001 08:51:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:59.001 08:51:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:59.001 08:51:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:59.001 08:51:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:59.001 08:51:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:59.001 08:51:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:59.001 08:51:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:59.001 08:51:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:59.001 08:51:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:59.001 08:51:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:59.001 08:51:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:59.001 08:51:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:59.001 08:51:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:59.001 08:51:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:59.001 08:51:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:59.258 08:51:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:59.259 08:51:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:59.259 08:51:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:59.259 08:51:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:59.259 08:51:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:59.259 08:51:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:59.259 08:51:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:59.259 08:51:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:59.515 08:51:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:59.515 08:51:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:59.515 08:51:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:59.515 08:51:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:59.515 08:51:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:59.515 08:51:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:59.515 08:51:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:59.515 08:51:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:59.515 08:51:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:59.515 08:51:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:59.515 08:51:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:59.515 08:51:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:59.515 08:51:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:59.515 08:51:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:59.515 08:51:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:59.515 08:51:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:59.515 08:51:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:59.515 08:51:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:59.515 08:51:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:59.515 08:51:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:59.515 08:51:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:59.515 08:51:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:59.515 08:51:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:59.515 08:51:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:59.773 08:51:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:59.773 08:51:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:59.773 08:51:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:59.773 08:51:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:59.773 08:51:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:59.773 08:51:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:59.773 08:51:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:59.773 08:51:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:00.031 08:51:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:00.031 08:51:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:00.031 08:51:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:00.031 08:51:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:00.031 08:51:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:00.031 08:51:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:00.031 08:51:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:00.031 08:51:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:00.031 08:51:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:00.031 08:51:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:00.031 08:51:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:00.031 08:51:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:00.031 08:51:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:00.031 08:51:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:00.031 08:51:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:00.031 08:51:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:00.031 08:51:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:00.031 08:51:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:00.031 08:51:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:00.031 08:51:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:00.031 08:51:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:00.031 08:51:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:00.031 08:51:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:00.031 08:51:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:00.289 08:51:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:00.289 08:51:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:00.289 08:51:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:00.289 08:51:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:00.289 08:51:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:00.289 08:51:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:00.289 08:51:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:00.289 08:51:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:00.547 08:51:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:00.547 08:51:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:00.547 08:51:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:00.547 08:51:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:00.547 08:51:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:00.547 08:51:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:00.547 08:51:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:00.547 08:51:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:00.547 08:51:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:00.547 08:51:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:00.547 08:51:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:00.547 08:51:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:00.547 08:51:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:00.547 08:51:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:00.547 08:51:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:00.547 08:51:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:00.547 08:51:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:00.547 08:51:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:00.547 08:51:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:00.547 08:51:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:00.547 08:51:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:00.547 08:51:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:00.547 08:51:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:00.547 08:51:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:00.804 08:51:49 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:00.804 08:51:49 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:00.804 08:51:49 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:00.804 08:51:49 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:00.804 08:51:49 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:00.804 08:51:49 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:00.804 08:51:49 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:00.804 08:51:49 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:01.061 08:51:49 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:01.061 08:51:49 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:01.061 08:51:49 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:01.061 08:51:49 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:01.062 08:51:49 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:01.062 08:51:49 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:01.062 08:51:49 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:01.062 08:51:49 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:01.062 08:51:49 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:01.062 08:51:49 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:01.062 08:51:49 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:01.062 08:51:49 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:01.062 08:51:49 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:01.062 08:51:49 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:01.062 08:51:49 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:01.062 08:51:49 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:01.062 08:51:49 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:13:01.062 08:51:49 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:13:01.062 08:51:49 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:01.062 08:51:49 -- nvmf/common.sh@116 -- # sync 00:13:01.062 08:51:49 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:01.062 08:51:49 -- nvmf/common.sh@119 -- # set +e 00:13:01.062 08:51:49 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:01.062 08:51:49 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:01.062 rmmod nvme_tcp 00:13:01.062 rmmod nvme_fabrics 00:13:01.062 rmmod nvme_keyring 00:13:01.062 08:51:49 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:01.062 08:51:49 -- nvmf/common.sh@123 -- # set -e 00:13:01.062 08:51:49 -- nvmf/common.sh@124 -- # return 0 00:13:01.062 08:51:49 -- nvmf/common.sh@477 -- # '[' -n 1456423 ']' 00:13:01.062 08:51:49 -- nvmf/common.sh@478 -- # killprocess 1456423 00:13:01.062 08:51:49 -- common/autotest_common.sh@926 -- # '[' -z 1456423 ']' 00:13:01.062 08:51:49 -- common/autotest_common.sh@930 -- # kill -0 1456423 00:13:01.062 08:51:49 -- common/autotest_common.sh@931 -- # uname 00:13:01.062 08:51:49 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:13:01.062 08:51:49 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1456423 00:13:01.062 08:51:49 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:13:01.062 08:51:49 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:13:01.062 08:51:49 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1456423' 00:13:01.062 killing process with pid 1456423 00:13:01.062 08:51:49 -- common/autotest_common.sh@945 -- # kill 1456423 00:13:01.062 08:51:49 -- common/autotest_common.sh@950 -- # wait 1456423 00:13:01.321 08:51:49 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:01.321 08:51:49 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:01.321 08:51:49 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:01.321 08:51:49 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:01.321 08:51:49 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:01.321 08:51:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:01.321 08:51:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:01.321 08:51:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:03.885 08:51:51 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:03.885 00:13:03.885 real 0m46.487s 00:13:03.885 user 3m29.655s 00:13:03.885 sys 0m16.226s 00:13:03.885 08:51:51 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:13:03.885 08:51:51 -- common/autotest_common.sh@10 -- # set +x 00:13:03.885 ************************************ 00:13:03.885 END TEST nvmf_ns_hotplug_stress 00:13:03.885 ************************************ 00:13:03.885 08:51:51 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:13:03.885 08:51:51 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:13:03.885 08:51:51 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:13:03.885 08:51:51 -- common/autotest_common.sh@10 -- # set +x 00:13:03.885 ************************************ 00:13:03.885 START TEST nvmf_connect_stress 00:13:03.885 ************************************ 00:13:03.885 08:51:51 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:13:03.885 * Looking for test storage... 00:13:03.885 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:03.885 08:51:51 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:03.885 08:51:51 -- nvmf/common.sh@7 -- # uname -s 00:13:03.885 08:51:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:03.885 08:51:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:03.885 08:51:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:03.885 08:51:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:03.885 08:51:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:03.885 08:51:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:03.885 08:51:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:03.885 08:51:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:03.885 08:51:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:03.885 08:51:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:03.885 08:51:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:03.885 08:51:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:03.885 08:51:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:03.885 08:51:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:03.886 08:51:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:03.886 08:51:51 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:03.886 08:51:51 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:03.886 08:51:51 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:03.886 08:51:51 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:03.886 08:51:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:03.886 08:51:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:03.886 08:51:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:03.886 08:51:51 -- paths/export.sh@5 -- # export PATH 00:13:03.886 08:51:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:03.886 08:51:51 -- nvmf/common.sh@46 -- # : 0 00:13:03.886 08:51:51 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:03.886 08:51:51 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:03.886 08:51:51 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:03.886 08:51:51 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:03.886 08:51:51 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:03.886 08:51:51 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:03.886 08:51:51 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:03.886 08:51:51 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:03.886 08:51:51 -- target/connect_stress.sh@12 -- # nvmftestinit 00:13:03.886 08:51:51 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:03.886 08:51:51 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:03.886 08:51:51 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:03.886 08:51:51 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:03.886 08:51:51 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:03.886 08:51:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:03.886 08:51:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:03.886 08:51:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:03.886 08:51:51 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:03.886 08:51:51 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:03.886 08:51:51 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:03.886 08:51:51 -- common/autotest_common.sh@10 -- # set +x 00:13:05.788 08:51:53 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:05.788 08:51:53 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:05.788 08:51:53 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:05.788 08:51:53 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:05.788 08:51:53 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:05.788 08:51:53 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:05.788 08:51:53 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:05.788 08:51:53 -- nvmf/common.sh@294 -- # net_devs=() 00:13:05.788 08:51:53 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:05.788 08:51:53 -- nvmf/common.sh@295 -- # e810=() 00:13:05.788 08:51:53 -- nvmf/common.sh@295 -- # local -ga e810 00:13:05.788 08:51:53 -- nvmf/common.sh@296 -- # x722=() 00:13:05.788 08:51:53 -- nvmf/common.sh@296 -- # local -ga x722 00:13:05.788 08:51:53 -- nvmf/common.sh@297 -- # mlx=() 00:13:05.788 08:51:53 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:05.788 08:51:53 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:05.788 08:51:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:05.788 08:51:53 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:05.788 08:51:53 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:05.788 08:51:53 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:05.788 08:51:53 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:05.788 08:51:53 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:05.788 08:51:53 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:05.788 08:51:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:05.788 08:51:53 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:05.788 08:51:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:05.788 08:51:53 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:05.788 08:51:53 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:05.788 08:51:53 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:05.788 08:51:53 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:05.788 08:51:53 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:05.788 08:51:53 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:05.788 08:51:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:05.788 08:51:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:05.788 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:05.788 08:51:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:05.788 08:51:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:05.788 08:51:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:05.788 08:51:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:05.788 08:51:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:05.788 08:51:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:05.788 08:51:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:05.788 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:05.788 08:51:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:05.788 08:51:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:05.788 08:51:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:05.788 08:51:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:05.788 08:51:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:05.788 08:51:53 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:05.788 08:51:53 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:05.788 08:51:53 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:05.788 08:51:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:05.788 08:51:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:05.788 08:51:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:05.788 08:51:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:05.788 08:51:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:05.788 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:05.788 08:51:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:05.788 08:51:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:05.788 08:51:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:05.788 08:51:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:05.788 08:51:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:05.788 08:51:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:05.788 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:05.788 08:51:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:05.788 08:51:53 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:05.788 08:51:53 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:05.788 08:51:53 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:05.788 08:51:53 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:05.788 08:51:53 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:05.788 08:51:53 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:05.788 08:51:53 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:05.788 08:51:53 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:05.788 08:51:53 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:05.788 08:51:53 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:05.788 08:51:53 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:05.788 08:51:53 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:05.788 08:51:53 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:05.788 08:51:53 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:05.788 08:51:53 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:05.789 08:51:53 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:05.789 08:51:53 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:05.789 08:51:53 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:05.789 08:51:53 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:05.789 08:51:53 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:05.789 08:51:53 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:05.789 08:51:53 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:05.789 08:51:54 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:05.789 08:51:54 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:05.789 08:51:54 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:05.789 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:05.789 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.173 ms 00:13:05.789 00:13:05.789 --- 10.0.0.2 ping statistics --- 00:13:05.789 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:05.789 rtt min/avg/max/mdev = 0.173/0.173/0.173/0.000 ms 00:13:05.789 08:51:54 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:05.789 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:05.789 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.151 ms 00:13:05.789 00:13:05.789 --- 10.0.0.1 ping statistics --- 00:13:05.789 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:05.789 rtt min/avg/max/mdev = 0.151/0.151/0.151/0.000 ms 00:13:05.789 08:51:54 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:05.789 08:51:54 -- nvmf/common.sh@410 -- # return 0 00:13:05.789 08:51:54 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:05.789 08:51:54 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:05.789 08:51:54 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:05.789 08:51:54 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:05.789 08:51:54 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:05.789 08:51:54 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:05.789 08:51:54 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:05.789 08:51:54 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:13:05.789 08:51:54 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:05.789 08:51:54 -- common/autotest_common.sh@712 -- # xtrace_disable 00:13:05.789 08:51:54 -- common/autotest_common.sh@10 -- # set +x 00:13:05.789 08:51:54 -- nvmf/common.sh@469 -- # nvmfpid=1464051 00:13:05.789 08:51:54 -- nvmf/common.sh@470 -- # waitforlisten 1464051 00:13:05.789 08:51:54 -- common/autotest_common.sh@819 -- # '[' -z 1464051 ']' 00:13:05.789 08:51:54 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:05.789 08:51:54 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:05.789 08:51:54 -- common/autotest_common.sh@824 -- # local max_retries=100 00:13:05.789 08:51:54 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:05.789 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:05.789 08:51:54 -- common/autotest_common.sh@828 -- # xtrace_disable 00:13:05.789 08:51:54 -- common/autotest_common.sh@10 -- # set +x 00:13:05.789 [2024-07-15 08:51:54.094908] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:13:05.789 [2024-07-15 08:51:54.094986] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:05.789 EAL: No free 2048 kB hugepages reported on node 1 00:13:05.789 [2024-07-15 08:51:54.164250] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:05.789 [2024-07-15 08:51:54.281184] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:05.789 [2024-07-15 08:51:54.281352] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:05.789 [2024-07-15 08:51:54.281390] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:05.789 [2024-07-15 08:51:54.281403] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:05.789 [2024-07-15 08:51:54.281475] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:05.789 [2024-07-15 08:51:54.281559] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:05.789 [2024-07-15 08:51:54.281562] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:06.721 08:51:55 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:13:06.721 08:51:55 -- common/autotest_common.sh@852 -- # return 0 00:13:06.721 08:51:55 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:06.721 08:51:55 -- common/autotest_common.sh@718 -- # xtrace_disable 00:13:06.721 08:51:55 -- common/autotest_common.sh@10 -- # set +x 00:13:06.721 08:51:55 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:06.721 08:51:55 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:06.721 08:51:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:06.721 08:51:55 -- common/autotest_common.sh@10 -- # set +x 00:13:06.721 [2024-07-15 08:51:55.053518] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:06.721 08:51:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:06.721 08:51:55 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:06.721 08:51:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:06.721 08:51:55 -- common/autotest_common.sh@10 -- # set +x 00:13:06.721 08:51:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:06.721 08:51:55 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:06.721 08:51:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:06.721 08:51:55 -- common/autotest_common.sh@10 -- # set +x 00:13:06.721 [2024-07-15 08:51:55.087998] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:06.721 08:51:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:06.721 08:51:55 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:06.721 08:51:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:06.721 08:51:55 -- common/autotest_common.sh@10 -- # set +x 00:13:06.721 NULL1 00:13:06.721 08:51:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:06.721 08:51:55 -- target/connect_stress.sh@21 -- # PERF_PID=1464211 00:13:06.721 08:51:55 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:13:06.721 08:51:55 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:06.721 08:51:55 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:06.721 08:51:55 -- target/connect_stress.sh@27 -- # seq 1 20 00:13:06.721 08:51:55 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:06.721 08:51:55 -- target/connect_stress.sh@28 -- # cat 00:13:06.721 08:51:55 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:06.721 08:51:55 -- target/connect_stress.sh@28 -- # cat 00:13:06.721 08:51:55 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:06.721 08:51:55 -- target/connect_stress.sh@28 -- # cat 00:13:06.721 08:51:55 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:06.721 08:51:55 -- target/connect_stress.sh@28 -- # cat 00:13:06.721 08:51:55 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:06.721 08:51:55 -- target/connect_stress.sh@28 -- # cat 00:13:06.721 08:51:55 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:06.721 08:51:55 -- target/connect_stress.sh@28 -- # cat 00:13:06.721 08:51:55 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:06.721 08:51:55 -- target/connect_stress.sh@28 -- # cat 00:13:06.722 08:51:55 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:06.722 08:51:55 -- target/connect_stress.sh@28 -- # cat 00:13:06.722 08:51:55 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:06.722 08:51:55 -- target/connect_stress.sh@28 -- # cat 00:13:06.722 08:51:55 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:06.722 08:51:55 -- target/connect_stress.sh@28 -- # cat 00:13:06.722 08:51:55 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:06.722 08:51:55 -- target/connect_stress.sh@28 -- # cat 00:13:06.722 08:51:55 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:06.722 08:51:55 -- target/connect_stress.sh@28 -- # cat 00:13:06.722 EAL: No free 2048 kB hugepages reported on node 1 00:13:06.722 08:51:55 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:06.722 08:51:55 -- target/connect_stress.sh@28 -- # cat 00:13:06.722 08:51:55 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:06.722 08:51:55 -- target/connect_stress.sh@28 -- # cat 00:13:06.722 08:51:55 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:06.722 08:51:55 -- target/connect_stress.sh@28 -- # cat 00:13:06.722 08:51:55 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:06.722 08:51:55 -- target/connect_stress.sh@28 -- # cat 00:13:06.722 08:51:55 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:06.722 08:51:55 -- target/connect_stress.sh@28 -- # cat 00:13:06.722 08:51:55 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:06.722 08:51:55 -- target/connect_stress.sh@28 -- # cat 00:13:06.722 08:51:55 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:06.722 08:51:55 -- target/connect_stress.sh@28 -- # cat 00:13:06.722 08:51:55 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:06.722 08:51:55 -- target/connect_stress.sh@28 -- # cat 00:13:06.722 08:51:55 -- target/connect_stress.sh@34 -- # kill -0 1464211 00:13:06.722 08:51:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:06.722 08:51:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:06.722 08:51:55 -- common/autotest_common.sh@10 -- # set +x 00:13:06.979 08:51:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:06.979 08:51:55 -- target/connect_stress.sh@34 -- # kill -0 1464211 00:13:06.979 08:51:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:06.979 08:51:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:06.979 08:51:55 -- common/autotest_common.sh@10 -- # set +x 00:13:07.544 08:51:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:07.544 08:51:55 -- target/connect_stress.sh@34 -- # kill -0 1464211 00:13:07.544 08:51:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:07.544 08:51:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:07.544 08:51:55 -- common/autotest_common.sh@10 -- # set +x 00:13:07.800 08:51:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:07.800 08:51:56 -- target/connect_stress.sh@34 -- # kill -0 1464211 00:13:07.800 08:51:56 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:07.800 08:51:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:07.800 08:51:56 -- common/autotest_common.sh@10 -- # set +x 00:13:08.057 08:51:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:08.057 08:51:56 -- target/connect_stress.sh@34 -- # kill -0 1464211 00:13:08.057 08:51:56 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:08.057 08:51:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:08.057 08:51:56 -- common/autotest_common.sh@10 -- # set +x 00:13:08.314 08:51:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:08.314 08:51:56 -- target/connect_stress.sh@34 -- # kill -0 1464211 00:13:08.314 08:51:56 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:08.314 08:51:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:08.314 08:51:56 -- common/autotest_common.sh@10 -- # set +x 00:13:08.572 08:51:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:08.572 08:51:57 -- target/connect_stress.sh@34 -- # kill -0 1464211 00:13:08.572 08:51:57 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:08.572 08:51:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:08.572 08:51:57 -- common/autotest_common.sh@10 -- # set +x 00:13:09.137 08:51:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:09.137 08:51:57 -- target/connect_stress.sh@34 -- # kill -0 1464211 00:13:09.137 08:51:57 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:09.137 08:51:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:09.137 08:51:57 -- common/autotest_common.sh@10 -- # set +x 00:13:09.393 08:51:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:09.393 08:51:57 -- target/connect_stress.sh@34 -- # kill -0 1464211 00:13:09.393 08:51:57 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:09.393 08:51:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:09.393 08:51:57 -- common/autotest_common.sh@10 -- # set +x 00:13:09.651 08:51:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:09.651 08:51:58 -- target/connect_stress.sh@34 -- # kill -0 1464211 00:13:09.651 08:51:58 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:09.651 08:51:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:09.651 08:51:58 -- common/autotest_common.sh@10 -- # set +x 00:13:09.908 08:51:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:09.908 08:51:58 -- target/connect_stress.sh@34 -- # kill -0 1464211 00:13:09.908 08:51:58 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:09.908 08:51:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:09.908 08:51:58 -- common/autotest_common.sh@10 -- # set +x 00:13:10.165 08:51:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:10.165 08:51:58 -- target/connect_stress.sh@34 -- # kill -0 1464211 00:13:10.166 08:51:58 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:10.166 08:51:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:10.166 08:51:58 -- common/autotest_common.sh@10 -- # set +x 00:13:10.730 08:51:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:10.730 08:51:58 -- target/connect_stress.sh@34 -- # kill -0 1464211 00:13:10.730 08:51:58 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:10.730 08:51:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:10.730 08:51:58 -- common/autotest_common.sh@10 -- # set +x 00:13:10.987 08:51:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:10.987 08:51:59 -- target/connect_stress.sh@34 -- # kill -0 1464211 00:13:10.987 08:51:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:10.987 08:51:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:10.987 08:51:59 -- common/autotest_common.sh@10 -- # set +x 00:13:11.244 08:51:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:11.244 08:51:59 -- target/connect_stress.sh@34 -- # kill -0 1464211 00:13:11.244 08:51:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:11.244 08:51:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:11.244 08:51:59 -- common/autotest_common.sh@10 -- # set +x 00:13:11.501 08:51:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:11.501 08:51:59 -- target/connect_stress.sh@34 -- # kill -0 1464211 00:13:11.501 08:51:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:11.501 08:51:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:11.501 08:51:59 -- common/autotest_common.sh@10 -- # set +x 00:13:11.759 08:52:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:11.759 08:52:00 -- target/connect_stress.sh@34 -- # kill -0 1464211 00:13:11.759 08:52:00 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:11.759 08:52:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:11.759 08:52:00 -- common/autotest_common.sh@10 -- # set +x 00:13:12.322 08:52:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:12.322 08:52:00 -- target/connect_stress.sh@34 -- # kill -0 1464211 00:13:12.322 08:52:00 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:12.322 08:52:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:12.322 08:52:00 -- common/autotest_common.sh@10 -- # set +x 00:13:12.579 08:52:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:12.579 08:52:00 -- target/connect_stress.sh@34 -- # kill -0 1464211 00:13:12.579 08:52:00 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:12.579 08:52:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:12.580 08:52:00 -- common/autotest_common.sh@10 -- # set +x 00:13:12.836 08:52:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:12.836 08:52:01 -- target/connect_stress.sh@34 -- # kill -0 1464211 00:13:12.836 08:52:01 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:12.836 08:52:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:12.836 08:52:01 -- common/autotest_common.sh@10 -- # set +x 00:13:13.093 08:52:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:13.093 08:52:01 -- target/connect_stress.sh@34 -- # kill -0 1464211 00:13:13.093 08:52:01 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:13.093 08:52:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:13.093 08:52:01 -- common/autotest_common.sh@10 -- # set +x 00:13:13.350 08:52:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:13.350 08:52:01 -- target/connect_stress.sh@34 -- # kill -0 1464211 00:13:13.350 08:52:01 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:13.350 08:52:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:13.350 08:52:01 -- common/autotest_common.sh@10 -- # set +x 00:13:13.916 08:52:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:13.916 08:52:02 -- target/connect_stress.sh@34 -- # kill -0 1464211 00:13:13.916 08:52:02 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:13.916 08:52:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:13.916 08:52:02 -- common/autotest_common.sh@10 -- # set +x 00:13:14.173 08:52:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:14.173 08:52:02 -- target/connect_stress.sh@34 -- # kill -0 1464211 00:13:14.173 08:52:02 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:14.173 08:52:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:14.173 08:52:02 -- common/autotest_common.sh@10 -- # set +x 00:13:14.430 08:52:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:14.430 08:52:02 -- target/connect_stress.sh@34 -- # kill -0 1464211 00:13:14.430 08:52:02 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:14.430 08:52:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:14.430 08:52:02 -- common/autotest_common.sh@10 -- # set +x 00:13:14.687 08:52:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:14.687 08:52:03 -- target/connect_stress.sh@34 -- # kill -0 1464211 00:13:14.687 08:52:03 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:14.687 08:52:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:14.687 08:52:03 -- common/autotest_common.sh@10 -- # set +x 00:13:15.250 08:52:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:15.250 08:52:03 -- target/connect_stress.sh@34 -- # kill -0 1464211 00:13:15.250 08:52:03 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:15.250 08:52:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:15.250 08:52:03 -- common/autotest_common.sh@10 -- # set +x 00:13:15.508 08:52:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:15.508 08:52:03 -- target/connect_stress.sh@34 -- # kill -0 1464211 00:13:15.508 08:52:03 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:15.508 08:52:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:15.508 08:52:03 -- common/autotest_common.sh@10 -- # set +x 00:13:15.765 08:52:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:15.766 08:52:04 -- target/connect_stress.sh@34 -- # kill -0 1464211 00:13:15.766 08:52:04 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:15.766 08:52:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:15.766 08:52:04 -- common/autotest_common.sh@10 -- # set +x 00:13:16.023 08:52:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.023 08:52:04 -- target/connect_stress.sh@34 -- # kill -0 1464211 00:13:16.023 08:52:04 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:16.023 08:52:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.023 08:52:04 -- common/autotest_common.sh@10 -- # set +x 00:13:16.280 08:52:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.280 08:52:04 -- target/connect_stress.sh@34 -- # kill -0 1464211 00:13:16.280 08:52:04 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:16.280 08:52:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.280 08:52:04 -- common/autotest_common.sh@10 -- # set +x 00:13:16.844 08:52:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.844 08:52:05 -- target/connect_stress.sh@34 -- # kill -0 1464211 00:13:16.844 08:52:05 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:16.844 08:52:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.844 08:52:05 -- common/autotest_common.sh@10 -- # set +x 00:13:16.844 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:17.102 08:52:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:17.102 08:52:05 -- target/connect_stress.sh@34 -- # kill -0 1464211 00:13:17.102 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (1464211) - No such process 00:13:17.102 08:52:05 -- target/connect_stress.sh@38 -- # wait 1464211 00:13:17.102 08:52:05 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:17.102 08:52:05 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:13:17.102 08:52:05 -- target/connect_stress.sh@43 -- # nvmftestfini 00:13:17.102 08:52:05 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:17.102 08:52:05 -- nvmf/common.sh@116 -- # sync 00:13:17.102 08:52:05 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:17.102 08:52:05 -- nvmf/common.sh@119 -- # set +e 00:13:17.102 08:52:05 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:17.102 08:52:05 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:17.102 rmmod nvme_tcp 00:13:17.102 rmmod nvme_fabrics 00:13:17.102 rmmod nvme_keyring 00:13:17.102 08:52:05 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:17.102 08:52:05 -- nvmf/common.sh@123 -- # set -e 00:13:17.102 08:52:05 -- nvmf/common.sh@124 -- # return 0 00:13:17.102 08:52:05 -- nvmf/common.sh@477 -- # '[' -n 1464051 ']' 00:13:17.102 08:52:05 -- nvmf/common.sh@478 -- # killprocess 1464051 00:13:17.102 08:52:05 -- common/autotest_common.sh@926 -- # '[' -z 1464051 ']' 00:13:17.102 08:52:05 -- common/autotest_common.sh@930 -- # kill -0 1464051 00:13:17.102 08:52:05 -- common/autotest_common.sh@931 -- # uname 00:13:17.102 08:52:05 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:13:17.102 08:52:05 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1464051 00:13:17.102 08:52:05 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:13:17.102 08:52:05 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:13:17.102 08:52:05 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1464051' 00:13:17.102 killing process with pid 1464051 00:13:17.102 08:52:05 -- common/autotest_common.sh@945 -- # kill 1464051 00:13:17.102 08:52:05 -- common/autotest_common.sh@950 -- # wait 1464051 00:13:17.393 08:52:05 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:17.393 08:52:05 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:17.393 08:52:05 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:17.393 08:52:05 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:17.393 08:52:05 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:17.393 08:52:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:17.393 08:52:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:17.393 08:52:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:19.297 08:52:07 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:19.297 00:13:19.297 real 0m15.936s 00:13:19.297 user 0m40.614s 00:13:19.297 sys 0m5.823s 00:13:19.297 08:52:07 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:13:19.297 08:52:07 -- common/autotest_common.sh@10 -- # set +x 00:13:19.297 ************************************ 00:13:19.297 END TEST nvmf_connect_stress 00:13:19.297 ************************************ 00:13:19.556 08:52:07 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:19.556 08:52:07 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:13:19.556 08:52:07 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:13:19.556 08:52:07 -- common/autotest_common.sh@10 -- # set +x 00:13:19.556 ************************************ 00:13:19.556 START TEST nvmf_fused_ordering 00:13:19.556 ************************************ 00:13:19.556 08:52:07 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:19.556 * Looking for test storage... 00:13:19.556 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:19.556 08:52:07 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:19.556 08:52:07 -- nvmf/common.sh@7 -- # uname -s 00:13:19.556 08:52:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:19.556 08:52:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:19.556 08:52:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:19.556 08:52:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:19.556 08:52:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:19.556 08:52:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:19.556 08:52:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:19.556 08:52:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:19.556 08:52:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:19.556 08:52:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:19.556 08:52:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:19.556 08:52:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:19.556 08:52:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:19.556 08:52:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:19.556 08:52:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:19.556 08:52:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:19.556 08:52:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:19.556 08:52:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:19.556 08:52:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:19.556 08:52:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:19.556 08:52:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:19.556 08:52:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:19.556 08:52:07 -- paths/export.sh@5 -- # export PATH 00:13:19.556 08:52:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:19.556 08:52:07 -- nvmf/common.sh@46 -- # : 0 00:13:19.556 08:52:07 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:19.556 08:52:07 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:19.556 08:52:07 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:19.556 08:52:07 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:19.556 08:52:07 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:19.556 08:52:07 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:19.556 08:52:07 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:19.556 08:52:07 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:19.556 08:52:07 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:13:19.556 08:52:07 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:19.556 08:52:07 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:19.556 08:52:07 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:19.556 08:52:07 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:19.556 08:52:07 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:19.556 08:52:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:19.556 08:52:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:19.556 08:52:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:19.556 08:52:07 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:19.556 08:52:07 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:19.556 08:52:07 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:19.556 08:52:07 -- common/autotest_common.sh@10 -- # set +x 00:13:21.455 08:52:09 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:21.455 08:52:09 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:21.455 08:52:09 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:21.455 08:52:09 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:21.455 08:52:09 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:21.455 08:52:09 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:21.455 08:52:09 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:21.455 08:52:09 -- nvmf/common.sh@294 -- # net_devs=() 00:13:21.455 08:52:09 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:21.455 08:52:09 -- nvmf/common.sh@295 -- # e810=() 00:13:21.455 08:52:09 -- nvmf/common.sh@295 -- # local -ga e810 00:13:21.455 08:52:09 -- nvmf/common.sh@296 -- # x722=() 00:13:21.455 08:52:09 -- nvmf/common.sh@296 -- # local -ga x722 00:13:21.455 08:52:09 -- nvmf/common.sh@297 -- # mlx=() 00:13:21.455 08:52:09 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:21.455 08:52:09 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:21.455 08:52:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:21.455 08:52:09 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:21.455 08:52:09 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:21.455 08:52:09 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:21.455 08:52:09 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:21.455 08:52:09 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:21.455 08:52:09 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:21.455 08:52:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:21.456 08:52:09 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:21.456 08:52:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:21.456 08:52:09 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:21.456 08:52:09 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:21.456 08:52:09 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:21.456 08:52:09 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:21.456 08:52:09 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:21.456 08:52:09 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:21.456 08:52:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:21.456 08:52:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:21.456 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:21.456 08:52:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:21.456 08:52:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:21.456 08:52:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:21.456 08:52:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:21.456 08:52:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:21.456 08:52:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:21.456 08:52:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:21.456 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:21.456 08:52:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:21.456 08:52:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:21.456 08:52:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:21.456 08:52:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:21.456 08:52:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:21.456 08:52:09 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:21.456 08:52:09 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:21.456 08:52:09 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:21.456 08:52:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:21.456 08:52:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:21.456 08:52:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:21.456 08:52:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:21.456 08:52:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:21.456 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:21.456 08:52:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:21.456 08:52:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:21.456 08:52:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:21.456 08:52:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:21.456 08:52:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:21.456 08:52:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:21.456 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:21.456 08:52:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:21.456 08:52:09 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:21.456 08:52:09 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:21.456 08:52:09 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:21.456 08:52:09 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:21.456 08:52:09 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:21.456 08:52:09 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:21.456 08:52:09 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:21.456 08:52:09 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:21.456 08:52:09 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:21.456 08:52:09 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:21.456 08:52:09 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:21.456 08:52:09 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:21.456 08:52:09 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:21.456 08:52:09 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:21.456 08:52:09 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:21.456 08:52:09 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:21.456 08:52:09 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:21.456 08:52:09 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:21.456 08:52:09 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:21.456 08:52:09 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:21.456 08:52:09 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:21.456 08:52:09 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:21.456 08:52:09 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:21.456 08:52:09 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:21.456 08:52:09 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:21.456 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:21.456 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.164 ms 00:13:21.456 00:13:21.456 --- 10.0.0.2 ping statistics --- 00:13:21.456 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:21.456 rtt min/avg/max/mdev = 0.164/0.164/0.164/0.000 ms 00:13:21.456 08:52:09 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:21.456 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:21.456 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.081 ms 00:13:21.456 00:13:21.456 --- 10.0.0.1 ping statistics --- 00:13:21.456 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:21.456 rtt min/avg/max/mdev = 0.081/0.081/0.081/0.000 ms 00:13:21.456 08:52:09 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:21.456 08:52:09 -- nvmf/common.sh@410 -- # return 0 00:13:21.456 08:52:09 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:21.456 08:52:09 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:21.456 08:52:09 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:21.456 08:52:09 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:21.456 08:52:09 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:21.456 08:52:09 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:21.456 08:52:09 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:21.714 08:52:10 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:13:21.714 08:52:10 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:21.714 08:52:10 -- common/autotest_common.sh@712 -- # xtrace_disable 00:13:21.714 08:52:10 -- common/autotest_common.sh@10 -- # set +x 00:13:21.714 08:52:10 -- nvmf/common.sh@469 -- # nvmfpid=1467461 00:13:21.714 08:52:10 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:13:21.714 08:52:10 -- nvmf/common.sh@470 -- # waitforlisten 1467461 00:13:21.714 08:52:10 -- common/autotest_common.sh@819 -- # '[' -z 1467461 ']' 00:13:21.714 08:52:10 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:21.714 08:52:10 -- common/autotest_common.sh@824 -- # local max_retries=100 00:13:21.714 08:52:10 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:21.714 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:21.714 08:52:10 -- common/autotest_common.sh@828 -- # xtrace_disable 00:13:21.714 08:52:10 -- common/autotest_common.sh@10 -- # set +x 00:13:21.714 [2024-07-15 08:52:10.050058] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:13:21.714 [2024-07-15 08:52:10.050147] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:21.714 EAL: No free 2048 kB hugepages reported on node 1 00:13:21.714 [2024-07-15 08:52:10.116413] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:21.714 [2024-07-15 08:52:10.221308] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:21.714 [2024-07-15 08:52:10.221481] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:21.714 [2024-07-15 08:52:10.221500] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:21.714 [2024-07-15 08:52:10.221511] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:21.714 [2024-07-15 08:52:10.221539] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:22.647 08:52:10 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:13:22.647 08:52:10 -- common/autotest_common.sh@852 -- # return 0 00:13:22.648 08:52:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:22.648 08:52:10 -- common/autotest_common.sh@718 -- # xtrace_disable 00:13:22.648 08:52:10 -- common/autotest_common.sh@10 -- # set +x 00:13:22.648 08:52:11 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:22.648 08:52:11 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:22.648 08:52:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:22.648 08:52:11 -- common/autotest_common.sh@10 -- # set +x 00:13:22.648 [2024-07-15 08:52:11.019731] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:22.648 08:52:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:22.648 08:52:11 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:22.648 08:52:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:22.648 08:52:11 -- common/autotest_common.sh@10 -- # set +x 00:13:22.648 08:52:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:22.648 08:52:11 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:22.648 08:52:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:22.648 08:52:11 -- common/autotest_common.sh@10 -- # set +x 00:13:22.648 [2024-07-15 08:52:11.035902] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:22.648 08:52:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:22.648 08:52:11 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:22.648 08:52:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:22.648 08:52:11 -- common/autotest_common.sh@10 -- # set +x 00:13:22.648 NULL1 00:13:22.648 08:52:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:22.648 08:52:11 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:13:22.648 08:52:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:22.648 08:52:11 -- common/autotest_common.sh@10 -- # set +x 00:13:22.648 08:52:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:22.648 08:52:11 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:13:22.648 08:52:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:22.648 08:52:11 -- common/autotest_common.sh@10 -- # set +x 00:13:22.648 08:52:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:22.648 08:52:11 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:13:22.648 [2024-07-15 08:52:11.080174] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:13:22.648 [2024-07-15 08:52:11.080216] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1467564 ] 00:13:22.648 EAL: No free 2048 kB hugepages reported on node 1 00:13:23.214 Attached to nqn.2016-06.io.spdk:cnode1 00:13:23.214 Namespace ID: 1 size: 1GB 00:13:23.214 fused_ordering(0) 00:13:23.214 fused_ordering(1) 00:13:23.214 fused_ordering(2) 00:13:23.214 fused_ordering(3) 00:13:23.214 fused_ordering(4) 00:13:23.214 fused_ordering(5) 00:13:23.214 fused_ordering(6) 00:13:23.214 fused_ordering(7) 00:13:23.214 fused_ordering(8) 00:13:23.214 fused_ordering(9) 00:13:23.214 fused_ordering(10) 00:13:23.214 fused_ordering(11) 00:13:23.214 fused_ordering(12) 00:13:23.214 fused_ordering(13) 00:13:23.214 fused_ordering(14) 00:13:23.214 fused_ordering(15) 00:13:23.214 fused_ordering(16) 00:13:23.215 fused_ordering(17) 00:13:23.215 fused_ordering(18) 00:13:23.215 fused_ordering(19) 00:13:23.215 fused_ordering(20) 00:13:23.215 fused_ordering(21) 00:13:23.215 fused_ordering(22) 00:13:23.215 fused_ordering(23) 00:13:23.215 fused_ordering(24) 00:13:23.215 fused_ordering(25) 00:13:23.215 fused_ordering(26) 00:13:23.215 fused_ordering(27) 00:13:23.215 fused_ordering(28) 00:13:23.215 fused_ordering(29) 00:13:23.215 fused_ordering(30) 00:13:23.215 fused_ordering(31) 00:13:23.215 fused_ordering(32) 00:13:23.215 fused_ordering(33) 00:13:23.215 fused_ordering(34) 00:13:23.215 fused_ordering(35) 00:13:23.215 fused_ordering(36) 00:13:23.215 fused_ordering(37) 00:13:23.215 fused_ordering(38) 00:13:23.215 fused_ordering(39) 00:13:23.215 fused_ordering(40) 00:13:23.215 fused_ordering(41) 00:13:23.215 fused_ordering(42) 00:13:23.215 fused_ordering(43) 00:13:23.215 fused_ordering(44) 00:13:23.215 fused_ordering(45) 00:13:23.215 fused_ordering(46) 00:13:23.215 fused_ordering(47) 00:13:23.215 fused_ordering(48) 00:13:23.215 fused_ordering(49) 00:13:23.215 fused_ordering(50) 00:13:23.215 fused_ordering(51) 00:13:23.215 fused_ordering(52) 00:13:23.215 fused_ordering(53) 00:13:23.215 fused_ordering(54) 00:13:23.215 fused_ordering(55) 00:13:23.215 fused_ordering(56) 00:13:23.215 fused_ordering(57) 00:13:23.215 fused_ordering(58) 00:13:23.215 fused_ordering(59) 00:13:23.215 fused_ordering(60) 00:13:23.215 fused_ordering(61) 00:13:23.215 fused_ordering(62) 00:13:23.215 fused_ordering(63) 00:13:23.215 fused_ordering(64) 00:13:23.215 fused_ordering(65) 00:13:23.215 fused_ordering(66) 00:13:23.215 fused_ordering(67) 00:13:23.215 fused_ordering(68) 00:13:23.215 fused_ordering(69) 00:13:23.215 fused_ordering(70) 00:13:23.215 fused_ordering(71) 00:13:23.215 fused_ordering(72) 00:13:23.215 fused_ordering(73) 00:13:23.215 fused_ordering(74) 00:13:23.215 fused_ordering(75) 00:13:23.215 fused_ordering(76) 00:13:23.215 fused_ordering(77) 00:13:23.215 fused_ordering(78) 00:13:23.215 fused_ordering(79) 00:13:23.215 fused_ordering(80) 00:13:23.215 fused_ordering(81) 00:13:23.215 fused_ordering(82) 00:13:23.215 fused_ordering(83) 00:13:23.215 fused_ordering(84) 00:13:23.215 fused_ordering(85) 00:13:23.215 fused_ordering(86) 00:13:23.215 fused_ordering(87) 00:13:23.215 fused_ordering(88) 00:13:23.215 fused_ordering(89) 00:13:23.215 fused_ordering(90) 00:13:23.215 fused_ordering(91) 00:13:23.215 fused_ordering(92) 00:13:23.215 fused_ordering(93) 00:13:23.215 fused_ordering(94) 00:13:23.215 fused_ordering(95) 00:13:23.215 fused_ordering(96) 00:13:23.215 fused_ordering(97) 00:13:23.215 fused_ordering(98) 00:13:23.215 fused_ordering(99) 00:13:23.215 fused_ordering(100) 00:13:23.215 fused_ordering(101) 00:13:23.215 fused_ordering(102) 00:13:23.215 fused_ordering(103) 00:13:23.215 fused_ordering(104) 00:13:23.215 fused_ordering(105) 00:13:23.215 fused_ordering(106) 00:13:23.215 fused_ordering(107) 00:13:23.215 fused_ordering(108) 00:13:23.215 fused_ordering(109) 00:13:23.215 fused_ordering(110) 00:13:23.215 fused_ordering(111) 00:13:23.215 fused_ordering(112) 00:13:23.215 fused_ordering(113) 00:13:23.215 fused_ordering(114) 00:13:23.215 fused_ordering(115) 00:13:23.215 fused_ordering(116) 00:13:23.215 fused_ordering(117) 00:13:23.215 fused_ordering(118) 00:13:23.215 fused_ordering(119) 00:13:23.215 fused_ordering(120) 00:13:23.215 fused_ordering(121) 00:13:23.215 fused_ordering(122) 00:13:23.215 fused_ordering(123) 00:13:23.215 fused_ordering(124) 00:13:23.215 fused_ordering(125) 00:13:23.215 fused_ordering(126) 00:13:23.215 fused_ordering(127) 00:13:23.215 fused_ordering(128) 00:13:23.215 fused_ordering(129) 00:13:23.215 fused_ordering(130) 00:13:23.215 fused_ordering(131) 00:13:23.215 fused_ordering(132) 00:13:23.215 fused_ordering(133) 00:13:23.215 fused_ordering(134) 00:13:23.215 fused_ordering(135) 00:13:23.215 fused_ordering(136) 00:13:23.215 fused_ordering(137) 00:13:23.215 fused_ordering(138) 00:13:23.215 fused_ordering(139) 00:13:23.215 fused_ordering(140) 00:13:23.215 fused_ordering(141) 00:13:23.215 fused_ordering(142) 00:13:23.215 fused_ordering(143) 00:13:23.215 fused_ordering(144) 00:13:23.215 fused_ordering(145) 00:13:23.215 fused_ordering(146) 00:13:23.215 fused_ordering(147) 00:13:23.215 fused_ordering(148) 00:13:23.215 fused_ordering(149) 00:13:23.215 fused_ordering(150) 00:13:23.215 fused_ordering(151) 00:13:23.215 fused_ordering(152) 00:13:23.215 fused_ordering(153) 00:13:23.215 fused_ordering(154) 00:13:23.215 fused_ordering(155) 00:13:23.215 fused_ordering(156) 00:13:23.215 fused_ordering(157) 00:13:23.215 fused_ordering(158) 00:13:23.215 fused_ordering(159) 00:13:23.215 fused_ordering(160) 00:13:23.215 fused_ordering(161) 00:13:23.215 fused_ordering(162) 00:13:23.215 fused_ordering(163) 00:13:23.215 fused_ordering(164) 00:13:23.215 fused_ordering(165) 00:13:23.215 fused_ordering(166) 00:13:23.215 fused_ordering(167) 00:13:23.215 fused_ordering(168) 00:13:23.215 fused_ordering(169) 00:13:23.215 fused_ordering(170) 00:13:23.215 fused_ordering(171) 00:13:23.215 fused_ordering(172) 00:13:23.215 fused_ordering(173) 00:13:23.215 fused_ordering(174) 00:13:23.215 fused_ordering(175) 00:13:23.215 fused_ordering(176) 00:13:23.215 fused_ordering(177) 00:13:23.215 fused_ordering(178) 00:13:23.215 fused_ordering(179) 00:13:23.215 fused_ordering(180) 00:13:23.215 fused_ordering(181) 00:13:23.215 fused_ordering(182) 00:13:23.215 fused_ordering(183) 00:13:23.215 fused_ordering(184) 00:13:23.215 fused_ordering(185) 00:13:23.215 fused_ordering(186) 00:13:23.215 fused_ordering(187) 00:13:23.215 fused_ordering(188) 00:13:23.215 fused_ordering(189) 00:13:23.215 fused_ordering(190) 00:13:23.215 fused_ordering(191) 00:13:23.215 fused_ordering(192) 00:13:23.215 fused_ordering(193) 00:13:23.215 fused_ordering(194) 00:13:23.215 fused_ordering(195) 00:13:23.215 fused_ordering(196) 00:13:23.215 fused_ordering(197) 00:13:23.215 fused_ordering(198) 00:13:23.215 fused_ordering(199) 00:13:23.215 fused_ordering(200) 00:13:23.215 fused_ordering(201) 00:13:23.215 fused_ordering(202) 00:13:23.215 fused_ordering(203) 00:13:23.215 fused_ordering(204) 00:13:23.215 fused_ordering(205) 00:13:23.475 fused_ordering(206) 00:13:23.475 fused_ordering(207) 00:13:23.475 fused_ordering(208) 00:13:23.475 fused_ordering(209) 00:13:23.475 fused_ordering(210) 00:13:23.475 fused_ordering(211) 00:13:23.475 fused_ordering(212) 00:13:23.475 fused_ordering(213) 00:13:23.475 fused_ordering(214) 00:13:23.475 fused_ordering(215) 00:13:23.475 fused_ordering(216) 00:13:23.475 fused_ordering(217) 00:13:23.475 fused_ordering(218) 00:13:23.475 fused_ordering(219) 00:13:23.475 fused_ordering(220) 00:13:23.475 fused_ordering(221) 00:13:23.475 fused_ordering(222) 00:13:23.475 fused_ordering(223) 00:13:23.475 fused_ordering(224) 00:13:23.475 fused_ordering(225) 00:13:23.475 fused_ordering(226) 00:13:23.475 fused_ordering(227) 00:13:23.475 fused_ordering(228) 00:13:23.475 fused_ordering(229) 00:13:23.475 fused_ordering(230) 00:13:23.475 fused_ordering(231) 00:13:23.475 fused_ordering(232) 00:13:23.475 fused_ordering(233) 00:13:23.475 fused_ordering(234) 00:13:23.475 fused_ordering(235) 00:13:23.475 fused_ordering(236) 00:13:23.475 fused_ordering(237) 00:13:23.475 fused_ordering(238) 00:13:23.475 fused_ordering(239) 00:13:23.475 fused_ordering(240) 00:13:23.475 fused_ordering(241) 00:13:23.475 fused_ordering(242) 00:13:23.475 fused_ordering(243) 00:13:23.475 fused_ordering(244) 00:13:23.475 fused_ordering(245) 00:13:23.475 fused_ordering(246) 00:13:23.475 fused_ordering(247) 00:13:23.475 fused_ordering(248) 00:13:23.475 fused_ordering(249) 00:13:23.475 fused_ordering(250) 00:13:23.475 fused_ordering(251) 00:13:23.475 fused_ordering(252) 00:13:23.475 fused_ordering(253) 00:13:23.475 fused_ordering(254) 00:13:23.475 fused_ordering(255) 00:13:23.475 fused_ordering(256) 00:13:23.475 fused_ordering(257) 00:13:23.475 fused_ordering(258) 00:13:23.475 fused_ordering(259) 00:13:23.475 fused_ordering(260) 00:13:23.475 fused_ordering(261) 00:13:23.475 fused_ordering(262) 00:13:23.475 fused_ordering(263) 00:13:23.475 fused_ordering(264) 00:13:23.475 fused_ordering(265) 00:13:23.475 fused_ordering(266) 00:13:23.475 fused_ordering(267) 00:13:23.475 fused_ordering(268) 00:13:23.475 fused_ordering(269) 00:13:23.475 fused_ordering(270) 00:13:23.475 fused_ordering(271) 00:13:23.475 fused_ordering(272) 00:13:23.475 fused_ordering(273) 00:13:23.475 fused_ordering(274) 00:13:23.475 fused_ordering(275) 00:13:23.475 fused_ordering(276) 00:13:23.475 fused_ordering(277) 00:13:23.475 fused_ordering(278) 00:13:23.475 fused_ordering(279) 00:13:23.475 fused_ordering(280) 00:13:23.475 fused_ordering(281) 00:13:23.475 fused_ordering(282) 00:13:23.475 fused_ordering(283) 00:13:23.475 fused_ordering(284) 00:13:23.475 fused_ordering(285) 00:13:23.475 fused_ordering(286) 00:13:23.475 fused_ordering(287) 00:13:23.475 fused_ordering(288) 00:13:23.475 fused_ordering(289) 00:13:23.475 fused_ordering(290) 00:13:23.475 fused_ordering(291) 00:13:23.475 fused_ordering(292) 00:13:23.475 fused_ordering(293) 00:13:23.475 fused_ordering(294) 00:13:23.475 fused_ordering(295) 00:13:23.475 fused_ordering(296) 00:13:23.475 fused_ordering(297) 00:13:23.475 fused_ordering(298) 00:13:23.475 fused_ordering(299) 00:13:23.475 fused_ordering(300) 00:13:23.475 fused_ordering(301) 00:13:23.475 fused_ordering(302) 00:13:23.475 fused_ordering(303) 00:13:23.475 fused_ordering(304) 00:13:23.475 fused_ordering(305) 00:13:23.475 fused_ordering(306) 00:13:23.475 fused_ordering(307) 00:13:23.475 fused_ordering(308) 00:13:23.475 fused_ordering(309) 00:13:23.475 fused_ordering(310) 00:13:23.475 fused_ordering(311) 00:13:23.475 fused_ordering(312) 00:13:23.475 fused_ordering(313) 00:13:23.475 fused_ordering(314) 00:13:23.475 fused_ordering(315) 00:13:23.475 fused_ordering(316) 00:13:23.475 fused_ordering(317) 00:13:23.475 fused_ordering(318) 00:13:23.475 fused_ordering(319) 00:13:23.475 fused_ordering(320) 00:13:23.475 fused_ordering(321) 00:13:23.475 fused_ordering(322) 00:13:23.475 fused_ordering(323) 00:13:23.475 fused_ordering(324) 00:13:23.475 fused_ordering(325) 00:13:23.475 fused_ordering(326) 00:13:23.475 fused_ordering(327) 00:13:23.475 fused_ordering(328) 00:13:23.475 fused_ordering(329) 00:13:23.475 fused_ordering(330) 00:13:23.475 fused_ordering(331) 00:13:23.475 fused_ordering(332) 00:13:23.475 fused_ordering(333) 00:13:23.475 fused_ordering(334) 00:13:23.475 fused_ordering(335) 00:13:23.475 fused_ordering(336) 00:13:23.475 fused_ordering(337) 00:13:23.475 fused_ordering(338) 00:13:23.475 fused_ordering(339) 00:13:23.475 fused_ordering(340) 00:13:23.475 fused_ordering(341) 00:13:23.475 fused_ordering(342) 00:13:23.475 fused_ordering(343) 00:13:23.475 fused_ordering(344) 00:13:23.475 fused_ordering(345) 00:13:23.475 fused_ordering(346) 00:13:23.475 fused_ordering(347) 00:13:23.475 fused_ordering(348) 00:13:23.475 fused_ordering(349) 00:13:23.475 fused_ordering(350) 00:13:23.475 fused_ordering(351) 00:13:23.475 fused_ordering(352) 00:13:23.475 fused_ordering(353) 00:13:23.475 fused_ordering(354) 00:13:23.475 fused_ordering(355) 00:13:23.475 fused_ordering(356) 00:13:23.475 fused_ordering(357) 00:13:23.476 fused_ordering(358) 00:13:23.476 fused_ordering(359) 00:13:23.476 fused_ordering(360) 00:13:23.476 fused_ordering(361) 00:13:23.476 fused_ordering(362) 00:13:23.476 fused_ordering(363) 00:13:23.476 fused_ordering(364) 00:13:23.476 fused_ordering(365) 00:13:23.476 fused_ordering(366) 00:13:23.476 fused_ordering(367) 00:13:23.476 fused_ordering(368) 00:13:23.476 fused_ordering(369) 00:13:23.476 fused_ordering(370) 00:13:23.476 fused_ordering(371) 00:13:23.476 fused_ordering(372) 00:13:23.476 fused_ordering(373) 00:13:23.476 fused_ordering(374) 00:13:23.476 fused_ordering(375) 00:13:23.476 fused_ordering(376) 00:13:23.476 fused_ordering(377) 00:13:23.476 fused_ordering(378) 00:13:23.476 fused_ordering(379) 00:13:23.476 fused_ordering(380) 00:13:23.476 fused_ordering(381) 00:13:23.476 fused_ordering(382) 00:13:23.476 fused_ordering(383) 00:13:23.476 fused_ordering(384) 00:13:23.476 fused_ordering(385) 00:13:23.476 fused_ordering(386) 00:13:23.476 fused_ordering(387) 00:13:23.476 fused_ordering(388) 00:13:23.476 fused_ordering(389) 00:13:23.476 fused_ordering(390) 00:13:23.476 fused_ordering(391) 00:13:23.476 fused_ordering(392) 00:13:23.476 fused_ordering(393) 00:13:23.476 fused_ordering(394) 00:13:23.476 fused_ordering(395) 00:13:23.476 fused_ordering(396) 00:13:23.476 fused_ordering(397) 00:13:23.476 fused_ordering(398) 00:13:23.476 fused_ordering(399) 00:13:23.476 fused_ordering(400) 00:13:23.476 fused_ordering(401) 00:13:23.476 fused_ordering(402) 00:13:23.476 fused_ordering(403) 00:13:23.476 fused_ordering(404) 00:13:23.476 fused_ordering(405) 00:13:23.476 fused_ordering(406) 00:13:23.476 fused_ordering(407) 00:13:23.476 fused_ordering(408) 00:13:23.476 fused_ordering(409) 00:13:23.476 fused_ordering(410) 00:13:24.040 fused_ordering(411) 00:13:24.040 fused_ordering(412) 00:13:24.040 fused_ordering(413) 00:13:24.040 fused_ordering(414) 00:13:24.040 fused_ordering(415) 00:13:24.040 fused_ordering(416) 00:13:24.040 fused_ordering(417) 00:13:24.040 fused_ordering(418) 00:13:24.040 fused_ordering(419) 00:13:24.040 fused_ordering(420) 00:13:24.040 fused_ordering(421) 00:13:24.040 fused_ordering(422) 00:13:24.040 fused_ordering(423) 00:13:24.040 fused_ordering(424) 00:13:24.040 fused_ordering(425) 00:13:24.040 fused_ordering(426) 00:13:24.040 fused_ordering(427) 00:13:24.040 fused_ordering(428) 00:13:24.040 fused_ordering(429) 00:13:24.040 fused_ordering(430) 00:13:24.040 fused_ordering(431) 00:13:24.040 fused_ordering(432) 00:13:24.040 fused_ordering(433) 00:13:24.040 fused_ordering(434) 00:13:24.040 fused_ordering(435) 00:13:24.040 fused_ordering(436) 00:13:24.040 fused_ordering(437) 00:13:24.040 fused_ordering(438) 00:13:24.040 fused_ordering(439) 00:13:24.040 fused_ordering(440) 00:13:24.040 fused_ordering(441) 00:13:24.040 fused_ordering(442) 00:13:24.040 fused_ordering(443) 00:13:24.040 fused_ordering(444) 00:13:24.040 fused_ordering(445) 00:13:24.040 fused_ordering(446) 00:13:24.040 fused_ordering(447) 00:13:24.040 fused_ordering(448) 00:13:24.040 fused_ordering(449) 00:13:24.040 fused_ordering(450) 00:13:24.040 fused_ordering(451) 00:13:24.040 fused_ordering(452) 00:13:24.040 fused_ordering(453) 00:13:24.040 fused_ordering(454) 00:13:24.040 fused_ordering(455) 00:13:24.040 fused_ordering(456) 00:13:24.040 fused_ordering(457) 00:13:24.040 fused_ordering(458) 00:13:24.040 fused_ordering(459) 00:13:24.040 fused_ordering(460) 00:13:24.040 fused_ordering(461) 00:13:24.040 fused_ordering(462) 00:13:24.040 fused_ordering(463) 00:13:24.040 fused_ordering(464) 00:13:24.040 fused_ordering(465) 00:13:24.040 fused_ordering(466) 00:13:24.040 fused_ordering(467) 00:13:24.040 fused_ordering(468) 00:13:24.040 fused_ordering(469) 00:13:24.040 fused_ordering(470) 00:13:24.040 fused_ordering(471) 00:13:24.040 fused_ordering(472) 00:13:24.040 fused_ordering(473) 00:13:24.040 fused_ordering(474) 00:13:24.040 fused_ordering(475) 00:13:24.040 fused_ordering(476) 00:13:24.040 fused_ordering(477) 00:13:24.040 fused_ordering(478) 00:13:24.040 fused_ordering(479) 00:13:24.040 fused_ordering(480) 00:13:24.040 fused_ordering(481) 00:13:24.040 fused_ordering(482) 00:13:24.040 fused_ordering(483) 00:13:24.040 fused_ordering(484) 00:13:24.040 fused_ordering(485) 00:13:24.040 fused_ordering(486) 00:13:24.040 fused_ordering(487) 00:13:24.040 fused_ordering(488) 00:13:24.040 fused_ordering(489) 00:13:24.040 fused_ordering(490) 00:13:24.040 fused_ordering(491) 00:13:24.040 fused_ordering(492) 00:13:24.040 fused_ordering(493) 00:13:24.040 fused_ordering(494) 00:13:24.040 fused_ordering(495) 00:13:24.040 fused_ordering(496) 00:13:24.040 fused_ordering(497) 00:13:24.040 fused_ordering(498) 00:13:24.040 fused_ordering(499) 00:13:24.040 fused_ordering(500) 00:13:24.040 fused_ordering(501) 00:13:24.040 fused_ordering(502) 00:13:24.040 fused_ordering(503) 00:13:24.040 fused_ordering(504) 00:13:24.040 fused_ordering(505) 00:13:24.040 fused_ordering(506) 00:13:24.040 fused_ordering(507) 00:13:24.040 fused_ordering(508) 00:13:24.040 fused_ordering(509) 00:13:24.040 fused_ordering(510) 00:13:24.040 fused_ordering(511) 00:13:24.040 fused_ordering(512) 00:13:24.040 fused_ordering(513) 00:13:24.040 fused_ordering(514) 00:13:24.040 fused_ordering(515) 00:13:24.040 fused_ordering(516) 00:13:24.040 fused_ordering(517) 00:13:24.040 fused_ordering(518) 00:13:24.040 fused_ordering(519) 00:13:24.040 fused_ordering(520) 00:13:24.040 fused_ordering(521) 00:13:24.040 fused_ordering(522) 00:13:24.040 fused_ordering(523) 00:13:24.040 fused_ordering(524) 00:13:24.040 fused_ordering(525) 00:13:24.040 fused_ordering(526) 00:13:24.040 fused_ordering(527) 00:13:24.040 fused_ordering(528) 00:13:24.040 fused_ordering(529) 00:13:24.040 fused_ordering(530) 00:13:24.040 fused_ordering(531) 00:13:24.040 fused_ordering(532) 00:13:24.040 fused_ordering(533) 00:13:24.040 fused_ordering(534) 00:13:24.040 fused_ordering(535) 00:13:24.040 fused_ordering(536) 00:13:24.040 fused_ordering(537) 00:13:24.040 fused_ordering(538) 00:13:24.040 fused_ordering(539) 00:13:24.040 fused_ordering(540) 00:13:24.040 fused_ordering(541) 00:13:24.040 fused_ordering(542) 00:13:24.040 fused_ordering(543) 00:13:24.040 fused_ordering(544) 00:13:24.040 fused_ordering(545) 00:13:24.040 fused_ordering(546) 00:13:24.040 fused_ordering(547) 00:13:24.040 fused_ordering(548) 00:13:24.040 fused_ordering(549) 00:13:24.040 fused_ordering(550) 00:13:24.040 fused_ordering(551) 00:13:24.040 fused_ordering(552) 00:13:24.040 fused_ordering(553) 00:13:24.040 fused_ordering(554) 00:13:24.040 fused_ordering(555) 00:13:24.040 fused_ordering(556) 00:13:24.040 fused_ordering(557) 00:13:24.040 fused_ordering(558) 00:13:24.040 fused_ordering(559) 00:13:24.040 fused_ordering(560) 00:13:24.040 fused_ordering(561) 00:13:24.040 fused_ordering(562) 00:13:24.040 fused_ordering(563) 00:13:24.040 fused_ordering(564) 00:13:24.040 fused_ordering(565) 00:13:24.040 fused_ordering(566) 00:13:24.040 fused_ordering(567) 00:13:24.040 fused_ordering(568) 00:13:24.040 fused_ordering(569) 00:13:24.040 fused_ordering(570) 00:13:24.040 fused_ordering(571) 00:13:24.040 fused_ordering(572) 00:13:24.040 fused_ordering(573) 00:13:24.040 fused_ordering(574) 00:13:24.040 fused_ordering(575) 00:13:24.040 fused_ordering(576) 00:13:24.040 fused_ordering(577) 00:13:24.040 fused_ordering(578) 00:13:24.040 fused_ordering(579) 00:13:24.040 fused_ordering(580) 00:13:24.040 fused_ordering(581) 00:13:24.040 fused_ordering(582) 00:13:24.040 fused_ordering(583) 00:13:24.040 fused_ordering(584) 00:13:24.040 fused_ordering(585) 00:13:24.040 fused_ordering(586) 00:13:24.040 fused_ordering(587) 00:13:24.040 fused_ordering(588) 00:13:24.040 fused_ordering(589) 00:13:24.040 fused_ordering(590) 00:13:24.040 fused_ordering(591) 00:13:24.040 fused_ordering(592) 00:13:24.040 fused_ordering(593) 00:13:24.040 fused_ordering(594) 00:13:24.040 fused_ordering(595) 00:13:24.040 fused_ordering(596) 00:13:24.040 fused_ordering(597) 00:13:24.040 fused_ordering(598) 00:13:24.040 fused_ordering(599) 00:13:24.040 fused_ordering(600) 00:13:24.040 fused_ordering(601) 00:13:24.041 fused_ordering(602) 00:13:24.041 fused_ordering(603) 00:13:24.041 fused_ordering(604) 00:13:24.041 fused_ordering(605) 00:13:24.041 fused_ordering(606) 00:13:24.041 fused_ordering(607) 00:13:24.041 fused_ordering(608) 00:13:24.041 fused_ordering(609) 00:13:24.041 fused_ordering(610) 00:13:24.041 fused_ordering(611) 00:13:24.041 fused_ordering(612) 00:13:24.041 fused_ordering(613) 00:13:24.041 fused_ordering(614) 00:13:24.041 fused_ordering(615) 00:13:24.971 fused_ordering(616) 00:13:24.971 fused_ordering(617) 00:13:24.971 fused_ordering(618) 00:13:24.971 fused_ordering(619) 00:13:24.971 fused_ordering(620) 00:13:24.971 fused_ordering(621) 00:13:24.971 fused_ordering(622) 00:13:24.971 fused_ordering(623) 00:13:24.971 fused_ordering(624) 00:13:24.971 fused_ordering(625) 00:13:24.971 fused_ordering(626) 00:13:24.971 fused_ordering(627) 00:13:24.971 fused_ordering(628) 00:13:24.971 fused_ordering(629) 00:13:24.971 fused_ordering(630) 00:13:24.971 fused_ordering(631) 00:13:24.971 fused_ordering(632) 00:13:24.971 fused_ordering(633) 00:13:24.971 fused_ordering(634) 00:13:24.971 fused_ordering(635) 00:13:24.971 fused_ordering(636) 00:13:24.971 fused_ordering(637) 00:13:24.971 fused_ordering(638) 00:13:24.971 fused_ordering(639) 00:13:24.971 fused_ordering(640) 00:13:24.971 fused_ordering(641) 00:13:24.971 fused_ordering(642) 00:13:24.971 fused_ordering(643) 00:13:24.971 fused_ordering(644) 00:13:24.971 fused_ordering(645) 00:13:24.971 fused_ordering(646) 00:13:24.971 fused_ordering(647) 00:13:24.971 fused_ordering(648) 00:13:24.971 fused_ordering(649) 00:13:24.971 fused_ordering(650) 00:13:24.971 fused_ordering(651) 00:13:24.971 fused_ordering(652) 00:13:24.971 fused_ordering(653) 00:13:24.971 fused_ordering(654) 00:13:24.971 fused_ordering(655) 00:13:24.971 fused_ordering(656) 00:13:24.971 fused_ordering(657) 00:13:24.971 fused_ordering(658) 00:13:24.971 fused_ordering(659) 00:13:24.971 fused_ordering(660) 00:13:24.971 fused_ordering(661) 00:13:24.971 fused_ordering(662) 00:13:24.971 fused_ordering(663) 00:13:24.971 fused_ordering(664) 00:13:24.971 fused_ordering(665) 00:13:24.971 fused_ordering(666) 00:13:24.971 fused_ordering(667) 00:13:24.972 fused_ordering(668) 00:13:24.972 fused_ordering(669) 00:13:24.972 fused_ordering(670) 00:13:24.972 fused_ordering(671) 00:13:24.972 fused_ordering(672) 00:13:24.972 fused_ordering(673) 00:13:24.972 fused_ordering(674) 00:13:24.972 fused_ordering(675) 00:13:24.972 fused_ordering(676) 00:13:24.972 fused_ordering(677) 00:13:24.972 fused_ordering(678) 00:13:24.972 fused_ordering(679) 00:13:24.972 fused_ordering(680) 00:13:24.972 fused_ordering(681) 00:13:24.972 fused_ordering(682) 00:13:24.972 fused_ordering(683) 00:13:24.972 fused_ordering(684) 00:13:24.972 fused_ordering(685) 00:13:24.972 fused_ordering(686) 00:13:24.972 fused_ordering(687) 00:13:24.972 fused_ordering(688) 00:13:24.972 fused_ordering(689) 00:13:24.972 fused_ordering(690) 00:13:24.972 fused_ordering(691) 00:13:24.972 fused_ordering(692) 00:13:24.972 fused_ordering(693) 00:13:24.972 fused_ordering(694) 00:13:24.972 fused_ordering(695) 00:13:24.972 fused_ordering(696) 00:13:24.972 fused_ordering(697) 00:13:24.972 fused_ordering(698) 00:13:24.972 fused_ordering(699) 00:13:24.972 fused_ordering(700) 00:13:24.972 fused_ordering(701) 00:13:24.972 fused_ordering(702) 00:13:24.972 fused_ordering(703) 00:13:24.972 fused_ordering(704) 00:13:24.972 fused_ordering(705) 00:13:24.972 fused_ordering(706) 00:13:24.972 fused_ordering(707) 00:13:24.972 fused_ordering(708) 00:13:24.972 fused_ordering(709) 00:13:24.972 fused_ordering(710) 00:13:24.972 fused_ordering(711) 00:13:24.972 fused_ordering(712) 00:13:24.972 fused_ordering(713) 00:13:24.972 fused_ordering(714) 00:13:24.972 fused_ordering(715) 00:13:24.972 fused_ordering(716) 00:13:24.972 fused_ordering(717) 00:13:24.972 fused_ordering(718) 00:13:24.972 fused_ordering(719) 00:13:24.972 fused_ordering(720) 00:13:24.972 fused_ordering(721) 00:13:24.972 fused_ordering(722) 00:13:24.972 fused_ordering(723) 00:13:24.972 fused_ordering(724) 00:13:24.972 fused_ordering(725) 00:13:24.972 fused_ordering(726) 00:13:24.972 fused_ordering(727) 00:13:24.972 fused_ordering(728) 00:13:24.972 fused_ordering(729) 00:13:24.972 fused_ordering(730) 00:13:24.972 fused_ordering(731) 00:13:24.972 fused_ordering(732) 00:13:24.972 fused_ordering(733) 00:13:24.972 fused_ordering(734) 00:13:24.972 fused_ordering(735) 00:13:24.972 fused_ordering(736) 00:13:24.972 fused_ordering(737) 00:13:24.972 fused_ordering(738) 00:13:24.972 fused_ordering(739) 00:13:24.972 fused_ordering(740) 00:13:24.972 fused_ordering(741) 00:13:24.972 fused_ordering(742) 00:13:24.972 fused_ordering(743) 00:13:24.972 fused_ordering(744) 00:13:24.972 fused_ordering(745) 00:13:24.972 fused_ordering(746) 00:13:24.972 fused_ordering(747) 00:13:24.972 fused_ordering(748) 00:13:24.972 fused_ordering(749) 00:13:24.972 fused_ordering(750) 00:13:24.972 fused_ordering(751) 00:13:24.972 fused_ordering(752) 00:13:24.972 fused_ordering(753) 00:13:24.972 fused_ordering(754) 00:13:24.972 fused_ordering(755) 00:13:24.972 fused_ordering(756) 00:13:24.972 fused_ordering(757) 00:13:24.972 fused_ordering(758) 00:13:24.972 fused_ordering(759) 00:13:24.972 fused_ordering(760) 00:13:24.972 fused_ordering(761) 00:13:24.972 fused_ordering(762) 00:13:24.972 fused_ordering(763) 00:13:24.972 fused_ordering(764) 00:13:24.972 fused_ordering(765) 00:13:24.972 fused_ordering(766) 00:13:24.972 fused_ordering(767) 00:13:24.972 fused_ordering(768) 00:13:24.972 fused_ordering(769) 00:13:24.972 fused_ordering(770) 00:13:24.972 fused_ordering(771) 00:13:24.972 fused_ordering(772) 00:13:24.972 fused_ordering(773) 00:13:24.972 fused_ordering(774) 00:13:24.972 fused_ordering(775) 00:13:24.972 fused_ordering(776) 00:13:24.972 fused_ordering(777) 00:13:24.972 fused_ordering(778) 00:13:24.972 fused_ordering(779) 00:13:24.972 fused_ordering(780) 00:13:24.972 fused_ordering(781) 00:13:24.972 fused_ordering(782) 00:13:24.972 fused_ordering(783) 00:13:24.972 fused_ordering(784) 00:13:24.972 fused_ordering(785) 00:13:24.972 fused_ordering(786) 00:13:24.972 fused_ordering(787) 00:13:24.972 fused_ordering(788) 00:13:24.972 fused_ordering(789) 00:13:24.972 fused_ordering(790) 00:13:24.972 fused_ordering(791) 00:13:24.972 fused_ordering(792) 00:13:24.972 fused_ordering(793) 00:13:24.972 fused_ordering(794) 00:13:24.972 fused_ordering(795) 00:13:24.972 fused_ordering(796) 00:13:24.972 fused_ordering(797) 00:13:24.972 fused_ordering(798) 00:13:24.972 fused_ordering(799) 00:13:24.972 fused_ordering(800) 00:13:24.972 fused_ordering(801) 00:13:24.972 fused_ordering(802) 00:13:24.972 fused_ordering(803) 00:13:24.972 fused_ordering(804) 00:13:24.972 fused_ordering(805) 00:13:24.972 fused_ordering(806) 00:13:24.972 fused_ordering(807) 00:13:24.972 fused_ordering(808) 00:13:24.972 fused_ordering(809) 00:13:24.972 fused_ordering(810) 00:13:24.972 fused_ordering(811) 00:13:24.972 fused_ordering(812) 00:13:24.972 fused_ordering(813) 00:13:24.972 fused_ordering(814) 00:13:24.972 fused_ordering(815) 00:13:24.972 fused_ordering(816) 00:13:24.972 fused_ordering(817) 00:13:24.972 fused_ordering(818) 00:13:24.972 fused_ordering(819) 00:13:24.972 fused_ordering(820) 00:13:25.536 fused_ordering(821) 00:13:25.536 fused_ordering(822) 00:13:25.536 fused_ordering(823) 00:13:25.536 fused_ordering(824) 00:13:25.536 fused_ordering(825) 00:13:25.537 fused_ordering(826) 00:13:25.537 fused_ordering(827) 00:13:25.537 fused_ordering(828) 00:13:25.537 fused_ordering(829) 00:13:25.537 fused_ordering(830) 00:13:25.537 fused_ordering(831) 00:13:25.537 fused_ordering(832) 00:13:25.537 fused_ordering(833) 00:13:25.537 fused_ordering(834) 00:13:25.537 fused_ordering(835) 00:13:25.537 fused_ordering(836) 00:13:25.537 fused_ordering(837) 00:13:25.537 fused_ordering(838) 00:13:25.537 fused_ordering(839) 00:13:25.537 fused_ordering(840) 00:13:25.537 fused_ordering(841) 00:13:25.537 fused_ordering(842) 00:13:25.537 fused_ordering(843) 00:13:25.537 fused_ordering(844) 00:13:25.537 fused_ordering(845) 00:13:25.537 fused_ordering(846) 00:13:25.537 fused_ordering(847) 00:13:25.537 fused_ordering(848) 00:13:25.537 fused_ordering(849) 00:13:25.537 fused_ordering(850) 00:13:25.537 fused_ordering(851) 00:13:25.537 fused_ordering(852) 00:13:25.537 fused_ordering(853) 00:13:25.537 fused_ordering(854) 00:13:25.537 fused_ordering(855) 00:13:25.537 fused_ordering(856) 00:13:25.537 fused_ordering(857) 00:13:25.537 fused_ordering(858) 00:13:25.537 fused_ordering(859) 00:13:25.537 fused_ordering(860) 00:13:25.537 fused_ordering(861) 00:13:25.537 fused_ordering(862) 00:13:25.537 fused_ordering(863) 00:13:25.537 fused_ordering(864) 00:13:25.537 fused_ordering(865) 00:13:25.537 fused_ordering(866) 00:13:25.537 fused_ordering(867) 00:13:25.537 fused_ordering(868) 00:13:25.537 fused_ordering(869) 00:13:25.537 fused_ordering(870) 00:13:25.537 fused_ordering(871) 00:13:25.537 fused_ordering(872) 00:13:25.537 fused_ordering(873) 00:13:25.537 fused_ordering(874) 00:13:25.537 fused_ordering(875) 00:13:25.537 fused_ordering(876) 00:13:25.537 fused_ordering(877) 00:13:25.537 fused_ordering(878) 00:13:25.537 fused_ordering(879) 00:13:25.537 fused_ordering(880) 00:13:25.537 fused_ordering(881) 00:13:25.537 fused_ordering(882) 00:13:25.537 fused_ordering(883) 00:13:25.537 fused_ordering(884) 00:13:25.537 fused_ordering(885) 00:13:25.537 fused_ordering(886) 00:13:25.537 fused_ordering(887) 00:13:25.537 fused_ordering(888) 00:13:25.537 fused_ordering(889) 00:13:25.537 fused_ordering(890) 00:13:25.537 fused_ordering(891) 00:13:25.537 fused_ordering(892) 00:13:25.537 fused_ordering(893) 00:13:25.537 fused_ordering(894) 00:13:25.537 fused_ordering(895) 00:13:25.537 fused_ordering(896) 00:13:25.537 fused_ordering(897) 00:13:25.537 fused_ordering(898) 00:13:25.537 fused_ordering(899) 00:13:25.537 fused_ordering(900) 00:13:25.537 fused_ordering(901) 00:13:25.537 fused_ordering(902) 00:13:25.537 fused_ordering(903) 00:13:25.537 fused_ordering(904) 00:13:25.537 fused_ordering(905) 00:13:25.537 fused_ordering(906) 00:13:25.537 fused_ordering(907) 00:13:25.537 fused_ordering(908) 00:13:25.537 fused_ordering(909) 00:13:25.537 fused_ordering(910) 00:13:25.537 fused_ordering(911) 00:13:25.537 fused_ordering(912) 00:13:25.537 fused_ordering(913) 00:13:25.537 fused_ordering(914) 00:13:25.537 fused_ordering(915) 00:13:25.537 fused_ordering(916) 00:13:25.537 fused_ordering(917) 00:13:25.537 fused_ordering(918) 00:13:25.537 fused_ordering(919) 00:13:25.537 fused_ordering(920) 00:13:25.537 fused_ordering(921) 00:13:25.537 fused_ordering(922) 00:13:25.537 fused_ordering(923) 00:13:25.537 fused_ordering(924) 00:13:25.537 fused_ordering(925) 00:13:25.537 fused_ordering(926) 00:13:25.537 fused_ordering(927) 00:13:25.537 fused_ordering(928) 00:13:25.537 fused_ordering(929) 00:13:25.537 fused_ordering(930) 00:13:25.537 fused_ordering(931) 00:13:25.537 fused_ordering(932) 00:13:25.537 fused_ordering(933) 00:13:25.537 fused_ordering(934) 00:13:25.537 fused_ordering(935) 00:13:25.537 fused_ordering(936) 00:13:25.537 fused_ordering(937) 00:13:25.537 fused_ordering(938) 00:13:25.537 fused_ordering(939) 00:13:25.537 fused_ordering(940) 00:13:25.537 fused_ordering(941) 00:13:25.537 fused_ordering(942) 00:13:25.537 fused_ordering(943) 00:13:25.537 fused_ordering(944) 00:13:25.537 fused_ordering(945) 00:13:25.537 fused_ordering(946) 00:13:25.537 fused_ordering(947) 00:13:25.537 fused_ordering(948) 00:13:25.537 fused_ordering(949) 00:13:25.537 fused_ordering(950) 00:13:25.537 fused_ordering(951) 00:13:25.537 fused_ordering(952) 00:13:25.537 fused_ordering(953) 00:13:25.537 fused_ordering(954) 00:13:25.537 fused_ordering(955) 00:13:25.537 fused_ordering(956) 00:13:25.537 fused_ordering(957) 00:13:25.537 fused_ordering(958) 00:13:25.537 fused_ordering(959) 00:13:25.537 fused_ordering(960) 00:13:25.537 fused_ordering(961) 00:13:25.537 fused_ordering(962) 00:13:25.537 fused_ordering(963) 00:13:25.537 fused_ordering(964) 00:13:25.537 fused_ordering(965) 00:13:25.537 fused_ordering(966) 00:13:25.537 fused_ordering(967) 00:13:25.537 fused_ordering(968) 00:13:25.537 fused_ordering(969) 00:13:25.537 fused_ordering(970) 00:13:25.537 fused_ordering(971) 00:13:25.537 fused_ordering(972) 00:13:25.537 fused_ordering(973) 00:13:25.537 fused_ordering(974) 00:13:25.537 fused_ordering(975) 00:13:25.537 fused_ordering(976) 00:13:25.537 fused_ordering(977) 00:13:25.537 fused_ordering(978) 00:13:25.537 fused_ordering(979) 00:13:25.537 fused_ordering(980) 00:13:25.537 fused_ordering(981) 00:13:25.537 fused_ordering(982) 00:13:25.537 fused_ordering(983) 00:13:25.537 fused_ordering(984) 00:13:25.537 fused_ordering(985) 00:13:25.537 fused_ordering(986) 00:13:25.537 fused_ordering(987) 00:13:25.537 fused_ordering(988) 00:13:25.537 fused_ordering(989) 00:13:25.537 fused_ordering(990) 00:13:25.537 fused_ordering(991) 00:13:25.537 fused_ordering(992) 00:13:25.537 fused_ordering(993) 00:13:25.537 fused_ordering(994) 00:13:25.537 fused_ordering(995) 00:13:25.537 fused_ordering(996) 00:13:25.537 fused_ordering(997) 00:13:25.537 fused_ordering(998) 00:13:25.537 fused_ordering(999) 00:13:25.537 fused_ordering(1000) 00:13:25.537 fused_ordering(1001) 00:13:25.537 fused_ordering(1002) 00:13:25.537 fused_ordering(1003) 00:13:25.537 fused_ordering(1004) 00:13:25.537 fused_ordering(1005) 00:13:25.537 fused_ordering(1006) 00:13:25.537 fused_ordering(1007) 00:13:25.537 fused_ordering(1008) 00:13:25.537 fused_ordering(1009) 00:13:25.537 fused_ordering(1010) 00:13:25.537 fused_ordering(1011) 00:13:25.537 fused_ordering(1012) 00:13:25.537 fused_ordering(1013) 00:13:25.537 fused_ordering(1014) 00:13:25.537 fused_ordering(1015) 00:13:25.537 fused_ordering(1016) 00:13:25.537 fused_ordering(1017) 00:13:25.537 fused_ordering(1018) 00:13:25.537 fused_ordering(1019) 00:13:25.537 fused_ordering(1020) 00:13:25.537 fused_ordering(1021) 00:13:25.537 fused_ordering(1022) 00:13:25.537 fused_ordering(1023) 00:13:25.537 08:52:13 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:13:25.537 08:52:13 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:13:25.537 08:52:13 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:25.537 08:52:13 -- nvmf/common.sh@116 -- # sync 00:13:25.537 08:52:13 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:25.537 08:52:13 -- nvmf/common.sh@119 -- # set +e 00:13:25.537 08:52:13 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:25.537 08:52:13 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:25.537 rmmod nvme_tcp 00:13:25.537 rmmod nvme_fabrics 00:13:25.537 rmmod nvme_keyring 00:13:25.537 08:52:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:25.537 08:52:14 -- nvmf/common.sh@123 -- # set -e 00:13:25.537 08:52:14 -- nvmf/common.sh@124 -- # return 0 00:13:25.537 08:52:14 -- nvmf/common.sh@477 -- # '[' -n 1467461 ']' 00:13:25.537 08:52:14 -- nvmf/common.sh@478 -- # killprocess 1467461 00:13:25.537 08:52:14 -- common/autotest_common.sh@926 -- # '[' -z 1467461 ']' 00:13:25.537 08:52:14 -- common/autotest_common.sh@930 -- # kill -0 1467461 00:13:25.537 08:52:14 -- common/autotest_common.sh@931 -- # uname 00:13:25.537 08:52:14 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:13:25.537 08:52:14 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1467461 00:13:25.795 08:52:14 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:13:25.795 08:52:14 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:13:25.795 08:52:14 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1467461' 00:13:25.795 killing process with pid 1467461 00:13:25.795 08:52:14 -- common/autotest_common.sh@945 -- # kill 1467461 00:13:25.795 08:52:14 -- common/autotest_common.sh@950 -- # wait 1467461 00:13:26.052 08:52:14 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:26.052 08:52:14 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:26.052 08:52:14 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:26.052 08:52:14 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:26.052 08:52:14 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:26.052 08:52:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:26.052 08:52:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:26.052 08:52:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:27.952 08:52:16 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:27.952 00:13:27.952 real 0m8.537s 00:13:27.952 user 0m6.344s 00:13:27.952 sys 0m3.614s 00:13:27.952 08:52:16 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:13:27.952 08:52:16 -- common/autotest_common.sh@10 -- # set +x 00:13:27.952 ************************************ 00:13:27.952 END TEST nvmf_fused_ordering 00:13:27.952 ************************************ 00:13:27.952 08:52:16 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:27.952 08:52:16 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:13:27.952 08:52:16 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:13:27.952 08:52:16 -- common/autotest_common.sh@10 -- # set +x 00:13:27.952 ************************************ 00:13:27.952 START TEST nvmf_delete_subsystem 00:13:27.952 ************************************ 00:13:27.952 08:52:16 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:27.952 * Looking for test storage... 00:13:27.952 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:27.952 08:52:16 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:27.952 08:52:16 -- nvmf/common.sh@7 -- # uname -s 00:13:27.952 08:52:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:27.952 08:52:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:27.952 08:52:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:27.952 08:52:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:27.952 08:52:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:27.952 08:52:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:27.952 08:52:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:27.952 08:52:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:27.952 08:52:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:27.952 08:52:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:27.952 08:52:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:27.952 08:52:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:27.952 08:52:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:27.952 08:52:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:27.952 08:52:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:27.952 08:52:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:27.952 08:52:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:27.952 08:52:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:27.953 08:52:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:27.953 08:52:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:27.953 08:52:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:27.953 08:52:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:27.953 08:52:16 -- paths/export.sh@5 -- # export PATH 00:13:27.953 08:52:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:27.953 08:52:16 -- nvmf/common.sh@46 -- # : 0 00:13:27.953 08:52:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:27.953 08:52:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:27.953 08:52:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:27.953 08:52:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:27.953 08:52:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:27.953 08:52:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:27.953 08:52:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:27.953 08:52:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:27.953 08:52:16 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:13:27.953 08:52:16 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:27.953 08:52:16 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:27.953 08:52:16 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:27.953 08:52:16 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:27.953 08:52:16 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:27.953 08:52:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:27.953 08:52:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:27.953 08:52:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:28.210 08:52:16 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:28.210 08:52:16 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:28.210 08:52:16 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:28.210 08:52:16 -- common/autotest_common.sh@10 -- # set +x 00:13:30.105 08:52:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:30.105 08:52:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:30.105 08:52:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:30.105 08:52:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:30.105 08:52:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:30.105 08:52:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:30.105 08:52:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:30.105 08:52:18 -- nvmf/common.sh@294 -- # net_devs=() 00:13:30.105 08:52:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:30.105 08:52:18 -- nvmf/common.sh@295 -- # e810=() 00:13:30.105 08:52:18 -- nvmf/common.sh@295 -- # local -ga e810 00:13:30.105 08:52:18 -- nvmf/common.sh@296 -- # x722=() 00:13:30.105 08:52:18 -- nvmf/common.sh@296 -- # local -ga x722 00:13:30.105 08:52:18 -- nvmf/common.sh@297 -- # mlx=() 00:13:30.105 08:52:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:30.105 08:52:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:30.105 08:52:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:30.105 08:52:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:30.105 08:52:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:30.105 08:52:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:30.105 08:52:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:30.105 08:52:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:30.105 08:52:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:30.105 08:52:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:30.105 08:52:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:30.105 08:52:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:30.105 08:52:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:30.105 08:52:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:30.105 08:52:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:30.105 08:52:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:30.105 08:52:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:30.105 08:52:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:30.105 08:52:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:30.105 08:52:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:30.105 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:30.105 08:52:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:30.105 08:52:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:30.105 08:52:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:30.105 08:52:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:30.105 08:52:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:30.105 08:52:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:30.105 08:52:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:30.105 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:30.106 08:52:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:30.106 08:52:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:30.106 08:52:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:30.106 08:52:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:30.106 08:52:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:30.106 08:52:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:30.106 08:52:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:30.106 08:52:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:30.106 08:52:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:30.106 08:52:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:30.106 08:52:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:30.106 08:52:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:30.106 08:52:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:30.106 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:30.106 08:52:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:30.106 08:52:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:30.106 08:52:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:30.106 08:52:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:30.106 08:52:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:30.106 08:52:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:30.106 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:30.106 08:52:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:30.106 08:52:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:30.106 08:52:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:30.106 08:52:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:30.106 08:52:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:30.106 08:52:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:30.106 08:52:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:30.106 08:52:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:30.106 08:52:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:30.106 08:52:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:30.106 08:52:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:30.106 08:52:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:30.106 08:52:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:30.106 08:52:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:30.106 08:52:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:30.106 08:52:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:30.106 08:52:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:30.106 08:52:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:30.106 08:52:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:30.364 08:52:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:30.364 08:52:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:30.364 08:52:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:30.364 08:52:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:30.364 08:52:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:30.364 08:52:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:30.364 08:52:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:30.364 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:30.364 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.148 ms 00:13:30.364 00:13:30.364 --- 10.0.0.2 ping statistics --- 00:13:30.364 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:30.364 rtt min/avg/max/mdev = 0.148/0.148/0.148/0.000 ms 00:13:30.364 08:52:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:30.364 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:30.364 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.161 ms 00:13:30.364 00:13:30.364 --- 10.0.0.1 ping statistics --- 00:13:30.364 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:30.364 rtt min/avg/max/mdev = 0.161/0.161/0.161/0.000 ms 00:13:30.364 08:52:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:30.364 08:52:18 -- nvmf/common.sh@410 -- # return 0 00:13:30.364 08:52:18 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:30.364 08:52:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:30.364 08:52:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:30.364 08:52:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:30.364 08:52:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:30.364 08:52:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:30.364 08:52:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:30.364 08:52:18 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:13:30.364 08:52:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:30.364 08:52:18 -- common/autotest_common.sh@712 -- # xtrace_disable 00:13:30.364 08:52:18 -- common/autotest_common.sh@10 -- # set +x 00:13:30.364 08:52:18 -- nvmf/common.sh@469 -- # nvmfpid=1469907 00:13:30.364 08:52:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:13:30.364 08:52:18 -- nvmf/common.sh@470 -- # waitforlisten 1469907 00:13:30.364 08:52:18 -- common/autotest_common.sh@819 -- # '[' -z 1469907 ']' 00:13:30.364 08:52:18 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:30.364 08:52:18 -- common/autotest_common.sh@824 -- # local max_retries=100 00:13:30.364 08:52:18 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:30.364 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:30.364 08:52:18 -- common/autotest_common.sh@828 -- # xtrace_disable 00:13:30.364 08:52:18 -- common/autotest_common.sh@10 -- # set +x 00:13:30.364 [2024-07-15 08:52:18.786181] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:13:30.364 [2024-07-15 08:52:18.786249] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:30.364 EAL: No free 2048 kB hugepages reported on node 1 00:13:30.364 [2024-07-15 08:52:18.848447] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:13:30.621 [2024-07-15 08:52:18.966113] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:30.621 [2024-07-15 08:52:18.966288] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:30.621 [2024-07-15 08:52:18.966308] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:30.621 [2024-07-15 08:52:18.966323] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:30.621 [2024-07-15 08:52:18.966383] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:30.621 [2024-07-15 08:52:18.966389] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:31.551 08:52:19 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:13:31.551 08:52:19 -- common/autotest_common.sh@852 -- # return 0 00:13:31.551 08:52:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:31.551 08:52:19 -- common/autotest_common.sh@718 -- # xtrace_disable 00:13:31.551 08:52:19 -- common/autotest_common.sh@10 -- # set +x 00:13:31.551 08:52:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:31.551 08:52:19 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:31.551 08:52:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:31.551 08:52:19 -- common/autotest_common.sh@10 -- # set +x 00:13:31.551 [2024-07-15 08:52:19.780861] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:31.551 08:52:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:31.551 08:52:19 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:31.551 08:52:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:31.551 08:52:19 -- common/autotest_common.sh@10 -- # set +x 00:13:31.551 08:52:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:31.551 08:52:19 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:31.551 08:52:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:31.551 08:52:19 -- common/autotest_common.sh@10 -- # set +x 00:13:31.551 [2024-07-15 08:52:19.797102] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:31.551 08:52:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:31.551 08:52:19 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:31.551 08:52:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:31.551 08:52:19 -- common/autotest_common.sh@10 -- # set +x 00:13:31.551 NULL1 00:13:31.551 08:52:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:31.551 08:52:19 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:31.551 08:52:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:31.551 08:52:19 -- common/autotest_common.sh@10 -- # set +x 00:13:31.551 Delay0 00:13:31.551 08:52:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:31.551 08:52:19 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:31.551 08:52:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:31.551 08:52:19 -- common/autotest_common.sh@10 -- # set +x 00:13:31.551 08:52:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:31.551 08:52:19 -- target/delete_subsystem.sh@28 -- # perf_pid=1470063 00:13:31.551 08:52:19 -- target/delete_subsystem.sh@30 -- # sleep 2 00:13:31.551 08:52:19 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:13:31.551 EAL: No free 2048 kB hugepages reported on node 1 00:13:31.551 [2024-07-15 08:52:19.871748] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:13:33.479 08:52:21 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:33.479 08:52:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:33.479 08:52:21 -- common/autotest_common.sh@10 -- # set +x 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 starting I/O failed: -6 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Write completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Write completed with error (sct=0, sc=8) 00:13:33.479 starting I/O failed: -6 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Write completed with error (sct=0, sc=8) 00:13:33.479 Write completed with error (sct=0, sc=8) 00:13:33.479 starting I/O failed: -6 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 starting I/O failed: -6 00:13:33.479 Write completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Write completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 starting I/O failed: -6 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 starting I/O failed: -6 00:13:33.479 Write completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 starting I/O failed: -6 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 starting I/O failed: -6 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 starting I/O failed: -6 00:13:33.479 Write completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Write completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 starting I/O failed: -6 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Write completed with error (sct=0, sc=8) 00:13:33.479 starting I/O failed: -6 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 starting I/O failed: -6 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 starting I/O failed: -6 00:13:33.479 Write completed with error (sct=0, sc=8) 00:13:33.479 Write completed with error (sct=0, sc=8) 00:13:33.479 starting I/O failed: -6 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Write completed with error (sct=0, sc=8) 00:13:33.479 starting I/O failed: -6 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 starting I/O failed: -6 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 starting I/O failed: -6 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 starting I/O failed: -6 00:13:33.479 Write completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 starting I/O failed: -6 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 starting I/O failed: -6 00:13:33.479 Write completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 starting I/O failed: -6 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 starting I/O failed: -6 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 starting I/O failed: -6 00:13:33.479 Write completed with error (sct=0, sc=8) 00:13:33.479 Write completed with error (sct=0, sc=8) 00:13:33.479 starting I/O failed: -6 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 starting I/O failed: -6 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Write completed with error (sct=0, sc=8) 00:13:33.479 starting I/O failed: -6 00:13:33.479 Write completed with error (sct=0, sc=8) 00:13:33.479 Write completed with error (sct=0, sc=8) 00:13:33.479 starting I/O failed: -6 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Write completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 starting I/O failed: -6 00:13:33.479 starting I/O failed: -6 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Write completed with error (sct=0, sc=8) 00:13:33.479 Write completed with error (sct=0, sc=8) 00:13:33.479 starting I/O failed: -6 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Write completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Write completed with error (sct=0, sc=8) 00:13:33.479 starting I/O failed: -6 00:13:33.479 Write completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 starting I/O failed: -6 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Write completed with error (sct=0, sc=8) 00:13:33.479 starting I/O failed: -6 00:13:33.479 Write completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Write completed with error (sct=0, sc=8) 00:13:33.479 starting I/O failed: -6 00:13:33.479 Write completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 starting I/O failed: -6 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 starting I/O failed: -6 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Write completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 starting I/O failed: -6 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Write completed with error (sct=0, sc=8) 00:13:33.479 starting I/O failed: -6 00:13:33.479 Write completed with error (sct=0, sc=8) 00:13:33.479 Write completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 starting I/O failed: -6 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 starting I/O failed: -6 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 Read completed with error (sct=0, sc=8) 00:13:33.479 starting I/O failed: -6 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 starting I/O failed: -6 00:13:33.480 Write completed with error (sct=0, sc=8) 00:13:33.480 Write completed with error (sct=0, sc=8) 00:13:33.480 starting I/O failed: -6 00:13:33.480 Write completed with error (sct=0, sc=8) 00:13:33.480 starting I/O failed: -6 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Write completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 starting I/O failed: -6 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Write completed with error (sct=0, sc=8) 00:13:33.480 Write completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 starting I/O failed: -6 00:13:33.480 starting I/O failed: -6 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Write completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 starting I/O failed: -6 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Write completed with error (sct=0, sc=8) 00:13:33.480 starting I/O failed: -6 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 starting I/O failed: -6 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 starting I/O failed: -6 00:13:33.480 starting I/O failed: -6 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Write completed with error (sct=0, sc=8) 00:13:33.480 starting I/O failed: -6 00:13:33.480 Write completed with error (sct=0, sc=8) 00:13:33.480 Write completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 starting I/O failed: -6 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Write completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 starting I/O failed: -6 00:13:33.480 [2024-07-15 08:52:21.955034] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f969c000c00 is same with the state(5) to be set 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Write completed with error (sct=0, sc=8) 00:13:33.480 Write completed with error (sct=0, sc=8) 00:13:33.480 Write completed with error (sct=0, sc=8) 00:13:33.480 Write completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Write completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Write completed with error (sct=0, sc=8) 00:13:33.480 Write completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Write completed with error (sct=0, sc=8) 00:13:33.480 Write completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Write completed with error (sct=0, sc=8) 00:13:33.480 Write completed with error (sct=0, sc=8) 00:13:33.480 Write completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Write completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Write completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Write completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Write completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:33.480 Read completed with error (sct=0, sc=8) 00:13:34.413 [2024-07-15 08:52:22.927480] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbd55a0 is same with the state(5) to be set 00:13:34.413 Write completed with error (sct=0, sc=8) 00:13:34.413 Write completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Write completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Write completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Write completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Write completed with error (sct=0, sc=8) 00:13:34.413 Write completed with error (sct=0, sc=8) 00:13:34.413 Write completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Write completed with error (sct=0, sc=8) 00:13:34.413 Write completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Write completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Write completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Write completed with error (sct=0, sc=8) 00:13:34.413 Write completed with error (sct=0, sc=8) 00:13:34.413 Write completed with error (sct=0, sc=8) 00:13:34.413 Write completed with error (sct=0, sc=8) 00:13:34.413 Write completed with error (sct=0, sc=8) 00:13:34.413 Write completed with error (sct=0, sc=8) 00:13:34.413 [2024-07-15 08:52:22.956264] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb5e10 is same with the state(5) to be set 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Write completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Write completed with error (sct=0, sc=8) 00:13:34.413 Write completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Write completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.413 Read completed with error (sct=0, sc=8) 00:13:34.671 [2024-07-15 08:52:22.956567] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f969c00bf20 is same with the state(5) to be set 00:13:34.671 Write completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Write completed with error (sct=0, sc=8) 00:13:34.671 Write completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Write completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Write completed with error (sct=0, sc=8) 00:13:34.671 Write completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Write completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Write completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Write completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Write completed with error (sct=0, sc=8) 00:13:34.671 Write completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 [2024-07-15 08:52:22.956782] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f969c00c600 is same with the state(5) to be set 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Write completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Write completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Write completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Write completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Write completed with error (sct=0, sc=8) 00:13:34.671 Write completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Write completed with error (sct=0, sc=8) 00:13:34.671 Write completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Write completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Write completed with error (sct=0, sc=8) 00:13:34.671 Write completed with error (sct=0, sc=8) 00:13:34.671 Write completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Write completed with error (sct=0, sc=8) 00:13:34.671 Write completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Read completed with error (sct=0, sc=8) 00:13:34.671 Write completed with error (sct=0, sc=8) 00:13:34.671 Write completed with error (sct=0, sc=8) 00:13:34.672 [2024-07-15 08:52:22.957709] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb69b0 is same with the state(5) to be set 00:13:34.672 [2024-07-15 08:52:22.958117] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbd55a0 (9): Bad file descriptor 00:13:34.672 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:13:34.672 08:52:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:34.672 08:52:22 -- target/delete_subsystem.sh@34 -- # delay=0 00:13:34.672 08:52:22 -- target/delete_subsystem.sh@35 -- # kill -0 1470063 00:13:34.672 08:52:22 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:13:34.672 Initializing NVMe Controllers 00:13:34.672 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:34.672 Controller IO queue size 128, less than required. 00:13:34.672 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:34.672 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:13:34.672 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:13:34.672 Initialization complete. Launching workers. 00:13:34.672 ======================================================== 00:13:34.672 Latency(us) 00:13:34.672 Device Information : IOPS MiB/s Average min max 00:13:34.672 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 190.06 0.09 895509.95 631.51 1011714.23 00:13:34.672 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 171.20 0.08 910294.99 470.91 2001149.50 00:13:34.672 ======================================================== 00:13:34.672 Total : 361.25 0.18 902516.60 470.91 2001149.50 00:13:34.672 00:13:34.929 08:52:23 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:13:34.929 08:52:23 -- target/delete_subsystem.sh@35 -- # kill -0 1470063 00:13:34.929 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (1470063) - No such process 00:13:34.929 08:52:23 -- target/delete_subsystem.sh@45 -- # NOT wait 1470063 00:13:34.930 08:52:23 -- common/autotest_common.sh@640 -- # local es=0 00:13:34.930 08:52:23 -- common/autotest_common.sh@642 -- # valid_exec_arg wait 1470063 00:13:34.930 08:52:23 -- common/autotest_common.sh@628 -- # local arg=wait 00:13:34.930 08:52:23 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:13:34.930 08:52:23 -- common/autotest_common.sh@632 -- # type -t wait 00:13:34.930 08:52:23 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:13:34.930 08:52:23 -- common/autotest_common.sh@643 -- # wait 1470063 00:13:34.930 08:52:23 -- common/autotest_common.sh@643 -- # es=1 00:13:34.930 08:52:23 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:13:34.930 08:52:23 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:13:34.930 08:52:23 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:13:34.930 08:52:23 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:34.930 08:52:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:34.930 08:52:23 -- common/autotest_common.sh@10 -- # set +x 00:13:35.187 08:52:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:35.188 08:52:23 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:35.188 08:52:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:35.188 08:52:23 -- common/autotest_common.sh@10 -- # set +x 00:13:35.188 [2024-07-15 08:52:23.481411] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:35.188 08:52:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:35.188 08:52:23 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:35.188 08:52:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:35.188 08:52:23 -- common/autotest_common.sh@10 -- # set +x 00:13:35.188 08:52:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:35.188 08:52:23 -- target/delete_subsystem.sh@54 -- # perf_pid=1470479 00:13:35.188 08:52:23 -- target/delete_subsystem.sh@56 -- # delay=0 00:13:35.188 08:52:23 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:13:35.188 08:52:23 -- target/delete_subsystem.sh@57 -- # kill -0 1470479 00:13:35.188 08:52:23 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:35.188 EAL: No free 2048 kB hugepages reported on node 1 00:13:35.188 [2024-07-15 08:52:23.544365] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:13:35.753 08:52:23 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:35.753 08:52:23 -- target/delete_subsystem.sh@57 -- # kill -0 1470479 00:13:35.753 08:52:23 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:36.011 08:52:24 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:36.011 08:52:24 -- target/delete_subsystem.sh@57 -- # kill -0 1470479 00:13:36.011 08:52:24 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:36.576 08:52:25 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:36.576 08:52:25 -- target/delete_subsystem.sh@57 -- # kill -0 1470479 00:13:36.576 08:52:25 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:37.141 08:52:25 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:37.141 08:52:25 -- target/delete_subsystem.sh@57 -- # kill -0 1470479 00:13:37.141 08:52:25 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:37.707 08:52:26 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:37.707 08:52:26 -- target/delete_subsystem.sh@57 -- # kill -0 1470479 00:13:37.707 08:52:26 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:38.271 08:52:26 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:38.271 08:52:26 -- target/delete_subsystem.sh@57 -- # kill -0 1470479 00:13:38.271 08:52:26 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:38.271 Initializing NVMe Controllers 00:13:38.271 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:38.271 Controller IO queue size 128, less than required. 00:13:38.271 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:38.271 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:13:38.271 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:13:38.271 Initialization complete. Launching workers. 00:13:38.271 ======================================================== 00:13:38.271 Latency(us) 00:13:38.271 Device Information : IOPS MiB/s Average min max 00:13:38.271 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1003880.90 1000204.83 1011747.10 00:13:38.271 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1004216.73 1000219.57 1012116.04 00:13:38.271 ======================================================== 00:13:38.271 Total : 256.00 0.12 1004048.82 1000204.83 1012116.04 00:13:38.271 00:13:38.528 08:52:27 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:38.528 08:52:27 -- target/delete_subsystem.sh@57 -- # kill -0 1470479 00:13:38.528 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (1470479) - No such process 00:13:38.528 08:52:27 -- target/delete_subsystem.sh@67 -- # wait 1470479 00:13:38.528 08:52:27 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:13:38.528 08:52:27 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:13:38.528 08:52:27 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:38.528 08:52:27 -- nvmf/common.sh@116 -- # sync 00:13:38.528 08:52:27 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:38.528 08:52:27 -- nvmf/common.sh@119 -- # set +e 00:13:38.528 08:52:27 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:38.528 08:52:27 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:38.528 rmmod nvme_tcp 00:13:38.528 rmmod nvme_fabrics 00:13:38.528 rmmod nvme_keyring 00:13:38.528 08:52:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:38.786 08:52:27 -- nvmf/common.sh@123 -- # set -e 00:13:38.786 08:52:27 -- nvmf/common.sh@124 -- # return 0 00:13:38.786 08:52:27 -- nvmf/common.sh@477 -- # '[' -n 1469907 ']' 00:13:38.786 08:52:27 -- nvmf/common.sh@478 -- # killprocess 1469907 00:13:38.786 08:52:27 -- common/autotest_common.sh@926 -- # '[' -z 1469907 ']' 00:13:38.786 08:52:27 -- common/autotest_common.sh@930 -- # kill -0 1469907 00:13:38.786 08:52:27 -- common/autotest_common.sh@931 -- # uname 00:13:38.786 08:52:27 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:13:38.786 08:52:27 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1469907 00:13:38.786 08:52:27 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:13:38.786 08:52:27 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:13:38.786 08:52:27 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1469907' 00:13:38.786 killing process with pid 1469907 00:13:38.786 08:52:27 -- common/autotest_common.sh@945 -- # kill 1469907 00:13:38.786 08:52:27 -- common/autotest_common.sh@950 -- # wait 1469907 00:13:39.045 08:52:27 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:39.045 08:52:27 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:39.045 08:52:27 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:39.045 08:52:27 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:39.045 08:52:27 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:39.045 08:52:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:39.045 08:52:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:39.045 08:52:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:40.947 08:52:29 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:40.947 00:13:40.947 real 0m12.982s 00:13:40.947 user 0m29.199s 00:13:40.947 sys 0m2.977s 00:13:40.947 08:52:29 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:13:40.947 08:52:29 -- common/autotest_common.sh@10 -- # set +x 00:13:40.947 ************************************ 00:13:40.947 END TEST nvmf_delete_subsystem 00:13:40.947 ************************************ 00:13:40.947 08:52:29 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:13:40.947 08:52:29 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:13:40.947 08:52:29 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:13:40.947 08:52:29 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:13:40.947 08:52:29 -- common/autotest_common.sh@10 -- # set +x 00:13:40.947 ************************************ 00:13:40.947 START TEST nvmf_nvme_cli 00:13:40.947 ************************************ 00:13:40.947 08:52:29 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:13:40.947 * Looking for test storage... 00:13:40.947 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:40.947 08:52:29 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:40.947 08:52:29 -- nvmf/common.sh@7 -- # uname -s 00:13:40.947 08:52:29 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:40.947 08:52:29 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:40.947 08:52:29 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:40.947 08:52:29 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:40.947 08:52:29 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:40.947 08:52:29 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:40.947 08:52:29 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:40.947 08:52:29 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:40.947 08:52:29 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:40.947 08:52:29 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:41.205 08:52:29 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:41.205 08:52:29 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:41.205 08:52:29 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:41.205 08:52:29 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:41.205 08:52:29 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:41.205 08:52:29 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:41.205 08:52:29 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:41.205 08:52:29 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:41.205 08:52:29 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:41.205 08:52:29 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:41.205 08:52:29 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:41.205 08:52:29 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:41.205 08:52:29 -- paths/export.sh@5 -- # export PATH 00:13:41.205 08:52:29 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:41.205 08:52:29 -- nvmf/common.sh@46 -- # : 0 00:13:41.205 08:52:29 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:41.205 08:52:29 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:41.205 08:52:29 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:41.205 08:52:29 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:41.205 08:52:29 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:41.205 08:52:29 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:41.205 08:52:29 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:41.205 08:52:29 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:41.205 08:52:29 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:41.205 08:52:29 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:41.205 08:52:29 -- target/nvme_cli.sh@14 -- # devs=() 00:13:41.205 08:52:29 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:13:41.205 08:52:29 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:41.205 08:52:29 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:41.205 08:52:29 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:41.205 08:52:29 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:41.205 08:52:29 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:41.205 08:52:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:41.205 08:52:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:41.205 08:52:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:41.205 08:52:29 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:41.205 08:52:29 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:41.205 08:52:29 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:41.205 08:52:29 -- common/autotest_common.sh@10 -- # set +x 00:13:43.105 08:52:31 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:43.105 08:52:31 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:43.105 08:52:31 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:43.105 08:52:31 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:43.105 08:52:31 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:43.105 08:52:31 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:43.105 08:52:31 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:43.105 08:52:31 -- nvmf/common.sh@294 -- # net_devs=() 00:13:43.105 08:52:31 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:43.105 08:52:31 -- nvmf/common.sh@295 -- # e810=() 00:13:43.105 08:52:31 -- nvmf/common.sh@295 -- # local -ga e810 00:13:43.105 08:52:31 -- nvmf/common.sh@296 -- # x722=() 00:13:43.105 08:52:31 -- nvmf/common.sh@296 -- # local -ga x722 00:13:43.105 08:52:31 -- nvmf/common.sh@297 -- # mlx=() 00:13:43.105 08:52:31 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:43.105 08:52:31 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:43.105 08:52:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:43.105 08:52:31 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:43.105 08:52:31 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:43.105 08:52:31 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:43.105 08:52:31 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:43.105 08:52:31 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:43.105 08:52:31 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:43.105 08:52:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:43.105 08:52:31 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:43.105 08:52:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:43.105 08:52:31 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:43.105 08:52:31 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:43.105 08:52:31 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:43.105 08:52:31 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:43.105 08:52:31 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:43.105 08:52:31 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:43.105 08:52:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:43.105 08:52:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:43.105 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:43.105 08:52:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:43.105 08:52:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:43.105 08:52:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:43.105 08:52:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:43.105 08:52:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:43.105 08:52:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:43.105 08:52:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:43.105 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:43.105 08:52:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:43.105 08:52:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:43.105 08:52:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:43.105 08:52:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:43.105 08:52:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:43.105 08:52:31 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:43.105 08:52:31 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:43.105 08:52:31 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:43.105 08:52:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:43.105 08:52:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:43.105 08:52:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:43.105 08:52:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:43.105 08:52:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:43.105 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:43.105 08:52:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:43.105 08:52:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:43.105 08:52:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:43.105 08:52:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:43.105 08:52:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:43.105 08:52:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:43.105 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:43.105 08:52:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:43.105 08:52:31 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:43.105 08:52:31 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:43.105 08:52:31 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:43.105 08:52:31 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:43.105 08:52:31 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:43.105 08:52:31 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:43.105 08:52:31 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:43.105 08:52:31 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:43.105 08:52:31 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:43.105 08:52:31 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:43.105 08:52:31 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:43.105 08:52:31 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:43.105 08:52:31 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:43.105 08:52:31 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:43.105 08:52:31 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:43.105 08:52:31 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:43.105 08:52:31 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:43.105 08:52:31 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:43.105 08:52:31 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:43.105 08:52:31 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:43.105 08:52:31 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:43.105 08:52:31 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:43.105 08:52:31 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:43.105 08:52:31 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:43.105 08:52:31 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:43.105 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:43.105 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.150 ms 00:13:43.105 00:13:43.105 --- 10.0.0.2 ping statistics --- 00:13:43.105 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:43.105 rtt min/avg/max/mdev = 0.150/0.150/0.150/0.000 ms 00:13:43.105 08:52:31 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:43.105 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:43.105 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.069 ms 00:13:43.105 00:13:43.105 --- 10.0.0.1 ping statistics --- 00:13:43.105 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:43.105 rtt min/avg/max/mdev = 0.069/0.069/0.069/0.000 ms 00:13:43.105 08:52:31 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:43.105 08:52:31 -- nvmf/common.sh@410 -- # return 0 00:13:43.105 08:52:31 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:43.105 08:52:31 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:43.105 08:52:31 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:43.105 08:52:31 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:43.105 08:52:31 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:43.105 08:52:31 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:43.105 08:52:31 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:43.105 08:52:31 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:13:43.105 08:52:31 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:43.105 08:52:31 -- common/autotest_common.sh@712 -- # xtrace_disable 00:13:43.105 08:52:31 -- common/autotest_common.sh@10 -- # set +x 00:13:43.105 08:52:31 -- nvmf/common.sh@469 -- # nvmfpid=1472907 00:13:43.105 08:52:31 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:43.105 08:52:31 -- nvmf/common.sh@470 -- # waitforlisten 1472907 00:13:43.105 08:52:31 -- common/autotest_common.sh@819 -- # '[' -z 1472907 ']' 00:13:43.105 08:52:31 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:43.105 08:52:31 -- common/autotest_common.sh@824 -- # local max_retries=100 00:13:43.105 08:52:31 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:43.105 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:43.105 08:52:31 -- common/autotest_common.sh@828 -- # xtrace_disable 00:13:43.105 08:52:31 -- common/autotest_common.sh@10 -- # set +x 00:13:43.105 [2024-07-15 08:52:31.608048] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:13:43.105 [2024-07-15 08:52:31.608127] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:43.105 EAL: No free 2048 kB hugepages reported on node 1 00:13:43.363 [2024-07-15 08:52:31.675112] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:43.363 [2024-07-15 08:52:31.790294] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:43.363 [2024-07-15 08:52:31.790463] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:43.363 [2024-07-15 08:52:31.790484] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:43.363 [2024-07-15 08:52:31.790498] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:43.363 [2024-07-15 08:52:31.790572] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:43.363 [2024-07-15 08:52:31.790650] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:43.363 [2024-07-15 08:52:31.790733] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:43.363 [2024-07-15 08:52:31.790736] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:44.294 08:52:32 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:13:44.294 08:52:32 -- common/autotest_common.sh@852 -- # return 0 00:13:44.294 08:52:32 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:44.294 08:52:32 -- common/autotest_common.sh@718 -- # xtrace_disable 00:13:44.294 08:52:32 -- common/autotest_common.sh@10 -- # set +x 00:13:44.294 08:52:32 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:44.294 08:52:32 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:44.294 08:52:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:44.294 08:52:32 -- common/autotest_common.sh@10 -- # set +x 00:13:44.294 [2024-07-15 08:52:32.620420] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:44.294 08:52:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:44.294 08:52:32 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:13:44.294 08:52:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:44.294 08:52:32 -- common/autotest_common.sh@10 -- # set +x 00:13:44.294 Malloc0 00:13:44.294 08:52:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:44.294 08:52:32 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:13:44.294 08:52:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:44.294 08:52:32 -- common/autotest_common.sh@10 -- # set +x 00:13:44.294 Malloc1 00:13:44.294 08:52:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:44.294 08:52:32 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:13:44.294 08:52:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:44.294 08:52:32 -- common/autotest_common.sh@10 -- # set +x 00:13:44.294 08:52:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:44.294 08:52:32 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:13:44.294 08:52:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:44.294 08:52:32 -- common/autotest_common.sh@10 -- # set +x 00:13:44.294 08:52:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:44.294 08:52:32 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:44.294 08:52:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:44.294 08:52:32 -- common/autotest_common.sh@10 -- # set +x 00:13:44.294 08:52:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:44.294 08:52:32 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:44.294 08:52:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:44.294 08:52:32 -- common/autotest_common.sh@10 -- # set +x 00:13:44.294 [2024-07-15 08:52:32.703486] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:44.294 08:52:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:44.295 08:52:32 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:44.295 08:52:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:44.295 08:52:32 -- common/autotest_common.sh@10 -- # set +x 00:13:44.295 08:52:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:44.295 08:52:32 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:13:44.295 00:13:44.295 Discovery Log Number of Records 2, Generation counter 2 00:13:44.295 =====Discovery Log Entry 0====== 00:13:44.295 trtype: tcp 00:13:44.295 adrfam: ipv4 00:13:44.295 subtype: current discovery subsystem 00:13:44.295 treq: not required 00:13:44.295 portid: 0 00:13:44.295 trsvcid: 4420 00:13:44.295 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:13:44.295 traddr: 10.0.0.2 00:13:44.295 eflags: explicit discovery connections, duplicate discovery information 00:13:44.295 sectype: none 00:13:44.295 =====Discovery Log Entry 1====== 00:13:44.295 trtype: tcp 00:13:44.295 adrfam: ipv4 00:13:44.295 subtype: nvme subsystem 00:13:44.295 treq: not required 00:13:44.295 portid: 0 00:13:44.295 trsvcid: 4420 00:13:44.295 subnqn: nqn.2016-06.io.spdk:cnode1 00:13:44.295 traddr: 10.0.0.2 00:13:44.295 eflags: none 00:13:44.295 sectype: none 00:13:44.295 08:52:32 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:13:44.295 08:52:32 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:13:44.295 08:52:32 -- nvmf/common.sh@510 -- # local dev _ 00:13:44.295 08:52:32 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:44.295 08:52:32 -- nvmf/common.sh@509 -- # nvme list 00:13:44.295 08:52:32 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:13:44.295 08:52:32 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:44.295 08:52:32 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:13:44.295 08:52:32 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:44.295 08:52:32 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:13:44.295 08:52:32 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:45.240 08:52:33 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:13:45.240 08:52:33 -- common/autotest_common.sh@1177 -- # local i=0 00:13:45.240 08:52:33 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:13:45.240 08:52:33 -- common/autotest_common.sh@1179 -- # [[ -n 2 ]] 00:13:45.240 08:52:33 -- common/autotest_common.sh@1180 -- # nvme_device_counter=2 00:13:45.240 08:52:33 -- common/autotest_common.sh@1184 -- # sleep 2 00:13:47.135 08:52:35 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:13:47.135 08:52:35 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:13:47.135 08:52:35 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:13:47.135 08:52:35 -- common/autotest_common.sh@1186 -- # nvme_devices=2 00:13:47.135 08:52:35 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:13:47.135 08:52:35 -- common/autotest_common.sh@1187 -- # return 0 00:13:47.135 08:52:35 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:13:47.135 08:52:35 -- nvmf/common.sh@510 -- # local dev _ 00:13:47.135 08:52:35 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:47.135 08:52:35 -- nvmf/common.sh@509 -- # nvme list 00:13:47.135 08:52:35 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:13:47.135 08:52:35 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:47.135 08:52:35 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:13:47.135 08:52:35 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:47.135 08:52:35 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:13:47.135 08:52:35 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:13:47.135 08:52:35 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:47.135 08:52:35 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:13:47.135 08:52:35 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:13:47.135 08:52:35 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:47.135 08:52:35 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n2 00:13:47.135 /dev/nvme0n1 ]] 00:13:47.135 08:52:35 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:13:47.135 08:52:35 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:13:47.135 08:52:35 -- nvmf/common.sh@510 -- # local dev _ 00:13:47.135 08:52:35 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:47.135 08:52:35 -- nvmf/common.sh@509 -- # nvme list 00:13:47.135 08:52:35 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:13:47.135 08:52:35 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:47.135 08:52:35 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:13:47.135 08:52:35 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:47.135 08:52:35 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:13:47.135 08:52:35 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:13:47.135 08:52:35 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:47.135 08:52:35 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:13:47.135 08:52:35 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:13:47.135 08:52:35 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:47.135 08:52:35 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:13:47.135 08:52:35 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:47.135 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:47.135 08:52:35 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:47.135 08:52:35 -- common/autotest_common.sh@1198 -- # local i=0 00:13:47.135 08:52:35 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:13:47.135 08:52:35 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:47.135 08:52:35 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:13:47.135 08:52:35 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:47.135 08:52:35 -- common/autotest_common.sh@1210 -- # return 0 00:13:47.135 08:52:35 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:13:47.135 08:52:35 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:47.135 08:52:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:47.135 08:52:35 -- common/autotest_common.sh@10 -- # set +x 00:13:47.135 08:52:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:47.135 08:52:35 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:13:47.135 08:52:35 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:13:47.135 08:52:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:47.135 08:52:35 -- nvmf/common.sh@116 -- # sync 00:13:47.135 08:52:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:47.135 08:52:35 -- nvmf/common.sh@119 -- # set +e 00:13:47.135 08:52:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:47.135 08:52:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:47.135 rmmod nvme_tcp 00:13:47.135 rmmod nvme_fabrics 00:13:47.393 rmmod nvme_keyring 00:13:47.393 08:52:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:47.393 08:52:35 -- nvmf/common.sh@123 -- # set -e 00:13:47.393 08:52:35 -- nvmf/common.sh@124 -- # return 0 00:13:47.393 08:52:35 -- nvmf/common.sh@477 -- # '[' -n 1472907 ']' 00:13:47.393 08:52:35 -- nvmf/common.sh@478 -- # killprocess 1472907 00:13:47.393 08:52:35 -- common/autotest_common.sh@926 -- # '[' -z 1472907 ']' 00:13:47.393 08:52:35 -- common/autotest_common.sh@930 -- # kill -0 1472907 00:13:47.393 08:52:35 -- common/autotest_common.sh@931 -- # uname 00:13:47.393 08:52:35 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:13:47.393 08:52:35 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1472907 00:13:47.393 08:52:35 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:13:47.393 08:52:35 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:13:47.393 08:52:35 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1472907' 00:13:47.393 killing process with pid 1472907 00:13:47.393 08:52:35 -- common/autotest_common.sh@945 -- # kill 1472907 00:13:47.393 08:52:35 -- common/autotest_common.sh@950 -- # wait 1472907 00:13:47.651 08:52:36 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:47.651 08:52:36 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:47.651 08:52:36 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:47.651 08:52:36 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:47.651 08:52:36 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:47.651 08:52:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:47.651 08:52:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:47.651 08:52:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:49.588 08:52:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:49.588 00:13:49.588 real 0m8.648s 00:13:49.588 user 0m17.511s 00:13:49.588 sys 0m2.132s 00:13:49.588 08:52:38 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:13:49.588 08:52:38 -- common/autotest_common.sh@10 -- # set +x 00:13:49.588 ************************************ 00:13:49.588 END TEST nvmf_nvme_cli 00:13:49.588 ************************************ 00:13:49.588 08:52:38 -- nvmf/nvmf.sh@39 -- # [[ 0 -eq 1 ]] 00:13:49.588 08:52:38 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:13:49.588 08:52:38 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:13:49.588 08:52:38 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:13:49.588 08:52:38 -- common/autotest_common.sh@10 -- # set +x 00:13:49.588 ************************************ 00:13:49.588 START TEST nvmf_host_management 00:13:49.588 ************************************ 00:13:49.588 08:52:38 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:13:49.846 * Looking for test storage... 00:13:49.846 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:49.846 08:52:38 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:49.846 08:52:38 -- nvmf/common.sh@7 -- # uname -s 00:13:49.846 08:52:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:49.846 08:52:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:49.846 08:52:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:49.846 08:52:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:49.846 08:52:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:49.846 08:52:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:49.846 08:52:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:49.846 08:52:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:49.846 08:52:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:49.846 08:52:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:49.846 08:52:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:49.846 08:52:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:49.846 08:52:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:49.846 08:52:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:49.846 08:52:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:49.846 08:52:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:49.846 08:52:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:49.846 08:52:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:49.846 08:52:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:49.846 08:52:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:49.846 08:52:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:49.846 08:52:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:49.846 08:52:38 -- paths/export.sh@5 -- # export PATH 00:13:49.846 08:52:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:49.846 08:52:38 -- nvmf/common.sh@46 -- # : 0 00:13:49.846 08:52:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:49.846 08:52:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:49.846 08:52:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:49.846 08:52:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:49.846 08:52:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:49.846 08:52:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:49.846 08:52:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:49.846 08:52:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:49.846 08:52:38 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:49.846 08:52:38 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:49.846 08:52:38 -- target/host_management.sh@104 -- # nvmftestinit 00:13:49.846 08:52:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:49.846 08:52:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:49.846 08:52:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:49.846 08:52:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:49.846 08:52:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:49.846 08:52:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:49.846 08:52:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:49.846 08:52:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:49.846 08:52:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:49.846 08:52:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:49.846 08:52:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:49.846 08:52:38 -- common/autotest_common.sh@10 -- # set +x 00:13:51.748 08:52:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:51.748 08:52:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:51.748 08:52:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:51.748 08:52:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:51.748 08:52:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:51.748 08:52:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:51.748 08:52:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:51.748 08:52:40 -- nvmf/common.sh@294 -- # net_devs=() 00:13:51.748 08:52:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:51.748 08:52:40 -- nvmf/common.sh@295 -- # e810=() 00:13:51.748 08:52:40 -- nvmf/common.sh@295 -- # local -ga e810 00:13:51.748 08:52:40 -- nvmf/common.sh@296 -- # x722=() 00:13:51.749 08:52:40 -- nvmf/common.sh@296 -- # local -ga x722 00:13:51.749 08:52:40 -- nvmf/common.sh@297 -- # mlx=() 00:13:51.749 08:52:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:51.749 08:52:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:51.749 08:52:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:51.749 08:52:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:51.749 08:52:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:51.749 08:52:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:51.749 08:52:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:51.749 08:52:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:51.749 08:52:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:51.749 08:52:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:51.749 08:52:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:51.749 08:52:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:51.749 08:52:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:51.749 08:52:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:51.749 08:52:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:51.749 08:52:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:51.749 08:52:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:51.749 08:52:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:51.749 08:52:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:51.749 08:52:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:51.749 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:51.749 08:52:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:51.749 08:52:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:51.749 08:52:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:51.749 08:52:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:51.749 08:52:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:51.749 08:52:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:51.749 08:52:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:51.749 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:51.749 08:52:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:51.749 08:52:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:51.749 08:52:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:51.749 08:52:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:51.749 08:52:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:51.749 08:52:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:51.749 08:52:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:51.749 08:52:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:51.749 08:52:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:51.749 08:52:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:51.749 08:52:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:51.749 08:52:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:51.749 08:52:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:51.749 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:51.749 08:52:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:51.749 08:52:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:51.749 08:52:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:51.749 08:52:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:51.749 08:52:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:51.749 08:52:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:51.749 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:51.749 08:52:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:51.749 08:52:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:51.749 08:52:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:51.749 08:52:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:51.749 08:52:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:51.749 08:52:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:51.749 08:52:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:51.749 08:52:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:51.749 08:52:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:51.749 08:52:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:51.749 08:52:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:51.749 08:52:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:51.749 08:52:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:51.749 08:52:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:51.749 08:52:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:51.749 08:52:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:51.749 08:52:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:51.749 08:52:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:51.749 08:52:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:51.749 08:52:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:51.749 08:52:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:51.749 08:52:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:51.749 08:52:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:51.749 08:52:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:51.749 08:52:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:51.749 08:52:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:51.749 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:51.749 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.206 ms 00:13:51.749 00:13:51.749 --- 10.0.0.2 ping statistics --- 00:13:51.749 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:51.749 rtt min/avg/max/mdev = 0.206/0.206/0.206/0.000 ms 00:13:51.749 08:52:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:51.749 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:51.749 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.137 ms 00:13:51.749 00:13:51.749 --- 10.0.0.1 ping statistics --- 00:13:51.749 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:51.749 rtt min/avg/max/mdev = 0.137/0.137/0.137/0.000 ms 00:13:51.749 08:52:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:51.749 08:52:40 -- nvmf/common.sh@410 -- # return 0 00:13:51.749 08:52:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:51.749 08:52:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:51.749 08:52:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:51.749 08:52:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:51.749 08:52:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:51.749 08:52:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:51.749 08:52:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:51.749 08:52:40 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:13:51.749 08:52:40 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:13:51.749 08:52:40 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:13:51.749 08:52:40 -- common/autotest_common.sh@10 -- # set +x 00:13:51.749 ************************************ 00:13:51.749 START TEST nvmf_host_management 00:13:51.749 ************************************ 00:13:51.749 08:52:40 -- common/autotest_common.sh@1104 -- # nvmf_host_management 00:13:51.749 08:52:40 -- target/host_management.sh@69 -- # starttarget 00:13:51.749 08:52:40 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:13:51.749 08:52:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:51.749 08:52:40 -- common/autotest_common.sh@712 -- # xtrace_disable 00:13:51.749 08:52:40 -- common/autotest_common.sh@10 -- # set +x 00:13:51.749 08:52:40 -- nvmf/common.sh@469 -- # nvmfpid=1475376 00:13:51.749 08:52:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:13:51.749 08:52:40 -- nvmf/common.sh@470 -- # waitforlisten 1475376 00:13:51.749 08:52:40 -- common/autotest_common.sh@819 -- # '[' -z 1475376 ']' 00:13:51.749 08:52:40 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:51.749 08:52:40 -- common/autotest_common.sh@824 -- # local max_retries=100 00:13:51.749 08:52:40 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:51.749 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:51.749 08:52:40 -- common/autotest_common.sh@828 -- # xtrace_disable 00:13:51.749 08:52:40 -- common/autotest_common.sh@10 -- # set +x 00:13:51.749 [2024-07-15 08:52:40.289111] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:13:51.749 [2024-07-15 08:52:40.289193] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:52.006 EAL: No free 2048 kB hugepages reported on node 1 00:13:52.006 [2024-07-15 08:52:40.356030] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:52.006 [2024-07-15 08:52:40.471845] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:52.006 [2024-07-15 08:52:40.472024] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:52.006 [2024-07-15 08:52:40.472042] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:52.006 [2024-07-15 08:52:40.472054] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:52.006 [2024-07-15 08:52:40.472120] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:52.006 [2024-07-15 08:52:40.472218] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:52.007 [2024-07-15 08:52:40.472269] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:13:52.007 [2024-07-15 08:52:40.472272] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:52.938 08:52:41 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:13:52.938 08:52:41 -- common/autotest_common.sh@852 -- # return 0 00:13:52.938 08:52:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:52.938 08:52:41 -- common/autotest_common.sh@718 -- # xtrace_disable 00:13:52.938 08:52:41 -- common/autotest_common.sh@10 -- # set +x 00:13:52.938 08:52:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:52.938 08:52:41 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:52.938 08:52:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:52.938 08:52:41 -- common/autotest_common.sh@10 -- # set +x 00:13:52.938 [2024-07-15 08:52:41.338661] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:52.938 08:52:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:52.938 08:52:41 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:13:52.938 08:52:41 -- common/autotest_common.sh@712 -- # xtrace_disable 00:13:52.938 08:52:41 -- common/autotest_common.sh@10 -- # set +x 00:13:52.938 08:52:41 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:13:52.938 08:52:41 -- target/host_management.sh@23 -- # cat 00:13:52.938 08:52:41 -- target/host_management.sh@30 -- # rpc_cmd 00:13:52.938 08:52:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:52.938 08:52:41 -- common/autotest_common.sh@10 -- # set +x 00:13:52.938 Malloc0 00:13:52.938 [2024-07-15 08:52:41.400285] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:52.938 08:52:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:52.938 08:52:41 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:13:52.938 08:52:41 -- common/autotest_common.sh@718 -- # xtrace_disable 00:13:52.938 08:52:41 -- common/autotest_common.sh@10 -- # set +x 00:13:52.938 08:52:41 -- target/host_management.sh@73 -- # perfpid=1475551 00:13:52.938 08:52:41 -- target/host_management.sh@74 -- # waitforlisten 1475551 /var/tmp/bdevperf.sock 00:13:52.938 08:52:41 -- common/autotest_common.sh@819 -- # '[' -z 1475551 ']' 00:13:52.938 08:52:41 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:13:52.938 08:52:41 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:13:52.938 08:52:41 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:13:52.938 08:52:41 -- common/autotest_common.sh@824 -- # local max_retries=100 00:13:52.938 08:52:41 -- nvmf/common.sh@520 -- # config=() 00:13:52.938 08:52:41 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:13:52.938 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:13:52.938 08:52:41 -- nvmf/common.sh@520 -- # local subsystem config 00:13:52.938 08:52:41 -- common/autotest_common.sh@828 -- # xtrace_disable 00:13:52.938 08:52:41 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:13:52.938 08:52:41 -- common/autotest_common.sh@10 -- # set +x 00:13:52.938 08:52:41 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:13:52.938 { 00:13:52.938 "params": { 00:13:52.938 "name": "Nvme$subsystem", 00:13:52.938 "trtype": "$TEST_TRANSPORT", 00:13:52.938 "traddr": "$NVMF_FIRST_TARGET_IP", 00:13:52.938 "adrfam": "ipv4", 00:13:52.938 "trsvcid": "$NVMF_PORT", 00:13:52.938 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:13:52.938 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:13:52.938 "hdgst": ${hdgst:-false}, 00:13:52.938 "ddgst": ${ddgst:-false} 00:13:52.938 }, 00:13:52.938 "method": "bdev_nvme_attach_controller" 00:13:52.938 } 00:13:52.938 EOF 00:13:52.938 )") 00:13:52.938 08:52:41 -- nvmf/common.sh@542 -- # cat 00:13:52.938 08:52:41 -- nvmf/common.sh@544 -- # jq . 00:13:52.938 08:52:41 -- nvmf/common.sh@545 -- # IFS=, 00:13:52.938 08:52:41 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:13:52.938 "params": { 00:13:52.938 "name": "Nvme0", 00:13:52.938 "trtype": "tcp", 00:13:52.938 "traddr": "10.0.0.2", 00:13:52.938 "adrfam": "ipv4", 00:13:52.938 "trsvcid": "4420", 00:13:52.938 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:13:52.939 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:13:52.939 "hdgst": false, 00:13:52.939 "ddgst": false 00:13:52.939 }, 00:13:52.939 "method": "bdev_nvme_attach_controller" 00:13:52.939 }' 00:13:52.939 [2024-07-15 08:52:41.475315] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:13:52.939 [2024-07-15 08:52:41.475402] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1475551 ] 00:13:53.196 EAL: No free 2048 kB hugepages reported on node 1 00:13:53.196 [2024-07-15 08:52:41.536185] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:53.196 [2024-07-15 08:52:41.644300] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:53.457 Running I/O for 10 seconds... 00:13:54.025 08:52:42 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:13:54.025 08:52:42 -- common/autotest_common.sh@852 -- # return 0 00:13:54.025 08:52:42 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:13:54.025 08:52:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:54.025 08:52:42 -- common/autotest_common.sh@10 -- # set +x 00:13:54.025 08:52:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:54.025 08:52:42 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:13:54.025 08:52:42 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:13:54.025 08:52:42 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:13:54.025 08:52:42 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:13:54.025 08:52:42 -- target/host_management.sh@52 -- # local ret=1 00:13:54.025 08:52:42 -- target/host_management.sh@53 -- # local i 00:13:54.025 08:52:42 -- target/host_management.sh@54 -- # (( i = 10 )) 00:13:54.025 08:52:42 -- target/host_management.sh@54 -- # (( i != 0 )) 00:13:54.025 08:52:42 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:13:54.025 08:52:42 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:13:54.025 08:52:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:54.025 08:52:42 -- common/autotest_common.sh@10 -- # set +x 00:13:54.025 08:52:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:54.025 08:52:42 -- target/host_management.sh@55 -- # read_io_count=1973 00:13:54.025 08:52:42 -- target/host_management.sh@58 -- # '[' 1973 -ge 100 ']' 00:13:54.025 08:52:42 -- target/host_management.sh@59 -- # ret=0 00:13:54.025 08:52:42 -- target/host_management.sh@60 -- # break 00:13:54.025 08:52:42 -- target/host_management.sh@64 -- # return 0 00:13:54.025 08:52:42 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:13:54.025 08:52:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:54.025 08:52:42 -- common/autotest_common.sh@10 -- # set +x 00:13:54.025 [2024-07-15 08:52:42.456183] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.025 [2024-07-15 08:52:42.456310] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.025 [2024-07-15 08:52:42.456339] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.025 [2024-07-15 08:52:42.456352] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.025 [2024-07-15 08:52:42.456365] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.025 [2024-07-15 08:52:42.456377] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.025 [2024-07-15 08:52:42.456389] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.025 [2024-07-15 08:52:42.456401] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.025 [2024-07-15 08:52:42.456413] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.025 [2024-07-15 08:52:42.456424] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.025 [2024-07-15 08:52:42.456436] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.025 [2024-07-15 08:52:42.456448] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.025 [2024-07-15 08:52:42.456459] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.025 [2024-07-15 08:52:42.456471] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.025 [2024-07-15 08:52:42.456483] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.025 [2024-07-15 08:52:42.456494] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.025 [2024-07-15 08:52:42.456506] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.025 [2024-07-15 08:52:42.456519] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.025 [2024-07-15 08:52:42.456530] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.025 [2024-07-15 08:52:42.456541] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.025 [2024-07-15 08:52:42.456553] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.025 [2024-07-15 08:52:42.456566] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.025 [2024-07-15 08:52:42.456578] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.025 [2024-07-15 08:52:42.456590] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.025 [2024-07-15 08:52:42.456602] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.025 [2024-07-15 08:52:42.456614] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.025 [2024-07-15 08:52:42.456626] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.025 [2024-07-15 08:52:42.456638] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.025 [2024-07-15 08:52:42.456650] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.025 [2024-07-15 08:52:42.456666] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.025 [2024-07-15 08:52:42.456678] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.025 [2024-07-15 08:52:42.456691] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.026 [2024-07-15 08:52:42.456703] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.026 [2024-07-15 08:52:42.456715] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.026 [2024-07-15 08:52:42.456728] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.026 [2024-07-15 08:52:42.456740] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.026 [2024-07-15 08:52:42.456751] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.026 [2024-07-15 08:52:42.456764] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.026 [2024-07-15 08:52:42.456776] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.026 [2024-07-15 08:52:42.456788] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.026 [2024-07-15 08:52:42.456800] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.026 [2024-07-15 08:52:42.456812] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.026 [2024-07-15 08:52:42.456824] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.026 [2024-07-15 08:52:42.456836] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.026 [2024-07-15 08:52:42.456848] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.026 [2024-07-15 08:52:42.456860] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.026 [2024-07-15 08:52:42.456872] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.026 [2024-07-15 08:52:42.456893] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.026 [2024-07-15 08:52:42.456905] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.026 [2024-07-15 08:52:42.456926] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.026 [2024-07-15 08:52:42.456938] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x123a480 is same with the state(5) to be set 00:13:54.026 [2024-07-15 08:52:42.457971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:12288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.026 [2024-07-15 08:52:42.458011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.026 [2024-07-15 08:52:42.458038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.026 [2024-07-15 08:52:42.458055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.026 [2024-07-15 08:52:42.458073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:12544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.026 [2024-07-15 08:52:42.458093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.026 [2024-07-15 08:52:42.458109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:12800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.026 [2024-07-15 08:52:42.458123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.026 [2024-07-15 08:52:42.458139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:13056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.026 [2024-07-15 08:52:42.458153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.026 [2024-07-15 08:52:42.458168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:13184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.026 [2024-07-15 08:52:42.458190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.026 [2024-07-15 08:52:42.458205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:13440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.026 [2024-07-15 08:52:42.458219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.026 [2024-07-15 08:52:42.458234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.026 [2024-07-15 08:52:42.458248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.026 [2024-07-15 08:52:42.458263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:13696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.026 [2024-07-15 08:52:42.458277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.026 [2024-07-15 08:52:42.458292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:7552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.026 [2024-07-15 08:52:42.458306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.026 [2024-07-15 08:52:42.458321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:13824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.026 [2024-07-15 08:52:42.458335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.026 [2024-07-15 08:52:42.458350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:13952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.026 [2024-07-15 08:52:42.458364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.026 [2024-07-15 08:52:42.458379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:14080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.026 [2024-07-15 08:52:42.458393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.026 [2024-07-15 08:52:42.458408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:14208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.026 [2024-07-15 08:52:42.458421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.026 [2024-07-15 08:52:42.458437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:14336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.026 [2024-07-15 08:52:42.458451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.026 [2024-07-15 08:52:42.458470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:7680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.026 [2024-07-15 08:52:42.458484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.026 [2024-07-15 08:52:42.458500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:14464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.026 [2024-07-15 08:52:42.458514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.026 [2024-07-15 08:52:42.458530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:14592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.026 [2024-07-15 08:52:42.458544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.026 [2024-07-15 08:52:42.458561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:7936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.026 [2024-07-15 08:52:42.458575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.026 [2024-07-15 08:52:42.458590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:14720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.026 [2024-07-15 08:52:42.458605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.026 [2024-07-15 08:52:42.458620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:14848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.026 [2024-07-15 08:52:42.458634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.026 [2024-07-15 08:52:42.458649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:8192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.026 [2024-07-15 08:52:42.458663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.026 [2024-07-15 08:52:42.458678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:14976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.026 [2024-07-15 08:52:42.458692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.026 [2024-07-15 08:52:42.458707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:15104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.026 [2024-07-15 08:52:42.458721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.026 [2024-07-15 08:52:42.458736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:15232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.026 [2024-07-15 08:52:42.458750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.026 [2024-07-15 08:52:42.458765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:8704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.026 [2024-07-15 08:52:42.458779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.026 [2024-07-15 08:52:42.458795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:15360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.026 [2024-07-15 08:52:42.458809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.026 [2024-07-15 08:52:42.458824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:15488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.026 [2024-07-15 08:52:42.458841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.026 [2024-07-15 08:52:42.458857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:9216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.026 [2024-07-15 08:52:42.458871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.026 [2024-07-15 08:52:42.458895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:9344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.026 [2024-07-15 08:52:42.458909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.026 [2024-07-15 08:52:42.458925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:15616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.026 [2024-07-15 08:52:42.458939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.026 [2024-07-15 08:52:42.458954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:15744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.026 [2024-07-15 08:52:42.458967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.026 [2024-07-15 08:52:42.458982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:15872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.026 [2024-07-15 08:52:42.458997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.026 [2024-07-15 08:52:42.459012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:9472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.027 [2024-07-15 08:52:42.459026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.027 [2024-07-15 08:52:42.459041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:16000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.027 [2024-07-15 08:52:42.459055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.027 [2024-07-15 08:52:42.459070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:9600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.027 [2024-07-15 08:52:42.459084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.027 [2024-07-15 08:52:42.459099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:9728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.027 [2024-07-15 08:52:42.459113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.027 [2024-07-15 08:52:42.459128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:16128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.027 [2024-07-15 08:52:42.459142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.027 [2024-07-15 08:52:42.459158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:16256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.027 [2024-07-15 08:52:42.459178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.027 [2024-07-15 08:52:42.459193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:9856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.027 [2024-07-15 08:52:42.459206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.027 [2024-07-15 08:52:42.459226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:16384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.027 [2024-07-15 08:52:42.459252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.027 [2024-07-15 08:52:42.459267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:10112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.027 [2024-07-15 08:52:42.459281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.027 [2024-07-15 08:52:42.459298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:16512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.027 [2024-07-15 08:52:42.459311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.027 [2024-07-15 08:52:42.459327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.027 [2024-07-15 08:52:42.459341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.027 [2024-07-15 08:52:42.459356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:16640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.027 [2024-07-15 08:52:42.459370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.027 [2024-07-15 08:52:42.459385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:16768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.027 [2024-07-15 08:52:42.459399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.027 [2024-07-15 08:52:42.459414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.027 [2024-07-15 08:52:42.459429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.027 [2024-07-15 08:52:42.459444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:17024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.027 [2024-07-15 08:52:42.459458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.027 [2024-07-15 08:52:42.459473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:10880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.027 [2024-07-15 08:52:42.459488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.027 [2024-07-15 08:52:42.459504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:11136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.027 [2024-07-15 08:52:42.459518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.027 [2024-07-15 08:52:42.459533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.027 [2024-07-15 08:52:42.459547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.027 [2024-07-15 08:52:42.459563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:17280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.027 [2024-07-15 08:52:42.459577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.027 [2024-07-15 08:52:42.459592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:17408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.027 [2024-07-15 08:52:42.459610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.027 [2024-07-15 08:52:42.459625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:17536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.027 [2024-07-15 08:52:42.459639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.027 [2024-07-15 08:52:42.459655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:17664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.027 [2024-07-15 08:52:42.459668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.027 [2024-07-15 08:52:42.459684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:11648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.027 [2024-07-15 08:52:42.459698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.027 [2024-07-15 08:52:42.459713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.027 [2024-07-15 08:52:42.459727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.027 [2024-07-15 08:52:42.459743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.027 [2024-07-15 08:52:42.459757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.027 [2024-07-15 08:52:42.459772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:18048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.027 [2024-07-15 08:52:42.459785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.027 [2024-07-15 08:52:42.459800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.027 [2024-07-15 08:52:42.459815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.027 [2024-07-15 08:52:42.459829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:11904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.027 [2024-07-15 08:52:42.459844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.027 [2024-07-15 08:52:42.459859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.027 [2024-07-15 08:52:42.459873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.027 [2024-07-15 08:52:42.459896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:18432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.027 [2024-07-15 08:52:42.459911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.027 [2024-07-15 08:52:42.459930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:12032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:54.027 [2024-07-15 08:52:42.459944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:54.027 [2024-07-15 08:52:42.460029] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2299b50 was disconnected and freed. reset controller. 00:13:54.027 08:52:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:54.027 08:52:42 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:13:54.027 08:52:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:54.027 08:52:42 -- common/autotest_common.sh@10 -- # set +x 00:13:54.027 [2024-07-15 08:52:42.461195] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:13:54.027 task offset: 12288 on job bdev=Nvme0n1 fails 00:13:54.027 00:13:54.027 Latency(us) 00:13:54.027 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:54.027 Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:13:54.027 Job: Nvme0n1 ended in about 0.60 seconds with error 00:13:54.027 Verification LBA range: start 0x0 length 0x400 00:13:54.027 Nvme0n1 : 0.60 3526.46 220.40 106.01 0.00 17316.15 2439.40 26214.40 00:13:54.027 =================================================================================================================== 00:13:54.027 Total : 3526.46 220.40 106.01 0.00 17316.15 2439.40 26214.40 00:13:54.027 [2024-07-15 08:52:42.463107] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:13:54.027 [2024-07-15 08:52:42.463136] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x229c400 (9): Bad file descriptor 00:13:54.027 08:52:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:54.027 08:52:42 -- target/host_management.sh@87 -- # sleep 1 00:13:54.027 [2024-07-15 08:52:42.476658] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:13:54.960 08:52:43 -- target/host_management.sh@91 -- # kill -9 1475551 00:13:54.960 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (1475551) - No such process 00:13:54.960 08:52:43 -- target/host_management.sh@91 -- # true 00:13:54.960 08:52:43 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:13:54.960 08:52:43 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:13:54.960 08:52:43 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:13:54.960 08:52:43 -- nvmf/common.sh@520 -- # config=() 00:13:54.960 08:52:43 -- nvmf/common.sh@520 -- # local subsystem config 00:13:54.960 08:52:43 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:13:54.960 08:52:43 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:13:54.960 { 00:13:54.960 "params": { 00:13:54.960 "name": "Nvme$subsystem", 00:13:54.960 "trtype": "$TEST_TRANSPORT", 00:13:54.960 "traddr": "$NVMF_FIRST_TARGET_IP", 00:13:54.960 "adrfam": "ipv4", 00:13:54.960 "trsvcid": "$NVMF_PORT", 00:13:54.960 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:13:54.960 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:13:54.960 "hdgst": ${hdgst:-false}, 00:13:54.960 "ddgst": ${ddgst:-false} 00:13:54.960 }, 00:13:54.960 "method": "bdev_nvme_attach_controller" 00:13:54.960 } 00:13:54.960 EOF 00:13:54.960 )") 00:13:54.960 08:52:43 -- nvmf/common.sh@542 -- # cat 00:13:54.960 08:52:43 -- nvmf/common.sh@544 -- # jq . 00:13:54.960 08:52:43 -- nvmf/common.sh@545 -- # IFS=, 00:13:54.960 08:52:43 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:13:54.960 "params": { 00:13:54.960 "name": "Nvme0", 00:13:54.960 "trtype": "tcp", 00:13:54.960 "traddr": "10.0.0.2", 00:13:54.960 "adrfam": "ipv4", 00:13:54.960 "trsvcid": "4420", 00:13:54.960 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:13:54.960 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:13:54.960 "hdgst": false, 00:13:54.960 "ddgst": false 00:13:54.960 }, 00:13:54.960 "method": "bdev_nvme_attach_controller" 00:13:54.960 }' 00:13:55.218 [2024-07-15 08:52:43.513711] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:13:55.218 [2024-07-15 08:52:43.513793] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1475840 ] 00:13:55.218 EAL: No free 2048 kB hugepages reported on node 1 00:13:55.218 [2024-07-15 08:52:43.573473] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:55.218 [2024-07-15 08:52:43.682730] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:55.782 Running I/O for 1 seconds... 00:13:56.713 00:13:56.713 Latency(us) 00:13:56.713 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:56.713 Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:13:56.713 Verification LBA range: start 0x0 length 0x400 00:13:56.713 Nvme0n1 : 1.01 3689.92 230.62 0.00 0.00 17097.89 1401.74 22427.88 00:13:56.713 =================================================================================================================== 00:13:56.713 Total : 3689.92 230.62 0.00 0.00 17097.89 1401.74 22427.88 00:13:56.971 08:52:45 -- target/host_management.sh@101 -- # stoptarget 00:13:56.971 08:52:45 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:13:56.971 08:52:45 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:13:56.971 08:52:45 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:13:56.971 08:52:45 -- target/host_management.sh@40 -- # nvmftestfini 00:13:56.971 08:52:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:56.971 08:52:45 -- nvmf/common.sh@116 -- # sync 00:13:56.971 08:52:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:56.971 08:52:45 -- nvmf/common.sh@119 -- # set +e 00:13:56.971 08:52:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:56.971 08:52:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:56.971 rmmod nvme_tcp 00:13:56.971 rmmod nvme_fabrics 00:13:56.971 rmmod nvme_keyring 00:13:56.971 08:52:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:56.971 08:52:45 -- nvmf/common.sh@123 -- # set -e 00:13:56.971 08:52:45 -- nvmf/common.sh@124 -- # return 0 00:13:56.971 08:52:45 -- nvmf/common.sh@477 -- # '[' -n 1475376 ']' 00:13:56.971 08:52:45 -- nvmf/common.sh@478 -- # killprocess 1475376 00:13:56.971 08:52:45 -- common/autotest_common.sh@926 -- # '[' -z 1475376 ']' 00:13:56.971 08:52:45 -- common/autotest_common.sh@930 -- # kill -0 1475376 00:13:56.971 08:52:45 -- common/autotest_common.sh@931 -- # uname 00:13:56.971 08:52:45 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:13:56.971 08:52:45 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1475376 00:13:56.971 08:52:45 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:13:56.971 08:52:45 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:13:56.971 08:52:45 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1475376' 00:13:56.971 killing process with pid 1475376 00:13:56.971 08:52:45 -- common/autotest_common.sh@945 -- # kill 1475376 00:13:56.971 08:52:45 -- common/autotest_common.sh@950 -- # wait 1475376 00:13:57.229 [2024-07-15 08:52:45.671400] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:13:57.229 08:52:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:57.229 08:52:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:57.229 08:52:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:57.229 08:52:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:57.229 08:52:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:57.229 08:52:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:57.229 08:52:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:57.229 08:52:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:59.758 08:52:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:59.758 00:13:59.758 real 0m7.498s 00:13:59.758 user 0m23.603s 00:13:59.758 sys 0m1.310s 00:13:59.758 08:52:47 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:13:59.758 08:52:47 -- common/autotest_common.sh@10 -- # set +x 00:13:59.758 ************************************ 00:13:59.758 END TEST nvmf_host_management 00:13:59.758 ************************************ 00:13:59.758 08:52:47 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:13:59.758 00:13:59.758 real 0m9.660s 00:13:59.758 user 0m24.387s 00:13:59.758 sys 0m2.709s 00:13:59.758 08:52:47 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:13:59.758 08:52:47 -- common/autotest_common.sh@10 -- # set +x 00:13:59.758 ************************************ 00:13:59.758 END TEST nvmf_host_management 00:13:59.758 ************************************ 00:13:59.758 08:52:47 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:13:59.758 08:52:47 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:13:59.758 08:52:47 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:13:59.758 08:52:47 -- common/autotest_common.sh@10 -- # set +x 00:13:59.758 ************************************ 00:13:59.758 START TEST nvmf_lvol 00:13:59.758 ************************************ 00:13:59.758 08:52:47 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:13:59.758 * Looking for test storage... 00:13:59.758 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:59.758 08:52:47 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:59.758 08:52:47 -- nvmf/common.sh@7 -- # uname -s 00:13:59.758 08:52:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:59.759 08:52:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:59.759 08:52:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:59.759 08:52:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:59.759 08:52:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:59.759 08:52:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:59.759 08:52:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:59.759 08:52:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:59.759 08:52:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:59.759 08:52:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:59.759 08:52:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:59.759 08:52:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:59.759 08:52:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:59.759 08:52:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:59.759 08:52:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:59.759 08:52:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:59.759 08:52:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:59.759 08:52:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:59.759 08:52:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:59.759 08:52:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:59.759 08:52:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:59.759 08:52:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:59.759 08:52:47 -- paths/export.sh@5 -- # export PATH 00:13:59.759 08:52:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:59.759 08:52:47 -- nvmf/common.sh@46 -- # : 0 00:13:59.759 08:52:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:59.759 08:52:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:59.759 08:52:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:59.759 08:52:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:59.759 08:52:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:59.759 08:52:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:59.759 08:52:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:59.759 08:52:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:59.759 08:52:47 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:59.759 08:52:47 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:59.759 08:52:47 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:13:59.759 08:52:47 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:13:59.759 08:52:47 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:59.759 08:52:47 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:13:59.759 08:52:47 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:59.759 08:52:47 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:59.759 08:52:47 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:59.759 08:52:47 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:59.759 08:52:47 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:59.759 08:52:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:59.759 08:52:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:59.759 08:52:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:59.759 08:52:47 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:59.759 08:52:47 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:59.759 08:52:47 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:59.759 08:52:47 -- common/autotest_common.sh@10 -- # set +x 00:14:01.658 08:52:49 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:01.658 08:52:49 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:01.658 08:52:49 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:01.658 08:52:49 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:01.658 08:52:49 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:01.658 08:52:49 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:01.658 08:52:49 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:01.658 08:52:49 -- nvmf/common.sh@294 -- # net_devs=() 00:14:01.658 08:52:49 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:01.658 08:52:49 -- nvmf/common.sh@295 -- # e810=() 00:14:01.658 08:52:49 -- nvmf/common.sh@295 -- # local -ga e810 00:14:01.658 08:52:49 -- nvmf/common.sh@296 -- # x722=() 00:14:01.658 08:52:49 -- nvmf/common.sh@296 -- # local -ga x722 00:14:01.658 08:52:49 -- nvmf/common.sh@297 -- # mlx=() 00:14:01.658 08:52:49 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:01.658 08:52:49 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:01.658 08:52:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:01.658 08:52:49 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:01.658 08:52:49 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:01.658 08:52:49 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:01.658 08:52:49 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:01.658 08:52:49 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:01.658 08:52:49 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:01.658 08:52:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:01.658 08:52:49 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:01.658 08:52:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:01.658 08:52:49 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:01.658 08:52:49 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:01.658 08:52:49 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:01.658 08:52:49 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:01.658 08:52:49 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:01.658 08:52:49 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:01.658 08:52:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:01.658 08:52:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:01.658 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:01.658 08:52:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:01.658 08:52:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:01.658 08:52:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:01.658 08:52:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:01.658 08:52:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:01.658 08:52:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:01.658 08:52:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:01.658 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:01.658 08:52:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:01.658 08:52:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:01.658 08:52:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:01.658 08:52:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:01.658 08:52:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:01.658 08:52:49 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:01.658 08:52:49 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:01.658 08:52:49 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:01.658 08:52:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:01.658 08:52:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:01.658 08:52:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:01.658 08:52:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:01.658 08:52:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:01.658 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:01.658 08:52:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:01.658 08:52:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:01.658 08:52:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:01.658 08:52:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:01.658 08:52:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:01.658 08:52:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:01.658 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:01.658 08:52:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:01.658 08:52:49 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:01.658 08:52:49 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:01.658 08:52:49 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:01.658 08:52:49 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:01.658 08:52:49 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:01.658 08:52:49 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:01.658 08:52:49 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:01.658 08:52:49 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:01.658 08:52:49 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:01.658 08:52:49 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:01.658 08:52:49 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:01.658 08:52:49 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:01.658 08:52:49 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:01.658 08:52:49 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:01.658 08:52:49 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:01.658 08:52:49 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:01.658 08:52:49 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:01.658 08:52:49 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:01.658 08:52:49 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:01.658 08:52:49 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:01.658 08:52:49 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:01.658 08:52:49 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:01.658 08:52:49 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:01.658 08:52:49 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:01.658 08:52:49 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:01.658 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:01.658 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.247 ms 00:14:01.658 00:14:01.658 --- 10.0.0.2 ping statistics --- 00:14:01.658 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:01.658 rtt min/avg/max/mdev = 0.247/0.247/0.247/0.000 ms 00:14:01.658 08:52:49 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:01.658 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:01.658 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.207 ms 00:14:01.658 00:14:01.658 --- 10.0.0.1 ping statistics --- 00:14:01.658 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:01.658 rtt min/avg/max/mdev = 0.207/0.207/0.207/0.000 ms 00:14:01.658 08:52:49 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:01.658 08:52:49 -- nvmf/common.sh@410 -- # return 0 00:14:01.658 08:52:49 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:01.658 08:52:49 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:01.658 08:52:49 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:01.658 08:52:49 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:01.658 08:52:49 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:01.658 08:52:49 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:01.658 08:52:49 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:01.658 08:52:49 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:14:01.658 08:52:49 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:01.658 08:52:49 -- common/autotest_common.sh@712 -- # xtrace_disable 00:14:01.658 08:52:49 -- common/autotest_common.sh@10 -- # set +x 00:14:01.658 08:52:49 -- nvmf/common.sh@469 -- # nvmfpid=1478067 00:14:01.658 08:52:49 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:14:01.658 08:52:49 -- nvmf/common.sh@470 -- # waitforlisten 1478067 00:14:01.658 08:52:49 -- common/autotest_common.sh@819 -- # '[' -z 1478067 ']' 00:14:01.658 08:52:49 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:01.658 08:52:49 -- common/autotest_common.sh@824 -- # local max_retries=100 00:14:01.658 08:52:49 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:01.658 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:01.658 08:52:49 -- common/autotest_common.sh@828 -- # xtrace_disable 00:14:01.658 08:52:49 -- common/autotest_common.sh@10 -- # set +x 00:14:01.658 [2024-07-15 08:52:50.036042] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:14:01.658 [2024-07-15 08:52:50.036141] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:01.658 EAL: No free 2048 kB hugepages reported on node 1 00:14:01.658 [2024-07-15 08:52:50.106767] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:01.916 [2024-07-15 08:52:50.222006] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:01.916 [2024-07-15 08:52:50.222168] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:01.916 [2024-07-15 08:52:50.222188] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:01.916 [2024-07-15 08:52:50.222217] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:01.916 [2024-07-15 08:52:50.222293] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:01.916 [2024-07-15 08:52:50.222396] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:01.916 [2024-07-15 08:52:50.222399] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:02.481 08:52:51 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:14:02.481 08:52:51 -- common/autotest_common.sh@852 -- # return 0 00:14:02.481 08:52:51 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:02.481 08:52:51 -- common/autotest_common.sh@718 -- # xtrace_disable 00:14:02.481 08:52:51 -- common/autotest_common.sh@10 -- # set +x 00:14:02.738 08:52:51 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:02.738 08:52:51 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:02.738 [2024-07-15 08:52:51.274024] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:02.995 08:52:51 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:03.252 08:52:51 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:14:03.252 08:52:51 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:03.510 08:52:51 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:14:03.510 08:52:51 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:14:03.768 08:52:52 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:14:04.025 08:52:52 -- target/nvmf_lvol.sh@29 -- # lvs=17d4c574-24b4-425b-bb3c-5663211cc272 00:14:04.025 08:52:52 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 17d4c574-24b4-425b-bb3c-5663211cc272 lvol 20 00:14:04.282 08:52:52 -- target/nvmf_lvol.sh@32 -- # lvol=43fd8b0a-84a4-4729-9be8-bab58a1fc8bb 00:14:04.282 08:52:52 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:04.282 08:52:52 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 43fd8b0a-84a4-4729-9be8-bab58a1fc8bb 00:14:04.573 08:52:53 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:04.850 [2024-07-15 08:52:53.278734] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:04.850 08:52:53 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:05.107 08:52:53 -- target/nvmf_lvol.sh@42 -- # perf_pid=1478521 00:14:05.107 08:52:53 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:14:05.107 08:52:53 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:14:05.107 EAL: No free 2048 kB hugepages reported on node 1 00:14:06.043 08:52:54 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot 43fd8b0a-84a4-4729-9be8-bab58a1fc8bb MY_SNAPSHOT 00:14:06.300 08:52:54 -- target/nvmf_lvol.sh@47 -- # snapshot=cb8e1773-e0e2-420f-aa35-ba0e5aad385a 00:14:06.300 08:52:54 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize 43fd8b0a-84a4-4729-9be8-bab58a1fc8bb 30 00:14:06.867 08:52:55 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone cb8e1773-e0e2-420f-aa35-ba0e5aad385a MY_CLONE 00:14:06.867 08:52:55 -- target/nvmf_lvol.sh@49 -- # clone=1121e60e-4608-4fa0-9807-bcc11aa36a7a 00:14:06.867 08:52:55 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate 1121e60e-4608-4fa0-9807-bcc11aa36a7a 00:14:07.435 08:52:55 -- target/nvmf_lvol.sh@53 -- # wait 1478521 00:14:15.556 Initializing NVMe Controllers 00:14:15.556 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:14:15.556 Controller IO queue size 128, less than required. 00:14:15.556 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:15.556 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:14:15.556 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:14:15.556 Initialization complete. Launching workers. 00:14:15.556 ======================================================== 00:14:15.556 Latency(us) 00:14:15.556 Device Information : IOPS MiB/s Average min max 00:14:15.556 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 10526.33 41.12 12168.85 1524.28 67941.12 00:14:15.556 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10751.62 42.00 11905.27 2052.67 70356.57 00:14:15.556 ======================================================== 00:14:15.556 Total : 21277.95 83.12 12035.67 1524.28 70356.57 00:14:15.556 00:14:15.556 08:53:03 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:15.813 08:53:04 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 43fd8b0a-84a4-4729-9be8-bab58a1fc8bb 00:14:16.070 08:53:04 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 17d4c574-24b4-425b-bb3c-5663211cc272 00:14:16.327 08:53:04 -- target/nvmf_lvol.sh@60 -- # rm -f 00:14:16.327 08:53:04 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:14:16.327 08:53:04 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:14:16.327 08:53:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:16.327 08:53:04 -- nvmf/common.sh@116 -- # sync 00:14:16.327 08:53:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:16.327 08:53:04 -- nvmf/common.sh@119 -- # set +e 00:14:16.327 08:53:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:16.327 08:53:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:16.327 rmmod nvme_tcp 00:14:16.327 rmmod nvme_fabrics 00:14:16.327 rmmod nvme_keyring 00:14:16.327 08:53:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:16.327 08:53:04 -- nvmf/common.sh@123 -- # set -e 00:14:16.327 08:53:04 -- nvmf/common.sh@124 -- # return 0 00:14:16.327 08:53:04 -- nvmf/common.sh@477 -- # '[' -n 1478067 ']' 00:14:16.327 08:53:04 -- nvmf/common.sh@478 -- # killprocess 1478067 00:14:16.327 08:53:04 -- common/autotest_common.sh@926 -- # '[' -z 1478067 ']' 00:14:16.327 08:53:04 -- common/autotest_common.sh@930 -- # kill -0 1478067 00:14:16.327 08:53:04 -- common/autotest_common.sh@931 -- # uname 00:14:16.327 08:53:04 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:14:16.327 08:53:04 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1478067 00:14:16.327 08:53:04 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:14:16.327 08:53:04 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:14:16.327 08:53:04 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1478067' 00:14:16.327 killing process with pid 1478067 00:14:16.327 08:53:04 -- common/autotest_common.sh@945 -- # kill 1478067 00:14:16.327 08:53:04 -- common/autotest_common.sh@950 -- # wait 1478067 00:14:16.585 08:53:05 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:16.585 08:53:05 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:16.585 08:53:05 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:16.585 08:53:05 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:16.585 08:53:05 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:16.585 08:53:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:16.585 08:53:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:16.585 08:53:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:19.118 08:53:07 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:19.118 00:14:19.118 real 0m19.370s 00:14:19.118 user 1m6.348s 00:14:19.118 sys 0m5.412s 00:14:19.118 08:53:07 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:14:19.118 08:53:07 -- common/autotest_common.sh@10 -- # set +x 00:14:19.118 ************************************ 00:14:19.118 END TEST nvmf_lvol 00:14:19.118 ************************************ 00:14:19.118 08:53:07 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:19.118 08:53:07 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:14:19.118 08:53:07 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:14:19.118 08:53:07 -- common/autotest_common.sh@10 -- # set +x 00:14:19.118 ************************************ 00:14:19.118 START TEST nvmf_lvs_grow 00:14:19.118 ************************************ 00:14:19.118 08:53:07 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:19.118 * Looking for test storage... 00:14:19.118 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:19.118 08:53:07 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:19.118 08:53:07 -- nvmf/common.sh@7 -- # uname -s 00:14:19.118 08:53:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:19.118 08:53:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:19.118 08:53:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:19.118 08:53:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:19.118 08:53:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:19.118 08:53:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:19.118 08:53:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:19.118 08:53:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:19.118 08:53:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:19.118 08:53:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:19.118 08:53:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:19.118 08:53:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:19.118 08:53:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:19.118 08:53:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:19.118 08:53:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:19.118 08:53:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:19.118 08:53:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:19.118 08:53:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:19.118 08:53:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:19.118 08:53:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:19.118 08:53:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:19.118 08:53:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:19.118 08:53:07 -- paths/export.sh@5 -- # export PATH 00:14:19.119 08:53:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:19.119 08:53:07 -- nvmf/common.sh@46 -- # : 0 00:14:19.119 08:53:07 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:19.119 08:53:07 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:19.119 08:53:07 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:19.119 08:53:07 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:19.119 08:53:07 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:19.119 08:53:07 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:19.119 08:53:07 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:19.119 08:53:07 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:19.119 08:53:07 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:19.119 08:53:07 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:14:19.119 08:53:07 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:14:19.119 08:53:07 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:19.119 08:53:07 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:19.119 08:53:07 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:19.119 08:53:07 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:19.119 08:53:07 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:19.119 08:53:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:19.119 08:53:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:19.119 08:53:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:19.119 08:53:07 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:19.119 08:53:07 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:19.119 08:53:07 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:19.119 08:53:07 -- common/autotest_common.sh@10 -- # set +x 00:14:21.021 08:53:09 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:21.021 08:53:09 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:21.021 08:53:09 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:21.021 08:53:09 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:21.021 08:53:09 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:21.021 08:53:09 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:21.021 08:53:09 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:21.021 08:53:09 -- nvmf/common.sh@294 -- # net_devs=() 00:14:21.021 08:53:09 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:21.021 08:53:09 -- nvmf/common.sh@295 -- # e810=() 00:14:21.021 08:53:09 -- nvmf/common.sh@295 -- # local -ga e810 00:14:21.021 08:53:09 -- nvmf/common.sh@296 -- # x722=() 00:14:21.021 08:53:09 -- nvmf/common.sh@296 -- # local -ga x722 00:14:21.021 08:53:09 -- nvmf/common.sh@297 -- # mlx=() 00:14:21.021 08:53:09 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:21.021 08:53:09 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:21.021 08:53:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:21.021 08:53:09 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:21.021 08:53:09 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:21.021 08:53:09 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:21.021 08:53:09 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:21.021 08:53:09 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:21.021 08:53:09 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:21.021 08:53:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:21.021 08:53:09 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:21.021 08:53:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:21.021 08:53:09 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:21.021 08:53:09 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:21.021 08:53:09 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:21.021 08:53:09 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:21.021 08:53:09 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:21.021 08:53:09 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:21.021 08:53:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:21.021 08:53:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:21.021 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:21.021 08:53:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:21.021 08:53:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:21.021 08:53:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:21.021 08:53:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:21.021 08:53:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:21.021 08:53:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:21.021 08:53:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:21.021 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:21.021 08:53:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:21.021 08:53:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:21.021 08:53:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:21.021 08:53:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:21.021 08:53:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:21.021 08:53:09 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:21.021 08:53:09 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:21.021 08:53:09 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:21.021 08:53:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:21.021 08:53:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:21.021 08:53:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:21.021 08:53:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:21.021 08:53:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:21.021 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:21.021 08:53:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:21.021 08:53:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:21.021 08:53:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:21.021 08:53:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:21.021 08:53:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:21.021 08:53:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:21.021 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:21.021 08:53:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:21.021 08:53:09 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:21.022 08:53:09 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:21.022 08:53:09 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:21.022 08:53:09 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:21.022 08:53:09 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:21.022 08:53:09 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:21.022 08:53:09 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:21.022 08:53:09 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:21.022 08:53:09 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:21.022 08:53:09 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:21.022 08:53:09 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:21.022 08:53:09 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:21.022 08:53:09 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:21.022 08:53:09 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:21.022 08:53:09 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:21.022 08:53:09 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:21.022 08:53:09 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:21.022 08:53:09 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:21.022 08:53:09 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:21.022 08:53:09 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:21.022 08:53:09 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:21.022 08:53:09 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:21.022 08:53:09 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:21.022 08:53:09 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:21.022 08:53:09 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:21.022 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:21.022 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.202 ms 00:14:21.022 00:14:21.022 --- 10.0.0.2 ping statistics --- 00:14:21.022 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:21.022 rtt min/avg/max/mdev = 0.202/0.202/0.202/0.000 ms 00:14:21.022 08:53:09 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:21.022 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:21.022 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.116 ms 00:14:21.022 00:14:21.022 --- 10.0.0.1 ping statistics --- 00:14:21.022 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:21.022 rtt min/avg/max/mdev = 0.116/0.116/0.116/0.000 ms 00:14:21.022 08:53:09 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:21.022 08:53:09 -- nvmf/common.sh@410 -- # return 0 00:14:21.022 08:53:09 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:21.022 08:53:09 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:21.022 08:53:09 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:21.022 08:53:09 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:21.022 08:53:09 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:21.022 08:53:09 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:21.022 08:53:09 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:21.022 08:53:09 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:14:21.022 08:53:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:21.022 08:53:09 -- common/autotest_common.sh@712 -- # xtrace_disable 00:14:21.022 08:53:09 -- common/autotest_common.sh@10 -- # set +x 00:14:21.022 08:53:09 -- nvmf/common.sh@469 -- # nvmfpid=1481829 00:14:21.022 08:53:09 -- nvmf/common.sh@470 -- # waitforlisten 1481829 00:14:21.022 08:53:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:14:21.022 08:53:09 -- common/autotest_common.sh@819 -- # '[' -z 1481829 ']' 00:14:21.022 08:53:09 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:21.022 08:53:09 -- common/autotest_common.sh@824 -- # local max_retries=100 00:14:21.022 08:53:09 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:21.022 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:21.022 08:53:09 -- common/autotest_common.sh@828 -- # xtrace_disable 00:14:21.022 08:53:09 -- common/autotest_common.sh@10 -- # set +x 00:14:21.022 [2024-07-15 08:53:09.351116] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:14:21.022 [2024-07-15 08:53:09.351201] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:21.022 EAL: No free 2048 kB hugepages reported on node 1 00:14:21.022 [2024-07-15 08:53:09.421365] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:21.022 [2024-07-15 08:53:09.529558] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:21.022 [2024-07-15 08:53:09.529697] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:21.022 [2024-07-15 08:53:09.529714] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:21.022 [2024-07-15 08:53:09.529726] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:21.022 [2024-07-15 08:53:09.529753] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:21.959 08:53:10 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:14:21.959 08:53:10 -- common/autotest_common.sh@852 -- # return 0 00:14:21.959 08:53:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:21.959 08:53:10 -- common/autotest_common.sh@718 -- # xtrace_disable 00:14:21.959 08:53:10 -- common/autotest_common.sh@10 -- # set +x 00:14:21.959 08:53:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:21.959 08:53:10 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:22.217 [2024-07-15 08:53:10.594993] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:22.217 08:53:10 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:14:22.217 08:53:10 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:14:22.217 08:53:10 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:14:22.217 08:53:10 -- common/autotest_common.sh@10 -- # set +x 00:14:22.217 ************************************ 00:14:22.217 START TEST lvs_grow_clean 00:14:22.217 ************************************ 00:14:22.217 08:53:10 -- common/autotest_common.sh@1104 -- # lvs_grow 00:14:22.217 08:53:10 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:14:22.217 08:53:10 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:14:22.217 08:53:10 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:14:22.217 08:53:10 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:14:22.217 08:53:10 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:14:22.217 08:53:10 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:14:22.217 08:53:10 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:22.217 08:53:10 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:22.217 08:53:10 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:22.477 08:53:10 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:14:22.477 08:53:10 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:14:22.735 08:53:11 -- target/nvmf_lvs_grow.sh@28 -- # lvs=597a9fd8-bc2c-4058-8355-12ef78f26cbe 00:14:22.735 08:53:11 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 597a9fd8-bc2c-4058-8355-12ef78f26cbe 00:14:22.735 08:53:11 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:14:22.994 08:53:11 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:14:22.994 08:53:11 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:14:22.994 08:53:11 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 597a9fd8-bc2c-4058-8355-12ef78f26cbe lvol 150 00:14:23.253 08:53:11 -- target/nvmf_lvs_grow.sh@33 -- # lvol=17df1c13-970c-40e9-a9a4-056715eddc85 00:14:23.253 08:53:11 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:23.253 08:53:11 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:14:23.512 [2024-07-15 08:53:11.828041] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:14:23.512 [2024-07-15 08:53:11.828134] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:14:23.512 true 00:14:23.512 08:53:11 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 597a9fd8-bc2c-4058-8355-12ef78f26cbe 00:14:23.512 08:53:11 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:14:23.772 08:53:12 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:14:23.772 08:53:12 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:23.772 08:53:12 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 17df1c13-970c-40e9-a9a4-056715eddc85 00:14:24.342 08:53:12 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:24.342 [2024-07-15 08:53:12.811197] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:24.342 08:53:12 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:24.613 08:53:13 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=1482288 00:14:24.613 08:53:13 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:14:24.613 08:53:13 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:24.613 08:53:13 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 1482288 /var/tmp/bdevperf.sock 00:14:24.613 08:53:13 -- common/autotest_common.sh@819 -- # '[' -z 1482288 ']' 00:14:24.613 08:53:13 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:24.614 08:53:13 -- common/autotest_common.sh@824 -- # local max_retries=100 00:14:24.614 08:53:13 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:24.614 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:24.614 08:53:13 -- common/autotest_common.sh@828 -- # xtrace_disable 00:14:24.614 08:53:13 -- common/autotest_common.sh@10 -- # set +x 00:14:24.614 [2024-07-15 08:53:13.134267] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:14:24.614 [2024-07-15 08:53:13.134336] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1482288 ] 00:14:24.916 EAL: No free 2048 kB hugepages reported on node 1 00:14:24.916 [2024-07-15 08:53:13.198258] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:24.916 [2024-07-15 08:53:13.311267] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:25.867 08:53:14 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:14:25.867 08:53:14 -- common/autotest_common.sh@852 -- # return 0 00:14:25.867 08:53:14 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:14:26.125 Nvme0n1 00:14:26.125 08:53:14 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:14:26.384 [ 00:14:26.384 { 00:14:26.384 "name": "Nvme0n1", 00:14:26.384 "aliases": [ 00:14:26.384 "17df1c13-970c-40e9-a9a4-056715eddc85" 00:14:26.384 ], 00:14:26.384 "product_name": "NVMe disk", 00:14:26.384 "block_size": 4096, 00:14:26.384 "num_blocks": 38912, 00:14:26.384 "uuid": "17df1c13-970c-40e9-a9a4-056715eddc85", 00:14:26.384 "assigned_rate_limits": { 00:14:26.384 "rw_ios_per_sec": 0, 00:14:26.384 "rw_mbytes_per_sec": 0, 00:14:26.384 "r_mbytes_per_sec": 0, 00:14:26.384 "w_mbytes_per_sec": 0 00:14:26.384 }, 00:14:26.384 "claimed": false, 00:14:26.384 "zoned": false, 00:14:26.384 "supported_io_types": { 00:14:26.384 "read": true, 00:14:26.384 "write": true, 00:14:26.384 "unmap": true, 00:14:26.384 "write_zeroes": true, 00:14:26.384 "flush": true, 00:14:26.384 "reset": true, 00:14:26.384 "compare": true, 00:14:26.384 "compare_and_write": true, 00:14:26.384 "abort": true, 00:14:26.384 "nvme_admin": true, 00:14:26.384 "nvme_io": true 00:14:26.384 }, 00:14:26.384 "driver_specific": { 00:14:26.384 "nvme": [ 00:14:26.384 { 00:14:26.384 "trid": { 00:14:26.384 "trtype": "TCP", 00:14:26.384 "adrfam": "IPv4", 00:14:26.384 "traddr": "10.0.0.2", 00:14:26.385 "trsvcid": "4420", 00:14:26.385 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:14:26.385 }, 00:14:26.385 "ctrlr_data": { 00:14:26.385 "cntlid": 1, 00:14:26.385 "vendor_id": "0x8086", 00:14:26.385 "model_number": "SPDK bdev Controller", 00:14:26.385 "serial_number": "SPDK0", 00:14:26.385 "firmware_revision": "24.01.1", 00:14:26.385 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:26.385 "oacs": { 00:14:26.385 "security": 0, 00:14:26.385 "format": 0, 00:14:26.385 "firmware": 0, 00:14:26.385 "ns_manage": 0 00:14:26.385 }, 00:14:26.385 "multi_ctrlr": true, 00:14:26.385 "ana_reporting": false 00:14:26.385 }, 00:14:26.385 "vs": { 00:14:26.385 "nvme_version": "1.3" 00:14:26.385 }, 00:14:26.385 "ns_data": { 00:14:26.385 "id": 1, 00:14:26.385 "can_share": true 00:14:26.385 } 00:14:26.385 } 00:14:26.385 ], 00:14:26.385 "mp_policy": "active_passive" 00:14:26.385 } 00:14:26.385 } 00:14:26.385 ] 00:14:26.385 08:53:14 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=1482557 00:14:26.385 08:53:14 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:14:26.385 08:53:14 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:14:26.385 Running I/O for 10 seconds... 00:14:27.762 Latency(us) 00:14:27.762 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:27.762 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:27.762 Nvme0n1 : 1.00 14443.00 56.42 0.00 0.00 0.00 0.00 0.00 00:14:27.762 =================================================================================================================== 00:14:27.762 Total : 14443.00 56.42 0.00 0.00 0.00 0.00 0.00 00:14:27.762 00:14:28.329 08:53:16 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 597a9fd8-bc2c-4058-8355-12ef78f26cbe 00:14:28.586 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:28.586 Nvme0n1 : 2.00 14581.00 56.96 0.00 0.00 0.00 0.00 0.00 00:14:28.586 =================================================================================================================== 00:14:28.586 Total : 14581.00 56.96 0.00 0.00 0.00 0.00 0.00 00:14:28.586 00:14:28.586 true 00:14:28.586 08:53:17 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 597a9fd8-bc2c-4058-8355-12ef78f26cbe 00:14:28.586 08:53:17 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:14:28.845 08:53:17 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:14:28.845 08:53:17 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:14:28.845 08:53:17 -- target/nvmf_lvs_grow.sh@65 -- # wait 1482557 00:14:29.412 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:29.412 Nvme0n1 : 3.00 14651.00 57.23 0.00 0.00 0.00 0.00 0.00 00:14:29.412 =================================================================================================================== 00:14:29.412 Total : 14651.00 57.23 0.00 0.00 0.00 0.00 0.00 00:14:29.412 00:14:30.785 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:30.785 Nvme0n1 : 4.00 14741.50 57.58 0.00 0.00 0.00 0.00 0.00 00:14:30.785 =================================================================================================================== 00:14:30.785 Total : 14741.50 57.58 0.00 0.00 0.00 0.00 0.00 00:14:30.785 00:14:31.718 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:31.719 Nvme0n1 : 5.00 14803.00 57.82 0.00 0.00 0.00 0.00 0.00 00:14:31.719 =================================================================================================================== 00:14:31.719 Total : 14803.00 57.82 0.00 0.00 0.00 0.00 0.00 00:14:31.719 00:14:32.656 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:32.656 Nvme0n1 : 6.00 14891.33 58.17 0.00 0.00 0.00 0.00 0.00 00:14:32.656 =================================================================================================================== 00:14:32.656 Total : 14891.33 58.17 0.00 0.00 0.00 0.00 0.00 00:14:32.656 00:14:33.593 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:33.593 Nvme0n1 : 7.00 14921.57 58.29 0.00 0.00 0.00 0.00 0.00 00:14:33.593 =================================================================================================================== 00:14:33.593 Total : 14921.57 58.29 0.00 0.00 0.00 0.00 0.00 00:14:33.593 00:14:34.529 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:34.529 Nvme0n1 : 8.00 14958.38 58.43 0.00 0.00 0.00 0.00 0.00 00:14:34.529 =================================================================================================================== 00:14:34.529 Total : 14958.38 58.43 0.00 0.00 0.00 0.00 0.00 00:14:34.529 00:14:35.466 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:35.466 Nvme0n1 : 9.00 15030.56 58.71 0.00 0.00 0.00 0.00 0.00 00:14:35.466 =================================================================================================================== 00:14:35.466 Total : 15030.56 58.71 0.00 0.00 0.00 0.00 0.00 00:14:35.466 00:14:36.425 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:36.425 Nvme0n1 : 10.00 15044.10 58.77 0.00 0.00 0.00 0.00 0.00 00:14:36.425 =================================================================================================================== 00:14:36.425 Total : 15044.10 58.77 0.00 0.00 0.00 0.00 0.00 00:14:36.425 00:14:36.425 00:14:36.425 Latency(us) 00:14:36.425 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:36.425 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:36.425 Nvme0n1 : 10.01 15043.88 58.77 0.00 0.00 8502.51 4660.34 18641.35 00:14:36.425 =================================================================================================================== 00:14:36.425 Total : 15043.88 58.77 0.00 0.00 8502.51 4660.34 18641.35 00:14:36.425 0 00:14:36.425 08:53:24 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 1482288 00:14:36.425 08:53:24 -- common/autotest_common.sh@926 -- # '[' -z 1482288 ']' 00:14:36.425 08:53:24 -- common/autotest_common.sh@930 -- # kill -0 1482288 00:14:36.425 08:53:24 -- common/autotest_common.sh@931 -- # uname 00:14:36.425 08:53:24 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:14:36.425 08:53:24 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1482288 00:14:36.683 08:53:24 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:14:36.683 08:53:24 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:14:36.683 08:53:24 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1482288' 00:14:36.683 killing process with pid 1482288 00:14:36.683 08:53:24 -- common/autotest_common.sh@945 -- # kill 1482288 00:14:36.683 Received shutdown signal, test time was about 10.000000 seconds 00:14:36.683 00:14:36.683 Latency(us) 00:14:36.683 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:36.683 =================================================================================================================== 00:14:36.683 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:14:36.683 08:53:24 -- common/autotest_common.sh@950 -- # wait 1482288 00:14:36.943 08:53:25 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:37.201 08:53:25 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 597a9fd8-bc2c-4058-8355-12ef78f26cbe 00:14:37.201 08:53:25 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:14:37.459 08:53:25 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:14:37.459 08:53:25 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:14:37.459 08:53:25 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:37.718 [2024-07-15 08:53:26.012653] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:14:37.718 08:53:26 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 597a9fd8-bc2c-4058-8355-12ef78f26cbe 00:14:37.718 08:53:26 -- common/autotest_common.sh@640 -- # local es=0 00:14:37.718 08:53:26 -- common/autotest_common.sh@642 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 597a9fd8-bc2c-4058-8355-12ef78f26cbe 00:14:37.718 08:53:26 -- common/autotest_common.sh@628 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:37.718 08:53:26 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:14:37.718 08:53:26 -- common/autotest_common.sh@632 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:37.718 08:53:26 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:14:37.718 08:53:26 -- common/autotest_common.sh@634 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:37.718 08:53:26 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:14:37.718 08:53:26 -- common/autotest_common.sh@634 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:37.718 08:53:26 -- common/autotest_common.sh@634 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:14:37.718 08:53:26 -- common/autotest_common.sh@643 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 597a9fd8-bc2c-4058-8355-12ef78f26cbe 00:14:37.976 request: 00:14:37.976 { 00:14:37.976 "uuid": "597a9fd8-bc2c-4058-8355-12ef78f26cbe", 00:14:37.976 "method": "bdev_lvol_get_lvstores", 00:14:37.976 "req_id": 1 00:14:37.976 } 00:14:37.976 Got JSON-RPC error response 00:14:37.976 response: 00:14:37.976 { 00:14:37.976 "code": -19, 00:14:37.976 "message": "No such device" 00:14:37.976 } 00:14:37.976 08:53:26 -- common/autotest_common.sh@643 -- # es=1 00:14:37.976 08:53:26 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:14:37.976 08:53:26 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:14:37.976 08:53:26 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:14:37.976 08:53:26 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:37.976 aio_bdev 00:14:38.234 08:53:26 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 17df1c13-970c-40e9-a9a4-056715eddc85 00:14:38.234 08:53:26 -- common/autotest_common.sh@887 -- # local bdev_name=17df1c13-970c-40e9-a9a4-056715eddc85 00:14:38.234 08:53:26 -- common/autotest_common.sh@888 -- # local bdev_timeout= 00:14:38.234 08:53:26 -- common/autotest_common.sh@889 -- # local i 00:14:38.234 08:53:26 -- common/autotest_common.sh@890 -- # [[ -z '' ]] 00:14:38.234 08:53:26 -- common/autotest_common.sh@890 -- # bdev_timeout=2000 00:14:38.234 08:53:26 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:14:38.234 08:53:26 -- common/autotest_common.sh@894 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 17df1c13-970c-40e9-a9a4-056715eddc85 -t 2000 00:14:38.493 [ 00:14:38.493 { 00:14:38.493 "name": "17df1c13-970c-40e9-a9a4-056715eddc85", 00:14:38.493 "aliases": [ 00:14:38.493 "lvs/lvol" 00:14:38.493 ], 00:14:38.493 "product_name": "Logical Volume", 00:14:38.493 "block_size": 4096, 00:14:38.493 "num_blocks": 38912, 00:14:38.493 "uuid": "17df1c13-970c-40e9-a9a4-056715eddc85", 00:14:38.493 "assigned_rate_limits": { 00:14:38.493 "rw_ios_per_sec": 0, 00:14:38.493 "rw_mbytes_per_sec": 0, 00:14:38.493 "r_mbytes_per_sec": 0, 00:14:38.493 "w_mbytes_per_sec": 0 00:14:38.493 }, 00:14:38.493 "claimed": false, 00:14:38.493 "zoned": false, 00:14:38.493 "supported_io_types": { 00:14:38.493 "read": true, 00:14:38.493 "write": true, 00:14:38.493 "unmap": true, 00:14:38.493 "write_zeroes": true, 00:14:38.493 "flush": false, 00:14:38.493 "reset": true, 00:14:38.493 "compare": false, 00:14:38.493 "compare_and_write": false, 00:14:38.493 "abort": false, 00:14:38.493 "nvme_admin": false, 00:14:38.493 "nvme_io": false 00:14:38.493 }, 00:14:38.493 "driver_specific": { 00:14:38.493 "lvol": { 00:14:38.493 "lvol_store_uuid": "597a9fd8-bc2c-4058-8355-12ef78f26cbe", 00:14:38.493 "base_bdev": "aio_bdev", 00:14:38.493 "thin_provision": false, 00:14:38.493 "snapshot": false, 00:14:38.493 "clone": false, 00:14:38.493 "esnap_clone": false 00:14:38.493 } 00:14:38.493 } 00:14:38.493 } 00:14:38.493 ] 00:14:38.493 08:53:27 -- common/autotest_common.sh@895 -- # return 0 00:14:38.751 08:53:27 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 597a9fd8-bc2c-4058-8355-12ef78f26cbe 00:14:38.751 08:53:27 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:14:38.751 08:53:27 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:14:38.751 08:53:27 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 597a9fd8-bc2c-4058-8355-12ef78f26cbe 00:14:38.751 08:53:27 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:14:39.009 08:53:27 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:14:39.009 08:53:27 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 17df1c13-970c-40e9-a9a4-056715eddc85 00:14:39.276 08:53:27 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 597a9fd8-bc2c-4058-8355-12ef78f26cbe 00:14:39.877 08:53:28 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:39.877 08:53:28 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:39.877 00:14:39.877 real 0m17.766s 00:14:39.877 user 0m17.426s 00:14:39.877 sys 0m1.833s 00:14:39.877 08:53:28 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:14:39.877 08:53:28 -- common/autotest_common.sh@10 -- # set +x 00:14:39.877 ************************************ 00:14:39.877 END TEST lvs_grow_clean 00:14:39.877 ************************************ 00:14:39.877 08:53:28 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:14:39.877 08:53:28 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:14:39.877 08:53:28 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:14:39.877 08:53:28 -- common/autotest_common.sh@10 -- # set +x 00:14:39.877 ************************************ 00:14:39.877 START TEST lvs_grow_dirty 00:14:39.877 ************************************ 00:14:39.877 08:53:28 -- common/autotest_common.sh@1104 -- # lvs_grow dirty 00:14:39.877 08:53:28 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:14:39.877 08:53:28 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:14:39.877 08:53:28 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:14:39.877 08:53:28 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:14:39.877 08:53:28 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:14:39.877 08:53:28 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:14:39.878 08:53:28 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:39.878 08:53:28 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:39.878 08:53:28 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:40.444 08:53:28 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:14:40.444 08:53:28 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:14:40.444 08:53:28 -- target/nvmf_lvs_grow.sh@28 -- # lvs=38fc006a-e1cc-47de-a165-df1d178595fc 00:14:40.444 08:53:28 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 38fc006a-e1cc-47de-a165-df1d178595fc 00:14:40.444 08:53:28 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:14:40.702 08:53:29 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:14:40.702 08:53:29 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:14:40.702 08:53:29 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 38fc006a-e1cc-47de-a165-df1d178595fc lvol 150 00:14:40.960 08:53:29 -- target/nvmf_lvs_grow.sh@33 -- # lvol=c2b415a2-23f4-437c-bb5a-7b64a7024f9d 00:14:40.960 08:53:29 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:40.960 08:53:29 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:14:41.218 [2024-07-15 08:53:29.685104] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:14:41.218 [2024-07-15 08:53:29.685210] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:14:41.218 true 00:14:41.218 08:53:29 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 38fc006a-e1cc-47de-a165-df1d178595fc 00:14:41.218 08:53:29 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:14:41.478 08:53:29 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:14:41.478 08:53:29 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:41.736 08:53:30 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 c2b415a2-23f4-437c-bb5a-7b64a7024f9d 00:14:41.995 08:53:30 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:42.253 08:53:30 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:42.512 08:53:30 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=1484524 00:14:42.512 08:53:30 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:42.512 08:53:30 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 1484524 /var/tmp/bdevperf.sock 00:14:42.512 08:53:30 -- common/autotest_common.sh@819 -- # '[' -z 1484524 ']' 00:14:42.512 08:53:30 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:14:42.512 08:53:30 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:42.512 08:53:30 -- common/autotest_common.sh@824 -- # local max_retries=100 00:14:42.512 08:53:30 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:42.512 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:42.512 08:53:30 -- common/autotest_common.sh@828 -- # xtrace_disable 00:14:42.512 08:53:30 -- common/autotest_common.sh@10 -- # set +x 00:14:42.512 [2024-07-15 08:53:31.015412] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:14:42.512 [2024-07-15 08:53:31.015500] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1484524 ] 00:14:42.512 EAL: No free 2048 kB hugepages reported on node 1 00:14:42.771 [2024-07-15 08:53:31.075869] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:42.771 [2024-07-15 08:53:31.181996] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:43.704 08:53:31 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:14:43.704 08:53:31 -- common/autotest_common.sh@852 -- # return 0 00:14:43.704 08:53:31 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:14:43.962 Nvme0n1 00:14:43.962 08:53:32 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:14:44.222 [ 00:14:44.222 { 00:14:44.222 "name": "Nvme0n1", 00:14:44.223 "aliases": [ 00:14:44.223 "c2b415a2-23f4-437c-bb5a-7b64a7024f9d" 00:14:44.223 ], 00:14:44.223 "product_name": "NVMe disk", 00:14:44.223 "block_size": 4096, 00:14:44.223 "num_blocks": 38912, 00:14:44.223 "uuid": "c2b415a2-23f4-437c-bb5a-7b64a7024f9d", 00:14:44.223 "assigned_rate_limits": { 00:14:44.223 "rw_ios_per_sec": 0, 00:14:44.223 "rw_mbytes_per_sec": 0, 00:14:44.223 "r_mbytes_per_sec": 0, 00:14:44.223 "w_mbytes_per_sec": 0 00:14:44.223 }, 00:14:44.223 "claimed": false, 00:14:44.223 "zoned": false, 00:14:44.223 "supported_io_types": { 00:14:44.223 "read": true, 00:14:44.223 "write": true, 00:14:44.223 "unmap": true, 00:14:44.223 "write_zeroes": true, 00:14:44.223 "flush": true, 00:14:44.223 "reset": true, 00:14:44.223 "compare": true, 00:14:44.223 "compare_and_write": true, 00:14:44.223 "abort": true, 00:14:44.223 "nvme_admin": true, 00:14:44.223 "nvme_io": true 00:14:44.223 }, 00:14:44.223 "driver_specific": { 00:14:44.223 "nvme": [ 00:14:44.223 { 00:14:44.223 "trid": { 00:14:44.223 "trtype": "TCP", 00:14:44.223 "adrfam": "IPv4", 00:14:44.223 "traddr": "10.0.0.2", 00:14:44.223 "trsvcid": "4420", 00:14:44.223 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:14:44.223 }, 00:14:44.223 "ctrlr_data": { 00:14:44.223 "cntlid": 1, 00:14:44.223 "vendor_id": "0x8086", 00:14:44.223 "model_number": "SPDK bdev Controller", 00:14:44.223 "serial_number": "SPDK0", 00:14:44.223 "firmware_revision": "24.01.1", 00:14:44.223 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:44.223 "oacs": { 00:14:44.223 "security": 0, 00:14:44.223 "format": 0, 00:14:44.223 "firmware": 0, 00:14:44.223 "ns_manage": 0 00:14:44.223 }, 00:14:44.223 "multi_ctrlr": true, 00:14:44.223 "ana_reporting": false 00:14:44.223 }, 00:14:44.223 "vs": { 00:14:44.223 "nvme_version": "1.3" 00:14:44.223 }, 00:14:44.223 "ns_data": { 00:14:44.223 "id": 1, 00:14:44.223 "can_share": true 00:14:44.223 } 00:14:44.223 } 00:14:44.223 ], 00:14:44.223 "mp_policy": "active_passive" 00:14:44.223 } 00:14:44.223 } 00:14:44.223 ] 00:14:44.223 08:53:32 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=1484678 00:14:44.223 08:53:32 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:14:44.223 08:53:32 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:14:44.223 Running I/O for 10 seconds... 00:14:45.604 Latency(us) 00:14:45.604 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:45.604 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:45.604 Nvme0n1 : 1.00 14779.00 57.73 0.00 0.00 0.00 0.00 0.00 00:14:45.604 =================================================================================================================== 00:14:45.604 Total : 14779.00 57.73 0.00 0.00 0.00 0.00 0.00 00:14:45.604 00:14:46.171 08:53:34 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 38fc006a-e1cc-47de-a165-df1d178595fc 00:14:46.171 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:46.171 Nvme0n1 : 2.00 14813.50 57.87 0.00 0.00 0.00 0.00 0.00 00:14:46.171 =================================================================================================================== 00:14:46.171 Total : 14813.50 57.87 0.00 0.00 0.00 0.00 0.00 00:14:46.171 00:14:46.429 true 00:14:46.429 08:53:34 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 38fc006a-e1cc-47de-a165-df1d178595fc 00:14:46.429 08:53:34 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:14:46.686 08:53:35 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:14:46.686 08:53:35 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:14:46.686 08:53:35 -- target/nvmf_lvs_grow.sh@65 -- # wait 1484678 00:14:47.254 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:47.254 Nvme0n1 : 3.00 14802.67 57.82 0.00 0.00 0.00 0.00 0.00 00:14:47.254 =================================================================================================================== 00:14:47.254 Total : 14802.67 57.82 0.00 0.00 0.00 0.00 0.00 00:14:47.254 00:14:48.188 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:48.188 Nvme0n1 : 4.00 14875.75 58.11 0.00 0.00 0.00 0.00 0.00 00:14:48.188 =================================================================================================================== 00:14:48.188 Total : 14875.75 58.11 0.00 0.00 0.00 0.00 0.00 00:14:48.188 00:14:49.564 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:49.564 Nvme0n1 : 5.00 14907.60 58.23 0.00 0.00 0.00 0.00 0.00 00:14:49.564 =================================================================================================================== 00:14:49.564 Total : 14907.60 58.23 0.00 0.00 0.00 0.00 0.00 00:14:49.564 00:14:50.498 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:50.498 Nvme0n1 : 6.00 14939.83 58.36 0.00 0.00 0.00 0.00 0.00 00:14:50.498 =================================================================================================================== 00:14:50.498 Total : 14939.83 58.36 0.00 0.00 0.00 0.00 0.00 00:14:50.498 00:14:51.435 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:51.435 Nvme0n1 : 7.00 14972.14 58.48 0.00 0.00 0.00 0.00 0.00 00:14:51.435 =================================================================================================================== 00:14:51.435 Total : 14972.14 58.48 0.00 0.00 0.00 0.00 0.00 00:14:51.435 00:14:52.376 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:52.376 Nvme0n1 : 8.00 14995.88 58.58 0.00 0.00 0.00 0.00 0.00 00:14:52.376 =================================================================================================================== 00:14:52.376 Total : 14995.88 58.58 0.00 0.00 0.00 0.00 0.00 00:14:52.376 00:14:53.310 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:53.310 Nvme0n1 : 9.00 15016.33 58.66 0.00 0.00 0.00 0.00 0.00 00:14:53.310 =================================================================================================================== 00:14:53.310 Total : 15016.33 58.66 0.00 0.00 0.00 0.00 0.00 00:14:53.310 00:14:54.310 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:54.310 Nvme0n1 : 10.00 15041.70 58.76 0.00 0.00 0.00 0.00 0.00 00:14:54.310 =================================================================================================================== 00:14:54.310 Total : 15041.70 58.76 0.00 0.00 0.00 0.00 0.00 00:14:54.310 00:14:54.310 00:14:54.310 Latency(us) 00:14:54.310 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:54.310 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:54.310 Nvme0n1 : 10.01 15045.08 58.77 0.00 0.00 8502.75 5000.15 17670.45 00:14:54.310 =================================================================================================================== 00:14:54.310 Total : 15045.08 58.77 0.00 0.00 8502.75 5000.15 17670.45 00:14:54.310 0 00:14:54.310 08:53:42 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 1484524 00:14:54.310 08:53:42 -- common/autotest_common.sh@926 -- # '[' -z 1484524 ']' 00:14:54.310 08:53:42 -- common/autotest_common.sh@930 -- # kill -0 1484524 00:14:54.310 08:53:42 -- common/autotest_common.sh@931 -- # uname 00:14:54.310 08:53:42 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:14:54.310 08:53:42 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1484524 00:14:54.310 08:53:42 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:14:54.310 08:53:42 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:14:54.310 08:53:42 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1484524' 00:14:54.310 killing process with pid 1484524 00:14:54.310 08:53:42 -- common/autotest_common.sh@945 -- # kill 1484524 00:14:54.310 Received shutdown signal, test time was about 10.000000 seconds 00:14:54.310 00:14:54.310 Latency(us) 00:14:54.310 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:54.310 =================================================================================================================== 00:14:54.310 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:14:54.310 08:53:42 -- common/autotest_common.sh@950 -- # wait 1484524 00:14:54.584 08:53:43 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:54.842 08:53:43 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 38fc006a-e1cc-47de-a165-df1d178595fc 00:14:54.842 08:53:43 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:14:55.103 08:53:43 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:14:55.103 08:53:43 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:14:55.103 08:53:43 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 1481829 00:14:55.103 08:53:43 -- target/nvmf_lvs_grow.sh@74 -- # wait 1481829 00:14:55.103 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 1481829 Killed "${NVMF_APP[@]}" "$@" 00:14:55.103 08:53:43 -- target/nvmf_lvs_grow.sh@74 -- # true 00:14:55.103 08:53:43 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:14:55.103 08:53:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:55.103 08:53:43 -- common/autotest_common.sh@712 -- # xtrace_disable 00:14:55.103 08:53:43 -- common/autotest_common.sh@10 -- # set +x 00:14:55.103 08:53:43 -- nvmf/common.sh@469 -- # nvmfpid=1486037 00:14:55.103 08:53:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:14:55.103 08:53:43 -- nvmf/common.sh@470 -- # waitforlisten 1486037 00:14:55.103 08:53:43 -- common/autotest_common.sh@819 -- # '[' -z 1486037 ']' 00:14:55.103 08:53:43 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:55.103 08:53:43 -- common/autotest_common.sh@824 -- # local max_retries=100 00:14:55.103 08:53:43 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:55.103 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:55.103 08:53:43 -- common/autotest_common.sh@828 -- # xtrace_disable 00:14:55.103 08:53:43 -- common/autotest_common.sh@10 -- # set +x 00:14:55.103 [2024-07-15 08:53:43.600040] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:14:55.103 [2024-07-15 08:53:43.600121] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:55.103 EAL: No free 2048 kB hugepages reported on node 1 00:14:55.364 [2024-07-15 08:53:43.666515] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:55.364 [2024-07-15 08:53:43.773627] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:55.364 [2024-07-15 08:53:43.773772] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:55.364 [2024-07-15 08:53:43.773789] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:55.364 [2024-07-15 08:53:43.773800] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:55.364 [2024-07-15 08:53:43.773827] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:56.300 08:53:44 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:14:56.301 08:53:44 -- common/autotest_common.sh@852 -- # return 0 00:14:56.301 08:53:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:56.301 08:53:44 -- common/autotest_common.sh@718 -- # xtrace_disable 00:14:56.301 08:53:44 -- common/autotest_common.sh@10 -- # set +x 00:14:56.301 08:53:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:56.301 08:53:44 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:56.301 [2024-07-15 08:53:44.779220] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:14:56.301 [2024-07-15 08:53:44.779333] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:14:56.301 [2024-07-15 08:53:44.779379] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:14:56.301 08:53:44 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:14:56.301 08:53:44 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev c2b415a2-23f4-437c-bb5a-7b64a7024f9d 00:14:56.301 08:53:44 -- common/autotest_common.sh@887 -- # local bdev_name=c2b415a2-23f4-437c-bb5a-7b64a7024f9d 00:14:56.301 08:53:44 -- common/autotest_common.sh@888 -- # local bdev_timeout= 00:14:56.301 08:53:44 -- common/autotest_common.sh@889 -- # local i 00:14:56.301 08:53:44 -- common/autotest_common.sh@890 -- # [[ -z '' ]] 00:14:56.301 08:53:44 -- common/autotest_common.sh@890 -- # bdev_timeout=2000 00:14:56.301 08:53:44 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:14:56.562 08:53:45 -- common/autotest_common.sh@894 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b c2b415a2-23f4-437c-bb5a-7b64a7024f9d -t 2000 00:14:56.820 [ 00:14:56.820 { 00:14:56.820 "name": "c2b415a2-23f4-437c-bb5a-7b64a7024f9d", 00:14:56.820 "aliases": [ 00:14:56.820 "lvs/lvol" 00:14:56.820 ], 00:14:56.820 "product_name": "Logical Volume", 00:14:56.820 "block_size": 4096, 00:14:56.820 "num_blocks": 38912, 00:14:56.820 "uuid": "c2b415a2-23f4-437c-bb5a-7b64a7024f9d", 00:14:56.820 "assigned_rate_limits": { 00:14:56.820 "rw_ios_per_sec": 0, 00:14:56.820 "rw_mbytes_per_sec": 0, 00:14:56.820 "r_mbytes_per_sec": 0, 00:14:56.820 "w_mbytes_per_sec": 0 00:14:56.820 }, 00:14:56.820 "claimed": false, 00:14:56.820 "zoned": false, 00:14:56.820 "supported_io_types": { 00:14:56.820 "read": true, 00:14:56.820 "write": true, 00:14:56.820 "unmap": true, 00:14:56.820 "write_zeroes": true, 00:14:56.820 "flush": false, 00:14:56.820 "reset": true, 00:14:56.820 "compare": false, 00:14:56.820 "compare_and_write": false, 00:14:56.820 "abort": false, 00:14:56.820 "nvme_admin": false, 00:14:56.820 "nvme_io": false 00:14:56.820 }, 00:14:56.820 "driver_specific": { 00:14:56.820 "lvol": { 00:14:56.820 "lvol_store_uuid": "38fc006a-e1cc-47de-a165-df1d178595fc", 00:14:56.820 "base_bdev": "aio_bdev", 00:14:56.820 "thin_provision": false, 00:14:56.820 "snapshot": false, 00:14:56.820 "clone": false, 00:14:56.820 "esnap_clone": false 00:14:56.820 } 00:14:56.820 } 00:14:56.820 } 00:14:56.820 ] 00:14:56.821 08:53:45 -- common/autotest_common.sh@895 -- # return 0 00:14:56.821 08:53:45 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 38fc006a-e1cc-47de-a165-df1d178595fc 00:14:56.821 08:53:45 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:14:57.079 08:53:45 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:14:57.079 08:53:45 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 38fc006a-e1cc-47de-a165-df1d178595fc 00:14:57.079 08:53:45 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:14:57.339 08:53:45 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:14:57.339 08:53:45 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:57.600 [2024-07-15 08:53:45.964503] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:14:57.600 08:53:45 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 38fc006a-e1cc-47de-a165-df1d178595fc 00:14:57.600 08:53:45 -- common/autotest_common.sh@640 -- # local es=0 00:14:57.600 08:53:45 -- common/autotest_common.sh@642 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 38fc006a-e1cc-47de-a165-df1d178595fc 00:14:57.600 08:53:45 -- common/autotest_common.sh@628 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:57.600 08:53:45 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:14:57.600 08:53:45 -- common/autotest_common.sh@632 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:57.600 08:53:45 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:14:57.600 08:53:45 -- common/autotest_common.sh@634 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:57.600 08:53:45 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:14:57.600 08:53:45 -- common/autotest_common.sh@634 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:57.600 08:53:45 -- common/autotest_common.sh@634 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:14:57.600 08:53:45 -- common/autotest_common.sh@643 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 38fc006a-e1cc-47de-a165-df1d178595fc 00:14:57.860 request: 00:14:57.860 { 00:14:57.860 "uuid": "38fc006a-e1cc-47de-a165-df1d178595fc", 00:14:57.860 "method": "bdev_lvol_get_lvstores", 00:14:57.860 "req_id": 1 00:14:57.860 } 00:14:57.860 Got JSON-RPC error response 00:14:57.860 response: 00:14:57.860 { 00:14:57.860 "code": -19, 00:14:57.860 "message": "No such device" 00:14:57.860 } 00:14:57.860 08:53:46 -- common/autotest_common.sh@643 -- # es=1 00:14:57.860 08:53:46 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:14:57.860 08:53:46 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:14:57.860 08:53:46 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:14:57.860 08:53:46 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:58.121 aio_bdev 00:14:58.121 08:53:46 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev c2b415a2-23f4-437c-bb5a-7b64a7024f9d 00:14:58.121 08:53:46 -- common/autotest_common.sh@887 -- # local bdev_name=c2b415a2-23f4-437c-bb5a-7b64a7024f9d 00:14:58.121 08:53:46 -- common/autotest_common.sh@888 -- # local bdev_timeout= 00:14:58.121 08:53:46 -- common/autotest_common.sh@889 -- # local i 00:14:58.121 08:53:46 -- common/autotest_common.sh@890 -- # [[ -z '' ]] 00:14:58.121 08:53:46 -- common/autotest_common.sh@890 -- # bdev_timeout=2000 00:14:58.121 08:53:46 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:14:58.379 08:53:46 -- common/autotest_common.sh@894 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b c2b415a2-23f4-437c-bb5a-7b64a7024f9d -t 2000 00:14:58.637 [ 00:14:58.637 { 00:14:58.637 "name": "c2b415a2-23f4-437c-bb5a-7b64a7024f9d", 00:14:58.637 "aliases": [ 00:14:58.637 "lvs/lvol" 00:14:58.637 ], 00:14:58.637 "product_name": "Logical Volume", 00:14:58.637 "block_size": 4096, 00:14:58.637 "num_blocks": 38912, 00:14:58.637 "uuid": "c2b415a2-23f4-437c-bb5a-7b64a7024f9d", 00:14:58.637 "assigned_rate_limits": { 00:14:58.637 "rw_ios_per_sec": 0, 00:14:58.637 "rw_mbytes_per_sec": 0, 00:14:58.637 "r_mbytes_per_sec": 0, 00:14:58.637 "w_mbytes_per_sec": 0 00:14:58.637 }, 00:14:58.637 "claimed": false, 00:14:58.637 "zoned": false, 00:14:58.637 "supported_io_types": { 00:14:58.637 "read": true, 00:14:58.637 "write": true, 00:14:58.637 "unmap": true, 00:14:58.637 "write_zeroes": true, 00:14:58.637 "flush": false, 00:14:58.637 "reset": true, 00:14:58.637 "compare": false, 00:14:58.637 "compare_and_write": false, 00:14:58.637 "abort": false, 00:14:58.637 "nvme_admin": false, 00:14:58.637 "nvme_io": false 00:14:58.637 }, 00:14:58.637 "driver_specific": { 00:14:58.637 "lvol": { 00:14:58.637 "lvol_store_uuid": "38fc006a-e1cc-47de-a165-df1d178595fc", 00:14:58.637 "base_bdev": "aio_bdev", 00:14:58.637 "thin_provision": false, 00:14:58.637 "snapshot": false, 00:14:58.637 "clone": false, 00:14:58.637 "esnap_clone": false 00:14:58.637 } 00:14:58.637 } 00:14:58.637 } 00:14:58.637 ] 00:14:58.637 08:53:46 -- common/autotest_common.sh@895 -- # return 0 00:14:58.637 08:53:46 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 38fc006a-e1cc-47de-a165-df1d178595fc 00:14:58.637 08:53:46 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:14:58.895 08:53:47 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:14:58.895 08:53:47 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 38fc006a-e1cc-47de-a165-df1d178595fc 00:14:58.895 08:53:47 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:14:58.895 08:53:47 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:14:58.895 08:53:47 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete c2b415a2-23f4-437c-bb5a-7b64a7024f9d 00:14:59.152 08:53:47 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 38fc006a-e1cc-47de-a165-df1d178595fc 00:14:59.412 08:53:47 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:59.670 08:53:48 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:59.670 00:14:59.670 real 0m19.746s 00:14:59.670 user 0m49.944s 00:14:59.670 sys 0m4.745s 00:14:59.670 08:53:48 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:14:59.670 08:53:48 -- common/autotest_common.sh@10 -- # set +x 00:14:59.670 ************************************ 00:14:59.670 END TEST lvs_grow_dirty 00:14:59.670 ************************************ 00:14:59.670 08:53:48 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:14:59.670 08:53:48 -- common/autotest_common.sh@796 -- # type=--id 00:14:59.670 08:53:48 -- common/autotest_common.sh@797 -- # id=0 00:14:59.671 08:53:48 -- common/autotest_common.sh@798 -- # '[' --id = --pid ']' 00:14:59.671 08:53:48 -- common/autotest_common.sh@802 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:14:59.671 08:53:48 -- common/autotest_common.sh@802 -- # shm_files=nvmf_trace.0 00:14:59.671 08:53:48 -- common/autotest_common.sh@804 -- # [[ -z nvmf_trace.0 ]] 00:14:59.671 08:53:48 -- common/autotest_common.sh@808 -- # for n in $shm_files 00:14:59.671 08:53:48 -- common/autotest_common.sh@809 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:14:59.671 nvmf_trace.0 00:14:59.671 08:53:48 -- common/autotest_common.sh@811 -- # return 0 00:14:59.671 08:53:48 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:14:59.671 08:53:48 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:59.671 08:53:48 -- nvmf/common.sh@116 -- # sync 00:14:59.671 08:53:48 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:59.671 08:53:48 -- nvmf/common.sh@119 -- # set +e 00:14:59.671 08:53:48 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:59.671 08:53:48 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:59.671 rmmod nvme_tcp 00:14:59.928 rmmod nvme_fabrics 00:14:59.928 rmmod nvme_keyring 00:14:59.928 08:53:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:59.928 08:53:48 -- nvmf/common.sh@123 -- # set -e 00:14:59.928 08:53:48 -- nvmf/common.sh@124 -- # return 0 00:14:59.928 08:53:48 -- nvmf/common.sh@477 -- # '[' -n 1486037 ']' 00:14:59.928 08:53:48 -- nvmf/common.sh@478 -- # killprocess 1486037 00:14:59.928 08:53:48 -- common/autotest_common.sh@926 -- # '[' -z 1486037 ']' 00:14:59.928 08:53:48 -- common/autotest_common.sh@930 -- # kill -0 1486037 00:14:59.928 08:53:48 -- common/autotest_common.sh@931 -- # uname 00:14:59.928 08:53:48 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:14:59.928 08:53:48 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1486037 00:14:59.928 08:53:48 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:14:59.928 08:53:48 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:14:59.928 08:53:48 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1486037' 00:14:59.928 killing process with pid 1486037 00:14:59.928 08:53:48 -- common/autotest_common.sh@945 -- # kill 1486037 00:14:59.928 08:53:48 -- common/autotest_common.sh@950 -- # wait 1486037 00:15:00.186 08:53:48 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:00.186 08:53:48 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:00.186 08:53:48 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:00.186 08:53:48 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:00.186 08:53:48 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:00.186 08:53:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:00.186 08:53:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:00.186 08:53:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:02.091 08:53:50 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:02.091 00:15:02.091 real 0m43.382s 00:15:02.091 user 1m13.638s 00:15:02.091 sys 0m8.334s 00:15:02.091 08:53:50 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:15:02.091 08:53:50 -- common/autotest_common.sh@10 -- # set +x 00:15:02.091 ************************************ 00:15:02.091 END TEST nvmf_lvs_grow 00:15:02.091 ************************************ 00:15:02.091 08:53:50 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:15:02.091 08:53:50 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:15:02.091 08:53:50 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:15:02.091 08:53:50 -- common/autotest_common.sh@10 -- # set +x 00:15:02.091 ************************************ 00:15:02.091 START TEST nvmf_bdev_io_wait 00:15:02.091 ************************************ 00:15:02.091 08:53:50 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:15:02.349 * Looking for test storage... 00:15:02.349 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:02.349 08:53:50 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:02.349 08:53:50 -- nvmf/common.sh@7 -- # uname -s 00:15:02.349 08:53:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:02.349 08:53:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:02.349 08:53:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:02.349 08:53:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:02.349 08:53:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:02.349 08:53:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:02.349 08:53:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:02.349 08:53:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:02.349 08:53:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:02.349 08:53:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:02.349 08:53:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:02.349 08:53:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:02.349 08:53:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:02.349 08:53:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:02.349 08:53:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:02.349 08:53:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:02.349 08:53:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:02.349 08:53:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:02.349 08:53:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:02.349 08:53:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:02.349 08:53:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:02.349 08:53:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:02.349 08:53:50 -- paths/export.sh@5 -- # export PATH 00:15:02.349 08:53:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:02.349 08:53:50 -- nvmf/common.sh@46 -- # : 0 00:15:02.349 08:53:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:02.349 08:53:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:02.349 08:53:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:02.349 08:53:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:02.349 08:53:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:02.349 08:53:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:02.349 08:53:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:02.349 08:53:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:02.349 08:53:50 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:02.349 08:53:50 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:02.349 08:53:50 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:15:02.349 08:53:50 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:02.349 08:53:50 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:02.349 08:53:50 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:02.349 08:53:50 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:02.349 08:53:50 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:02.349 08:53:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:02.349 08:53:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:02.349 08:53:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:02.349 08:53:50 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:02.349 08:53:50 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:02.349 08:53:50 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:02.349 08:53:50 -- common/autotest_common.sh@10 -- # set +x 00:15:04.251 08:53:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:04.251 08:53:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:04.251 08:53:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:04.251 08:53:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:04.251 08:53:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:04.251 08:53:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:04.251 08:53:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:04.251 08:53:52 -- nvmf/common.sh@294 -- # net_devs=() 00:15:04.251 08:53:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:04.251 08:53:52 -- nvmf/common.sh@295 -- # e810=() 00:15:04.251 08:53:52 -- nvmf/common.sh@295 -- # local -ga e810 00:15:04.251 08:53:52 -- nvmf/common.sh@296 -- # x722=() 00:15:04.251 08:53:52 -- nvmf/common.sh@296 -- # local -ga x722 00:15:04.251 08:53:52 -- nvmf/common.sh@297 -- # mlx=() 00:15:04.251 08:53:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:04.251 08:53:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:04.251 08:53:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:04.251 08:53:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:04.251 08:53:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:04.251 08:53:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:04.251 08:53:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:04.251 08:53:52 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:04.251 08:53:52 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:04.251 08:53:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:04.251 08:53:52 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:04.251 08:53:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:04.251 08:53:52 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:04.251 08:53:52 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:04.251 08:53:52 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:04.251 08:53:52 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:04.251 08:53:52 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:04.251 08:53:52 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:04.251 08:53:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:04.251 08:53:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:04.251 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:04.251 08:53:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:04.251 08:53:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:04.251 08:53:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:04.251 08:53:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:04.251 08:53:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:04.251 08:53:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:04.251 08:53:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:04.251 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:04.251 08:53:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:04.251 08:53:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:04.251 08:53:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:04.251 08:53:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:04.251 08:53:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:04.251 08:53:52 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:04.251 08:53:52 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:04.251 08:53:52 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:04.251 08:53:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:04.251 08:53:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:04.251 08:53:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:04.251 08:53:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:04.251 08:53:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:04.251 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:04.251 08:53:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:04.251 08:53:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:04.251 08:53:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:04.251 08:53:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:04.251 08:53:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:04.251 08:53:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:04.251 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:04.251 08:53:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:04.251 08:53:52 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:04.251 08:53:52 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:04.251 08:53:52 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:04.251 08:53:52 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:04.251 08:53:52 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:04.251 08:53:52 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:04.251 08:53:52 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:04.251 08:53:52 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:04.251 08:53:52 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:04.251 08:53:52 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:04.251 08:53:52 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:04.251 08:53:52 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:04.251 08:53:52 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:04.251 08:53:52 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:04.251 08:53:52 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:04.251 08:53:52 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:04.251 08:53:52 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:04.251 08:53:52 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:04.509 08:53:52 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:04.509 08:53:52 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:04.509 08:53:52 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:04.509 08:53:52 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:04.509 08:53:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:04.509 08:53:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:04.510 08:53:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:04.510 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:04.510 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.216 ms 00:15:04.510 00:15:04.510 --- 10.0.0.2 ping statistics --- 00:15:04.510 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:04.510 rtt min/avg/max/mdev = 0.216/0.216/0.216/0.000 ms 00:15:04.510 08:53:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:04.510 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:04.510 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.116 ms 00:15:04.510 00:15:04.510 --- 10.0.0.1 ping statistics --- 00:15:04.510 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:04.510 rtt min/avg/max/mdev = 0.116/0.116/0.116/0.000 ms 00:15:04.510 08:53:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:04.510 08:53:52 -- nvmf/common.sh@410 -- # return 0 00:15:04.510 08:53:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:04.510 08:53:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:04.510 08:53:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:04.510 08:53:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:04.510 08:53:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:04.510 08:53:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:04.510 08:53:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:04.510 08:53:52 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:15:04.510 08:53:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:04.510 08:53:52 -- common/autotest_common.sh@712 -- # xtrace_disable 00:15:04.510 08:53:52 -- common/autotest_common.sh@10 -- # set +x 00:15:04.510 08:53:52 -- nvmf/common.sh@469 -- # nvmfpid=1488601 00:15:04.510 08:53:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:15:04.510 08:53:52 -- nvmf/common.sh@470 -- # waitforlisten 1488601 00:15:04.510 08:53:52 -- common/autotest_common.sh@819 -- # '[' -z 1488601 ']' 00:15:04.510 08:53:52 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:04.510 08:53:52 -- common/autotest_common.sh@824 -- # local max_retries=100 00:15:04.510 08:53:52 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:04.510 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:04.510 08:53:52 -- common/autotest_common.sh@828 -- # xtrace_disable 00:15:04.510 08:53:52 -- common/autotest_common.sh@10 -- # set +x 00:15:04.510 [2024-07-15 08:53:52.977103] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:15:04.510 [2024-07-15 08:53:52.977185] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:04.510 EAL: No free 2048 kB hugepages reported on node 1 00:15:04.510 [2024-07-15 08:53:53.042994] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:04.768 [2024-07-15 08:53:53.149850] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:04.768 [2024-07-15 08:53:53.150020] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:04.768 [2024-07-15 08:53:53.150038] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:04.768 [2024-07-15 08:53:53.150050] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:04.768 [2024-07-15 08:53:53.150114] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:04.768 [2024-07-15 08:53:53.150130] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:04.768 [2024-07-15 08:53:53.150188] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:04.768 [2024-07-15 08:53:53.150191] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:04.768 08:53:53 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:15:04.768 08:53:53 -- common/autotest_common.sh@852 -- # return 0 00:15:04.768 08:53:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:04.768 08:53:53 -- common/autotest_common.sh@718 -- # xtrace_disable 00:15:04.768 08:53:53 -- common/autotest_common.sh@10 -- # set +x 00:15:04.768 08:53:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:04.768 08:53:53 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:15:04.768 08:53:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:04.768 08:53:53 -- common/autotest_common.sh@10 -- # set +x 00:15:04.768 08:53:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:04.768 08:53:53 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:15:04.768 08:53:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:04.768 08:53:53 -- common/autotest_common.sh@10 -- # set +x 00:15:04.768 08:53:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:04.768 08:53:53 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:04.768 08:53:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:04.768 08:53:53 -- common/autotest_common.sh@10 -- # set +x 00:15:04.768 [2024-07-15 08:53:53.279756] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:04.768 08:53:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:04.768 08:53:53 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:04.768 08:53:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:04.768 08:53:53 -- common/autotest_common.sh@10 -- # set +x 00:15:05.026 Malloc0 00:15:05.026 08:53:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:05.026 08:53:53 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:05.026 08:53:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:05.026 08:53:53 -- common/autotest_common.sh@10 -- # set +x 00:15:05.026 08:53:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:05.026 08:53:53 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:05.026 08:53:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:05.026 08:53:53 -- common/autotest_common.sh@10 -- # set +x 00:15:05.026 08:53:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:05.026 08:53:53 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:05.026 08:53:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:05.026 08:53:53 -- common/autotest_common.sh@10 -- # set +x 00:15:05.026 [2024-07-15 08:53:53.345389] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:05.026 08:53:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:05.026 08:53:53 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=1488687 00:15:05.026 08:53:53 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:15:05.026 08:53:53 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:15:05.026 08:53:53 -- nvmf/common.sh@520 -- # config=() 00:15:05.026 08:53:53 -- target/bdev_io_wait.sh@30 -- # READ_PID=1488690 00:15:05.026 08:53:53 -- nvmf/common.sh@520 -- # local subsystem config 00:15:05.026 08:53:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:05.026 08:53:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:05.026 { 00:15:05.026 "params": { 00:15:05.026 "name": "Nvme$subsystem", 00:15:05.026 "trtype": "$TEST_TRANSPORT", 00:15:05.026 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:05.026 "adrfam": "ipv4", 00:15:05.026 "trsvcid": "$NVMF_PORT", 00:15:05.026 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:05.026 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:05.026 "hdgst": ${hdgst:-false}, 00:15:05.026 "ddgst": ${ddgst:-false} 00:15:05.026 }, 00:15:05.026 "method": "bdev_nvme_attach_controller" 00:15:05.026 } 00:15:05.026 EOF 00:15:05.026 )") 00:15:05.026 08:53:53 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:15:05.026 08:53:53 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:15:05.026 08:53:53 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=1488693 00:15:05.027 08:53:53 -- nvmf/common.sh@520 -- # config=() 00:15:05.027 08:53:53 -- nvmf/common.sh@520 -- # local subsystem config 00:15:05.027 08:53:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:05.027 08:53:53 -- nvmf/common.sh@542 -- # cat 00:15:05.027 08:53:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:05.027 { 00:15:05.027 "params": { 00:15:05.027 "name": "Nvme$subsystem", 00:15:05.027 "trtype": "$TEST_TRANSPORT", 00:15:05.027 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:05.027 "adrfam": "ipv4", 00:15:05.027 "trsvcid": "$NVMF_PORT", 00:15:05.027 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:05.027 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:05.027 "hdgst": ${hdgst:-false}, 00:15:05.027 "ddgst": ${ddgst:-false} 00:15:05.027 }, 00:15:05.027 "method": "bdev_nvme_attach_controller" 00:15:05.027 } 00:15:05.027 EOF 00:15:05.027 )") 00:15:05.027 08:53:53 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:15:05.027 08:53:53 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:15:05.027 08:53:53 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=1488697 00:15:05.027 08:53:53 -- target/bdev_io_wait.sh@35 -- # sync 00:15:05.027 08:53:53 -- nvmf/common.sh@520 -- # config=() 00:15:05.027 08:53:53 -- nvmf/common.sh@520 -- # local subsystem config 00:15:05.027 08:53:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:05.027 08:53:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:05.027 { 00:15:05.027 "params": { 00:15:05.027 "name": "Nvme$subsystem", 00:15:05.027 "trtype": "$TEST_TRANSPORT", 00:15:05.027 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:05.027 "adrfam": "ipv4", 00:15:05.027 "trsvcid": "$NVMF_PORT", 00:15:05.027 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:05.027 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:05.027 "hdgst": ${hdgst:-false}, 00:15:05.027 "ddgst": ${ddgst:-false} 00:15:05.027 }, 00:15:05.027 "method": "bdev_nvme_attach_controller" 00:15:05.027 } 00:15:05.027 EOF 00:15:05.027 )") 00:15:05.027 08:53:53 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:15:05.027 08:53:53 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:15:05.027 08:53:53 -- nvmf/common.sh@520 -- # config=() 00:15:05.027 08:53:53 -- nvmf/common.sh@542 -- # cat 00:15:05.027 08:53:53 -- nvmf/common.sh@520 -- # local subsystem config 00:15:05.027 08:53:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:05.027 08:53:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:05.027 { 00:15:05.027 "params": { 00:15:05.027 "name": "Nvme$subsystem", 00:15:05.027 "trtype": "$TEST_TRANSPORT", 00:15:05.027 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:05.027 "adrfam": "ipv4", 00:15:05.027 "trsvcid": "$NVMF_PORT", 00:15:05.027 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:05.027 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:05.027 "hdgst": ${hdgst:-false}, 00:15:05.027 "ddgst": ${ddgst:-false} 00:15:05.027 }, 00:15:05.027 "method": "bdev_nvme_attach_controller" 00:15:05.027 } 00:15:05.027 EOF 00:15:05.027 )") 00:15:05.027 08:53:53 -- nvmf/common.sh@542 -- # cat 00:15:05.027 08:53:53 -- nvmf/common.sh@544 -- # jq . 00:15:05.027 08:53:53 -- target/bdev_io_wait.sh@37 -- # wait 1488687 00:15:05.027 08:53:53 -- nvmf/common.sh@542 -- # cat 00:15:05.027 08:53:53 -- nvmf/common.sh@544 -- # jq . 00:15:05.027 08:53:53 -- nvmf/common.sh@545 -- # IFS=, 00:15:05.027 08:53:53 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:05.027 "params": { 00:15:05.027 "name": "Nvme1", 00:15:05.027 "trtype": "tcp", 00:15:05.027 "traddr": "10.0.0.2", 00:15:05.027 "adrfam": "ipv4", 00:15:05.027 "trsvcid": "4420", 00:15:05.027 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:05.027 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:05.027 "hdgst": false, 00:15:05.027 "ddgst": false 00:15:05.027 }, 00:15:05.027 "method": "bdev_nvme_attach_controller" 00:15:05.027 }' 00:15:05.027 08:53:53 -- nvmf/common.sh@544 -- # jq . 00:15:05.027 08:53:53 -- nvmf/common.sh@545 -- # IFS=, 00:15:05.027 08:53:53 -- nvmf/common.sh@544 -- # jq . 00:15:05.027 08:53:53 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:05.027 "params": { 00:15:05.027 "name": "Nvme1", 00:15:05.027 "trtype": "tcp", 00:15:05.027 "traddr": "10.0.0.2", 00:15:05.027 "adrfam": "ipv4", 00:15:05.027 "trsvcid": "4420", 00:15:05.027 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:05.027 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:05.027 "hdgst": false, 00:15:05.027 "ddgst": false 00:15:05.027 }, 00:15:05.027 "method": "bdev_nvme_attach_controller" 00:15:05.027 }' 00:15:05.027 08:53:53 -- nvmf/common.sh@545 -- # IFS=, 00:15:05.027 08:53:53 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:05.027 "params": { 00:15:05.027 "name": "Nvme1", 00:15:05.027 "trtype": "tcp", 00:15:05.027 "traddr": "10.0.0.2", 00:15:05.027 "adrfam": "ipv4", 00:15:05.027 "trsvcid": "4420", 00:15:05.027 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:05.027 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:05.027 "hdgst": false, 00:15:05.027 "ddgst": false 00:15:05.027 }, 00:15:05.027 "method": "bdev_nvme_attach_controller" 00:15:05.027 }' 00:15:05.027 08:53:53 -- nvmf/common.sh@545 -- # IFS=, 00:15:05.027 08:53:53 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:05.027 "params": { 00:15:05.027 "name": "Nvme1", 00:15:05.027 "trtype": "tcp", 00:15:05.027 "traddr": "10.0.0.2", 00:15:05.027 "adrfam": "ipv4", 00:15:05.027 "trsvcid": "4420", 00:15:05.027 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:05.027 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:05.027 "hdgst": false, 00:15:05.027 "ddgst": false 00:15:05.027 }, 00:15:05.027 "method": "bdev_nvme_attach_controller" 00:15:05.027 }' 00:15:05.027 [2024-07-15 08:53:53.387671] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:15:05.027 [2024-07-15 08:53:53.387672] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:15:05.027 [2024-07-15 08:53:53.387671] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:15:05.027 [2024-07-15 08:53:53.387759] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-07-15 08:53:53.387759] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-07-15 08:53:53.387760] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:15:05.027 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:15:05.027 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:15:05.027 [2024-07-15 08:53:53.388635] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:15:05.027 [2024-07-15 08:53:53.388705] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:15:05.027 EAL: No free 2048 kB hugepages reported on node 1 00:15:05.027 EAL: No free 2048 kB hugepages reported on node 1 00:15:05.027 [2024-07-15 08:53:53.559125] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:05.286 EAL: No free 2048 kB hugepages reported on node 1 00:15:05.286 [2024-07-15 08:53:53.654811] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:15:05.286 [2024-07-15 08:53:53.660397] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:05.286 EAL: No free 2048 kB hugepages reported on node 1 00:15:05.286 [2024-07-15 08:53:53.756178] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:15:05.286 [2024-07-15 08:53:53.759175] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:05.546 [2024-07-15 08:53:53.834633] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:05.546 [2024-07-15 08:53:53.858887] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:15:05.546 [2024-07-15 08:53:53.927353] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:15:05.546 Running I/O for 1 seconds... 00:15:05.546 Running I/O for 1 seconds... 00:15:05.546 Running I/O for 1 seconds... 00:15:05.546 Running I/O for 1 seconds... 00:15:06.506 00:15:06.506 Latency(us) 00:15:06.506 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:06.506 Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:15:06.506 Nvme1n1 : 1.01 12093.58 47.24 0.00 0.00 10546.23 5825.42 19709.35 00:15:06.506 =================================================================================================================== 00:15:06.506 Total : 12093.58 47.24 0.00 0.00 10546.23 5825.42 19709.35 00:15:06.506 00:15:06.506 Latency(us) 00:15:06.506 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:06.506 Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:15:06.506 Nvme1n1 : 1.02 5410.12 21.13 0.00 0.00 23417.78 11553.75 33593.27 00:15:06.506 =================================================================================================================== 00:15:06.506 Total : 5410.12 21.13 0.00 0.00 23417.78 11553.75 33593.27 00:15:06.506 00:15:06.506 Latency(us) 00:15:06.506 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:06.506 Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:15:06.506 Nvme1n1 : 1.00 198147.96 774.02 0.00 0.00 643.50 259.41 825.27 00:15:06.506 =================================================================================================================== 00:15:06.506 Total : 198147.96 774.02 0.00 0.00 643.50 259.41 825.27 00:15:06.772 00:15:06.772 Latency(us) 00:15:06.772 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:06.772 Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:15:06.772 Nvme1n1 : 1.01 5418.81 21.17 0.00 0.00 23533.34 6893.42 49516.09 00:15:06.772 =================================================================================================================== 00:15:06.772 Total : 5418.81 21.17 0.00 0.00 23533.34 6893.42 49516.09 00:15:06.772 08:53:55 -- target/bdev_io_wait.sh@38 -- # wait 1488690 00:15:07.031 08:53:55 -- target/bdev_io_wait.sh@39 -- # wait 1488693 00:15:07.031 08:53:55 -- target/bdev_io_wait.sh@40 -- # wait 1488697 00:15:07.031 08:53:55 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:07.031 08:53:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:07.031 08:53:55 -- common/autotest_common.sh@10 -- # set +x 00:15:07.031 08:53:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:07.031 08:53:55 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:15:07.031 08:53:55 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:15:07.031 08:53:55 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:07.031 08:53:55 -- nvmf/common.sh@116 -- # sync 00:15:07.031 08:53:55 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:07.031 08:53:55 -- nvmf/common.sh@119 -- # set +e 00:15:07.031 08:53:55 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:07.031 08:53:55 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:07.031 rmmod nvme_tcp 00:15:07.031 rmmod nvme_fabrics 00:15:07.031 rmmod nvme_keyring 00:15:07.031 08:53:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:07.031 08:53:55 -- nvmf/common.sh@123 -- # set -e 00:15:07.031 08:53:55 -- nvmf/common.sh@124 -- # return 0 00:15:07.031 08:53:55 -- nvmf/common.sh@477 -- # '[' -n 1488601 ']' 00:15:07.031 08:53:55 -- nvmf/common.sh@478 -- # killprocess 1488601 00:15:07.031 08:53:55 -- common/autotest_common.sh@926 -- # '[' -z 1488601 ']' 00:15:07.031 08:53:55 -- common/autotest_common.sh@930 -- # kill -0 1488601 00:15:07.031 08:53:55 -- common/autotest_common.sh@931 -- # uname 00:15:07.031 08:53:55 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:15:07.031 08:53:55 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1488601 00:15:07.031 08:53:55 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:15:07.031 08:53:55 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:15:07.031 08:53:55 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1488601' 00:15:07.031 killing process with pid 1488601 00:15:07.031 08:53:55 -- common/autotest_common.sh@945 -- # kill 1488601 00:15:07.031 08:53:55 -- common/autotest_common.sh@950 -- # wait 1488601 00:15:07.289 08:53:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:07.289 08:53:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:07.289 08:53:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:07.289 08:53:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:07.289 08:53:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:07.289 08:53:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:07.289 08:53:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:07.289 08:53:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:09.882 08:53:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:09.882 00:15:09.882 real 0m7.212s 00:15:09.882 user 0m16.140s 00:15:09.882 sys 0m3.577s 00:15:09.882 08:53:57 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:15:09.882 08:53:57 -- common/autotest_common.sh@10 -- # set +x 00:15:09.882 ************************************ 00:15:09.882 END TEST nvmf_bdev_io_wait 00:15:09.882 ************************************ 00:15:09.882 08:53:57 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:09.882 08:53:57 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:15:09.882 08:53:57 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:15:09.882 08:53:57 -- common/autotest_common.sh@10 -- # set +x 00:15:09.882 ************************************ 00:15:09.882 START TEST nvmf_queue_depth 00:15:09.882 ************************************ 00:15:09.882 08:53:57 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:09.882 * Looking for test storage... 00:15:09.882 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:09.882 08:53:57 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:09.882 08:53:57 -- nvmf/common.sh@7 -- # uname -s 00:15:09.882 08:53:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:09.882 08:53:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:09.882 08:53:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:09.882 08:53:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:09.882 08:53:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:09.882 08:53:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:09.882 08:53:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:09.882 08:53:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:09.882 08:53:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:09.882 08:53:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:09.882 08:53:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:09.882 08:53:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:09.882 08:53:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:09.882 08:53:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:09.882 08:53:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:09.882 08:53:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:09.882 08:53:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:09.882 08:53:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:09.882 08:53:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:09.882 08:53:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:09.882 08:53:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:09.882 08:53:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:09.882 08:53:57 -- paths/export.sh@5 -- # export PATH 00:15:09.882 08:53:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:09.882 08:53:57 -- nvmf/common.sh@46 -- # : 0 00:15:09.882 08:53:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:09.882 08:53:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:09.882 08:53:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:09.882 08:53:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:09.882 08:53:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:09.882 08:53:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:09.882 08:53:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:09.882 08:53:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:09.882 08:53:57 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:15:09.882 08:53:57 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:15:09.882 08:53:57 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:15:09.882 08:53:57 -- target/queue_depth.sh@19 -- # nvmftestinit 00:15:09.882 08:53:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:09.882 08:53:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:09.882 08:53:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:09.882 08:53:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:09.882 08:53:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:09.882 08:53:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:09.882 08:53:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:09.882 08:53:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:09.882 08:53:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:09.882 08:53:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:09.882 08:53:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:09.882 08:53:57 -- common/autotest_common.sh@10 -- # set +x 00:15:11.258 08:53:59 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:11.258 08:53:59 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:11.258 08:53:59 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:11.258 08:53:59 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:11.258 08:53:59 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:11.258 08:53:59 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:11.258 08:53:59 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:11.258 08:53:59 -- nvmf/common.sh@294 -- # net_devs=() 00:15:11.258 08:53:59 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:11.258 08:53:59 -- nvmf/common.sh@295 -- # e810=() 00:15:11.258 08:53:59 -- nvmf/common.sh@295 -- # local -ga e810 00:15:11.258 08:53:59 -- nvmf/common.sh@296 -- # x722=() 00:15:11.258 08:53:59 -- nvmf/common.sh@296 -- # local -ga x722 00:15:11.258 08:53:59 -- nvmf/common.sh@297 -- # mlx=() 00:15:11.258 08:53:59 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:11.258 08:53:59 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:11.258 08:53:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:11.258 08:53:59 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:11.258 08:53:59 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:11.258 08:53:59 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:11.258 08:53:59 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:11.258 08:53:59 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:11.258 08:53:59 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:11.258 08:53:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:11.258 08:53:59 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:11.258 08:53:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:11.258 08:53:59 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:11.258 08:53:59 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:11.258 08:53:59 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:11.258 08:53:59 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:11.258 08:53:59 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:11.258 08:53:59 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:11.258 08:53:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:11.258 08:53:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:11.258 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:11.258 08:53:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:11.258 08:53:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:11.258 08:53:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:11.258 08:53:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:11.258 08:53:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:11.258 08:53:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:11.259 08:53:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:11.259 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:11.259 08:53:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:11.259 08:53:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:11.259 08:53:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:11.259 08:53:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:11.259 08:53:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:11.259 08:53:59 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:11.259 08:53:59 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:11.259 08:53:59 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:11.259 08:53:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:11.259 08:53:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:11.259 08:53:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:11.259 08:53:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:11.259 08:53:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:11.259 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:11.259 08:53:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:11.259 08:53:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:11.259 08:53:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:11.259 08:53:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:11.259 08:53:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:11.259 08:53:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:11.259 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:11.259 08:53:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:11.259 08:53:59 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:11.259 08:53:59 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:11.259 08:53:59 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:11.259 08:53:59 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:11.259 08:53:59 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:11.259 08:53:59 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:11.259 08:53:59 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:11.259 08:53:59 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:11.259 08:53:59 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:11.259 08:53:59 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:11.259 08:53:59 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:11.259 08:53:59 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:11.259 08:53:59 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:11.259 08:53:59 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:11.259 08:53:59 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:11.516 08:53:59 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:11.516 08:53:59 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:11.516 08:53:59 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:11.516 08:53:59 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:11.516 08:53:59 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:11.516 08:53:59 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:11.516 08:53:59 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:11.516 08:53:59 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:11.516 08:53:59 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:11.516 08:53:59 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:11.516 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:11.516 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.139 ms 00:15:11.516 00:15:11.516 --- 10.0.0.2 ping statistics --- 00:15:11.516 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:11.516 rtt min/avg/max/mdev = 0.139/0.139/0.139/0.000 ms 00:15:11.516 08:53:59 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:11.516 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:11.516 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.198 ms 00:15:11.516 00:15:11.516 --- 10.0.0.1 ping statistics --- 00:15:11.516 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:11.516 rtt min/avg/max/mdev = 0.198/0.198/0.198/0.000 ms 00:15:11.516 08:53:59 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:11.516 08:53:59 -- nvmf/common.sh@410 -- # return 0 00:15:11.516 08:53:59 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:11.516 08:53:59 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:11.516 08:53:59 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:11.516 08:53:59 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:11.516 08:53:59 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:11.516 08:53:59 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:11.516 08:53:59 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:11.517 08:53:59 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:15:11.517 08:53:59 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:11.517 08:53:59 -- common/autotest_common.sh@712 -- # xtrace_disable 00:15:11.517 08:53:59 -- common/autotest_common.sh@10 -- # set +x 00:15:11.517 08:53:59 -- nvmf/common.sh@469 -- # nvmfpid=1490868 00:15:11.517 08:53:59 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:11.517 08:53:59 -- nvmf/common.sh@470 -- # waitforlisten 1490868 00:15:11.517 08:53:59 -- common/autotest_common.sh@819 -- # '[' -z 1490868 ']' 00:15:11.517 08:53:59 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:11.517 08:53:59 -- common/autotest_common.sh@824 -- # local max_retries=100 00:15:11.517 08:53:59 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:11.517 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:11.517 08:53:59 -- common/autotest_common.sh@828 -- # xtrace_disable 00:15:11.517 08:53:59 -- common/autotest_common.sh@10 -- # set +x 00:15:11.517 [2024-07-15 08:53:59.998961] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:15:11.517 [2024-07-15 08:53:59.999026] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:11.517 EAL: No free 2048 kB hugepages reported on node 1 00:15:11.774 [2024-07-15 08:54:00.067899] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:11.774 [2024-07-15 08:54:00.191198] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:11.774 [2024-07-15 08:54:00.191356] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:11.774 [2024-07-15 08:54:00.191374] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:11.774 [2024-07-15 08:54:00.191387] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:11.774 [2024-07-15 08:54:00.191430] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:12.707 08:54:00 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:15:12.707 08:54:00 -- common/autotest_common.sh@852 -- # return 0 00:15:12.707 08:54:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:12.707 08:54:00 -- common/autotest_common.sh@718 -- # xtrace_disable 00:15:12.707 08:54:00 -- common/autotest_common.sh@10 -- # set +x 00:15:12.707 08:54:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:12.707 08:54:00 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:12.707 08:54:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:12.707 08:54:00 -- common/autotest_common.sh@10 -- # set +x 00:15:12.707 [2024-07-15 08:54:00.996979] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:12.707 08:54:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:12.707 08:54:01 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:12.707 08:54:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:12.707 08:54:01 -- common/autotest_common.sh@10 -- # set +x 00:15:12.707 Malloc0 00:15:12.707 08:54:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:12.707 08:54:01 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:12.707 08:54:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:12.707 08:54:01 -- common/autotest_common.sh@10 -- # set +x 00:15:12.707 08:54:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:12.707 08:54:01 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:12.707 08:54:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:12.707 08:54:01 -- common/autotest_common.sh@10 -- # set +x 00:15:12.707 08:54:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:12.707 08:54:01 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:12.707 08:54:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:12.707 08:54:01 -- common/autotest_common.sh@10 -- # set +x 00:15:12.707 [2024-07-15 08:54:01.056468] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:12.707 08:54:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:12.707 08:54:01 -- target/queue_depth.sh@30 -- # bdevperf_pid=1491094 00:15:12.707 08:54:01 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:15:12.707 08:54:01 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:12.707 08:54:01 -- target/queue_depth.sh@33 -- # waitforlisten 1491094 /var/tmp/bdevperf.sock 00:15:12.707 08:54:01 -- common/autotest_common.sh@819 -- # '[' -z 1491094 ']' 00:15:12.707 08:54:01 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:12.707 08:54:01 -- common/autotest_common.sh@824 -- # local max_retries=100 00:15:12.707 08:54:01 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:12.707 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:12.707 08:54:01 -- common/autotest_common.sh@828 -- # xtrace_disable 00:15:12.707 08:54:01 -- common/autotest_common.sh@10 -- # set +x 00:15:12.707 [2024-07-15 08:54:01.098255] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:15:12.707 [2024-07-15 08:54:01.098318] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1491094 ] 00:15:12.707 EAL: No free 2048 kB hugepages reported on node 1 00:15:12.707 [2024-07-15 08:54:01.160361] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:12.965 [2024-07-15 08:54:01.283961] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:13.533 08:54:02 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:15:13.533 08:54:02 -- common/autotest_common.sh@852 -- # return 0 00:15:13.533 08:54:02 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:15:13.533 08:54:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:13.533 08:54:02 -- common/autotest_common.sh@10 -- # set +x 00:15:13.793 NVMe0n1 00:15:13.793 08:54:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:13.793 08:54:02 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:14.052 Running I/O for 10 seconds... 00:15:24.028 00:15:24.028 Latency(us) 00:15:24.028 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:24.028 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:15:24.028 Verification LBA range: start 0x0 length 0x4000 00:15:24.028 NVMe0n1 : 10.07 12361.31 48.29 0.00 0.00 82511.71 15340.28 61749.48 00:15:24.028 =================================================================================================================== 00:15:24.028 Total : 12361.31 48.29 0.00 0.00 82511.71 15340.28 61749.48 00:15:24.028 0 00:15:24.028 08:54:12 -- target/queue_depth.sh@39 -- # killprocess 1491094 00:15:24.028 08:54:12 -- common/autotest_common.sh@926 -- # '[' -z 1491094 ']' 00:15:24.028 08:54:12 -- common/autotest_common.sh@930 -- # kill -0 1491094 00:15:24.028 08:54:12 -- common/autotest_common.sh@931 -- # uname 00:15:24.028 08:54:12 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:15:24.028 08:54:12 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1491094 00:15:24.028 08:54:12 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:15:24.028 08:54:12 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:15:24.028 08:54:12 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1491094' 00:15:24.028 killing process with pid 1491094 00:15:24.028 08:54:12 -- common/autotest_common.sh@945 -- # kill 1491094 00:15:24.028 Received shutdown signal, test time was about 10.000000 seconds 00:15:24.028 00:15:24.028 Latency(us) 00:15:24.028 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:24.028 =================================================================================================================== 00:15:24.029 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:24.029 08:54:12 -- common/autotest_common.sh@950 -- # wait 1491094 00:15:24.288 08:54:12 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:15:24.288 08:54:12 -- target/queue_depth.sh@43 -- # nvmftestfini 00:15:24.288 08:54:12 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:24.288 08:54:12 -- nvmf/common.sh@116 -- # sync 00:15:24.288 08:54:12 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:24.288 08:54:12 -- nvmf/common.sh@119 -- # set +e 00:15:24.288 08:54:12 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:24.288 08:54:12 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:24.288 rmmod nvme_tcp 00:15:24.288 rmmod nvme_fabrics 00:15:24.288 rmmod nvme_keyring 00:15:24.288 08:54:12 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:24.288 08:54:12 -- nvmf/common.sh@123 -- # set -e 00:15:24.288 08:54:12 -- nvmf/common.sh@124 -- # return 0 00:15:24.288 08:54:12 -- nvmf/common.sh@477 -- # '[' -n 1490868 ']' 00:15:24.288 08:54:12 -- nvmf/common.sh@478 -- # killprocess 1490868 00:15:24.288 08:54:12 -- common/autotest_common.sh@926 -- # '[' -z 1490868 ']' 00:15:24.288 08:54:12 -- common/autotest_common.sh@930 -- # kill -0 1490868 00:15:24.288 08:54:12 -- common/autotest_common.sh@931 -- # uname 00:15:24.288 08:54:12 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:15:24.288 08:54:12 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1490868 00:15:24.288 08:54:12 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:15:24.289 08:54:12 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:15:24.289 08:54:12 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1490868' 00:15:24.289 killing process with pid 1490868 00:15:24.289 08:54:12 -- common/autotest_common.sh@945 -- # kill 1490868 00:15:24.289 08:54:12 -- common/autotest_common.sh@950 -- # wait 1490868 00:15:24.855 08:54:13 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:24.855 08:54:13 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:24.855 08:54:13 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:24.855 08:54:13 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:24.855 08:54:13 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:24.855 08:54:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:24.855 08:54:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:24.855 08:54:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:26.756 08:54:15 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:26.756 00:15:26.756 real 0m17.309s 00:15:26.756 user 0m24.920s 00:15:26.756 sys 0m3.083s 00:15:26.756 08:54:15 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:15:26.756 08:54:15 -- common/autotest_common.sh@10 -- # set +x 00:15:26.756 ************************************ 00:15:26.756 END TEST nvmf_queue_depth 00:15:26.756 ************************************ 00:15:26.756 08:54:15 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:26.756 08:54:15 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:15:26.756 08:54:15 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:15:26.756 08:54:15 -- common/autotest_common.sh@10 -- # set +x 00:15:26.756 ************************************ 00:15:26.756 START TEST nvmf_multipath 00:15:26.756 ************************************ 00:15:26.756 08:54:15 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:26.756 * Looking for test storage... 00:15:26.756 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:26.756 08:54:15 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:26.756 08:54:15 -- nvmf/common.sh@7 -- # uname -s 00:15:26.756 08:54:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:26.756 08:54:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:26.756 08:54:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:26.756 08:54:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:26.756 08:54:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:26.756 08:54:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:26.756 08:54:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:26.756 08:54:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:26.756 08:54:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:26.756 08:54:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:26.756 08:54:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:26.756 08:54:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:26.756 08:54:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:26.756 08:54:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:26.756 08:54:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:26.756 08:54:15 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:26.756 08:54:15 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:26.756 08:54:15 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:26.756 08:54:15 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:26.756 08:54:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:26.756 08:54:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:26.756 08:54:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:26.756 08:54:15 -- paths/export.sh@5 -- # export PATH 00:15:26.756 08:54:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:26.756 08:54:15 -- nvmf/common.sh@46 -- # : 0 00:15:26.756 08:54:15 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:26.756 08:54:15 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:26.756 08:54:15 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:26.756 08:54:15 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:26.756 08:54:15 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:26.756 08:54:15 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:26.756 08:54:15 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:26.756 08:54:15 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:26.756 08:54:15 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:26.756 08:54:15 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:26.756 08:54:15 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:15:26.756 08:54:15 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:26.756 08:54:15 -- target/multipath.sh@43 -- # nvmftestinit 00:15:26.756 08:54:15 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:26.756 08:54:15 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:26.756 08:54:15 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:26.756 08:54:15 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:26.757 08:54:15 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:26.757 08:54:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:26.757 08:54:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:26.757 08:54:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:26.757 08:54:15 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:26.757 08:54:15 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:26.757 08:54:15 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:26.757 08:54:15 -- common/autotest_common.sh@10 -- # set +x 00:15:28.663 08:54:17 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:28.663 08:54:17 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:28.663 08:54:17 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:28.663 08:54:17 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:28.663 08:54:17 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:28.663 08:54:17 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:28.663 08:54:17 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:28.663 08:54:17 -- nvmf/common.sh@294 -- # net_devs=() 00:15:28.663 08:54:17 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:28.663 08:54:17 -- nvmf/common.sh@295 -- # e810=() 00:15:28.663 08:54:17 -- nvmf/common.sh@295 -- # local -ga e810 00:15:28.663 08:54:17 -- nvmf/common.sh@296 -- # x722=() 00:15:28.663 08:54:17 -- nvmf/common.sh@296 -- # local -ga x722 00:15:28.663 08:54:17 -- nvmf/common.sh@297 -- # mlx=() 00:15:28.663 08:54:17 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:28.663 08:54:17 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:28.663 08:54:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:28.663 08:54:17 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:28.663 08:54:17 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:28.663 08:54:17 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:28.663 08:54:17 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:28.663 08:54:17 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:28.663 08:54:17 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:28.663 08:54:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:28.663 08:54:17 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:28.663 08:54:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:28.663 08:54:17 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:28.663 08:54:17 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:28.663 08:54:17 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:28.663 08:54:17 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:28.663 08:54:17 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:28.663 08:54:17 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:28.663 08:54:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:28.663 08:54:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:28.663 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:28.663 08:54:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:28.663 08:54:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:28.663 08:54:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:28.663 08:54:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:28.663 08:54:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:28.663 08:54:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:28.663 08:54:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:28.663 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:28.663 08:54:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:28.663 08:54:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:28.663 08:54:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:28.663 08:54:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:28.663 08:54:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:28.663 08:54:17 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:28.663 08:54:17 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:28.663 08:54:17 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:28.663 08:54:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:28.663 08:54:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:28.663 08:54:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:28.663 08:54:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:28.663 08:54:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:28.663 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:28.663 08:54:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:28.663 08:54:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:28.664 08:54:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:28.664 08:54:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:28.664 08:54:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:28.664 08:54:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:28.664 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:28.664 08:54:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:28.664 08:54:17 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:28.664 08:54:17 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:28.664 08:54:17 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:28.664 08:54:17 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:28.664 08:54:17 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:28.664 08:54:17 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:28.664 08:54:17 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:28.664 08:54:17 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:28.664 08:54:17 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:28.664 08:54:17 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:28.664 08:54:17 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:28.664 08:54:17 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:28.664 08:54:17 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:28.664 08:54:17 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:28.664 08:54:17 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:28.664 08:54:17 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:28.664 08:54:17 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:28.664 08:54:17 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:28.921 08:54:17 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:28.921 08:54:17 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:28.921 08:54:17 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:28.921 08:54:17 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:28.921 08:54:17 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:28.921 08:54:17 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:28.921 08:54:17 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:28.921 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:28.921 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.131 ms 00:15:28.921 00:15:28.921 --- 10.0.0.2 ping statistics --- 00:15:28.921 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:28.921 rtt min/avg/max/mdev = 0.131/0.131/0.131/0.000 ms 00:15:28.921 08:54:17 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:28.921 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:28.921 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.191 ms 00:15:28.921 00:15:28.921 --- 10.0.0.1 ping statistics --- 00:15:28.921 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:28.921 rtt min/avg/max/mdev = 0.191/0.191/0.191/0.000 ms 00:15:28.921 08:54:17 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:28.921 08:54:17 -- nvmf/common.sh@410 -- # return 0 00:15:28.921 08:54:17 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:28.921 08:54:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:28.921 08:54:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:28.921 08:54:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:28.921 08:54:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:28.921 08:54:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:28.921 08:54:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:28.921 08:54:17 -- target/multipath.sh@45 -- # '[' -z ']' 00:15:28.921 08:54:17 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:15:28.921 only one NIC for nvmf test 00:15:28.921 08:54:17 -- target/multipath.sh@47 -- # nvmftestfini 00:15:28.921 08:54:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:28.921 08:54:17 -- nvmf/common.sh@116 -- # sync 00:15:28.921 08:54:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:28.921 08:54:17 -- nvmf/common.sh@119 -- # set +e 00:15:28.921 08:54:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:28.921 08:54:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:28.921 rmmod nvme_tcp 00:15:28.921 rmmod nvme_fabrics 00:15:28.921 rmmod nvme_keyring 00:15:28.921 08:54:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:28.921 08:54:17 -- nvmf/common.sh@123 -- # set -e 00:15:28.921 08:54:17 -- nvmf/common.sh@124 -- # return 0 00:15:28.921 08:54:17 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:15:28.921 08:54:17 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:28.921 08:54:17 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:28.921 08:54:17 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:28.921 08:54:17 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:28.921 08:54:17 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:28.921 08:54:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:28.921 08:54:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:28.921 08:54:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:31.451 08:54:19 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:31.451 08:54:19 -- target/multipath.sh@48 -- # exit 0 00:15:31.451 08:54:19 -- target/multipath.sh@1 -- # nvmftestfini 00:15:31.451 08:54:19 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:31.451 08:54:19 -- nvmf/common.sh@116 -- # sync 00:15:31.451 08:54:19 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:31.451 08:54:19 -- nvmf/common.sh@119 -- # set +e 00:15:31.451 08:54:19 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:31.451 08:54:19 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:31.451 08:54:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:31.451 08:54:19 -- nvmf/common.sh@123 -- # set -e 00:15:31.451 08:54:19 -- nvmf/common.sh@124 -- # return 0 00:15:31.451 08:54:19 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:15:31.451 08:54:19 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:31.451 08:54:19 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:31.451 08:54:19 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:31.451 08:54:19 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:31.451 08:54:19 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:31.451 08:54:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:31.451 08:54:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:31.451 08:54:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:31.451 08:54:19 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:31.451 00:15:31.451 real 0m4.236s 00:15:31.451 user 0m0.809s 00:15:31.451 sys 0m1.416s 00:15:31.451 08:54:19 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:15:31.451 08:54:19 -- common/autotest_common.sh@10 -- # set +x 00:15:31.451 ************************************ 00:15:31.451 END TEST nvmf_multipath 00:15:31.451 ************************************ 00:15:31.451 08:54:19 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:15:31.451 08:54:19 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:15:31.451 08:54:19 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:15:31.451 08:54:19 -- common/autotest_common.sh@10 -- # set +x 00:15:31.451 ************************************ 00:15:31.451 START TEST nvmf_zcopy 00:15:31.451 ************************************ 00:15:31.451 08:54:19 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:15:31.451 * Looking for test storage... 00:15:31.451 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:31.451 08:54:19 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:31.451 08:54:19 -- nvmf/common.sh@7 -- # uname -s 00:15:31.451 08:54:19 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:31.451 08:54:19 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:31.451 08:54:19 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:31.451 08:54:19 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:31.451 08:54:19 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:31.451 08:54:19 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:31.451 08:54:19 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:31.451 08:54:19 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:31.451 08:54:19 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:31.451 08:54:19 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:31.451 08:54:19 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:31.451 08:54:19 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:31.451 08:54:19 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:31.451 08:54:19 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:31.451 08:54:19 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:31.451 08:54:19 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:31.451 08:54:19 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:31.451 08:54:19 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:31.451 08:54:19 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:31.451 08:54:19 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:31.451 08:54:19 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:31.451 08:54:19 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:31.452 08:54:19 -- paths/export.sh@5 -- # export PATH 00:15:31.452 08:54:19 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:31.452 08:54:19 -- nvmf/common.sh@46 -- # : 0 00:15:31.452 08:54:19 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:31.452 08:54:19 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:31.452 08:54:19 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:31.452 08:54:19 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:31.452 08:54:19 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:31.452 08:54:19 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:31.452 08:54:19 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:31.452 08:54:19 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:31.452 08:54:19 -- target/zcopy.sh@12 -- # nvmftestinit 00:15:31.452 08:54:19 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:31.452 08:54:19 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:31.452 08:54:19 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:31.452 08:54:19 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:31.452 08:54:19 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:31.452 08:54:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:31.452 08:54:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:31.452 08:54:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:31.452 08:54:19 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:31.452 08:54:19 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:31.452 08:54:19 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:31.452 08:54:19 -- common/autotest_common.sh@10 -- # set +x 00:15:33.416 08:54:21 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:33.416 08:54:21 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:33.416 08:54:21 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:33.416 08:54:21 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:33.416 08:54:21 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:33.416 08:54:21 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:33.416 08:54:21 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:33.416 08:54:21 -- nvmf/common.sh@294 -- # net_devs=() 00:15:33.416 08:54:21 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:33.416 08:54:21 -- nvmf/common.sh@295 -- # e810=() 00:15:33.416 08:54:21 -- nvmf/common.sh@295 -- # local -ga e810 00:15:33.416 08:54:21 -- nvmf/common.sh@296 -- # x722=() 00:15:33.416 08:54:21 -- nvmf/common.sh@296 -- # local -ga x722 00:15:33.416 08:54:21 -- nvmf/common.sh@297 -- # mlx=() 00:15:33.416 08:54:21 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:33.416 08:54:21 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:33.416 08:54:21 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:33.416 08:54:21 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:33.416 08:54:21 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:33.416 08:54:21 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:33.416 08:54:21 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:33.416 08:54:21 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:33.416 08:54:21 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:33.416 08:54:21 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:33.416 08:54:21 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:33.416 08:54:21 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:33.416 08:54:21 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:33.416 08:54:21 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:33.416 08:54:21 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:33.416 08:54:21 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:33.416 08:54:21 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:33.416 08:54:21 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:33.416 08:54:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:33.416 08:54:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:33.416 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:33.416 08:54:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:33.416 08:54:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:33.416 08:54:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:33.416 08:54:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:33.416 08:54:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:33.416 08:54:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:33.416 08:54:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:33.416 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:33.416 08:54:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:33.416 08:54:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:33.416 08:54:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:33.416 08:54:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:33.416 08:54:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:33.416 08:54:21 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:33.416 08:54:21 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:33.416 08:54:21 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:33.416 08:54:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:33.416 08:54:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:33.416 08:54:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:33.416 08:54:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:33.416 08:54:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:33.416 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:33.416 08:54:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:33.416 08:54:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:33.416 08:54:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:33.416 08:54:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:33.416 08:54:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:33.416 08:54:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:33.416 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:33.416 08:54:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:33.416 08:54:21 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:33.416 08:54:21 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:33.416 08:54:21 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:33.416 08:54:21 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:33.416 08:54:21 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:33.416 08:54:21 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:33.416 08:54:21 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:33.416 08:54:21 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:33.416 08:54:21 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:33.416 08:54:21 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:33.416 08:54:21 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:33.416 08:54:21 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:33.416 08:54:21 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:33.416 08:54:21 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:33.416 08:54:21 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:33.416 08:54:21 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:33.416 08:54:21 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:33.416 08:54:21 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:33.416 08:54:21 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:33.416 08:54:21 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:33.416 08:54:21 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:33.416 08:54:21 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:33.416 08:54:21 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:33.416 08:54:21 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:33.416 08:54:21 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:33.416 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:33.416 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.131 ms 00:15:33.416 00:15:33.416 --- 10.0.0.2 ping statistics --- 00:15:33.416 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:33.416 rtt min/avg/max/mdev = 0.131/0.131/0.131/0.000 ms 00:15:33.416 08:54:21 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:33.416 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:33.416 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.107 ms 00:15:33.416 00:15:33.416 --- 10.0.0.1 ping statistics --- 00:15:33.416 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:33.416 rtt min/avg/max/mdev = 0.107/0.107/0.107/0.000 ms 00:15:33.416 08:54:21 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:33.416 08:54:21 -- nvmf/common.sh@410 -- # return 0 00:15:33.416 08:54:21 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:33.416 08:54:21 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:33.416 08:54:21 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:33.416 08:54:21 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:33.416 08:54:21 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:33.416 08:54:21 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:33.416 08:54:21 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:33.416 08:54:21 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:15:33.416 08:54:21 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:33.416 08:54:21 -- common/autotest_common.sh@712 -- # xtrace_disable 00:15:33.416 08:54:21 -- common/autotest_common.sh@10 -- # set +x 00:15:33.416 08:54:21 -- nvmf/common.sh@469 -- # nvmfpid=1496956 00:15:33.416 08:54:21 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:33.416 08:54:21 -- nvmf/common.sh@470 -- # waitforlisten 1496956 00:15:33.416 08:54:21 -- common/autotest_common.sh@819 -- # '[' -z 1496956 ']' 00:15:33.416 08:54:21 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:33.416 08:54:21 -- common/autotest_common.sh@824 -- # local max_retries=100 00:15:33.416 08:54:21 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:33.416 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:33.416 08:54:21 -- common/autotest_common.sh@828 -- # xtrace_disable 00:15:33.416 08:54:21 -- common/autotest_common.sh@10 -- # set +x 00:15:33.416 [2024-07-15 08:54:21.665138] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:15:33.416 [2024-07-15 08:54:21.665249] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:33.416 EAL: No free 2048 kB hugepages reported on node 1 00:15:33.416 [2024-07-15 08:54:21.727989] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:33.416 [2024-07-15 08:54:21.830915] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:33.416 [2024-07-15 08:54:21.831065] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:33.416 [2024-07-15 08:54:21.831082] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:33.416 [2024-07-15 08:54:21.831094] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:33.416 [2024-07-15 08:54:21.831120] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:34.352 08:54:22 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:15:34.352 08:54:22 -- common/autotest_common.sh@852 -- # return 0 00:15:34.352 08:54:22 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:34.352 08:54:22 -- common/autotest_common.sh@718 -- # xtrace_disable 00:15:34.352 08:54:22 -- common/autotest_common.sh@10 -- # set +x 00:15:34.352 08:54:22 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:34.352 08:54:22 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:15:34.352 08:54:22 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:15:34.352 08:54:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:34.352 08:54:22 -- common/autotest_common.sh@10 -- # set +x 00:15:34.352 [2024-07-15 08:54:22.675861] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:34.352 08:54:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:34.352 08:54:22 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:34.352 08:54:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:34.352 08:54:22 -- common/autotest_common.sh@10 -- # set +x 00:15:34.352 08:54:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:34.352 08:54:22 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:34.352 08:54:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:34.352 08:54:22 -- common/autotest_common.sh@10 -- # set +x 00:15:34.352 [2024-07-15 08:54:22.692039] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:34.352 08:54:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:34.352 08:54:22 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:34.352 08:54:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:34.352 08:54:22 -- common/autotest_common.sh@10 -- # set +x 00:15:34.352 08:54:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:34.352 08:54:22 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:15:34.352 08:54:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:34.353 08:54:22 -- common/autotest_common.sh@10 -- # set +x 00:15:34.353 malloc0 00:15:34.353 08:54:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:34.353 08:54:22 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:15:34.353 08:54:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:34.353 08:54:22 -- common/autotest_common.sh@10 -- # set +x 00:15:34.353 08:54:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:34.353 08:54:22 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:15:34.353 08:54:22 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:15:34.353 08:54:22 -- nvmf/common.sh@520 -- # config=() 00:15:34.353 08:54:22 -- nvmf/common.sh@520 -- # local subsystem config 00:15:34.353 08:54:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:34.353 08:54:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:34.353 { 00:15:34.353 "params": { 00:15:34.353 "name": "Nvme$subsystem", 00:15:34.353 "trtype": "$TEST_TRANSPORT", 00:15:34.353 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:34.353 "adrfam": "ipv4", 00:15:34.353 "trsvcid": "$NVMF_PORT", 00:15:34.353 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:34.353 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:34.353 "hdgst": ${hdgst:-false}, 00:15:34.353 "ddgst": ${ddgst:-false} 00:15:34.353 }, 00:15:34.353 "method": "bdev_nvme_attach_controller" 00:15:34.353 } 00:15:34.353 EOF 00:15:34.353 )") 00:15:34.353 08:54:22 -- nvmf/common.sh@542 -- # cat 00:15:34.353 08:54:22 -- nvmf/common.sh@544 -- # jq . 00:15:34.353 08:54:22 -- nvmf/common.sh@545 -- # IFS=, 00:15:34.353 08:54:22 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:34.353 "params": { 00:15:34.353 "name": "Nvme1", 00:15:34.353 "trtype": "tcp", 00:15:34.353 "traddr": "10.0.0.2", 00:15:34.353 "adrfam": "ipv4", 00:15:34.353 "trsvcid": "4420", 00:15:34.353 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:34.353 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:34.353 "hdgst": false, 00:15:34.353 "ddgst": false 00:15:34.353 }, 00:15:34.353 "method": "bdev_nvme_attach_controller" 00:15:34.353 }' 00:15:34.353 [2024-07-15 08:54:22.771014] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:15:34.353 [2024-07-15 08:54:22.771091] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1497087 ] 00:15:34.353 EAL: No free 2048 kB hugepages reported on node 1 00:15:34.353 [2024-07-15 08:54:22.837441] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:34.610 [2024-07-15 08:54:22.956000] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:34.610 Running I/O for 10 seconds... 00:15:46.814 00:15:46.814 Latency(us) 00:15:46.814 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:46.814 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:15:46.814 Verification LBA range: start 0x0 length 0x1000 00:15:46.814 Nvme1n1 : 10.02 5773.98 45.11 0.00 0.00 22121.80 1784.04 31651.46 00:15:46.814 =================================================================================================================== 00:15:46.814 Total : 5773.98 45.11 0.00 0.00 22121.80 1784.04 31651.46 00:15:46.814 08:54:33 -- target/zcopy.sh@39 -- # perfpid=1498405 00:15:46.814 08:54:33 -- target/zcopy.sh@41 -- # xtrace_disable 00:15:46.814 08:54:33 -- common/autotest_common.sh@10 -- # set +x 00:15:46.814 08:54:33 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:15:46.814 08:54:33 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:15:46.814 08:54:33 -- nvmf/common.sh@520 -- # config=() 00:15:46.814 08:54:33 -- nvmf/common.sh@520 -- # local subsystem config 00:15:46.814 08:54:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:46.814 08:54:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:46.814 { 00:15:46.814 "params": { 00:15:46.814 "name": "Nvme$subsystem", 00:15:46.814 "trtype": "$TEST_TRANSPORT", 00:15:46.814 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:46.814 "adrfam": "ipv4", 00:15:46.814 "trsvcid": "$NVMF_PORT", 00:15:46.814 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:46.814 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:46.814 "hdgst": ${hdgst:-false}, 00:15:46.814 "ddgst": ${ddgst:-false} 00:15:46.814 }, 00:15:46.814 "method": "bdev_nvme_attach_controller" 00:15:46.814 } 00:15:46.814 EOF 00:15:46.814 )") 00:15:46.814 08:54:33 -- nvmf/common.sh@542 -- # cat 00:15:46.814 [2024-07-15 08:54:33.469175] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.469221] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 08:54:33 -- nvmf/common.sh@544 -- # jq . 00:15:46.814 08:54:33 -- nvmf/common.sh@545 -- # IFS=, 00:15:46.814 08:54:33 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:46.814 "params": { 00:15:46.814 "name": "Nvme1", 00:15:46.814 "trtype": "tcp", 00:15:46.814 "traddr": "10.0.0.2", 00:15:46.814 "adrfam": "ipv4", 00:15:46.814 "trsvcid": "4420", 00:15:46.814 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:46.814 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:46.814 "hdgst": false, 00:15:46.814 "ddgst": false 00:15:46.814 }, 00:15:46.814 "method": "bdev_nvme_attach_controller" 00:15:46.814 }' 00:15:46.814 [2024-07-15 08:54:33.477130] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.477157] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 [2024-07-15 08:54:33.485151] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.485176] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 [2024-07-15 08:54:33.493173] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.493198] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 [2024-07-15 08:54:33.501194] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.501218] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 [2024-07-15 08:54:33.504425] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:15:46.814 [2024-07-15 08:54:33.504502] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1498405 ] 00:15:46.814 [2024-07-15 08:54:33.509215] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.509251] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 [2024-07-15 08:54:33.517241] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.517266] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 [2024-07-15 08:54:33.525260] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.525285] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 EAL: No free 2048 kB hugepages reported on node 1 00:15:46.814 [2024-07-15 08:54:33.533281] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.533306] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 [2024-07-15 08:54:33.541302] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.541327] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 [2024-07-15 08:54:33.549325] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.549349] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 [2024-07-15 08:54:33.557347] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.557371] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 [2024-07-15 08:54:33.565372] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.565396] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 [2024-07-15 08:54:33.568504] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:46.814 [2024-07-15 08:54:33.573413] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.573444] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 [2024-07-15 08:54:33.581446] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.581483] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 [2024-07-15 08:54:33.589438] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.589462] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 [2024-07-15 08:54:33.597459] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.597506] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 [2024-07-15 08:54:33.605480] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.605506] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 [2024-07-15 08:54:33.613502] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.613528] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 [2024-07-15 08:54:33.621527] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.621552] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 [2024-07-15 08:54:33.629549] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.629574] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 [2024-07-15 08:54:33.637603] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.637640] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 [2024-07-15 08:54:33.645597] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.645623] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 [2024-07-15 08:54:33.653615] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.653640] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 [2024-07-15 08:54:33.661639] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.661665] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 [2024-07-15 08:54:33.669660] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.669684] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 [2024-07-15 08:54:33.677683] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.677708] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 [2024-07-15 08:54:33.685521] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:46.814 [2024-07-15 08:54:33.685704] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.685729] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 [2024-07-15 08:54:33.693729] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.693753] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 [2024-07-15 08:54:33.701776] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.701809] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 [2024-07-15 08:54:33.709802] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.709840] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 [2024-07-15 08:54:33.717830] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.717870] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 [2024-07-15 08:54:33.725846] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.725894] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 [2024-07-15 08:54:33.733889] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.733930] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 [2024-07-15 08:54:33.741898] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.741938] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 [2024-07-15 08:54:33.749895] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.749920] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 [2024-07-15 08:54:33.757942] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.757980] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 [2024-07-15 08:54:33.765967] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.766007] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 [2024-07-15 08:54:33.773966] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.773995] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 [2024-07-15 08:54:33.781979] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.782004] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 [2024-07-15 08:54:33.789999] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.790024] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 [2024-07-15 08:54:33.798035] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.798065] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 [2024-07-15 08:54:33.806055] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.814 [2024-07-15 08:54:33.806082] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.814 [2024-07-15 08:54:33.814080] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:33.814108] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:33.822105] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:33.822134] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:33.830120] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:33.830145] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:33.838141] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:33.838176] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:33.846165] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:33.846189] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:33.854191] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:33.854216] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:33.862216] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:33.862242] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:33.870242] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:33.870269] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:33.878266] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:33.878294] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:33.886285] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:33.886310] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:33.894309] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:33.894342] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:33.902334] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:33.902359] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:33.910356] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:33.910380] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:33.918383] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:33.918409] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:33.926413] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:33.926439] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:33.934426] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:33.934450] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:33.942449] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:33.942473] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:33.950473] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:33.950497] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:33.958495] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:33.958520] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:33.966518] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:33.966543] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:33.974540] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:33.974564] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:33.982568] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:33.982598] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 Running I/O for 5 seconds... 00:15:46.815 [2024-07-15 08:54:33.990591] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:33.990618] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.004587] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.004619] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.014995] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.015027] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.025833] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.025865] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.036899] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.036931] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.047891] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.047922] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.058678] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.058710] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.069709] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.069747] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.082663] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.082694] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.092872] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.092913] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.104719] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.104750] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.115287] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.115318] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.126118] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.126148] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.137489] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.137519] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.148715] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.148745] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.160097] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.160127] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.173063] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.173095] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.182668] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.182710] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.194128] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.194159] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.205333] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.205364] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.216452] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.216483] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.229560] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.229591] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.239861] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.239903] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.251448] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.251480] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.262128] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.262158] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.272557] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.272588] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.283333] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.283371] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.294138] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.294168] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.305208] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.305239] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.316401] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.316433] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.327597] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.327629] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.340224] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.340255] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.349375] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.349405] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.361495] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.361525] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.372544] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.372575] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.383361] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.383392] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.394763] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.394794] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.405672] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.405704] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.416594] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.416625] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.429730] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.429761] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.439528] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.439558] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.450595] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.450625] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.461070] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.461100] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.471956] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.471987] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.484845] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.484884] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.495084] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.495114] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.506229] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.506259] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.519051] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.519082] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.529364] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.529395] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.539887] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.539917] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.550161] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.550191] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.561102] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.561133] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.574523] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.574553] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.584175] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.584206] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.595509] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.595539] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.608579] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.608610] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.619096] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.619126] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.629564] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.629594] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.640604] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.640635] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.651293] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.651324] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.664057] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.664087] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.674245] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.674276] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.685189] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.685220] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.697803] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.697833] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.708117] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.708149] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.718742] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.718774] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.731992] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.732023] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.741691] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.741722] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.752898] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.752929] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.766114] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.766144] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.776479] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.776510] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.815 [2024-07-15 08:54:34.787421] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.815 [2024-07-15 08:54:34.787452] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:34.800077] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:34.800108] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:34.810261] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:34.810291] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:34.821382] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:34.821412] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:34.834351] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:34.834383] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:34.844322] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:34.844352] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:34.856218] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:34.856249] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:34.867475] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:34.867505] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:34.880020] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:34.880051] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:34.890057] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:34.890088] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:34.901632] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:34.901663] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:34.912363] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:34.912394] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:34.923495] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:34.923526] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:34.934569] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:34.934600] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:34.945320] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:34.945350] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:34.955975] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:34.956006] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:34.966913] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:34.966943] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:34.977821] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:34.977852] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:34.989348] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:34.989378] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:35.000794] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:35.000824] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:35.011897] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:35.011928] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:35.022782] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:35.022812] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:35.034171] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:35.034201] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:35.047031] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:35.047061] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:35.057186] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:35.057217] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:35.068667] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:35.068697] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:35.079745] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:35.079775] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:35.092526] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:35.092556] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:35.102936] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:35.102966] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:35.114487] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:35.114517] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:35.125486] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:35.125516] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:35.137984] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:35.138014] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:35.148214] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:35.148245] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:35.159500] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:35.159530] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:35.170682] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:35.170712] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:35.181910] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:35.181940] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:35.192639] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:35.192669] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:35.203596] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:35.203637] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:35.216632] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:35.216662] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:35.226806] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:35.226837] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:35.238233] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:35.238264] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:35.249451] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:35.249493] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:35.262379] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:35.262410] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:35.272338] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:35.272369] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:35.284014] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:35.284044] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:35.294837] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:35.294886] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:35.306015] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:35.306046] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:35.319083] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:35.319113] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:35.329257] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:35.329288] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:35.340476] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:35.340517] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.816 [2024-07-15 08:54:35.351579] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.816 [2024-07-15 08:54:35.351609] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.075 [2024-07-15 08:54:35.362513] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.075 [2024-07-15 08:54:35.362543] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.075 [2024-07-15 08:54:35.375874] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.075 [2024-07-15 08:54:35.375915] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.075 [2024-07-15 08:54:35.386627] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.075 [2024-07-15 08:54:35.386657] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.075 [2024-07-15 08:54:35.397870] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.075 [2024-07-15 08:54:35.397909] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.075 [2024-07-15 08:54:35.409011] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.075 [2024-07-15 08:54:35.409057] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.075 [2024-07-15 08:54:35.419936] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.075 [2024-07-15 08:54:35.419966] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.075 [2024-07-15 08:54:35.432660] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.075 [2024-07-15 08:54:35.432690] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.075 [2024-07-15 08:54:35.442835] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.075 [2024-07-15 08:54:35.442866] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.075 [2024-07-15 08:54:35.454347] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.075 [2024-07-15 08:54:35.454377] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.076 [2024-07-15 08:54:35.465504] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.076 [2024-07-15 08:54:35.465535] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.076 [2024-07-15 08:54:35.476138] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.076 [2024-07-15 08:54:35.476169] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.076 [2024-07-15 08:54:35.486996] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.076 [2024-07-15 08:54:35.487028] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.076 [2024-07-15 08:54:35.498285] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.076 [2024-07-15 08:54:35.498316] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.076 [2024-07-15 08:54:35.509434] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.076 [2024-07-15 08:54:35.509466] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.076 [2024-07-15 08:54:35.520644] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.076 [2024-07-15 08:54:35.520675] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.076 [2024-07-15 08:54:35.531833] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.076 [2024-07-15 08:54:35.531864] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.076 [2024-07-15 08:54:35.542409] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.076 [2024-07-15 08:54:35.542440] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.076 [2024-07-15 08:54:35.553605] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.076 [2024-07-15 08:54:35.553645] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.076 [2024-07-15 08:54:35.566851] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.076 [2024-07-15 08:54:35.566891] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.076 [2024-07-15 08:54:35.577399] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.076 [2024-07-15 08:54:35.577430] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.076 [2024-07-15 08:54:35.589105] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.076 [2024-07-15 08:54:35.589135] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.076 [2024-07-15 08:54:35.599984] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.076 [2024-07-15 08:54:35.600015] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.076 [2024-07-15 08:54:35.612816] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.076 [2024-07-15 08:54:35.612846] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.336 [2024-07-15 08:54:35.623034] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.336 [2024-07-15 08:54:35.623065] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.336 [2024-07-15 08:54:35.633677] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.336 [2024-07-15 08:54:35.633707] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.336 [2024-07-15 08:54:35.646782] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.336 [2024-07-15 08:54:35.646813] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.336 [2024-07-15 08:54:35.657150] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.336 [2024-07-15 08:54:35.657181] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.336 [2024-07-15 08:54:35.668261] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.336 [2024-07-15 08:54:35.668292] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.336 [2024-07-15 08:54:35.680825] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.336 [2024-07-15 08:54:35.680856] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.336 [2024-07-15 08:54:35.691095] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.336 [2024-07-15 08:54:35.691125] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.336 [2024-07-15 08:54:35.701707] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.336 [2024-07-15 08:54:35.701737] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.336 [2024-07-15 08:54:35.714199] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.336 [2024-07-15 08:54:35.714229] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.336 [2024-07-15 08:54:35.724228] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.336 [2024-07-15 08:54:35.724258] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.336 [2024-07-15 08:54:35.736042] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.336 [2024-07-15 08:54:35.736072] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.336 [2024-07-15 08:54:35.747092] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.336 [2024-07-15 08:54:35.747122] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.336 [2024-07-15 08:54:35.758144] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.336 [2024-07-15 08:54:35.758175] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.336 [2024-07-15 08:54:35.768780] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.336 [2024-07-15 08:54:35.768820] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.336 [2024-07-15 08:54:35.781198] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.336 [2024-07-15 08:54:35.781228] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.336 [2024-07-15 08:54:35.791117] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.336 [2024-07-15 08:54:35.791148] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.336 [2024-07-15 08:54:35.802208] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.336 [2024-07-15 08:54:35.802238] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.336 [2024-07-15 08:54:35.812954] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.336 [2024-07-15 08:54:35.812984] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.336 [2024-07-15 08:54:35.823948] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.336 [2024-07-15 08:54:35.823978] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.336 [2024-07-15 08:54:35.834817] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.336 [2024-07-15 08:54:35.834847] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.336 [2024-07-15 08:54:35.845724] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.336 [2024-07-15 08:54:35.845754] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.336 [2024-07-15 08:54:35.858465] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.336 [2024-07-15 08:54:35.858496] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.336 [2024-07-15 08:54:35.868239] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.336 [2024-07-15 08:54:35.868269] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.595 [2024-07-15 08:54:35.879867] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.595 [2024-07-15 08:54:35.879909] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.595 [2024-07-15 08:54:35.890886] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.595 [2024-07-15 08:54:35.890916] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.595 [2024-07-15 08:54:35.901801] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.595 [2024-07-15 08:54:35.901832] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.595 [2024-07-15 08:54:35.912922] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.595 [2024-07-15 08:54:35.912952] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.595 [2024-07-15 08:54:35.924086] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.595 [2024-07-15 08:54:35.924117] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.595 [2024-07-15 08:54:35.935302] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.595 [2024-07-15 08:54:35.935333] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.595 [2024-07-15 08:54:35.946326] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.595 [2024-07-15 08:54:35.946357] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.595 [2024-07-15 08:54:35.957417] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.595 [2024-07-15 08:54:35.957448] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.595 [2024-07-15 08:54:35.968335] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.595 [2024-07-15 08:54:35.968366] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.595 [2024-07-15 08:54:35.979256] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.595 [2024-07-15 08:54:35.979295] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.595 [2024-07-15 08:54:35.989917] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.595 [2024-07-15 08:54:35.989948] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.595 [2024-07-15 08:54:36.002666] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.595 [2024-07-15 08:54:36.002697] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.595 [2024-07-15 08:54:36.012837] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.595 [2024-07-15 08:54:36.012868] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.595 [2024-07-15 08:54:36.023845] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.595 [2024-07-15 08:54:36.023884] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.595 [2024-07-15 08:54:36.036817] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.595 [2024-07-15 08:54:36.036848] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.595 [2024-07-15 08:54:36.047161] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.595 [2024-07-15 08:54:36.047192] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.595 [2024-07-15 08:54:36.058215] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.595 [2024-07-15 08:54:36.058247] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.595 [2024-07-15 08:54:36.069185] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.595 [2024-07-15 08:54:36.069216] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.595 [2024-07-15 08:54:36.080095] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.595 [2024-07-15 08:54:36.080126] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.595 [2024-07-15 08:54:36.093264] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.595 [2024-07-15 08:54:36.093294] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.595 [2024-07-15 08:54:36.103126] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.595 [2024-07-15 08:54:36.103156] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.595 [2024-07-15 08:54:36.113918] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.595 [2024-07-15 08:54:36.113949] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.595 [2024-07-15 08:54:36.124643] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.595 [2024-07-15 08:54:36.124674] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.595 [2024-07-15 08:54:36.135472] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.595 [2024-07-15 08:54:36.135502] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.853 [2024-07-15 08:54:36.146556] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.853 [2024-07-15 08:54:36.146588] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.853 [2024-07-15 08:54:36.157640] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.853 [2024-07-15 08:54:36.157670] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.853 [2024-07-15 08:54:36.170351] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.853 [2024-07-15 08:54:36.170381] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.853 [2024-07-15 08:54:36.180778] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.853 [2024-07-15 08:54:36.180808] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.853 [2024-07-15 08:54:36.192649] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.853 [2024-07-15 08:54:36.192679] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.853 [2024-07-15 08:54:36.203573] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.853 [2024-07-15 08:54:36.203603] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.853 [2024-07-15 08:54:36.214783] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.853 [2024-07-15 08:54:36.214814] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.853 [2024-07-15 08:54:36.225594] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.853 [2024-07-15 08:54:36.225623] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.854 [2024-07-15 08:54:36.238801] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.854 [2024-07-15 08:54:36.238831] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.854 [2024-07-15 08:54:36.249179] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.854 [2024-07-15 08:54:36.249209] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.854 [2024-07-15 08:54:36.260000] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.854 [2024-07-15 08:54:36.260032] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.854 [2024-07-15 08:54:36.270794] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.854 [2024-07-15 08:54:36.270825] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.854 [2024-07-15 08:54:36.281568] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.854 [2024-07-15 08:54:36.281598] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.854 [2024-07-15 08:54:36.294227] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.854 [2024-07-15 08:54:36.294258] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.854 [2024-07-15 08:54:36.304829] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.854 [2024-07-15 08:54:36.304861] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.854 [2024-07-15 08:54:36.316035] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.854 [2024-07-15 08:54:36.316076] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.854 [2024-07-15 08:54:36.326635] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.854 [2024-07-15 08:54:36.326666] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.854 [2024-07-15 08:54:36.337787] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.854 [2024-07-15 08:54:36.337819] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.854 [2024-07-15 08:54:36.349055] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.854 [2024-07-15 08:54:36.349090] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.854 [2024-07-15 08:54:36.360270] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.854 [2024-07-15 08:54:36.360306] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.854 [2024-07-15 08:54:36.371720] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.854 [2024-07-15 08:54:36.371751] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.854 [2024-07-15 08:54:36.382950] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.854 [2024-07-15 08:54:36.382980] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:47.854 [2024-07-15 08:54:36.393953] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:47.854 [2024-07-15 08:54:36.393983] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.112 [2024-07-15 08:54:36.404776] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.112 [2024-07-15 08:54:36.404807] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.112 [2024-07-15 08:54:36.415860] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.112 [2024-07-15 08:54:36.415899] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.112 [2024-07-15 08:54:36.429123] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.112 [2024-07-15 08:54:36.429154] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.112 [2024-07-15 08:54:36.439498] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.112 [2024-07-15 08:54:36.439530] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.112 [2024-07-15 08:54:36.450476] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.112 [2024-07-15 08:54:36.450507] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.112 [2024-07-15 08:54:36.461902] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.112 [2024-07-15 08:54:36.461932] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.112 [2024-07-15 08:54:36.472696] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.112 [2024-07-15 08:54:36.472726] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.112 [2024-07-15 08:54:36.485501] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.112 [2024-07-15 08:54:36.485530] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.112 [2024-07-15 08:54:36.495500] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.112 [2024-07-15 08:54:36.495530] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.112 [2024-07-15 08:54:36.506646] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.112 [2024-07-15 08:54:36.506676] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.112 [2024-07-15 08:54:36.517827] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.112 [2024-07-15 08:54:36.517857] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.112 [2024-07-15 08:54:36.528782] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.112 [2024-07-15 08:54:36.528815] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.112 [2024-07-15 08:54:36.539758] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.112 [2024-07-15 08:54:36.539788] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.112 [2024-07-15 08:54:36.551193] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.112 [2024-07-15 08:54:36.551223] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.112 [2024-07-15 08:54:36.561962] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.112 [2024-07-15 08:54:36.561992] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.112 [2024-07-15 08:54:36.572736] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.112 [2024-07-15 08:54:36.572766] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.112 [2024-07-15 08:54:36.586101] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.112 [2024-07-15 08:54:36.586131] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.112 [2024-07-15 08:54:36.596108] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.112 [2024-07-15 08:54:36.596139] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.112 [2024-07-15 08:54:36.606588] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.112 [2024-07-15 08:54:36.606630] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.112 [2024-07-15 08:54:36.617344] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.112 [2024-07-15 08:54:36.617374] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.113 [2024-07-15 08:54:36.627952] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.113 [2024-07-15 08:54:36.627983] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.113 [2024-07-15 08:54:36.639213] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.113 [2024-07-15 08:54:36.639243] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.113 [2024-07-15 08:54:36.649831] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.113 [2024-07-15 08:54:36.649861] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.373 [2024-07-15 08:54:36.662429] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.373 [2024-07-15 08:54:36.662459] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.373 [2024-07-15 08:54:36.672377] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.373 [2024-07-15 08:54:36.672406] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.373 [2024-07-15 08:54:36.683428] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.373 [2024-07-15 08:54:36.683458] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.373 [2024-07-15 08:54:36.694680] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.373 [2024-07-15 08:54:36.694710] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.373 [2024-07-15 08:54:36.706292] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.373 [2024-07-15 08:54:36.706322] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.373 [2024-07-15 08:54:36.717532] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.373 [2024-07-15 08:54:36.717562] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.373 [2024-07-15 08:54:36.728367] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.373 [2024-07-15 08:54:36.728396] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.373 [2024-07-15 08:54:36.739622] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.373 [2024-07-15 08:54:36.739652] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.373 [2024-07-15 08:54:36.752685] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.373 [2024-07-15 08:54:36.752716] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.373 [2024-07-15 08:54:36.762439] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.373 [2024-07-15 08:54:36.762468] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.373 [2024-07-15 08:54:36.774446] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.373 [2024-07-15 08:54:36.774476] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.373 [2024-07-15 08:54:36.785599] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.373 [2024-07-15 08:54:36.785629] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.373 [2024-07-15 08:54:36.796790] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.373 [2024-07-15 08:54:36.796820] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.373 [2024-07-15 08:54:36.807549] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.373 [2024-07-15 08:54:36.807579] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.373 [2024-07-15 08:54:36.818342] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.373 [2024-07-15 08:54:36.818372] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.373 [2024-07-15 08:54:36.829408] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.373 [2024-07-15 08:54:36.829437] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.373 [2024-07-15 08:54:36.842029] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.373 [2024-07-15 08:54:36.842059] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.373 [2024-07-15 08:54:36.851841] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.373 [2024-07-15 08:54:36.851871] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.373 [2024-07-15 08:54:36.862952] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.373 [2024-07-15 08:54:36.862982] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.373 [2024-07-15 08:54:36.873346] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.373 [2024-07-15 08:54:36.873377] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.373 [2024-07-15 08:54:36.884520] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.373 [2024-07-15 08:54:36.884550] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.373 [2024-07-15 08:54:36.897416] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.373 [2024-07-15 08:54:36.897446] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.373 [2024-07-15 08:54:36.907592] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.373 [2024-07-15 08:54:36.907622] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.634 [2024-07-15 08:54:36.918739] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.634 [2024-07-15 08:54:36.918770] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.634 [2024-07-15 08:54:36.929558] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.634 [2024-07-15 08:54:36.929589] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.634 [2024-07-15 08:54:36.940408] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.634 [2024-07-15 08:54:36.940439] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.634 [2024-07-15 08:54:36.951367] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.634 [2024-07-15 08:54:36.951398] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.634 [2024-07-15 08:54:36.962371] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.634 [2024-07-15 08:54:36.962403] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.634 [2024-07-15 08:54:36.973185] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.634 [2024-07-15 08:54:36.973216] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.634 [2024-07-15 08:54:36.983996] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.634 [2024-07-15 08:54:36.984026] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.634 [2024-07-15 08:54:36.994759] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.634 [2024-07-15 08:54:36.994790] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.634 [2024-07-15 08:54:37.005379] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.634 [2024-07-15 08:54:37.005410] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.634 [2024-07-15 08:54:37.016294] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.634 [2024-07-15 08:54:37.016325] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.634 [2024-07-15 08:54:37.027454] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.634 [2024-07-15 08:54:37.027494] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.634 [2024-07-15 08:54:37.038159] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.634 [2024-07-15 08:54:37.038190] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.634 [2024-07-15 08:54:37.049250] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.634 [2024-07-15 08:54:37.049280] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.634 [2024-07-15 08:54:37.062271] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.634 [2024-07-15 08:54:37.062301] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.634 [2024-07-15 08:54:37.073030] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.634 [2024-07-15 08:54:37.073075] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.634 [2024-07-15 08:54:37.083920] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.634 [2024-07-15 08:54:37.083951] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.634 [2024-07-15 08:54:37.094840] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.634 [2024-07-15 08:54:37.094870] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.634 [2024-07-15 08:54:37.105911] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.634 [2024-07-15 08:54:37.105951] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.634 [2024-07-15 08:54:37.116632] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.634 [2024-07-15 08:54:37.116664] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.634 [2024-07-15 08:54:37.127378] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.634 [2024-07-15 08:54:37.127409] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.634 [2024-07-15 08:54:37.140215] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.634 [2024-07-15 08:54:37.140247] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.634 [2024-07-15 08:54:37.150205] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.634 [2024-07-15 08:54:37.150235] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.634 [2024-07-15 08:54:37.161705] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.634 [2024-07-15 08:54:37.161736] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.634 [2024-07-15 08:54:37.172275] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.634 [2024-07-15 08:54:37.172305] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.894 [2024-07-15 08:54:37.183320] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.894 [2024-07-15 08:54:37.183351] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.894 [2024-07-15 08:54:37.196365] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.894 [2024-07-15 08:54:37.196396] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.894 [2024-07-15 08:54:37.206657] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.894 [2024-07-15 08:54:37.206688] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.894 [2024-07-15 08:54:37.218365] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.894 [2024-07-15 08:54:37.218396] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.894 [2024-07-15 08:54:37.228984] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.894 [2024-07-15 08:54:37.229014] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.894 [2024-07-15 08:54:37.239842] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.894 [2024-07-15 08:54:37.239888] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.894 [2024-07-15 08:54:37.250966] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.894 [2024-07-15 08:54:37.250996] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.894 [2024-07-15 08:54:37.262150] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.894 [2024-07-15 08:54:37.262180] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.894 [2024-07-15 08:54:37.273545] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.894 [2024-07-15 08:54:37.273576] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.894 [2024-07-15 08:54:37.284862] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.894 [2024-07-15 08:54:37.284902] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.894 [2024-07-15 08:54:37.296680] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.894 [2024-07-15 08:54:37.296711] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.894 [2024-07-15 08:54:37.307569] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.894 [2024-07-15 08:54:37.307599] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.894 [2024-07-15 08:54:37.318539] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.894 [2024-07-15 08:54:37.318570] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.894 [2024-07-15 08:54:37.331438] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.894 [2024-07-15 08:54:37.331468] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.894 [2024-07-15 08:54:37.341176] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.894 [2024-07-15 08:54:37.341206] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.894 [2024-07-15 08:54:37.353182] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.894 [2024-07-15 08:54:37.353213] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.895 [2024-07-15 08:54:37.363840] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.895 [2024-07-15 08:54:37.363871] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.895 [2024-07-15 08:54:37.374904] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.895 [2024-07-15 08:54:37.374935] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.895 [2024-07-15 08:54:37.386965] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.895 [2024-07-15 08:54:37.386995] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.895 [2024-07-15 08:54:37.396720] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.895 [2024-07-15 08:54:37.396750] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.895 [2024-07-15 08:54:37.408069] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.895 [2024-07-15 08:54:37.408100] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.895 [2024-07-15 08:54:37.421090] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.895 [2024-07-15 08:54:37.421121] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:48.895 [2024-07-15 08:54:37.430970] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:48.895 [2024-07-15 08:54:37.431011] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.155 [2024-07-15 08:54:37.442292] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.155 [2024-07-15 08:54:37.442323] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.155 [2024-07-15 08:54:37.454961] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.155 [2024-07-15 08:54:37.455000] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.155 [2024-07-15 08:54:37.464502] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.155 [2024-07-15 08:54:37.464533] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.155 [2024-07-15 08:54:37.476106] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.155 [2024-07-15 08:54:37.476137] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.155 [2024-07-15 08:54:37.486615] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.155 [2024-07-15 08:54:37.486656] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.155 [2024-07-15 08:54:37.497417] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.155 [2024-07-15 08:54:37.497447] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.155 [2024-07-15 08:54:37.509863] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.155 [2024-07-15 08:54:37.509904] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.155 [2024-07-15 08:54:37.519024] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.155 [2024-07-15 08:54:37.519055] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.155 [2024-07-15 08:54:37.532553] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.155 [2024-07-15 08:54:37.532585] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.155 [2024-07-15 08:54:37.543571] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.155 [2024-07-15 08:54:37.543602] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.155 [2024-07-15 08:54:37.554398] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.155 [2024-07-15 08:54:37.554429] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.155 [2024-07-15 08:54:37.565006] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.155 [2024-07-15 08:54:37.565037] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.155 [2024-07-15 08:54:37.577787] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.155 [2024-07-15 08:54:37.577819] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.155 [2024-07-15 08:54:37.587798] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.155 [2024-07-15 08:54:37.587831] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.155 [2024-07-15 08:54:37.599353] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.155 [2024-07-15 08:54:37.599383] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.155 [2024-07-15 08:54:37.610013] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.155 [2024-07-15 08:54:37.610043] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.155 [2024-07-15 08:54:37.620760] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.155 [2024-07-15 08:54:37.620790] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.155 [2024-07-15 08:54:37.631397] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.155 [2024-07-15 08:54:37.631428] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.155 [2024-07-15 08:54:37.641942] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.155 [2024-07-15 08:54:37.641972] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.155 [2024-07-15 08:54:37.652615] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.155 [2024-07-15 08:54:37.652646] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.155 [2024-07-15 08:54:37.663177] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.155 [2024-07-15 08:54:37.663215] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.155 [2024-07-15 08:54:37.674444] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.156 [2024-07-15 08:54:37.674475] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.156 [2024-07-15 08:54:37.687396] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.156 [2024-07-15 08:54:37.687426] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.156 [2024-07-15 08:54:37.697666] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.156 [2024-07-15 08:54:37.697696] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.413 [2024-07-15 08:54:37.708626] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.413 [2024-07-15 08:54:37.708657] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.414 [2024-07-15 08:54:37.719624] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.414 [2024-07-15 08:54:37.719655] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.414 [2024-07-15 08:54:37.730602] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.414 [2024-07-15 08:54:37.730632] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.414 [2024-07-15 08:54:37.743771] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.414 [2024-07-15 08:54:37.743801] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.414 [2024-07-15 08:54:37.754390] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.414 [2024-07-15 08:54:37.754421] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.414 [2024-07-15 08:54:37.765714] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.414 [2024-07-15 08:54:37.765744] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.414 [2024-07-15 08:54:37.776512] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.414 [2024-07-15 08:54:37.776542] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.414 [2024-07-15 08:54:37.787185] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.414 [2024-07-15 08:54:37.787216] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.414 [2024-07-15 08:54:37.800066] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.414 [2024-07-15 08:54:37.800097] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.414 [2024-07-15 08:54:37.809993] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.414 [2024-07-15 08:54:37.810023] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.414 [2024-07-15 08:54:37.821669] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.414 [2024-07-15 08:54:37.821700] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.414 [2024-07-15 08:54:37.832750] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.414 [2024-07-15 08:54:37.832781] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.414 [2024-07-15 08:54:37.843911] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.414 [2024-07-15 08:54:37.843941] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.414 [2024-07-15 08:54:37.854905] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.414 [2024-07-15 08:54:37.854935] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.414 [2024-07-15 08:54:37.865648] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.414 [2024-07-15 08:54:37.865679] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.414 [2024-07-15 08:54:37.876343] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.414 [2024-07-15 08:54:37.876382] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.414 [2024-07-15 08:54:37.887333] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.414 [2024-07-15 08:54:37.887365] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.414 [2024-07-15 08:54:37.898666] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.414 [2024-07-15 08:54:37.898697] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.414 [2024-07-15 08:54:37.911226] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.414 [2024-07-15 08:54:37.911257] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.414 [2024-07-15 08:54:37.921312] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.414 [2024-07-15 08:54:37.921342] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.414 [2024-07-15 08:54:37.932342] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.414 [2024-07-15 08:54:37.932372] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.414 [2024-07-15 08:54:37.945266] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.414 [2024-07-15 08:54:37.945296] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.414 [2024-07-15 08:54:37.955113] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.414 [2024-07-15 08:54:37.955143] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.672 [2024-07-15 08:54:37.966887] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.672 [2024-07-15 08:54:37.966917] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.672 [2024-07-15 08:54:37.977632] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.672 [2024-07-15 08:54:37.977661] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.672 [2024-07-15 08:54:37.988300] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.672 [2024-07-15 08:54:37.988330] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.672 [2024-07-15 08:54:38.001100] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.672 [2024-07-15 08:54:38.001130] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.672 [2024-07-15 08:54:38.011558] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.672 [2024-07-15 08:54:38.011588] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.672 [2024-07-15 08:54:38.022820] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.672 [2024-07-15 08:54:38.022851] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.672 [2024-07-15 08:54:38.034256] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.672 [2024-07-15 08:54:38.034285] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.672 [2024-07-15 08:54:38.045204] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.672 [2024-07-15 08:54:38.045234] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.672 [2024-07-15 08:54:38.056192] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.672 [2024-07-15 08:54:38.056222] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.672 [2024-07-15 08:54:38.067268] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.672 [2024-07-15 08:54:38.067298] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.672 [2024-07-15 08:54:38.079910] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.672 [2024-07-15 08:54:38.079940] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.672 [2024-07-15 08:54:38.090200] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.672 [2024-07-15 08:54:38.090230] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.672 [2024-07-15 08:54:38.101501] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.672 [2024-07-15 08:54:38.101532] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.672 [2024-07-15 08:54:38.114317] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.672 [2024-07-15 08:54:38.114348] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.672 [2024-07-15 08:54:38.124586] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.672 [2024-07-15 08:54:38.124616] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.672 [2024-07-15 08:54:38.136363] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.672 [2024-07-15 08:54:38.136393] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.672 [2024-07-15 08:54:38.147322] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.672 [2024-07-15 08:54:38.147352] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.672 [2024-07-15 08:54:38.158573] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.672 [2024-07-15 08:54:38.158603] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.672 [2024-07-15 08:54:38.169479] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.672 [2024-07-15 08:54:38.169509] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.672 [2024-07-15 08:54:38.180531] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.672 [2024-07-15 08:54:38.180561] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.672 [2024-07-15 08:54:38.191675] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.672 [2024-07-15 08:54:38.191705] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.672 [2024-07-15 08:54:38.202560] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.672 [2024-07-15 08:54:38.202590] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.672 [2024-07-15 08:54:38.213497] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.672 [2024-07-15 08:54:38.213527] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.931 [2024-07-15 08:54:38.226125] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.931 [2024-07-15 08:54:38.226156] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.931 [2024-07-15 08:54:38.236016] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.931 [2024-07-15 08:54:38.236046] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.931 [2024-07-15 08:54:38.247382] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.931 [2024-07-15 08:54:38.247413] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.931 [2024-07-15 08:54:38.258030] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.931 [2024-07-15 08:54:38.258060] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.931 [2024-07-15 08:54:38.268728] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.931 [2024-07-15 08:54:38.268759] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.931 [2024-07-15 08:54:38.279467] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.931 [2024-07-15 08:54:38.279498] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.931 [2024-07-15 08:54:38.290621] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.931 [2024-07-15 08:54:38.290651] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.931 [2024-07-15 08:54:38.303634] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.931 [2024-07-15 08:54:38.303665] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.931 [2024-07-15 08:54:38.313444] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.931 [2024-07-15 08:54:38.313474] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.931 [2024-07-15 08:54:38.324289] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.931 [2024-07-15 08:54:38.324319] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.931 [2024-07-15 08:54:38.334899] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.931 [2024-07-15 08:54:38.334930] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.931 [2024-07-15 08:54:38.345798] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.931 [2024-07-15 08:54:38.345828] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.931 [2024-07-15 08:54:38.356674] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.931 [2024-07-15 08:54:38.356705] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.931 [2024-07-15 08:54:38.371576] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.931 [2024-07-15 08:54:38.371608] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.931 [2024-07-15 08:54:38.381205] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.931 [2024-07-15 08:54:38.381235] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.931 [2024-07-15 08:54:38.393078] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.931 [2024-07-15 08:54:38.393108] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.931 [2024-07-15 08:54:38.405937] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.931 [2024-07-15 08:54:38.405967] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.931 [2024-07-15 08:54:38.416468] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.931 [2024-07-15 08:54:38.416498] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.931 [2024-07-15 08:54:38.427562] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.931 [2024-07-15 08:54:38.427594] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.931 [2024-07-15 08:54:38.438930] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.931 [2024-07-15 08:54:38.438960] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.931 [2024-07-15 08:54:38.449931] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.931 [2024-07-15 08:54:38.449961] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.931 [2024-07-15 08:54:38.461293] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.931 [2024-07-15 08:54:38.461323] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:49.931 [2024-07-15 08:54:38.472159] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:49.931 [2024-07-15 08:54:38.472189] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.190 [2024-07-15 08:54:38.484919] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.190 [2024-07-15 08:54:38.484949] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.190 [2024-07-15 08:54:38.495133] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.190 [2024-07-15 08:54:38.495164] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.190 [2024-07-15 08:54:38.506412] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.190 [2024-07-15 08:54:38.506443] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.190 [2024-07-15 08:54:38.517437] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.190 [2024-07-15 08:54:38.517468] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.190 [2024-07-15 08:54:38.528289] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.190 [2024-07-15 08:54:38.528320] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.190 [2024-07-15 08:54:38.538711] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.190 [2024-07-15 08:54:38.538741] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.190 [2024-07-15 08:54:38.549345] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.190 [2024-07-15 08:54:38.549376] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.190 [2024-07-15 08:54:38.560483] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.190 [2024-07-15 08:54:38.560514] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.190 [2024-07-15 08:54:38.571137] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.190 [2024-07-15 08:54:38.571170] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.190 [2024-07-15 08:54:38.582082] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.190 [2024-07-15 08:54:38.582113] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.190 [2024-07-15 08:54:38.594524] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.190 [2024-07-15 08:54:38.594555] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.190 [2024-07-15 08:54:38.604555] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.190 [2024-07-15 08:54:38.604586] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.190 [2024-07-15 08:54:38.616159] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.190 [2024-07-15 08:54:38.616190] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.190 [2024-07-15 08:54:38.626857] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.190 [2024-07-15 08:54:38.626898] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.190 [2024-07-15 08:54:38.637650] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.190 [2024-07-15 08:54:38.637681] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.190 [2024-07-15 08:54:38.650931] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.190 [2024-07-15 08:54:38.650961] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.190 [2024-07-15 08:54:38.661082] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.190 [2024-07-15 08:54:38.661113] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.190 [2024-07-15 08:54:38.672672] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.190 [2024-07-15 08:54:38.672702] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.190 [2024-07-15 08:54:38.683844] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.190 [2024-07-15 08:54:38.683875] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.190 [2024-07-15 08:54:38.696514] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.190 [2024-07-15 08:54:38.696544] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.190 [2024-07-15 08:54:38.706817] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.190 [2024-07-15 08:54:38.706848] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.190 [2024-07-15 08:54:38.718150] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.190 [2024-07-15 08:54:38.718188] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.190 [2024-07-15 08:54:38.728822] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.190 [2024-07-15 08:54:38.728852] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.450 [2024-07-15 08:54:38.739686] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.450 [2024-07-15 08:54:38.739718] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.450 [2024-07-15 08:54:38.750273] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.450 [2024-07-15 08:54:38.750304] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.450 [2024-07-15 08:54:38.760984] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.450 [2024-07-15 08:54:38.761014] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.450 [2024-07-15 08:54:38.772274] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.450 [2024-07-15 08:54:38.772305] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.450 [2024-07-15 08:54:38.783183] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.450 [2024-07-15 08:54:38.783213] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.450 [2024-07-15 08:54:38.794073] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.450 [2024-07-15 08:54:38.794104] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.450 [2024-07-15 08:54:38.804863] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.450 [2024-07-15 08:54:38.804903] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.450 [2024-07-15 08:54:38.817634] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.450 [2024-07-15 08:54:38.817665] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.450 [2024-07-15 08:54:38.827635] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.450 [2024-07-15 08:54:38.827666] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.450 [2024-07-15 08:54:38.839009] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.450 [2024-07-15 08:54:38.839039] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.450 [2024-07-15 08:54:38.850024] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.450 [2024-07-15 08:54:38.850055] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.450 [2024-07-15 08:54:38.862556] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.450 [2024-07-15 08:54:38.862587] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.450 [2024-07-15 08:54:38.872663] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.450 [2024-07-15 08:54:38.872694] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.450 [2024-07-15 08:54:38.884073] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.450 [2024-07-15 08:54:38.884104] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.450 [2024-07-15 08:54:38.894730] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.450 [2024-07-15 08:54:38.894760] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.450 [2024-07-15 08:54:38.905696] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.450 [2024-07-15 08:54:38.905727] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.450 [2024-07-15 08:54:38.918254] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.450 [2024-07-15 08:54:38.918285] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.450 [2024-07-15 08:54:38.928519] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.450 [2024-07-15 08:54:38.928559] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.450 [2024-07-15 08:54:38.939197] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.450 [2024-07-15 08:54:38.939228] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.450 [2024-07-15 08:54:38.952082] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.450 [2024-07-15 08:54:38.952112] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.450 [2024-07-15 08:54:38.961591] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.450 [2024-07-15 08:54:38.961622] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.450 [2024-07-15 08:54:38.972814] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.450 [2024-07-15 08:54:38.972845] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.450 [2024-07-15 08:54:38.983750] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.450 [2024-07-15 08:54:38.983781] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.709 [2024-07-15 08:54:38.994728] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.709 [2024-07-15 08:54:38.994759] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.709 [2024-07-15 08:54:39.005718] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.709 [2024-07-15 08:54:39.005749] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.709 [2024-07-15 08:54:39.011579] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.709 [2024-07-15 08:54:39.011609] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.709 00:15:50.709 Latency(us) 00:15:50.709 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:50.709 Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:15:50.709 Nvme1n1 : 5.01 11601.36 90.64 0.00 0.00 11017.75 4708.88 22719.15 00:15:50.709 =================================================================================================================== 00:15:50.709 Total : 11601.36 90.64 0.00 0.00 11017.75 4708.88 22719.15 00:15:50.709 [2024-07-15 08:54:39.019595] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.709 [2024-07-15 08:54:39.019624] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.710 [2024-07-15 08:54:39.027614] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.710 [2024-07-15 08:54:39.027643] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.710 [2024-07-15 08:54:39.035639] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.710 [2024-07-15 08:54:39.035666] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.710 [2024-07-15 08:54:39.043709] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.710 [2024-07-15 08:54:39.043756] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.710 [2024-07-15 08:54:39.051731] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.710 [2024-07-15 08:54:39.051779] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.710 [2024-07-15 08:54:39.059749] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.710 [2024-07-15 08:54:39.059795] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.710 [2024-07-15 08:54:39.067777] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.710 [2024-07-15 08:54:39.067823] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.710 [2024-07-15 08:54:39.075794] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.710 [2024-07-15 08:54:39.075857] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.710 [2024-07-15 08:54:39.083823] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.710 [2024-07-15 08:54:39.083870] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.710 [2024-07-15 08:54:39.091836] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.710 [2024-07-15 08:54:39.091888] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.710 [2024-07-15 08:54:39.099859] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.710 [2024-07-15 08:54:39.099913] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.710 [2024-07-15 08:54:39.107894] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.710 [2024-07-15 08:54:39.107939] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.710 [2024-07-15 08:54:39.115922] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.710 [2024-07-15 08:54:39.115968] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.710 [2024-07-15 08:54:39.123954] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.710 [2024-07-15 08:54:39.124004] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.710 [2024-07-15 08:54:39.131965] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.710 [2024-07-15 08:54:39.132008] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.710 [2024-07-15 08:54:39.139983] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.710 [2024-07-15 08:54:39.140027] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.710 [2024-07-15 08:54:39.148005] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.710 [2024-07-15 08:54:39.148048] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.710 [2024-07-15 08:54:39.156023] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.710 [2024-07-15 08:54:39.156067] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.710 [2024-07-15 08:54:39.164009] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.710 [2024-07-15 08:54:39.164038] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.710 [2024-07-15 08:54:39.172019] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.710 [2024-07-15 08:54:39.172044] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.710 [2024-07-15 08:54:39.180040] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.710 [2024-07-15 08:54:39.180065] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.710 [2024-07-15 08:54:39.188063] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.710 [2024-07-15 08:54:39.188088] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.710 [2024-07-15 08:54:39.196086] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.710 [2024-07-15 08:54:39.196111] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.710 [2024-07-15 08:54:39.204150] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.710 [2024-07-15 08:54:39.204190] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.710 [2024-07-15 08:54:39.212177] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.710 [2024-07-15 08:54:39.212220] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.710 [2024-07-15 08:54:39.220202] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.710 [2024-07-15 08:54:39.220245] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.710 [2024-07-15 08:54:39.228177] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.710 [2024-07-15 08:54:39.228219] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.710 [2024-07-15 08:54:39.236200] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.710 [2024-07-15 08:54:39.236225] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.710 [2024-07-15 08:54:39.244221] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.710 [2024-07-15 08:54:39.244246] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.710 [2024-07-15 08:54:39.252242] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.710 [2024-07-15 08:54:39.252268] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.968 [2024-07-15 08:54:39.260274] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.968 [2024-07-15 08:54:39.260302] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.968 [2024-07-15 08:54:39.268345] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.968 [2024-07-15 08:54:39.268392] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.968 [2024-07-15 08:54:39.276362] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.968 [2024-07-15 08:54:39.276407] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.968 [2024-07-15 08:54:39.284333] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.968 [2024-07-15 08:54:39.284358] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.968 [2024-07-15 08:54:39.292351] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.968 [2024-07-15 08:54:39.292376] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.968 [2024-07-15 08:54:39.300374] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:50.968 [2024-07-15 08:54:39.300399] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:50.968 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (1498405) - No such process 00:15:50.968 08:54:39 -- target/zcopy.sh@49 -- # wait 1498405 00:15:50.968 08:54:39 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:50.968 08:54:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:50.968 08:54:39 -- common/autotest_common.sh@10 -- # set +x 00:15:50.968 08:54:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:50.968 08:54:39 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:15:50.968 08:54:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:50.968 08:54:39 -- common/autotest_common.sh@10 -- # set +x 00:15:50.968 delay0 00:15:50.968 08:54:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:50.968 08:54:39 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:15:50.968 08:54:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:50.968 08:54:39 -- common/autotest_common.sh@10 -- # set +x 00:15:50.968 08:54:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:50.968 08:54:39 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:15:50.968 EAL: No free 2048 kB hugepages reported on node 1 00:15:50.968 [2024-07-15 08:54:39.423906] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:15:57.548 Initializing NVMe Controllers 00:15:57.548 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:57.548 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:15:57.548 Initialization complete. Launching workers. 00:15:57.548 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 320, failed: 822 00:15:57.548 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 1108, failed to submit 34 00:15:57.548 success 916, unsuccess 192, failed 0 00:15:57.548 08:54:45 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:15:57.548 08:54:45 -- target/zcopy.sh@60 -- # nvmftestfini 00:15:57.548 08:54:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:57.548 08:54:45 -- nvmf/common.sh@116 -- # sync 00:15:57.548 08:54:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:57.548 08:54:45 -- nvmf/common.sh@119 -- # set +e 00:15:57.548 08:54:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:57.548 08:54:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:57.548 rmmod nvme_tcp 00:15:57.548 rmmod nvme_fabrics 00:15:57.548 rmmod nvme_keyring 00:15:57.548 08:54:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:57.548 08:54:45 -- nvmf/common.sh@123 -- # set -e 00:15:57.548 08:54:45 -- nvmf/common.sh@124 -- # return 0 00:15:57.548 08:54:45 -- nvmf/common.sh@477 -- # '[' -n 1496956 ']' 00:15:57.548 08:54:45 -- nvmf/common.sh@478 -- # killprocess 1496956 00:15:57.548 08:54:45 -- common/autotest_common.sh@926 -- # '[' -z 1496956 ']' 00:15:57.548 08:54:45 -- common/autotest_common.sh@930 -- # kill -0 1496956 00:15:57.548 08:54:45 -- common/autotest_common.sh@931 -- # uname 00:15:57.548 08:54:45 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:15:57.548 08:54:45 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1496956 00:15:57.548 08:54:45 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:15:57.548 08:54:45 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:15:57.548 08:54:45 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1496956' 00:15:57.548 killing process with pid 1496956 00:15:57.548 08:54:45 -- common/autotest_common.sh@945 -- # kill 1496956 00:15:57.548 08:54:45 -- common/autotest_common.sh@950 -- # wait 1496956 00:15:57.548 08:54:46 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:57.548 08:54:46 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:57.548 08:54:46 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:57.548 08:54:46 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:57.548 08:54:46 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:57.548 08:54:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:57.548 08:54:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:57.548 08:54:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:00.114 08:54:48 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:00.114 00:16:00.114 real 0m28.675s 00:16:00.114 user 0m37.704s 00:16:00.114 sys 0m9.900s 00:16:00.114 08:54:48 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:16:00.114 08:54:48 -- common/autotest_common.sh@10 -- # set +x 00:16:00.114 ************************************ 00:16:00.114 END TEST nvmf_zcopy 00:16:00.114 ************************************ 00:16:00.114 08:54:48 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:16:00.114 08:54:48 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:16:00.114 08:54:48 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:16:00.114 08:54:48 -- common/autotest_common.sh@10 -- # set +x 00:16:00.114 ************************************ 00:16:00.114 START TEST nvmf_nmic 00:16:00.114 ************************************ 00:16:00.114 08:54:48 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:16:00.114 * Looking for test storage... 00:16:00.114 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:00.114 08:54:48 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:00.114 08:54:48 -- nvmf/common.sh@7 -- # uname -s 00:16:00.114 08:54:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:00.114 08:54:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:00.114 08:54:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:00.114 08:54:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:00.114 08:54:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:00.114 08:54:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:00.114 08:54:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:00.114 08:54:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:00.114 08:54:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:00.114 08:54:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:00.114 08:54:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:00.114 08:54:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:00.114 08:54:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:00.114 08:54:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:00.114 08:54:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:00.114 08:54:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:00.114 08:54:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:00.114 08:54:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:00.114 08:54:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:00.114 08:54:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:00.115 08:54:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:00.115 08:54:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:00.115 08:54:48 -- paths/export.sh@5 -- # export PATH 00:16:00.115 08:54:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:00.115 08:54:48 -- nvmf/common.sh@46 -- # : 0 00:16:00.115 08:54:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:00.115 08:54:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:00.115 08:54:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:00.115 08:54:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:00.115 08:54:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:00.115 08:54:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:00.115 08:54:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:00.115 08:54:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:00.115 08:54:48 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:00.115 08:54:48 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:00.115 08:54:48 -- target/nmic.sh@14 -- # nvmftestinit 00:16:00.115 08:54:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:00.115 08:54:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:00.115 08:54:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:00.115 08:54:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:00.115 08:54:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:00.115 08:54:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:00.115 08:54:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:00.115 08:54:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:00.115 08:54:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:00.115 08:54:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:00.115 08:54:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:00.115 08:54:48 -- common/autotest_common.sh@10 -- # set +x 00:16:02.072 08:54:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:02.072 08:54:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:02.072 08:54:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:02.072 08:54:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:02.072 08:54:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:02.072 08:54:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:02.072 08:54:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:02.072 08:54:50 -- nvmf/common.sh@294 -- # net_devs=() 00:16:02.072 08:54:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:02.072 08:54:50 -- nvmf/common.sh@295 -- # e810=() 00:16:02.072 08:54:50 -- nvmf/common.sh@295 -- # local -ga e810 00:16:02.072 08:54:50 -- nvmf/common.sh@296 -- # x722=() 00:16:02.072 08:54:50 -- nvmf/common.sh@296 -- # local -ga x722 00:16:02.072 08:54:50 -- nvmf/common.sh@297 -- # mlx=() 00:16:02.072 08:54:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:02.072 08:54:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:02.072 08:54:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:02.072 08:54:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:02.072 08:54:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:02.072 08:54:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:02.072 08:54:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:02.072 08:54:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:02.072 08:54:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:02.072 08:54:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:02.072 08:54:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:02.072 08:54:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:02.072 08:54:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:02.072 08:54:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:02.072 08:54:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:02.072 08:54:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:02.072 08:54:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:02.072 08:54:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:02.072 08:54:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:02.072 08:54:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:02.072 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:02.072 08:54:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:02.072 08:54:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:02.072 08:54:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:02.072 08:54:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:02.072 08:54:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:02.072 08:54:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:02.072 08:54:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:02.072 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:02.072 08:54:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:02.072 08:54:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:02.072 08:54:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:02.072 08:54:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:02.072 08:54:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:02.072 08:54:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:02.072 08:54:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:02.072 08:54:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:02.072 08:54:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:02.072 08:54:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:02.072 08:54:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:02.072 08:54:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:02.072 08:54:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:02.072 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:02.072 08:54:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:02.072 08:54:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:02.072 08:54:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:02.072 08:54:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:02.072 08:54:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:02.072 08:54:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:02.072 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:02.072 08:54:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:02.072 08:54:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:02.072 08:54:50 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:02.072 08:54:50 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:02.072 08:54:50 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:02.073 08:54:50 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:02.073 08:54:50 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:02.073 08:54:50 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:02.073 08:54:50 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:02.073 08:54:50 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:02.073 08:54:50 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:02.073 08:54:50 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:02.073 08:54:50 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:02.073 08:54:50 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:02.073 08:54:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:02.073 08:54:50 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:02.073 08:54:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:02.073 08:54:50 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:02.073 08:54:50 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:02.073 08:54:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:02.073 08:54:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:02.073 08:54:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:02.073 08:54:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:02.073 08:54:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:02.073 08:54:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:02.073 08:54:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:02.073 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:02.073 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.197 ms 00:16:02.073 00:16:02.073 --- 10.0.0.2 ping statistics --- 00:16:02.073 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:02.073 rtt min/avg/max/mdev = 0.197/0.197/0.197/0.000 ms 00:16:02.073 08:54:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:02.073 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:02.073 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.108 ms 00:16:02.073 00:16:02.073 --- 10.0.0.1 ping statistics --- 00:16:02.073 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:02.073 rtt min/avg/max/mdev = 0.108/0.108/0.108/0.000 ms 00:16:02.073 08:54:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:02.073 08:54:50 -- nvmf/common.sh@410 -- # return 0 00:16:02.073 08:54:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:02.073 08:54:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:02.073 08:54:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:02.073 08:54:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:02.073 08:54:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:02.073 08:54:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:02.073 08:54:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:02.073 08:54:50 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:16:02.073 08:54:50 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:02.073 08:54:50 -- common/autotest_common.sh@712 -- # xtrace_disable 00:16:02.073 08:54:50 -- common/autotest_common.sh@10 -- # set +x 00:16:02.073 08:54:50 -- nvmf/common.sh@469 -- # nvmfpid=1501845 00:16:02.073 08:54:50 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:02.073 08:54:50 -- nvmf/common.sh@470 -- # waitforlisten 1501845 00:16:02.073 08:54:50 -- common/autotest_common.sh@819 -- # '[' -z 1501845 ']' 00:16:02.073 08:54:50 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:02.073 08:54:50 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:02.073 08:54:50 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:02.073 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:02.073 08:54:50 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:02.073 08:54:50 -- common/autotest_common.sh@10 -- # set +x 00:16:02.073 [2024-07-15 08:54:50.448456] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:16:02.073 [2024-07-15 08:54:50.448542] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:02.073 EAL: No free 2048 kB hugepages reported on node 1 00:16:02.073 [2024-07-15 08:54:50.520750] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:02.331 [2024-07-15 08:54:50.644499] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:02.331 [2024-07-15 08:54:50.644662] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:02.331 [2024-07-15 08:54:50.644683] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:02.331 [2024-07-15 08:54:50.644697] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:02.331 [2024-07-15 08:54:50.645902] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:02.331 [2024-07-15 08:54:50.645933] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:02.331 [2024-07-15 08:54:50.645985] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:02.331 [2024-07-15 08:54:50.645988] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:02.894 08:54:51 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:02.894 08:54:51 -- common/autotest_common.sh@852 -- # return 0 00:16:02.894 08:54:51 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:02.894 08:54:51 -- common/autotest_common.sh@718 -- # xtrace_disable 00:16:02.894 08:54:51 -- common/autotest_common.sh@10 -- # set +x 00:16:03.152 08:54:51 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:03.152 08:54:51 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:03.152 08:54:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:03.152 08:54:51 -- common/autotest_common.sh@10 -- # set +x 00:16:03.152 [2024-07-15 08:54:51.457515] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:03.152 08:54:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:03.152 08:54:51 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:03.152 08:54:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:03.152 08:54:51 -- common/autotest_common.sh@10 -- # set +x 00:16:03.152 Malloc0 00:16:03.152 08:54:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:03.152 08:54:51 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:03.152 08:54:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:03.152 08:54:51 -- common/autotest_common.sh@10 -- # set +x 00:16:03.152 08:54:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:03.152 08:54:51 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:03.152 08:54:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:03.152 08:54:51 -- common/autotest_common.sh@10 -- # set +x 00:16:03.152 08:54:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:03.152 08:54:51 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:03.152 08:54:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:03.152 08:54:51 -- common/autotest_common.sh@10 -- # set +x 00:16:03.152 [2024-07-15 08:54:51.511050] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:03.152 08:54:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:03.152 08:54:51 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:16:03.152 test case1: single bdev can't be used in multiple subsystems 00:16:03.152 08:54:51 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:16:03.152 08:54:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:03.152 08:54:51 -- common/autotest_common.sh@10 -- # set +x 00:16:03.152 08:54:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:03.152 08:54:51 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:16:03.152 08:54:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:03.152 08:54:51 -- common/autotest_common.sh@10 -- # set +x 00:16:03.152 08:54:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:03.152 08:54:51 -- target/nmic.sh@28 -- # nmic_status=0 00:16:03.152 08:54:51 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:16:03.152 08:54:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:03.152 08:54:51 -- common/autotest_common.sh@10 -- # set +x 00:16:03.152 [2024-07-15 08:54:51.534913] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:16:03.152 [2024-07-15 08:54:51.534966] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:16:03.152 [2024-07-15 08:54:51.534981] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.152 request: 00:16:03.152 { 00:16:03.152 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:16:03.152 "namespace": { 00:16:03.152 "bdev_name": "Malloc0" 00:16:03.152 }, 00:16:03.152 "method": "nvmf_subsystem_add_ns", 00:16:03.152 "req_id": 1 00:16:03.152 } 00:16:03.152 Got JSON-RPC error response 00:16:03.152 response: 00:16:03.152 { 00:16:03.152 "code": -32602, 00:16:03.152 "message": "Invalid parameters" 00:16:03.152 } 00:16:03.152 08:54:51 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:16:03.152 08:54:51 -- target/nmic.sh@29 -- # nmic_status=1 00:16:03.152 08:54:51 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:16:03.152 08:54:51 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:16:03.152 Adding namespace failed - expected result. 00:16:03.152 08:54:51 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:16:03.152 test case2: host connect to nvmf target in multiple paths 00:16:03.152 08:54:51 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:16:03.152 08:54:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:03.152 08:54:51 -- common/autotest_common.sh@10 -- # set +x 00:16:03.152 [2024-07-15 08:54:51.543065] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:16:03.152 08:54:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:03.152 08:54:51 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:16:03.716 08:54:52 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:16:04.281 08:54:52 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:16:04.281 08:54:52 -- common/autotest_common.sh@1177 -- # local i=0 00:16:04.281 08:54:52 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:16:04.281 08:54:52 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:16:04.281 08:54:52 -- common/autotest_common.sh@1184 -- # sleep 2 00:16:06.808 08:54:54 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:16:06.808 08:54:54 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:16:06.808 08:54:54 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:16:06.808 08:54:54 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:16:06.808 08:54:54 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:16:06.808 08:54:54 -- common/autotest_common.sh@1187 -- # return 0 00:16:06.808 08:54:54 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:16:06.808 [global] 00:16:06.808 thread=1 00:16:06.808 invalidate=1 00:16:06.808 rw=write 00:16:06.808 time_based=1 00:16:06.808 runtime=1 00:16:06.808 ioengine=libaio 00:16:06.808 direct=1 00:16:06.808 bs=4096 00:16:06.808 iodepth=1 00:16:06.808 norandommap=0 00:16:06.808 numjobs=1 00:16:06.808 00:16:06.808 verify_dump=1 00:16:06.808 verify_backlog=512 00:16:06.808 verify_state_save=0 00:16:06.808 do_verify=1 00:16:06.808 verify=crc32c-intel 00:16:06.808 [job0] 00:16:06.808 filename=/dev/nvme0n1 00:16:06.808 Could not set queue depth (nvme0n1) 00:16:06.808 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:06.808 fio-3.35 00:16:06.808 Starting 1 thread 00:16:07.739 00:16:07.740 job0: (groupid=0, jobs=1): err= 0: pid=1502505: Mon Jul 15 08:54:56 2024 00:16:07.740 read: IOPS=1085, BW=4341KiB/s (4446kB/s)(4476KiB/1031msec) 00:16:07.740 slat (nsec): min=5693, max=33989, avg=12275.76, stdev=5277.65 00:16:07.740 clat (usec): min=314, max=41971, avg=557.99, stdev=2755.31 00:16:07.740 lat (usec): min=321, max=41988, avg=570.27, stdev=2756.55 00:16:07.740 clat percentiles (usec): 00:16:07.740 | 1.00th=[ 322], 5.00th=[ 330], 10.00th=[ 338], 20.00th=[ 347], 00:16:07.740 | 30.00th=[ 355], 40.00th=[ 363], 50.00th=[ 375], 60.00th=[ 383], 00:16:07.740 | 70.00th=[ 388], 80.00th=[ 396], 90.00th=[ 404], 95.00th=[ 416], 00:16:07.740 | 99.00th=[ 545], 99.50th=[ 611], 99.90th=[42206], 99.95th=[42206], 00:16:07.740 | 99.99th=[42206] 00:16:07.740 write: IOPS=1489, BW=5959KiB/s (6102kB/s)(6144KiB/1031msec); 0 zone resets 00:16:07.740 slat (usec): min=7, max=28657, avg=35.57, stdev=730.81 00:16:07.740 clat (usec): min=169, max=408, avg=212.02, stdev=18.63 00:16:07.740 lat (usec): min=177, max=28903, avg=247.60, stdev=732.00 00:16:07.740 clat percentiles (usec): 00:16:07.740 | 1.00th=[ 176], 5.00th=[ 182], 10.00th=[ 188], 20.00th=[ 198], 00:16:07.740 | 30.00th=[ 204], 40.00th=[ 210], 50.00th=[ 212], 60.00th=[ 217], 00:16:07.740 | 70.00th=[ 221], 80.00th=[ 225], 90.00th=[ 231], 95.00th=[ 237], 00:16:07.740 | 99.00th=[ 269], 99.50th=[ 273], 99.90th=[ 363], 99.95th=[ 408], 00:16:07.740 | 99.99th=[ 408] 00:16:07.740 bw ( KiB/s): min= 4096, max= 8192, per=100.00%, avg=6144.00, stdev=2896.31, samples=2 00:16:07.740 iops : min= 1024, max= 2048, avg=1536.00, stdev=724.08, samples=2 00:16:07.740 lat (usec) : 250=56.23%, 500=42.94%, 750=0.64% 00:16:07.740 lat (msec) : 50=0.19% 00:16:07.740 cpu : usr=3.59%, sys=4.56%, ctx=2657, majf=0, minf=2 00:16:07.740 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:07.740 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:07.740 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:07.740 issued rwts: total=1119,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:07.740 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:07.740 00:16:07.740 Run status group 0 (all jobs): 00:16:07.740 READ: bw=4341KiB/s (4446kB/s), 4341KiB/s-4341KiB/s (4446kB/s-4446kB/s), io=4476KiB (4583kB), run=1031-1031msec 00:16:07.740 WRITE: bw=5959KiB/s (6102kB/s), 5959KiB/s-5959KiB/s (6102kB/s-6102kB/s), io=6144KiB (6291kB), run=1031-1031msec 00:16:07.740 00:16:07.740 Disk stats (read/write): 00:16:07.740 nvme0n1: ios=1141/1536, merge=0/0, ticks=1420/307, in_queue=1727, util=98.60% 00:16:07.740 08:54:56 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:07.996 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:16:07.996 08:54:56 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:16:07.996 08:54:56 -- common/autotest_common.sh@1198 -- # local i=0 00:16:07.996 08:54:56 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:16:07.996 08:54:56 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:07.996 08:54:56 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:16:07.996 08:54:56 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:07.996 08:54:56 -- common/autotest_common.sh@1210 -- # return 0 00:16:07.996 08:54:56 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:16:07.996 08:54:56 -- target/nmic.sh@53 -- # nvmftestfini 00:16:07.996 08:54:56 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:07.996 08:54:56 -- nvmf/common.sh@116 -- # sync 00:16:07.996 08:54:56 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:07.996 08:54:56 -- nvmf/common.sh@119 -- # set +e 00:16:07.996 08:54:56 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:07.996 08:54:56 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:07.996 rmmod nvme_tcp 00:16:07.996 rmmod nvme_fabrics 00:16:07.996 rmmod nvme_keyring 00:16:07.997 08:54:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:07.997 08:54:56 -- nvmf/common.sh@123 -- # set -e 00:16:07.997 08:54:56 -- nvmf/common.sh@124 -- # return 0 00:16:07.997 08:54:56 -- nvmf/common.sh@477 -- # '[' -n 1501845 ']' 00:16:07.997 08:54:56 -- nvmf/common.sh@478 -- # killprocess 1501845 00:16:07.997 08:54:56 -- common/autotest_common.sh@926 -- # '[' -z 1501845 ']' 00:16:07.997 08:54:56 -- common/autotest_common.sh@930 -- # kill -0 1501845 00:16:07.997 08:54:56 -- common/autotest_common.sh@931 -- # uname 00:16:07.997 08:54:56 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:16:07.997 08:54:56 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1501845 00:16:07.997 08:54:56 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:16:07.997 08:54:56 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:16:07.997 08:54:56 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1501845' 00:16:07.997 killing process with pid 1501845 00:16:07.997 08:54:56 -- common/autotest_common.sh@945 -- # kill 1501845 00:16:07.997 08:54:56 -- common/autotest_common.sh@950 -- # wait 1501845 00:16:08.255 08:54:56 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:08.255 08:54:56 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:08.255 08:54:56 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:08.255 08:54:56 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:08.255 08:54:56 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:08.255 08:54:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:08.255 08:54:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:08.255 08:54:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:10.788 08:54:58 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:10.788 00:16:10.788 real 0m10.630s 00:16:10.788 user 0m25.243s 00:16:10.788 sys 0m2.391s 00:16:10.788 08:54:58 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:16:10.788 08:54:58 -- common/autotest_common.sh@10 -- # set +x 00:16:10.788 ************************************ 00:16:10.788 END TEST nvmf_nmic 00:16:10.788 ************************************ 00:16:10.788 08:54:58 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:10.788 08:54:58 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:16:10.788 08:54:58 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:16:10.788 08:54:58 -- common/autotest_common.sh@10 -- # set +x 00:16:10.788 ************************************ 00:16:10.788 START TEST nvmf_fio_target 00:16:10.788 ************************************ 00:16:10.788 08:54:58 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:10.788 * Looking for test storage... 00:16:10.788 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:10.788 08:54:58 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:10.788 08:54:58 -- nvmf/common.sh@7 -- # uname -s 00:16:10.788 08:54:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:10.788 08:54:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:10.788 08:54:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:10.788 08:54:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:10.788 08:54:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:10.788 08:54:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:10.788 08:54:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:10.788 08:54:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:10.788 08:54:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:10.788 08:54:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:10.788 08:54:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:10.788 08:54:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:10.788 08:54:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:10.788 08:54:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:10.788 08:54:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:10.788 08:54:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:10.788 08:54:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:10.788 08:54:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:10.788 08:54:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:10.788 08:54:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:10.788 08:54:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:10.788 08:54:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:10.788 08:54:58 -- paths/export.sh@5 -- # export PATH 00:16:10.789 08:54:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:10.789 08:54:58 -- nvmf/common.sh@46 -- # : 0 00:16:10.789 08:54:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:10.789 08:54:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:10.789 08:54:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:10.789 08:54:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:10.789 08:54:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:10.789 08:54:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:10.789 08:54:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:10.789 08:54:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:10.789 08:54:58 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:10.789 08:54:58 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:10.789 08:54:58 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:10.789 08:54:58 -- target/fio.sh@16 -- # nvmftestinit 00:16:10.789 08:54:58 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:10.789 08:54:58 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:10.789 08:54:58 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:10.789 08:54:58 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:10.789 08:54:58 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:10.789 08:54:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:10.789 08:54:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:10.789 08:54:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:10.789 08:54:58 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:10.789 08:54:58 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:10.789 08:54:58 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:10.789 08:54:58 -- common/autotest_common.sh@10 -- # set +x 00:16:12.688 08:55:00 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:12.688 08:55:00 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:12.688 08:55:00 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:12.688 08:55:00 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:12.688 08:55:00 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:12.688 08:55:00 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:12.688 08:55:00 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:12.688 08:55:00 -- nvmf/common.sh@294 -- # net_devs=() 00:16:12.688 08:55:00 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:12.688 08:55:00 -- nvmf/common.sh@295 -- # e810=() 00:16:12.688 08:55:00 -- nvmf/common.sh@295 -- # local -ga e810 00:16:12.688 08:55:00 -- nvmf/common.sh@296 -- # x722=() 00:16:12.688 08:55:00 -- nvmf/common.sh@296 -- # local -ga x722 00:16:12.688 08:55:00 -- nvmf/common.sh@297 -- # mlx=() 00:16:12.688 08:55:00 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:12.688 08:55:00 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:12.688 08:55:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:12.688 08:55:00 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:12.688 08:55:00 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:12.688 08:55:00 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:12.688 08:55:00 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:12.688 08:55:00 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:12.688 08:55:00 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:12.688 08:55:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:12.688 08:55:00 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:12.688 08:55:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:12.688 08:55:00 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:12.688 08:55:00 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:12.688 08:55:00 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:12.688 08:55:00 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:12.688 08:55:00 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:12.689 08:55:00 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:12.689 08:55:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:12.689 08:55:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:12.689 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:12.689 08:55:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:12.689 08:55:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:12.689 08:55:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:12.689 08:55:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:12.689 08:55:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:12.689 08:55:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:12.689 08:55:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:12.689 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:12.689 08:55:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:12.689 08:55:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:12.689 08:55:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:12.689 08:55:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:12.689 08:55:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:12.689 08:55:00 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:12.689 08:55:00 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:12.689 08:55:00 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:12.689 08:55:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:12.689 08:55:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:12.689 08:55:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:12.689 08:55:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:12.689 08:55:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:12.689 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:12.689 08:55:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:12.689 08:55:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:12.689 08:55:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:12.689 08:55:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:12.689 08:55:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:12.689 08:55:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:12.689 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:12.689 08:55:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:12.689 08:55:00 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:12.689 08:55:00 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:12.689 08:55:00 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:12.689 08:55:00 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:12.689 08:55:00 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:12.689 08:55:00 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:12.689 08:55:00 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:12.689 08:55:00 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:12.689 08:55:00 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:12.689 08:55:00 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:12.689 08:55:00 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:12.689 08:55:00 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:12.689 08:55:00 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:12.689 08:55:00 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:12.689 08:55:00 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:12.689 08:55:00 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:12.689 08:55:00 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:12.689 08:55:00 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:12.689 08:55:00 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:12.689 08:55:00 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:12.689 08:55:00 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:12.689 08:55:00 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:12.689 08:55:00 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:12.689 08:55:00 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:12.689 08:55:00 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:12.689 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:12.689 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.135 ms 00:16:12.689 00:16:12.689 --- 10.0.0.2 ping statistics --- 00:16:12.689 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:12.689 rtt min/avg/max/mdev = 0.135/0.135/0.135/0.000 ms 00:16:12.689 08:55:01 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:12.689 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:12.689 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.147 ms 00:16:12.689 00:16:12.689 --- 10.0.0.1 ping statistics --- 00:16:12.689 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:12.689 rtt min/avg/max/mdev = 0.147/0.147/0.147/0.000 ms 00:16:12.689 08:55:01 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:12.689 08:55:01 -- nvmf/common.sh@410 -- # return 0 00:16:12.689 08:55:01 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:12.689 08:55:01 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:12.689 08:55:01 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:12.689 08:55:01 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:12.689 08:55:01 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:12.689 08:55:01 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:12.689 08:55:01 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:12.689 08:55:01 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:16:12.689 08:55:01 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:12.689 08:55:01 -- common/autotest_common.sh@712 -- # xtrace_disable 00:16:12.689 08:55:01 -- common/autotest_common.sh@10 -- # set +x 00:16:12.689 08:55:01 -- nvmf/common.sh@469 -- # nvmfpid=1504595 00:16:12.689 08:55:01 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:12.689 08:55:01 -- nvmf/common.sh@470 -- # waitforlisten 1504595 00:16:12.689 08:55:01 -- common/autotest_common.sh@819 -- # '[' -z 1504595 ']' 00:16:12.689 08:55:01 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:12.689 08:55:01 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:12.689 08:55:01 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:12.689 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:12.689 08:55:01 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:12.689 08:55:01 -- common/autotest_common.sh@10 -- # set +x 00:16:12.689 [2024-07-15 08:55:01.083928] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:16:12.689 [2024-07-15 08:55:01.083996] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:12.689 EAL: No free 2048 kB hugepages reported on node 1 00:16:12.689 [2024-07-15 08:55:01.148930] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:12.946 [2024-07-15 08:55:01.259430] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:12.946 [2024-07-15 08:55:01.259580] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:12.947 [2024-07-15 08:55:01.259600] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:12.947 [2024-07-15 08:55:01.259614] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:12.947 [2024-07-15 08:55:01.259672] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:12.947 [2024-07-15 08:55:01.259745] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:12.947 [2024-07-15 08:55:01.259837] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:12.947 [2024-07-15 08:55:01.259840] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:13.877 08:55:02 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:13.877 08:55:02 -- common/autotest_common.sh@852 -- # return 0 00:16:13.877 08:55:02 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:13.877 08:55:02 -- common/autotest_common.sh@718 -- # xtrace_disable 00:16:13.877 08:55:02 -- common/autotest_common.sh@10 -- # set +x 00:16:13.877 08:55:02 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:13.877 08:55:02 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:16:13.877 [2024-07-15 08:55:02.370432] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:13.877 08:55:02 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:14.135 08:55:02 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:16:14.135 08:55:02 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:14.393 08:55:02 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:16:14.393 08:55:02 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:14.651 08:55:03 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:16:14.651 08:55:03 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:14.907 08:55:03 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:16:14.907 08:55:03 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:16:15.164 08:55:03 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:15.421 08:55:03 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:16:15.421 08:55:03 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:15.679 08:55:04 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:16:15.679 08:55:04 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:15.936 08:55:04 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:16:15.936 08:55:04 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:16:16.194 08:55:04 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:16.451 08:55:04 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:16:16.451 08:55:04 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:16.708 08:55:05 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:16:16.708 08:55:05 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:16:16.965 08:55:05 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:17.222 [2024-07-15 08:55:05.589436] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:17.222 08:55:05 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:16:17.480 08:55:05 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:16:17.737 08:55:06 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:16:18.311 08:55:06 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:16:18.311 08:55:06 -- common/autotest_common.sh@1177 -- # local i=0 00:16:18.311 08:55:06 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:16:18.311 08:55:06 -- common/autotest_common.sh@1179 -- # [[ -n 4 ]] 00:16:18.311 08:55:06 -- common/autotest_common.sh@1180 -- # nvme_device_counter=4 00:16:18.311 08:55:06 -- common/autotest_common.sh@1184 -- # sleep 2 00:16:20.206 08:55:08 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:16:20.206 08:55:08 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:16:20.206 08:55:08 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:16:20.206 08:55:08 -- common/autotest_common.sh@1186 -- # nvme_devices=4 00:16:20.206 08:55:08 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:16:20.206 08:55:08 -- common/autotest_common.sh@1187 -- # return 0 00:16:20.206 08:55:08 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:16:20.206 [global] 00:16:20.206 thread=1 00:16:20.206 invalidate=1 00:16:20.206 rw=write 00:16:20.206 time_based=1 00:16:20.206 runtime=1 00:16:20.206 ioengine=libaio 00:16:20.206 direct=1 00:16:20.206 bs=4096 00:16:20.206 iodepth=1 00:16:20.206 norandommap=0 00:16:20.206 numjobs=1 00:16:20.206 00:16:20.206 verify_dump=1 00:16:20.206 verify_backlog=512 00:16:20.206 verify_state_save=0 00:16:20.206 do_verify=1 00:16:20.206 verify=crc32c-intel 00:16:20.206 [job0] 00:16:20.206 filename=/dev/nvme0n1 00:16:20.206 [job1] 00:16:20.206 filename=/dev/nvme0n2 00:16:20.206 [job2] 00:16:20.206 filename=/dev/nvme0n3 00:16:20.206 [job3] 00:16:20.206 filename=/dev/nvme0n4 00:16:20.463 Could not set queue depth (nvme0n1) 00:16:20.463 Could not set queue depth (nvme0n2) 00:16:20.463 Could not set queue depth (nvme0n3) 00:16:20.463 Could not set queue depth (nvme0n4) 00:16:20.463 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:20.463 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:20.463 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:20.463 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:20.463 fio-3.35 00:16:20.463 Starting 4 threads 00:16:21.842 00:16:21.842 job0: (groupid=0, jobs=1): err= 0: pid=1505705: Mon Jul 15 08:55:10 2024 00:16:21.842 read: IOPS=781, BW=3125KiB/s (3200kB/s)(3128KiB/1001msec) 00:16:21.842 slat (nsec): min=4754, max=37779, avg=7811.92, stdev=4165.12 00:16:21.842 clat (usec): min=232, max=42067, avg=951.09, stdev=4889.71 00:16:21.842 lat (usec): min=237, max=42086, avg=958.90, stdev=4891.93 00:16:21.842 clat percentiles (usec): 00:16:21.842 | 1.00th=[ 237], 5.00th=[ 245], 10.00th=[ 260], 20.00th=[ 302], 00:16:21.842 | 30.00th=[ 326], 40.00th=[ 343], 50.00th=[ 351], 60.00th=[ 363], 00:16:21.842 | 70.00th=[ 383], 80.00th=[ 412], 90.00th=[ 441], 95.00th=[ 461], 00:16:21.842 | 99.00th=[41681], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:21.842 | 99.99th=[42206] 00:16:21.842 write: IOPS=1022, BW=4092KiB/s (4190kB/s)(4096KiB/1001msec); 0 zone resets 00:16:21.842 slat (nsec): min=6934, max=59846, avg=14226.79, stdev=8876.17 00:16:21.842 clat (usec): min=154, max=554, avg=223.66, stdev=60.33 00:16:21.842 lat (usec): min=162, max=596, avg=237.89, stdev=67.03 00:16:21.842 clat percentiles (usec): 00:16:21.842 | 1.00th=[ 161], 5.00th=[ 163], 10.00th=[ 165], 20.00th=[ 169], 00:16:21.842 | 30.00th=[ 174], 40.00th=[ 180], 50.00th=[ 204], 60.00th=[ 245], 00:16:21.842 | 70.00th=[ 262], 80.00th=[ 277], 90.00th=[ 293], 95.00th=[ 338], 00:16:21.842 | 99.00th=[ 400], 99.50th=[ 429], 99.90th=[ 474], 99.95th=[ 553], 00:16:21.842 | 99.99th=[ 553] 00:16:21.842 bw ( KiB/s): min= 4096, max= 4096, per=40.92%, avg=4096.00, stdev= 0.00, samples=1 00:16:21.842 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:21.842 lat (usec) : 250=39.04%, 500=59.91%, 750=0.28%, 1000=0.06% 00:16:21.842 lat (msec) : 2=0.06%, 20=0.06%, 50=0.61% 00:16:21.842 cpu : usr=1.80%, sys=2.20%, ctx=1808, majf=0, minf=2 00:16:21.842 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:21.842 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:21.842 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:21.842 issued rwts: total=782,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:21.842 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:21.842 job1: (groupid=0, jobs=1): err= 0: pid=1505706: Mon Jul 15 08:55:10 2024 00:16:21.842 read: IOPS=27, BW=110KiB/s (113kB/s)(112KiB/1017msec) 00:16:21.842 slat (nsec): min=6799, max=33441, avg=16695.04, stdev=8019.89 00:16:21.842 clat (usec): min=298, max=41450, avg=30878.77, stdev=17896.73 00:16:21.842 lat (usec): min=313, max=41465, avg=30895.47, stdev=17899.10 00:16:21.842 clat percentiles (usec): 00:16:21.842 | 1.00th=[ 297], 5.00th=[ 437], 10.00th=[ 445], 20.00th=[ 469], 00:16:21.842 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:21.842 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:16:21.842 | 99.00th=[41681], 99.50th=[41681], 99.90th=[41681], 99.95th=[41681], 00:16:21.842 | 99.99th=[41681] 00:16:21.843 write: IOPS=503, BW=2014KiB/s (2062kB/s)(2048KiB/1017msec); 0 zone resets 00:16:21.843 slat (nsec): min=7237, max=77283, avg=20482.81, stdev=10970.36 00:16:21.843 clat (usec): min=178, max=472, avg=269.18, stdev=54.18 00:16:21.843 lat (usec): min=192, max=520, avg=289.66, stdev=55.57 00:16:21.843 clat percentiles (usec): 00:16:21.843 | 1.00th=[ 188], 5.00th=[ 202], 10.00th=[ 210], 20.00th=[ 221], 00:16:21.843 | 30.00th=[ 233], 40.00th=[ 243], 50.00th=[ 260], 60.00th=[ 273], 00:16:21.843 | 70.00th=[ 293], 80.00th=[ 318], 90.00th=[ 351], 95.00th=[ 367], 00:16:21.843 | 99.00th=[ 412], 99.50th=[ 453], 99.90th=[ 474], 99.95th=[ 474], 00:16:21.843 | 99.99th=[ 474] 00:16:21.843 bw ( KiB/s): min= 4096, max= 4096, per=40.92%, avg=4096.00, stdev= 0.00, samples=1 00:16:21.843 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:21.843 lat (usec) : 250=43.33%, 500=52.59%, 750=0.19% 00:16:21.843 lat (msec) : 50=3.89% 00:16:21.843 cpu : usr=0.39%, sys=1.18%, ctx=541, majf=0, minf=1 00:16:21.843 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:21.843 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:21.843 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:21.843 issued rwts: total=28,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:21.843 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:21.843 job2: (groupid=0, jobs=1): err= 0: pid=1505707: Mon Jul 15 08:55:10 2024 00:16:21.843 read: IOPS=21, BW=86.0KiB/s (88.1kB/s)(88.0KiB/1023msec) 00:16:21.843 slat (nsec): min=10297, max=34117, avg=19209.36, stdev=8306.19 00:16:21.843 clat (usec): min=40864, max=41128, avg=40975.75, stdev=56.07 00:16:21.843 lat (usec): min=40898, max=41139, avg=40994.95, stdev=53.22 00:16:21.843 clat percentiles (usec): 00:16:21.843 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:16:21.843 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:21.843 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:16:21.843 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:21.843 | 99.99th=[41157] 00:16:21.843 write: IOPS=500, BW=2002KiB/s (2050kB/s)(2048KiB/1023msec); 0 zone resets 00:16:21.843 slat (nsec): min=8321, max=74746, avg=17353.25, stdev=7562.83 00:16:21.843 clat (usec): min=169, max=418, avg=213.37, stdev=27.48 00:16:21.843 lat (usec): min=179, max=430, avg=230.72, stdev=29.54 00:16:21.843 clat percentiles (usec): 00:16:21.843 | 1.00th=[ 180], 5.00th=[ 186], 10.00th=[ 190], 20.00th=[ 196], 00:16:21.843 | 30.00th=[ 202], 40.00th=[ 204], 50.00th=[ 208], 60.00th=[ 212], 00:16:21.843 | 70.00th=[ 219], 80.00th=[ 225], 90.00th=[ 237], 95.00th=[ 249], 00:16:21.843 | 99.00th=[ 326], 99.50th=[ 371], 99.90th=[ 420], 99.95th=[ 420], 00:16:21.843 | 99.99th=[ 420] 00:16:21.843 bw ( KiB/s): min= 4096, max= 4096, per=40.92%, avg=4096.00, stdev= 0.00, samples=1 00:16:21.843 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:21.843 lat (usec) : 250=91.57%, 500=4.31% 00:16:21.843 lat (msec) : 50=4.12% 00:16:21.843 cpu : usr=0.49%, sys=0.78%, ctx=537, majf=0, minf=1 00:16:21.843 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:21.843 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:21.843 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:21.843 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:21.843 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:21.843 job3: (groupid=0, jobs=1): err= 0: pid=1505708: Mon Jul 15 08:55:10 2024 00:16:21.843 read: IOPS=234, BW=936KiB/s (959kB/s)(940KiB/1004msec) 00:16:21.843 slat (nsec): min=5721, max=48123, avg=8177.26, stdev=5114.46 00:16:21.843 clat (usec): min=301, max=41062, avg=3693.23, stdev=11062.78 00:16:21.843 lat (usec): min=308, max=41078, avg=3701.41, stdev=11066.46 00:16:21.843 clat percentiles (usec): 00:16:21.843 | 1.00th=[ 306], 5.00th=[ 318], 10.00th=[ 334], 20.00th=[ 383], 00:16:21.843 | 30.00th=[ 404], 40.00th=[ 420], 50.00th=[ 433], 60.00th=[ 445], 00:16:21.843 | 70.00th=[ 453], 80.00th=[ 469], 90.00th=[ 529], 95.00th=[41157], 00:16:21.843 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:21.843 | 99.99th=[41157] 00:16:21.843 write: IOPS=509, BW=2040KiB/s (2089kB/s)(2048KiB/1004msec); 0 zone resets 00:16:21.843 slat (nsec): min=7956, max=72043, avg=17301.91, stdev=8538.17 00:16:21.843 clat (usec): min=179, max=421, avg=236.91, stdev=35.87 00:16:21.843 lat (usec): min=189, max=434, avg=254.21, stdev=36.91 00:16:21.843 clat percentiles (usec): 00:16:21.843 | 1.00th=[ 184], 5.00th=[ 194], 10.00th=[ 200], 20.00th=[ 208], 00:16:21.843 | 30.00th=[ 217], 40.00th=[ 223], 50.00th=[ 229], 60.00th=[ 237], 00:16:21.843 | 70.00th=[ 245], 80.00th=[ 262], 90.00th=[ 281], 95.00th=[ 318], 00:16:21.843 | 99.00th=[ 351], 99.50th=[ 363], 99.90th=[ 420], 99.95th=[ 420], 00:16:21.843 | 99.99th=[ 420] 00:16:21.843 bw ( KiB/s): min= 4096, max= 4096, per=40.92%, avg=4096.00, stdev= 0.00, samples=1 00:16:21.843 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:21.843 lat (usec) : 250=50.60%, 500=45.65%, 750=1.20% 00:16:21.843 lat (msec) : 50=2.54% 00:16:21.843 cpu : usr=0.50%, sys=1.20%, ctx=748, majf=0, minf=1 00:16:21.843 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:21.843 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:21.843 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:21.843 issued rwts: total=235,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:21.843 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:21.843 00:16:21.843 Run status group 0 (all jobs): 00:16:21.843 READ: bw=4172KiB/s (4272kB/s), 86.0KiB/s-3125KiB/s (88.1kB/s-3200kB/s), io=4268KiB (4370kB), run=1001-1023msec 00:16:21.843 WRITE: bw=9.77MiB/s (10.2MB/s), 2002KiB/s-4092KiB/s (2050kB/s-4190kB/s), io=10.0MiB (10.5MB), run=1001-1023msec 00:16:21.843 00:16:21.843 Disk stats (read/write): 00:16:21.843 nvme0n1: ios=561/674, merge=0/0, ticks=1313/166, in_queue=1479, util=85.57% 00:16:21.843 nvme0n2: ios=72/512, merge=0/0, ticks=1548/126, in_queue=1674, util=89.52% 00:16:21.843 nvme0n3: ios=74/512, merge=0/0, ticks=1665/107, in_queue=1772, util=93.52% 00:16:21.843 nvme0n4: ios=288/512, merge=0/0, ticks=785/121, in_queue=906, util=95.89% 00:16:21.843 08:55:10 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:16:21.843 [global] 00:16:21.843 thread=1 00:16:21.843 invalidate=1 00:16:21.843 rw=randwrite 00:16:21.843 time_based=1 00:16:21.843 runtime=1 00:16:21.843 ioengine=libaio 00:16:21.843 direct=1 00:16:21.843 bs=4096 00:16:21.843 iodepth=1 00:16:21.843 norandommap=0 00:16:21.843 numjobs=1 00:16:21.843 00:16:21.843 verify_dump=1 00:16:21.843 verify_backlog=512 00:16:21.843 verify_state_save=0 00:16:21.843 do_verify=1 00:16:21.843 verify=crc32c-intel 00:16:21.843 [job0] 00:16:21.843 filename=/dev/nvme0n1 00:16:21.843 [job1] 00:16:21.843 filename=/dev/nvme0n2 00:16:21.843 [job2] 00:16:21.843 filename=/dev/nvme0n3 00:16:21.843 [job3] 00:16:21.843 filename=/dev/nvme0n4 00:16:21.843 Could not set queue depth (nvme0n1) 00:16:21.843 Could not set queue depth (nvme0n2) 00:16:21.843 Could not set queue depth (nvme0n3) 00:16:21.843 Could not set queue depth (nvme0n4) 00:16:22.101 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:22.101 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:22.101 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:22.101 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:22.101 fio-3.35 00:16:22.101 Starting 4 threads 00:16:23.471 00:16:23.471 job0: (groupid=0, jobs=1): err= 0: pid=1506010: Mon Jul 15 08:55:11 2024 00:16:23.471 read: IOPS=21, BW=84.5KiB/s (86.5kB/s)(88.0KiB/1042msec) 00:16:23.471 slat (nsec): min=7889, max=33776, avg=17760.32, stdev=6741.99 00:16:23.471 clat (usec): min=40787, max=42011, avg=41692.52, stdev=473.00 00:16:23.471 lat (usec): min=40795, max=42026, avg=41710.28, stdev=475.16 00:16:23.471 clat percentiles (usec): 00:16:23.471 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:16:23.471 | 30.00th=[41681], 40.00th=[42206], 50.00th=[42206], 60.00th=[42206], 00:16:23.471 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:16:23.471 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:23.471 | 99.99th=[42206] 00:16:23.471 write: IOPS=491, BW=1965KiB/s (2013kB/s)(2048KiB/1042msec); 0 zone resets 00:16:23.471 slat (nsec): min=6524, max=76050, avg=12862.31, stdev=6256.21 00:16:23.471 clat (usec): min=180, max=437, avg=225.76, stdev=21.00 00:16:23.471 lat (usec): min=186, max=453, avg=238.62, stdev=22.07 00:16:23.471 clat percentiles (usec): 00:16:23.471 | 1.00th=[ 190], 5.00th=[ 196], 10.00th=[ 202], 20.00th=[ 210], 00:16:23.471 | 30.00th=[ 217], 40.00th=[ 221], 50.00th=[ 225], 60.00th=[ 229], 00:16:23.471 | 70.00th=[ 235], 80.00th=[ 239], 90.00th=[ 247], 95.00th=[ 255], 00:16:23.471 | 99.00th=[ 269], 99.50th=[ 338], 99.90th=[ 437], 99.95th=[ 437], 00:16:23.471 | 99.99th=[ 437] 00:16:23.471 bw ( KiB/s): min= 4096, max= 4096, per=23.96%, avg=4096.00, stdev= 0.00, samples=1 00:16:23.471 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:23.471 lat (usec) : 250=88.20%, 500=7.68% 00:16:23.471 lat (msec) : 50=4.12% 00:16:23.471 cpu : usr=0.38%, sys=0.58%, ctx=534, majf=0, minf=1 00:16:23.471 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:23.471 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:23.471 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:23.471 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:23.471 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:23.471 job1: (groupid=0, jobs=1): err= 0: pid=1506025: Mon Jul 15 08:55:11 2024 00:16:23.471 read: IOPS=695, BW=2781KiB/s (2848kB/s)(2784KiB/1001msec) 00:16:23.471 slat (nsec): min=6064, max=49547, avg=11457.88, stdev=6189.55 00:16:23.471 clat (usec): min=281, max=41990, avg=1017.01, stdev=5209.25 00:16:23.471 lat (usec): min=288, max=42005, avg=1028.47, stdev=5210.16 00:16:23.471 clat percentiles (usec): 00:16:23.471 | 1.00th=[ 285], 5.00th=[ 293], 10.00th=[ 297], 20.00th=[ 306], 00:16:23.471 | 30.00th=[ 314], 40.00th=[ 322], 50.00th=[ 330], 60.00th=[ 338], 00:16:23.471 | 70.00th=[ 347], 80.00th=[ 355], 90.00th=[ 367], 95.00th=[ 404], 00:16:23.471 | 99.00th=[41681], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:23.471 | 99.99th=[42206] 00:16:23.471 write: IOPS=1022, BW=4092KiB/s (4190kB/s)(4096KiB/1001msec); 0 zone resets 00:16:23.471 slat (nsec): min=7334, max=58904, avg=17627.67, stdev=8773.49 00:16:23.472 clat (usec): min=178, max=547, avg=252.65, stdev=54.98 00:16:23.472 lat (usec): min=186, max=558, avg=270.28, stdev=57.92 00:16:23.472 clat percentiles (usec): 00:16:23.472 | 1.00th=[ 188], 5.00th=[ 194], 10.00th=[ 200], 20.00th=[ 210], 00:16:23.472 | 30.00th=[ 217], 40.00th=[ 225], 50.00th=[ 231], 60.00th=[ 243], 00:16:23.472 | 70.00th=[ 273], 80.00th=[ 306], 90.00th=[ 330], 95.00th=[ 367], 00:16:23.472 | 99.00th=[ 404], 99.50th=[ 429], 99.90th=[ 490], 99.95th=[ 545], 00:16:23.472 | 99.99th=[ 545] 00:16:23.472 bw ( KiB/s): min= 8192, max= 8192, per=47.91%, avg=8192.00, stdev= 0.00, samples=1 00:16:23.472 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:23.472 lat (usec) : 250=37.67%, 500=61.22%, 750=0.23%, 1000=0.12% 00:16:23.472 lat (msec) : 2=0.06%, 20=0.06%, 50=0.64% 00:16:23.472 cpu : usr=2.80%, sys=2.60%, ctx=1721, majf=0, minf=1 00:16:23.472 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:23.472 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:23.472 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:23.472 issued rwts: total=696,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:23.472 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:23.472 job2: (groupid=0, jobs=1): err= 0: pid=1506062: Mon Jul 15 08:55:11 2024 00:16:23.472 read: IOPS=782, BW=3129KiB/s (3204kB/s)(3132KiB/1001msec) 00:16:23.472 slat (nsec): min=5518, max=66158, avg=13764.33, stdev=9504.19 00:16:23.472 clat (usec): min=287, max=41094, avg=924.57, stdev=4784.62 00:16:23.472 lat (usec): min=294, max=41110, avg=938.33, stdev=4785.42 00:16:23.472 clat percentiles (usec): 00:16:23.472 | 1.00th=[ 297], 5.00th=[ 310], 10.00th=[ 314], 20.00th=[ 322], 00:16:23.472 | 30.00th=[ 330], 40.00th=[ 338], 50.00th=[ 347], 60.00th=[ 355], 00:16:23.472 | 70.00th=[ 367], 80.00th=[ 383], 90.00th=[ 400], 95.00th=[ 433], 00:16:23.472 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:23.472 | 99.99th=[41157] 00:16:23.472 write: IOPS=1022, BW=4092KiB/s (4190kB/s)(4096KiB/1001msec); 0 zone resets 00:16:23.472 slat (nsec): min=7042, max=46245, avg=15540.27, stdev=7182.11 00:16:23.472 clat (usec): min=183, max=480, avg=236.33, stdev=27.43 00:16:23.472 lat (usec): min=191, max=526, avg=251.87, stdev=29.14 00:16:23.472 clat percentiles (usec): 00:16:23.472 | 1.00th=[ 194], 5.00th=[ 202], 10.00th=[ 208], 20.00th=[ 217], 00:16:23.472 | 30.00th=[ 223], 40.00th=[ 229], 50.00th=[ 233], 60.00th=[ 237], 00:16:23.472 | 70.00th=[ 243], 80.00th=[ 251], 90.00th=[ 265], 95.00th=[ 285], 00:16:23.472 | 99.00th=[ 334], 99.50th=[ 338], 99.90th=[ 383], 99.95th=[ 482], 00:16:23.472 | 99.99th=[ 482] 00:16:23.472 bw ( KiB/s): min= 8192, max= 8192, per=47.91%, avg=8192.00, stdev= 0.00, samples=1 00:16:23.472 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:23.472 lat (usec) : 250=44.38%, 500=54.68%, 750=0.33% 00:16:23.472 lat (msec) : 50=0.61% 00:16:23.472 cpu : usr=1.70%, sys=2.70%, ctx=1807, majf=0, minf=2 00:16:23.472 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:23.472 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:23.472 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:23.472 issued rwts: total=783,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:23.472 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:23.472 job3: (groupid=0, jobs=1): err= 0: pid=1506063: Mon Jul 15 08:55:11 2024 00:16:23.472 read: IOPS=1534, BW=6138KiB/s (6285kB/s)(6144KiB/1001msec) 00:16:23.472 slat (nsec): min=6071, max=47583, avg=11602.23, stdev=5418.16 00:16:23.472 clat (usec): min=282, max=803, avg=351.92, stdev=42.02 00:16:23.472 lat (usec): min=289, max=813, avg=363.52, stdev=43.98 00:16:23.472 clat percentiles (usec): 00:16:23.472 | 1.00th=[ 293], 5.00th=[ 306], 10.00th=[ 314], 20.00th=[ 322], 00:16:23.472 | 30.00th=[ 326], 40.00th=[ 338], 50.00th=[ 351], 60.00th=[ 359], 00:16:23.472 | 70.00th=[ 363], 80.00th=[ 371], 90.00th=[ 392], 95.00th=[ 424], 00:16:23.472 | 99.00th=[ 494], 99.50th=[ 545], 99.90th=[ 709], 99.95th=[ 807], 00:16:23.472 | 99.99th=[ 807] 00:16:23.472 write: IOPS=1892, BW=7568KiB/s (7750kB/s)(7576KiB/1001msec); 0 zone resets 00:16:23.472 slat (nsec): min=7507, max=55340, avg=13560.43, stdev=6783.52 00:16:23.472 clat (usec): min=170, max=491, avg=212.71, stdev=25.94 00:16:23.472 lat (usec): min=179, max=528, avg=226.27, stdev=30.01 00:16:23.472 clat percentiles (usec): 00:16:23.472 | 1.00th=[ 176], 5.00th=[ 182], 10.00th=[ 184], 20.00th=[ 190], 00:16:23.472 | 30.00th=[ 196], 40.00th=[ 202], 50.00th=[ 210], 60.00th=[ 219], 00:16:23.472 | 70.00th=[ 227], 80.00th=[ 233], 90.00th=[ 243], 95.00th=[ 253], 00:16:23.472 | 99.00th=[ 293], 99.50th=[ 314], 99.90th=[ 359], 99.95th=[ 490], 00:16:23.472 | 99.99th=[ 490] 00:16:23.472 bw ( KiB/s): min= 8192, max= 8192, per=47.91%, avg=8192.00, stdev= 0.00, samples=1 00:16:23.472 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:23.472 lat (usec) : 250=51.92%, 500=47.67%, 750=0.38%, 1000=0.03% 00:16:23.472 cpu : usr=4.20%, sys=5.00%, ctx=3430, majf=0, minf=1 00:16:23.472 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:23.472 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:23.472 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:23.472 issued rwts: total=1536,1894,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:23.472 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:23.472 00:16:23.472 Run status group 0 (all jobs): 00:16:23.472 READ: bw=11.4MiB/s (11.9MB/s), 84.5KiB/s-6138KiB/s (86.5kB/s-6285kB/s), io=11.9MiB (12.4MB), run=1001-1042msec 00:16:23.472 WRITE: bw=16.7MiB/s (17.5MB/s), 1965KiB/s-7568KiB/s (2013kB/s-7750kB/s), io=17.4MiB (18.2MB), run=1001-1042msec 00:16:23.472 00:16:23.472 Disk stats (read/write): 00:16:23.472 nvme0n1: ios=67/512, merge=0/0, ticks=740/116, in_queue=856, util=86.67% 00:16:23.472 nvme0n2: ios=547/1024, merge=0/0, ticks=1520/249, in_queue=1769, util=97.86% 00:16:23.472 nvme0n3: ios=521/1024, merge=0/0, ticks=552/241, in_queue=793, util=88.89% 00:16:23.472 nvme0n4: ios=1302/1536, merge=0/0, ticks=453/321, in_queue=774, util=89.64% 00:16:23.472 08:55:11 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:16:23.472 [global] 00:16:23.472 thread=1 00:16:23.472 invalidate=1 00:16:23.472 rw=write 00:16:23.472 time_based=1 00:16:23.472 runtime=1 00:16:23.472 ioengine=libaio 00:16:23.472 direct=1 00:16:23.472 bs=4096 00:16:23.472 iodepth=128 00:16:23.472 norandommap=0 00:16:23.472 numjobs=1 00:16:23.472 00:16:23.472 verify_dump=1 00:16:23.472 verify_backlog=512 00:16:23.472 verify_state_save=0 00:16:23.472 do_verify=1 00:16:23.472 verify=crc32c-intel 00:16:23.472 [job0] 00:16:23.472 filename=/dev/nvme0n1 00:16:23.472 [job1] 00:16:23.472 filename=/dev/nvme0n2 00:16:23.472 [job2] 00:16:23.472 filename=/dev/nvme0n3 00:16:23.472 [job3] 00:16:23.472 filename=/dev/nvme0n4 00:16:23.472 Could not set queue depth (nvme0n1) 00:16:23.472 Could not set queue depth (nvme0n2) 00:16:23.472 Could not set queue depth (nvme0n3) 00:16:23.472 Could not set queue depth (nvme0n4) 00:16:23.472 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:23.472 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:23.472 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:23.472 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:23.472 fio-3.35 00:16:23.472 Starting 4 threads 00:16:24.848 00:16:24.848 job0: (groupid=0, jobs=1): err= 0: pid=1506299: Mon Jul 15 08:55:13 2024 00:16:24.848 read: IOPS=2022, BW=8092KiB/s (8286kB/s)(8448KiB/1044msec) 00:16:24.848 slat (usec): min=2, max=30995, avg=219.57, stdev=1620.50 00:16:24.848 clat (msec): min=4, max=126, avg=30.08, stdev=24.29 00:16:24.848 lat (msec): min=4, max=136, avg=30.30, stdev=24.47 00:16:24.848 clat percentiles (msec): 00:16:24.848 | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 14], 00:16:24.848 | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 24], 60.00th=[ 27], 00:16:24.848 | 70.00th=[ 31], 80.00th=[ 46], 90.00th=[ 72], 95.00th=[ 85], 00:16:24.848 | 99.00th=[ 113], 99.50th=[ 120], 99.90th=[ 127], 99.95th=[ 127], 00:16:24.848 | 99.99th=[ 127] 00:16:24.848 write: IOPS=2452, BW=9808KiB/s (10.0MB/s)(10.0MiB/1044msec); 0 zone resets 00:16:24.848 slat (usec): min=3, max=20101, avg=194.95, stdev=1072.28 00:16:24.848 clat (msec): min=4, max=107, avg=26.92, stdev=23.04 00:16:24.848 lat (msec): min=4, max=107, avg=27.11, stdev=23.17 00:16:24.848 clat percentiles (msec): 00:16:24.848 | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], 00:16:24.848 | 30.00th=[ 10], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 26], 00:16:24.848 | 70.00th=[ 37], 80.00th=[ 48], 90.00th=[ 61], 95.00th=[ 72], 00:16:24.848 | 99.00th=[ 103], 99.50th=[ 108], 99.90th=[ 108], 99.95th=[ 108], 00:16:24.848 | 99.99th=[ 108] 00:16:24.848 bw ( KiB/s): min= 8192, max=11784, per=17.53%, avg=9988.00, stdev=2539.93, samples=2 00:16:24.848 iops : min= 2048, max= 2946, avg=2497.00, stdev=634.98, samples=2 00:16:24.848 lat (msec) : 10=24.23%, 20=26.82%, 50=33.11%, 100=13.89%, 250=1.95% 00:16:24.848 cpu : usr=2.78%, sys=3.84%, ctx=224, majf=0, minf=1 00:16:24.848 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:16:24.848 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:24.848 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:24.848 issued rwts: total=2112,2560,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:24.848 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:24.848 job1: (groupid=0, jobs=1): err= 0: pid=1506300: Mon Jul 15 08:55:13 2024 00:16:24.848 read: IOPS=4231, BW=16.5MiB/s (17.3MB/s)(16.7MiB/1008msec) 00:16:24.848 slat (usec): min=3, max=19884, avg=102.07, stdev=709.54 00:16:24.848 clat (usec): min=3604, max=44587, avg=13051.72, stdev=7742.35 00:16:24.848 lat (usec): min=4790, max=44601, avg=13153.78, stdev=7803.62 00:16:24.848 clat percentiles (usec): 00:16:24.848 | 1.00th=[ 5604], 5.00th=[ 7111], 10.00th=[ 7963], 20.00th=[ 8356], 00:16:24.848 | 30.00th=[ 8586], 40.00th=[ 8979], 50.00th=[ 9765], 60.00th=[ 9896], 00:16:24.848 | 70.00th=[10683], 80.00th=[21365], 90.00th=[25035], 95.00th=[30802], 00:16:24.848 | 99.00th=[36963], 99.50th=[38536], 99.90th=[39060], 99.95th=[39060], 00:16:24.848 | 99.99th=[44827] 00:16:24.848 write: IOPS=4571, BW=17.9MiB/s (18.7MB/s)(18.0MiB/1008msec); 0 zone resets 00:16:24.848 slat (usec): min=4, max=31053, avg=113.04, stdev=942.73 00:16:24.848 clat (usec): min=4766, max=91813, avg=14202.16, stdev=9665.05 00:16:24.848 lat (usec): min=4777, max=91862, avg=14315.20, stdev=9793.79 00:16:24.848 clat percentiles (usec): 00:16:24.848 | 1.00th=[ 5669], 5.00th=[ 7635], 10.00th=[ 8455], 20.00th=[ 8848], 00:16:24.848 | 30.00th=[ 9241], 40.00th=[ 9634], 50.00th=[ 9896], 60.00th=[10421], 00:16:24.848 | 70.00th=[13173], 80.00th=[18744], 90.00th=[26346], 95.00th=[37487], 00:16:24.848 | 99.00th=[50070], 99.50th=[61080], 99.90th=[61080], 99.95th=[62129], 00:16:24.848 | 99.99th=[91751] 00:16:24.848 bw ( KiB/s): min=14744, max=22120, per=32.35%, avg=18432.00, stdev=5215.62, samples=2 00:16:24.848 iops : min= 3686, max= 5530, avg=4608.00, stdev=1303.90, samples=2 00:16:24.848 lat (msec) : 4=0.01%, 10=55.84%, 20=25.29%, 50=18.34%, 100=0.52% 00:16:24.848 cpu : usr=5.96%, sys=9.14%, ctx=339, majf=0, minf=1 00:16:24.848 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:16:24.848 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:24.848 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:24.848 issued rwts: total=4265,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:24.848 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:24.848 job2: (groupid=0, jobs=1): err= 0: pid=1506303: Mon Jul 15 08:55:13 2024 00:16:24.848 read: IOPS=4059, BW=15.9MiB/s (16.6MB/s)(16.0MiB/1009msec) 00:16:24.848 slat (usec): min=2, max=9809, avg=88.01, stdev=654.72 00:16:24.848 clat (usec): min=2912, max=93368, avg=13327.16, stdev=8243.23 00:16:24.848 lat (usec): min=2946, max=93378, avg=13415.17, stdev=8273.23 00:16:24.848 clat percentiles (usec): 00:16:24.848 | 1.00th=[ 3949], 5.00th=[ 7963], 10.00th=[ 8717], 20.00th=[ 8979], 00:16:24.848 | 30.00th=[ 9503], 40.00th=[10683], 50.00th=[11207], 60.00th=[12256], 00:16:24.848 | 70.00th=[13829], 80.00th=[16188], 90.00th=[19530], 95.00th=[22414], 00:16:24.848 | 99.00th=[55837], 99.50th=[70779], 99.90th=[93848], 99.95th=[93848], 00:16:24.848 | 99.99th=[93848] 00:16:24.848 write: IOPS=4240, BW=16.6MiB/s (17.4MB/s)(16.7MiB/1009msec); 0 zone resets 00:16:24.848 slat (usec): min=3, max=19443, avg=127.48, stdev=796.26 00:16:24.848 clat (usec): min=458, max=112497, avg=17155.85, stdev=19212.85 00:16:24.848 lat (usec): min=502, max=112506, avg=17283.33, stdev=19357.11 00:16:24.848 clat percentiles (msec): 00:16:24.848 | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 7], 20.00th=[ 8], 00:16:24.848 | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 11], 60.00th=[ 12], 00:16:24.848 | 70.00th=[ 12], 80.00th=[ 16], 90.00th=[ 43], 95.00th=[ 68], 00:16:24.848 | 99.00th=[ 96], 99.50th=[ 104], 99.90th=[ 113], 99.95th=[ 113], 00:16:24.848 | 99.99th=[ 113] 00:16:24.848 bw ( KiB/s): min= 8640, max=24526, per=29.11%, avg=16583.00, stdev=11233.10, samples=2 00:16:24.848 iops : min= 2160, max= 6131, avg=4145.50, stdev=2807.92, samples=2 00:16:24.848 lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01% 00:16:24.849 lat (msec) : 2=0.04%, 4=2.64%, 10=34.14%, 20=50.42%, 50=7.70% 00:16:24.849 lat (msec) : 100=4.70%, 250=0.32% 00:16:24.849 cpu : usr=5.65%, sys=8.23%, ctx=402, majf=0, minf=1 00:16:24.849 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:16:24.849 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:24.849 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:24.849 issued rwts: total=4096,4279,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:24.849 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:24.849 job3: (groupid=0, jobs=1): err= 0: pid=1506304: Mon Jul 15 08:55:13 2024 00:16:24.849 read: IOPS=3041, BW=11.9MiB/s (12.5MB/s)(12.0MiB/1010msec) 00:16:24.849 slat (usec): min=3, max=17235, avg=128.28, stdev=885.03 00:16:24.849 clat (usec): min=4461, max=52129, avg=16016.52, stdev=6582.71 00:16:24.849 lat (usec): min=4467, max=52153, avg=16144.81, stdev=6646.61 00:16:24.849 clat percentiles (usec): 00:16:24.849 | 1.00th=[ 8455], 5.00th=[ 9372], 10.00th=[ 9765], 20.00th=[12256], 00:16:24.849 | 30.00th=[13304], 40.00th=[13829], 50.00th=[14222], 60.00th=[15401], 00:16:24.849 | 70.00th=[16581], 80.00th=[19006], 90.00th=[21365], 95.00th=[27919], 00:16:24.849 | 99.00th=[44303], 99.50th=[46924], 99.90th=[52167], 99.95th=[52167], 00:16:24.849 | 99.99th=[52167] 00:16:24.849 write: IOPS=3388, BW=13.2MiB/s (13.9MB/s)(13.4MiB/1010msec); 0 zone resets 00:16:24.849 slat (usec): min=4, max=18380, avg=165.92, stdev=911.15 00:16:24.849 clat (usec): min=1473, max=103776, avg=23066.21, stdev=16918.79 00:16:24.849 lat (msec): min=2, max=103, avg=23.23, stdev=17.02 00:16:24.849 clat percentiles (msec): 00:16:24.849 | 1.00th=[ 5], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 11], 00:16:24.849 | 30.00th=[ 13], 40.00th=[ 14], 50.00th=[ 19], 60.00th=[ 20], 00:16:24.849 | 70.00th=[ 31], 80.00th=[ 36], 90.00th=[ 41], 95.00th=[ 50], 00:16:24.849 | 99.00th=[ 93], 99.50th=[ 96], 99.90th=[ 104], 99.95th=[ 104], 00:16:24.849 | 99.99th=[ 104] 00:16:24.849 bw ( KiB/s): min=12016, max=14344, per=23.14%, avg=13180.00, stdev=1646.14, samples=2 00:16:24.849 iops : min= 3004, max= 3586, avg=3295.00, stdev=411.54, samples=2 00:16:24.849 lat (msec) : 2=0.02%, 4=0.20%, 10=12.47%, 20=59.87%, 50=24.68% 00:16:24.849 lat (msec) : 100=2.66%, 250=0.09% 00:16:24.849 cpu : usr=5.05%, sys=5.95%, ctx=341, majf=0, minf=1 00:16:24.849 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:16:24.849 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:24.849 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:24.849 issued rwts: total=3072,3422,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:24.849 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:24.849 00:16:24.849 Run status group 0 (all jobs): 00:16:24.849 READ: bw=50.7MiB/s (53.1MB/s), 8092KiB/s-16.5MiB/s (8286kB/s-17.3MB/s), io=52.9MiB (55.5MB), run=1008-1044msec 00:16:24.849 WRITE: bw=55.6MiB/s (58.3MB/s), 9808KiB/s-17.9MiB/s (10.0MB/s-18.7MB/s), io=58.1MiB (60.9MB), run=1008-1044msec 00:16:24.849 00:16:24.849 Disk stats (read/write): 00:16:24.849 nvme0n1: ios=1768/2048, merge=0/0, ticks=21385/23358, in_queue=44743, util=99.50% 00:16:24.849 nvme0n2: ios=3951/4096, merge=0/0, ticks=21082/23275, in_queue=44357, util=97.66% 00:16:24.849 nvme0n3: ios=3625/3991, merge=0/0, ticks=32691/43216, in_queue=75907, util=98.01% 00:16:24.849 nvme0n4: ios=2118/2560, merge=0/0, ticks=36738/63350, in_queue=100088, util=97.57% 00:16:24.849 08:55:13 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:16:24.849 [global] 00:16:24.849 thread=1 00:16:24.849 invalidate=1 00:16:24.849 rw=randwrite 00:16:24.849 time_based=1 00:16:24.849 runtime=1 00:16:24.849 ioengine=libaio 00:16:24.849 direct=1 00:16:24.849 bs=4096 00:16:24.849 iodepth=128 00:16:24.849 norandommap=0 00:16:24.849 numjobs=1 00:16:24.849 00:16:24.849 verify_dump=1 00:16:24.849 verify_backlog=512 00:16:24.849 verify_state_save=0 00:16:24.849 do_verify=1 00:16:24.849 verify=crc32c-intel 00:16:24.849 [job0] 00:16:24.849 filename=/dev/nvme0n1 00:16:24.849 [job1] 00:16:24.849 filename=/dev/nvme0n2 00:16:24.849 [job2] 00:16:24.849 filename=/dev/nvme0n3 00:16:24.849 [job3] 00:16:24.849 filename=/dev/nvme0n4 00:16:24.849 Could not set queue depth (nvme0n1) 00:16:24.849 Could not set queue depth (nvme0n2) 00:16:24.849 Could not set queue depth (nvme0n3) 00:16:24.849 Could not set queue depth (nvme0n4) 00:16:24.849 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:24.849 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:24.849 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:24.849 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:24.849 fio-3.35 00:16:24.849 Starting 4 threads 00:16:26.223 00:16:26.223 job0: (groupid=0, jobs=1): err= 0: pid=1506535: Mon Jul 15 08:55:14 2024 00:16:26.223 read: IOPS=5109, BW=20.0MiB/s (20.9MB/s)(20.0MiB/1002msec) 00:16:26.223 slat (usec): min=2, max=9986, avg=90.87, stdev=471.91 00:16:26.223 clat (usec): min=5572, max=28680, avg=12325.66, stdev=2193.39 00:16:26.223 lat (usec): min=5581, max=28687, avg=12416.53, stdev=2178.94 00:16:26.223 clat percentiles (usec): 00:16:26.223 | 1.00th=[ 6587], 5.00th=[ 9765], 10.00th=[10683], 20.00th=[11338], 00:16:26.223 | 30.00th=[11600], 40.00th=[11863], 50.00th=[11994], 60.00th=[12256], 00:16:26.223 | 70.00th=[12518], 80.00th=[13042], 90.00th=[14222], 95.00th=[15795], 00:16:26.223 | 99.00th=[20579], 99.50th=[25822], 99.90th=[28705], 99.95th=[28705], 00:16:26.223 | 99.99th=[28705] 00:16:26.223 write: IOPS=5197, BW=20.3MiB/s (21.3MB/s)(20.3MiB/1002msec); 0 zone resets 00:16:26.223 slat (usec): min=3, max=10406, avg=93.30, stdev=488.24 00:16:26.223 clat (usec): min=354, max=22962, avg=12111.66, stdev=2084.60 00:16:26.223 lat (usec): min=1515, max=22966, avg=12204.96, stdev=2068.34 00:16:26.223 clat percentiles (usec): 00:16:26.223 | 1.00th=[ 5473], 5.00th=[ 7635], 10.00th=[10028], 20.00th=[10814], 00:16:26.223 | 30.00th=[11600], 40.00th=[12125], 50.00th=[12518], 60.00th=[12780], 00:16:26.223 | 70.00th=[13042], 80.00th=[13304], 90.00th=[13698], 95.00th=[14222], 00:16:26.223 | 99.00th=[16909], 99.50th=[20317], 99.90th=[20317], 99.95th=[20317], 00:16:26.223 | 99.99th=[22938] 00:16:26.223 bw ( KiB/s): min=20439, max=20480, per=31.27%, avg=20459.50, stdev=28.99, samples=2 00:16:26.223 iops : min= 5109, max= 5120, avg=5114.50, stdev= 7.78, samples=2 00:16:26.223 lat (usec) : 500=0.01% 00:16:26.223 lat (msec) : 2=0.08%, 4=0.37%, 10=7.61%, 20=90.88%, 50=1.06% 00:16:26.223 cpu : usr=5.59%, sys=10.19%, ctx=518, majf=0, minf=1 00:16:26.223 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:16:26.223 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:26.223 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:26.223 issued rwts: total=5120,5208,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:26.223 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:26.223 job1: (groupid=0, jobs=1): err= 0: pid=1506536: Mon Jul 15 08:55:14 2024 00:16:26.223 read: IOPS=2031, BW=8127KiB/s (8322kB/s)(8192KiB/1008msec) 00:16:26.223 slat (usec): min=3, max=14802, avg=238.08, stdev=1225.70 00:16:26.223 clat (usec): min=9778, max=61943, avg=30204.16, stdev=14356.83 00:16:26.223 lat (usec): min=9989, max=61954, avg=30442.24, stdev=14474.64 00:16:26.223 clat percentiles (usec): 00:16:26.223 | 1.00th=[10552], 5.00th=[12256], 10.00th=[12518], 20.00th=[13042], 00:16:26.223 | 30.00th=[14877], 40.00th=[26608], 50.00th=[34866], 60.00th=[36439], 00:16:26.223 | 70.00th=[40109], 80.00th=[44303], 90.00th=[48497], 95.00th=[52167], 00:16:26.223 | 99.00th=[56361], 99.50th=[59507], 99.90th=[62129], 99.95th=[62129], 00:16:26.223 | 99.99th=[62129] 00:16:26.223 write: IOPS=2303, BW=9214KiB/s (9435kB/s)(9288KiB/1008msec); 0 zone resets 00:16:26.223 slat (usec): min=4, max=9838, avg=211.25, stdev=991.85 00:16:26.223 clat (usec): min=7471, max=67149, avg=28218.43, stdev=17410.16 00:16:26.223 lat (usec): min=9371, max=67171, avg=28429.67, stdev=17531.52 00:16:26.223 clat percentiles (usec): 00:16:26.223 | 1.00th=[10290], 5.00th=[11207], 10.00th=[11863], 20.00th=[13042], 00:16:26.223 | 30.00th=[13829], 40.00th=[14484], 50.00th=[17433], 60.00th=[29754], 00:16:26.223 | 70.00th=[40633], 80.00th=[47973], 90.00th=[54789], 95.00th=[59507], 00:16:26.223 | 99.00th=[65799], 99.50th=[66323], 99.90th=[67634], 99.95th=[67634], 00:16:26.223 | 99.99th=[67634] 00:16:26.223 bw ( KiB/s): min= 6344, max=11193, per=13.40%, avg=8768.50, stdev=3428.76, samples=2 00:16:26.223 iops : min= 1586, max= 2798, avg=2192.00, stdev=857.01, samples=2 00:16:26.223 lat (msec) : 10=0.30%, 20=44.35%, 50=43.52%, 100=11.83% 00:16:26.223 cpu : usr=3.48%, sys=3.57%, ctx=269, majf=0, minf=1 00:16:26.223 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:16:26.223 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:26.223 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:26.223 issued rwts: total=2048,2322,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:26.223 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:26.223 job2: (groupid=0, jobs=1): err= 0: pid=1506537: Mon Jul 15 08:55:14 2024 00:16:26.223 read: IOPS=3555, BW=13.9MiB/s (14.6MB/s)(14.0MiB/1008msec) 00:16:26.223 slat (usec): min=2, max=9286, avg=127.93, stdev=728.64 00:16:26.223 clat (usec): min=8552, max=27394, avg=16707.75, stdev=2584.54 00:16:26.223 lat (usec): min=8558, max=27410, avg=16835.68, stdev=2630.50 00:16:26.223 clat percentiles (usec): 00:16:26.223 | 1.00th=[11469], 5.00th=[13042], 10.00th=[13304], 20.00th=[14091], 00:16:26.223 | 30.00th=[15270], 40.00th=[16319], 50.00th=[16909], 60.00th=[17171], 00:16:26.223 | 70.00th=[17957], 80.00th=[18744], 90.00th=[20055], 95.00th=[21103], 00:16:26.223 | 99.00th=[23200], 99.50th=[25035], 99.90th=[25822], 99.95th=[26346], 00:16:26.223 | 99.99th=[27395] 00:16:26.223 write: IOPS=3979, BW=15.5MiB/s (16.3MB/s)(15.7MiB/1008msec); 0 zone resets 00:16:26.223 slat (usec): min=3, max=22225, avg=129.94, stdev=933.63 00:16:26.223 clat (usec): min=1389, max=38885, avg=16752.94, stdev=3422.80 00:16:26.223 lat (usec): min=7507, max=38903, avg=16882.87, stdev=3508.86 00:16:26.223 clat percentiles (usec): 00:16:26.223 | 1.00th=[ 7963], 5.00th=[12518], 10.00th=[13829], 20.00th=[14877], 00:16:26.223 | 30.00th=[15664], 40.00th=[15795], 50.00th=[16188], 60.00th=[16450], 00:16:26.223 | 70.00th=[16909], 80.00th=[18744], 90.00th=[20055], 95.00th=[21365], 00:16:26.223 | 99.00th=[29754], 99.50th=[31589], 99.90th=[31589], 99.95th=[31589], 00:16:26.223 | 99.99th=[39060] 00:16:26.223 bw ( KiB/s): min=14680, max=16384, per=23.74%, avg=15532.00, stdev=1204.91, samples=2 00:16:26.223 iops : min= 3670, max= 4096, avg=3883.00, stdev=301.23, samples=2 00:16:26.223 lat (msec) : 2=0.01%, 10=1.12%, 20=89.15%, 50=9.72% 00:16:26.223 cpu : usr=2.09%, sys=6.16%, ctx=242, majf=0, minf=1 00:16:26.223 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:16:26.223 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:26.223 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:26.223 issued rwts: total=3584,4011,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:26.223 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:26.223 job3: (groupid=0, jobs=1): err= 0: pid=1506538: Mon Jul 15 08:55:14 2024 00:16:26.223 read: IOPS=4996, BW=19.5MiB/s (20.5MB/s)(20.5MiB/1050msec) 00:16:26.224 slat (usec): min=3, max=10560, avg=94.52, stdev=685.60 00:16:26.224 clat (usec): min=5015, max=63066, avg=13460.16, stdev=7383.58 00:16:26.224 lat (usec): min=5030, max=63073, avg=13554.68, stdev=7405.74 00:16:26.224 clat percentiles (usec): 00:16:26.224 | 1.00th=[ 6652], 5.00th=[ 8979], 10.00th=[ 9634], 20.00th=[10552], 00:16:26.224 | 30.00th=[10814], 40.00th=[11207], 50.00th=[11731], 60.00th=[12387], 00:16:26.224 | 70.00th=[13173], 80.00th=[14746], 90.00th=[16909], 95.00th=[19530], 00:16:26.224 | 99.00th=[57934], 99.50th=[60556], 99.90th=[62129], 99.95th=[63177], 00:16:26.224 | 99.99th=[63177] 00:16:26.224 write: IOPS=5363, BW=21.0MiB/s (22.0MB/s)(22.0MiB/1050msec); 0 zone resets 00:16:26.224 slat (usec): min=4, max=14173, avg=81.31, stdev=579.09 00:16:26.224 clat (usec): min=1509, max=63076, avg=11095.95, stdev=3565.19 00:16:26.224 lat (usec): min=1521, max=63083, avg=11177.26, stdev=3581.35 00:16:26.224 clat percentiles (usec): 00:16:26.224 | 1.00th=[ 4113], 5.00th=[ 6652], 10.00th=[ 6980], 20.00th=[ 7635], 00:16:26.224 | 30.00th=[ 8586], 40.00th=[10290], 50.00th=[11338], 60.00th=[12125], 00:16:26.224 | 70.00th=[12518], 80.00th=[13435], 90.00th=[15533], 95.00th=[17171], 00:16:26.224 | 99.00th=[22414], 99.50th=[25560], 99.90th=[25560], 99.95th=[25822], 00:16:26.224 | 99.99th=[63177] 00:16:26.224 bw ( KiB/s): min=21864, max=23176, per=34.42%, avg=22520.00, stdev=927.72, samples=2 00:16:26.224 iops : min= 5466, max= 5794, avg=5630.00, stdev=231.93, samples=2 00:16:26.224 lat (msec) : 2=0.09%, 4=0.33%, 10=25.01%, 20=71.84%, 50=1.56% 00:16:26.224 lat (msec) : 100=1.16% 00:16:26.224 cpu : usr=7.24%, sys=9.25%, ctx=376, majf=0, minf=1 00:16:26.224 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:16:26.224 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:26.224 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:26.224 issued rwts: total=5246,5632,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:26.224 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:26.224 00:16:26.224 Run status group 0 (all jobs): 00:16:26.224 READ: bw=59.5MiB/s (62.4MB/s), 8127KiB/s-20.0MiB/s (8322kB/s-20.9MB/s), io=62.5MiB (65.5MB), run=1002-1050msec 00:16:26.224 WRITE: bw=63.9MiB/s (67.0MB/s), 9214KiB/s-21.0MiB/s (9435kB/s-22.0MB/s), io=67.1MiB (70.3MB), run=1002-1050msec 00:16:26.224 00:16:26.224 Disk stats (read/write): 00:16:26.224 nvme0n1: ios=4180/4608, merge=0/0, ticks=18885/20236, in_queue=39121, util=98.10% 00:16:26.224 nvme0n2: ios=1887/2048, merge=0/0, ticks=16693/15624, in_queue=32317, util=86.79% 00:16:26.224 nvme0n3: ios=3130/3243, merge=0/0, ticks=24682/23561, in_queue=48243, util=98.01% 00:16:26.224 nvme0n4: ios=4547/4608, merge=0/0, ticks=54227/48957, in_queue=103184, util=98.11% 00:16:26.224 08:55:14 -- target/fio.sh@55 -- # sync 00:16:26.224 08:55:14 -- target/fio.sh@59 -- # fio_pid=1506677 00:16:26.224 08:55:14 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:16:26.224 08:55:14 -- target/fio.sh@61 -- # sleep 3 00:16:26.224 [global] 00:16:26.224 thread=1 00:16:26.224 invalidate=1 00:16:26.224 rw=read 00:16:26.224 time_based=1 00:16:26.224 runtime=10 00:16:26.224 ioengine=libaio 00:16:26.224 direct=1 00:16:26.224 bs=4096 00:16:26.224 iodepth=1 00:16:26.224 norandommap=1 00:16:26.224 numjobs=1 00:16:26.224 00:16:26.224 [job0] 00:16:26.224 filename=/dev/nvme0n1 00:16:26.224 [job1] 00:16:26.224 filename=/dev/nvme0n2 00:16:26.224 [job2] 00:16:26.224 filename=/dev/nvme0n3 00:16:26.224 [job3] 00:16:26.224 filename=/dev/nvme0n4 00:16:26.224 Could not set queue depth (nvme0n1) 00:16:26.224 Could not set queue depth (nvme0n2) 00:16:26.224 Could not set queue depth (nvme0n3) 00:16:26.224 Could not set queue depth (nvme0n4) 00:16:26.482 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:26.482 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:26.482 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:26.482 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:26.482 fio-3.35 00:16:26.482 Starting 4 threads 00:16:29.063 08:55:17 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:16:29.320 08:55:17 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:16:29.320 fio: io_u error on file /dev/nvme0n4: Remote I/O error: read offset=4296704, buflen=4096 00:16:29.320 fio: pid=1506775, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:16:29.577 08:55:18 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:29.577 08:55:18 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:16:29.577 fio: io_u error on file /dev/nvme0n3: Remote I/O error: read offset=356352, buflen=4096 00:16:29.577 fio: pid=1506774, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:16:29.835 08:55:18 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:29.835 08:55:18 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:16:29.835 fio: io_u error on file /dev/nvme0n1: Remote I/O error: read offset=32309248, buflen=4096 00:16:29.835 fio: pid=1506772, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:16:30.093 08:55:18 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:30.093 08:55:18 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:16:30.093 fio: io_u error on file /dev/nvme0n2: Remote I/O error: read offset=1220608, buflen=4096 00:16:30.093 fio: pid=1506773, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:16:30.093 00:16:30.093 job0: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=1506772: Mon Jul 15 08:55:18 2024 00:16:30.093 read: IOPS=2325, BW=9302KiB/s (9525kB/s)(30.8MiB/3392msec) 00:16:30.093 slat (usec): min=5, max=10199, avg=13.71, stdev=143.28 00:16:30.093 clat (usec): min=275, max=42363, avg=410.40, stdev=1870.38 00:16:30.093 lat (usec): min=281, max=42380, avg=424.11, stdev=1876.02 00:16:30.093 clat percentiles (usec): 00:16:30.093 | 1.00th=[ 285], 5.00th=[ 289], 10.00th=[ 293], 20.00th=[ 302], 00:16:30.093 | 30.00th=[ 306], 40.00th=[ 314], 50.00th=[ 326], 60.00th=[ 334], 00:16:30.093 | 70.00th=[ 338], 80.00th=[ 347], 90.00th=[ 355], 95.00th=[ 367], 00:16:30.093 | 99.00th=[ 461], 99.50th=[ 494], 99.90th=[42206], 99.95th=[42206], 00:16:30.093 | 99.99th=[42206] 00:16:30.093 bw ( KiB/s): min= 4624, max=12056, per=96.45%, avg=9864.00, stdev=2950.57, samples=6 00:16:30.093 iops : min= 1156, max= 3014, avg=2466.00, stdev=737.64, samples=6 00:16:30.093 lat (usec) : 500=99.49%, 750=0.24%, 1000=0.03% 00:16:30.093 lat (msec) : 2=0.03%, 50=0.20% 00:16:30.093 cpu : usr=2.18%, sys=3.92%, ctx=7892, majf=0, minf=1 00:16:30.093 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:30.093 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:30.093 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:30.093 issued rwts: total=7889,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:30.093 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:30.093 job1: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=1506773: Mon Jul 15 08:55:18 2024 00:16:30.093 read: IOPS=82, BW=327KiB/s (335kB/s)(1192KiB/3646msec) 00:16:30.093 slat (usec): min=5, max=14838, avg=80.31, stdev=921.55 00:16:30.093 clat (usec): min=285, max=42969, avg=12074.61, stdev=18494.29 00:16:30.093 lat (usec): min=291, max=56929, avg=12155.07, stdev=18636.27 00:16:30.093 clat percentiles (usec): 00:16:30.093 | 1.00th=[ 289], 5.00th=[ 297], 10.00th=[ 302], 20.00th=[ 306], 00:16:30.093 | 30.00th=[ 314], 40.00th=[ 318], 50.00th=[ 318], 60.00th=[ 326], 00:16:30.093 | 70.00th=[ 449], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:16:30.093 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42730], 99.95th=[42730], 00:16:30.093 | 99.99th=[42730] 00:16:30.093 bw ( KiB/s): min= 96, max= 1360, per=2.93%, avg=300.57, stdev=469.69, samples=7 00:16:30.093 iops : min= 24, max= 340, avg=75.14, stdev=117.42, samples=7 00:16:30.093 lat (usec) : 500=69.90%, 750=1.00% 00:16:30.093 lat (msec) : 50=28.76% 00:16:30.093 cpu : usr=0.00%, sys=0.19%, ctx=302, majf=0, minf=1 00:16:30.093 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:30.093 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:30.093 complete : 0=0.3%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:30.093 issued rwts: total=299,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:30.093 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:30.093 job2: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=1506774: Mon Jul 15 08:55:18 2024 00:16:30.093 read: IOPS=27, BW=111KiB/s (113kB/s)(348KiB/3144msec) 00:16:30.093 slat (nsec): min=7874, max=35821, avg=20532.48, stdev=9382.32 00:16:30.093 clat (usec): min=362, max=42981, avg=35858.96, stdev=13594.75 00:16:30.093 lat (usec): min=370, max=43000, avg=35879.34, stdev=13598.52 00:16:30.093 clat percentiles (usec): 00:16:30.093 | 1.00th=[ 363], 5.00th=[ 388], 10.00th=[ 412], 20.00th=[41157], 00:16:30.093 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:30.093 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[42206], 00:16:30.093 | 99.00th=[42730], 99.50th=[42730], 99.90th=[42730], 99.95th=[42730], 00:16:30.093 | 99.99th=[42730] 00:16:30.093 bw ( KiB/s): min= 96, max= 184, per=1.10%, avg=112.00, stdev=35.42, samples=6 00:16:30.093 iops : min= 24, max= 46, avg=28.00, stdev= 8.85, samples=6 00:16:30.093 lat (usec) : 500=12.50% 00:16:30.093 lat (msec) : 50=86.36% 00:16:30.093 cpu : usr=0.00%, sys=0.13%, ctx=89, majf=0, minf=1 00:16:30.093 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:30.093 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:30.093 complete : 0=1.1%, 4=98.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:30.093 issued rwts: total=88,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:30.093 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:30.093 job3: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=1506775: Mon Jul 15 08:55:18 2024 00:16:30.093 read: IOPS=361, BW=1446KiB/s (1481kB/s)(4196KiB/2901msec) 00:16:30.093 slat (nsec): min=4589, max=69341, avg=17344.23, stdev=10220.76 00:16:30.093 clat (usec): min=234, max=44990, avg=2722.78, stdev=9607.75 00:16:30.093 lat (usec): min=253, max=45011, avg=2740.13, stdev=9609.17 00:16:30.093 clat percentiles (usec): 00:16:30.093 | 1.00th=[ 249], 5.00th=[ 260], 10.00th=[ 265], 20.00th=[ 281], 00:16:30.093 | 30.00th=[ 302], 40.00th=[ 322], 50.00th=[ 343], 60.00th=[ 367], 00:16:30.093 | 70.00th=[ 375], 80.00th=[ 392], 90.00th=[ 416], 95.00th=[41157], 00:16:30.093 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[44827], 00:16:30.093 | 99.99th=[44827] 00:16:30.093 bw ( KiB/s): min= 96, max= 6672, per=16.25%, avg=1662.40, stdev=2851.03, samples=5 00:16:30.093 iops : min= 24, max= 1668, avg=415.60, stdev=712.76, samples=5 00:16:30.093 lat (usec) : 250=1.14%, 500=92.48%, 750=0.19%, 1000=0.19% 00:16:30.093 lat (msec) : 2=0.10%, 50=5.81% 00:16:30.093 cpu : usr=0.45%, sys=0.59%, ctx=1050, majf=0, minf=1 00:16:30.093 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:30.093 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:30.093 complete : 0=0.1%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:30.093 issued rwts: total=1050,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:30.093 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:30.093 00:16:30.093 Run status group 0 (all jobs): 00:16:30.093 READ: bw=9.99MiB/s (10.5MB/s), 111KiB/s-9302KiB/s (113kB/s-9525kB/s), io=36.4MiB (38.2MB), run=2901-3646msec 00:16:30.093 00:16:30.093 Disk stats (read/write): 00:16:30.093 nvme0n1: ios=7887/0, merge=0/0, ticks=3076/0, in_queue=3076, util=95.48% 00:16:30.093 nvme0n2: ios=297/0, merge=0/0, ticks=3558/0, in_queue=3558, util=96.09% 00:16:30.093 nvme0n3: ios=86/0, merge=0/0, ticks=3080/0, in_queue=3080, util=96.79% 00:16:30.093 nvme0n4: ios=1048/0, merge=0/0, ticks=2808/0, in_queue=2808, util=96.75% 00:16:30.351 08:55:18 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:30.351 08:55:18 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:16:30.608 08:55:19 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:30.609 08:55:19 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:16:30.878 08:55:19 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:30.878 08:55:19 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:16:31.138 08:55:19 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:31.138 08:55:19 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:16:31.394 08:55:19 -- target/fio.sh@69 -- # fio_status=0 00:16:31.395 08:55:19 -- target/fio.sh@70 -- # wait 1506677 00:16:31.395 08:55:19 -- target/fio.sh@70 -- # fio_status=4 00:16:31.395 08:55:19 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:31.395 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:16:31.395 08:55:19 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:16:31.395 08:55:19 -- common/autotest_common.sh@1198 -- # local i=0 00:16:31.395 08:55:19 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:16:31.395 08:55:19 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:31.651 08:55:19 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:16:31.651 08:55:19 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:31.651 08:55:19 -- common/autotest_common.sh@1210 -- # return 0 00:16:31.651 08:55:19 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:16:31.651 08:55:19 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:16:31.651 nvmf hotplug test: fio failed as expected 00:16:31.651 08:55:19 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:31.909 08:55:20 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:16:31.909 08:55:20 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:16:31.909 08:55:20 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:16:31.909 08:55:20 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:16:31.909 08:55:20 -- target/fio.sh@91 -- # nvmftestfini 00:16:31.909 08:55:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:31.909 08:55:20 -- nvmf/common.sh@116 -- # sync 00:16:31.909 08:55:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:31.909 08:55:20 -- nvmf/common.sh@119 -- # set +e 00:16:31.909 08:55:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:31.909 08:55:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:31.909 rmmod nvme_tcp 00:16:31.909 rmmod nvme_fabrics 00:16:31.909 rmmod nvme_keyring 00:16:31.909 08:55:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:31.909 08:55:20 -- nvmf/common.sh@123 -- # set -e 00:16:31.909 08:55:20 -- nvmf/common.sh@124 -- # return 0 00:16:31.909 08:55:20 -- nvmf/common.sh@477 -- # '[' -n 1504595 ']' 00:16:31.909 08:55:20 -- nvmf/common.sh@478 -- # killprocess 1504595 00:16:31.909 08:55:20 -- common/autotest_common.sh@926 -- # '[' -z 1504595 ']' 00:16:31.909 08:55:20 -- common/autotest_common.sh@930 -- # kill -0 1504595 00:16:31.909 08:55:20 -- common/autotest_common.sh@931 -- # uname 00:16:31.909 08:55:20 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:16:31.909 08:55:20 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1504595 00:16:31.909 08:55:20 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:16:31.909 08:55:20 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:16:31.909 08:55:20 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1504595' 00:16:31.909 killing process with pid 1504595 00:16:31.909 08:55:20 -- common/autotest_common.sh@945 -- # kill 1504595 00:16:31.909 08:55:20 -- common/autotest_common.sh@950 -- # wait 1504595 00:16:32.168 08:55:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:32.168 08:55:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:32.168 08:55:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:32.168 08:55:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:32.168 08:55:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:32.168 08:55:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:32.168 08:55:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:32.168 08:55:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:34.071 08:55:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:34.071 00:16:34.071 real 0m23.790s 00:16:34.071 user 1m23.754s 00:16:34.071 sys 0m6.213s 00:16:34.071 08:55:22 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:16:34.071 08:55:22 -- common/autotest_common.sh@10 -- # set +x 00:16:34.071 ************************************ 00:16:34.071 END TEST nvmf_fio_target 00:16:34.071 ************************************ 00:16:34.329 08:55:22 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:16:34.329 08:55:22 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:16:34.329 08:55:22 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:16:34.329 08:55:22 -- common/autotest_common.sh@10 -- # set +x 00:16:34.329 ************************************ 00:16:34.329 START TEST nvmf_bdevio 00:16:34.329 ************************************ 00:16:34.329 08:55:22 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:16:34.329 * Looking for test storage... 00:16:34.329 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:34.329 08:55:22 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:34.329 08:55:22 -- nvmf/common.sh@7 -- # uname -s 00:16:34.329 08:55:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:34.329 08:55:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:34.329 08:55:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:34.329 08:55:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:34.329 08:55:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:34.329 08:55:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:34.329 08:55:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:34.329 08:55:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:34.329 08:55:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:34.329 08:55:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:34.329 08:55:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:34.329 08:55:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:34.329 08:55:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:34.329 08:55:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:34.329 08:55:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:34.329 08:55:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:34.329 08:55:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:34.329 08:55:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:34.329 08:55:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:34.329 08:55:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:34.329 08:55:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:34.329 08:55:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:34.329 08:55:22 -- paths/export.sh@5 -- # export PATH 00:16:34.329 08:55:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:34.329 08:55:22 -- nvmf/common.sh@46 -- # : 0 00:16:34.329 08:55:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:34.329 08:55:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:34.330 08:55:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:34.330 08:55:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:34.330 08:55:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:34.330 08:55:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:34.330 08:55:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:34.330 08:55:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:34.330 08:55:22 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:34.330 08:55:22 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:34.330 08:55:22 -- target/bdevio.sh@14 -- # nvmftestinit 00:16:34.330 08:55:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:34.330 08:55:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:34.330 08:55:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:34.330 08:55:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:34.330 08:55:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:34.330 08:55:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:34.330 08:55:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:34.330 08:55:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:34.330 08:55:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:34.330 08:55:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:34.330 08:55:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:34.330 08:55:22 -- common/autotest_common.sh@10 -- # set +x 00:16:36.239 08:55:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:36.239 08:55:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:36.239 08:55:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:36.239 08:55:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:36.239 08:55:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:36.239 08:55:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:36.239 08:55:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:36.239 08:55:24 -- nvmf/common.sh@294 -- # net_devs=() 00:16:36.239 08:55:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:36.239 08:55:24 -- nvmf/common.sh@295 -- # e810=() 00:16:36.239 08:55:24 -- nvmf/common.sh@295 -- # local -ga e810 00:16:36.239 08:55:24 -- nvmf/common.sh@296 -- # x722=() 00:16:36.239 08:55:24 -- nvmf/common.sh@296 -- # local -ga x722 00:16:36.239 08:55:24 -- nvmf/common.sh@297 -- # mlx=() 00:16:36.239 08:55:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:36.239 08:55:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:36.239 08:55:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:36.239 08:55:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:36.239 08:55:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:36.239 08:55:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:36.239 08:55:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:36.239 08:55:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:36.239 08:55:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:36.239 08:55:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:36.239 08:55:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:36.239 08:55:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:36.239 08:55:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:36.239 08:55:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:36.239 08:55:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:36.239 08:55:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:36.239 08:55:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:36.239 08:55:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:36.239 08:55:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:36.239 08:55:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:36.239 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:36.239 08:55:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:36.239 08:55:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:36.239 08:55:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:36.239 08:55:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:36.239 08:55:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:36.239 08:55:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:36.239 08:55:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:36.239 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:36.239 08:55:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:36.239 08:55:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:36.239 08:55:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:36.239 08:55:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:36.239 08:55:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:36.239 08:55:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:36.239 08:55:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:36.239 08:55:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:36.239 08:55:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:36.239 08:55:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:36.239 08:55:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:36.239 08:55:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:36.239 08:55:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:36.239 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:36.239 08:55:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:36.239 08:55:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:36.239 08:55:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:36.239 08:55:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:36.239 08:55:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:36.239 08:55:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:36.239 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:36.239 08:55:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:36.239 08:55:24 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:36.239 08:55:24 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:36.239 08:55:24 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:36.239 08:55:24 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:36.239 08:55:24 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:36.239 08:55:24 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:36.239 08:55:24 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:36.239 08:55:24 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:36.239 08:55:24 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:36.239 08:55:24 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:36.239 08:55:24 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:36.239 08:55:24 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:36.239 08:55:24 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:36.239 08:55:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:36.239 08:55:24 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:36.239 08:55:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:36.239 08:55:24 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:36.239 08:55:24 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:36.239 08:55:24 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:36.239 08:55:24 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:36.239 08:55:24 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:36.239 08:55:24 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:36.239 08:55:24 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:36.239 08:55:24 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:36.239 08:55:24 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:36.239 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:36.239 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.266 ms 00:16:36.239 00:16:36.239 --- 10.0.0.2 ping statistics --- 00:16:36.239 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:36.239 rtt min/avg/max/mdev = 0.266/0.266/0.266/0.000 ms 00:16:36.239 08:55:24 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:36.239 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:36.239 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.213 ms 00:16:36.239 00:16:36.239 --- 10.0.0.1 ping statistics --- 00:16:36.240 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:36.240 rtt min/avg/max/mdev = 0.213/0.213/0.213/0.000 ms 00:16:36.240 08:55:24 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:36.240 08:55:24 -- nvmf/common.sh@410 -- # return 0 00:16:36.240 08:55:24 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:36.240 08:55:24 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:36.240 08:55:24 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:36.240 08:55:24 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:36.240 08:55:24 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:36.240 08:55:24 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:36.240 08:55:24 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:36.240 08:55:24 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:16:36.240 08:55:24 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:36.240 08:55:24 -- common/autotest_common.sh@712 -- # xtrace_disable 00:16:36.240 08:55:24 -- common/autotest_common.sh@10 -- # set +x 00:16:36.240 08:55:24 -- nvmf/common.sh@469 -- # nvmfpid=1509423 00:16:36.240 08:55:24 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:16:36.240 08:55:24 -- nvmf/common.sh@470 -- # waitforlisten 1509423 00:16:36.240 08:55:24 -- common/autotest_common.sh@819 -- # '[' -z 1509423 ']' 00:16:36.240 08:55:24 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:36.240 08:55:24 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:36.240 08:55:24 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:36.240 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:36.240 08:55:24 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:36.240 08:55:24 -- common/autotest_common.sh@10 -- # set +x 00:16:36.498 [2024-07-15 08:55:24.784314] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:16:36.498 [2024-07-15 08:55:24.784388] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:36.498 EAL: No free 2048 kB hugepages reported on node 1 00:16:36.498 [2024-07-15 08:55:24.848687] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:36.498 [2024-07-15 08:55:24.955852] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:36.498 [2024-07-15 08:55:24.955995] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:36.498 [2024-07-15 08:55:24.956013] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:36.498 [2024-07-15 08:55:24.956025] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:36.498 [2024-07-15 08:55:24.956120] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:16:36.498 [2024-07-15 08:55:24.956249] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:16:36.498 [2024-07-15 08:55:24.956309] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:16:36.498 [2024-07-15 08:55:24.956312] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:37.430 08:55:25 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:37.430 08:55:25 -- common/autotest_common.sh@852 -- # return 0 00:16:37.430 08:55:25 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:37.430 08:55:25 -- common/autotest_common.sh@718 -- # xtrace_disable 00:16:37.430 08:55:25 -- common/autotest_common.sh@10 -- # set +x 00:16:37.430 08:55:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:37.430 08:55:25 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:37.430 08:55:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:37.430 08:55:25 -- common/autotest_common.sh@10 -- # set +x 00:16:37.430 [2024-07-15 08:55:25.780486] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:37.430 08:55:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:37.430 08:55:25 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:37.430 08:55:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:37.430 08:55:25 -- common/autotest_common.sh@10 -- # set +x 00:16:37.430 Malloc0 00:16:37.430 08:55:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:37.430 08:55:25 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:16:37.430 08:55:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:37.430 08:55:25 -- common/autotest_common.sh@10 -- # set +x 00:16:37.430 08:55:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:37.430 08:55:25 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:37.430 08:55:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:37.430 08:55:25 -- common/autotest_common.sh@10 -- # set +x 00:16:37.430 08:55:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:37.430 08:55:25 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:37.430 08:55:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:37.430 08:55:25 -- common/autotest_common.sh@10 -- # set +x 00:16:37.430 [2024-07-15 08:55:25.833795] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:37.430 08:55:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:37.430 08:55:25 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:16:37.430 08:55:25 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:16:37.430 08:55:25 -- nvmf/common.sh@520 -- # config=() 00:16:37.430 08:55:25 -- nvmf/common.sh@520 -- # local subsystem config 00:16:37.430 08:55:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:37.430 08:55:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:37.430 { 00:16:37.430 "params": { 00:16:37.430 "name": "Nvme$subsystem", 00:16:37.430 "trtype": "$TEST_TRANSPORT", 00:16:37.430 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:37.430 "adrfam": "ipv4", 00:16:37.430 "trsvcid": "$NVMF_PORT", 00:16:37.430 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:37.430 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:37.430 "hdgst": ${hdgst:-false}, 00:16:37.430 "ddgst": ${ddgst:-false} 00:16:37.430 }, 00:16:37.431 "method": "bdev_nvme_attach_controller" 00:16:37.431 } 00:16:37.431 EOF 00:16:37.431 )") 00:16:37.431 08:55:25 -- nvmf/common.sh@542 -- # cat 00:16:37.431 08:55:25 -- nvmf/common.sh@544 -- # jq . 00:16:37.431 08:55:25 -- nvmf/common.sh@545 -- # IFS=, 00:16:37.431 08:55:25 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:37.431 "params": { 00:16:37.431 "name": "Nvme1", 00:16:37.431 "trtype": "tcp", 00:16:37.431 "traddr": "10.0.0.2", 00:16:37.431 "adrfam": "ipv4", 00:16:37.431 "trsvcid": "4420", 00:16:37.431 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:37.431 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:37.431 "hdgst": false, 00:16:37.431 "ddgst": false 00:16:37.431 }, 00:16:37.431 "method": "bdev_nvme_attach_controller" 00:16:37.431 }' 00:16:37.431 [2024-07-15 08:55:25.872794] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:16:37.431 [2024-07-15 08:55:25.872872] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1509587 ] 00:16:37.431 EAL: No free 2048 kB hugepages reported on node 1 00:16:37.431 [2024-07-15 08:55:25.934923] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:37.689 [2024-07-15 08:55:26.049145] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:37.689 [2024-07-15 08:55:26.049197] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:37.689 [2024-07-15 08:55:26.049200] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:37.689 [2024-07-15 08:55:26.225045] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:16:37.689 [2024-07-15 08:55:26.225096] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:16:37.689 I/O targets: 00:16:37.689 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:16:37.689 00:16:37.689 00:16:37.689 CUnit - A unit testing framework for C - Version 2.1-3 00:16:37.689 http://cunit.sourceforge.net/ 00:16:37.689 00:16:37.689 00:16:37.689 Suite: bdevio tests on: Nvme1n1 00:16:37.947 Test: blockdev write read block ...passed 00:16:37.947 Test: blockdev write zeroes read block ...passed 00:16:37.947 Test: blockdev write zeroes read no split ...passed 00:16:37.947 Test: blockdev write zeroes read split ...passed 00:16:37.947 Test: blockdev write zeroes read split partial ...passed 00:16:37.947 Test: blockdev reset ...[2024-07-15 08:55:26.434749] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:16:37.947 [2024-07-15 08:55:26.434851] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14bf180 (9): Bad file descriptor 00:16:37.947 [2024-07-15 08:55:26.485860] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:16:37.947 passed 00:16:37.947 Test: blockdev write read 8 blocks ...passed 00:16:37.947 Test: blockdev write read size > 128k ...passed 00:16:37.947 Test: blockdev write read invalid size ...passed 00:16:38.205 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:16:38.205 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:16:38.205 Test: blockdev write read max offset ...passed 00:16:38.205 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:16:38.205 Test: blockdev writev readv 8 blocks ...passed 00:16:38.205 Test: blockdev writev readv 30 x 1block ...passed 00:16:38.205 Test: blockdev writev readv block ...passed 00:16:38.205 Test: blockdev writev readv size > 128k ...passed 00:16:38.205 Test: blockdev writev readv size > 128k in two iovs ...passed 00:16:38.205 Test: blockdev comparev and writev ...[2024-07-15 08:55:26.699951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:38.205 [2024-07-15 08:55:26.699987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:16:38.205 [2024-07-15 08:55:26.700011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:38.205 [2024-07-15 08:55:26.700036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:16:38.205 [2024-07-15 08:55:26.700398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:38.205 [2024-07-15 08:55:26.700423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:16:38.205 [2024-07-15 08:55:26.700445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:38.205 [2024-07-15 08:55:26.700461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:16:38.205 [2024-07-15 08:55:26.700807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:38.205 [2024-07-15 08:55:26.700831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:16:38.205 [2024-07-15 08:55:26.700852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:38.205 [2024-07-15 08:55:26.700868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:16:38.205 [2024-07-15 08:55:26.701211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:38.205 [2024-07-15 08:55:26.701235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:16:38.205 [2024-07-15 08:55:26.701257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:38.205 [2024-07-15 08:55:26.701273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:16:38.205 passed 00:16:38.463 Test: blockdev nvme passthru rw ...passed 00:16:38.463 Test: blockdev nvme passthru vendor specific ...[2024-07-15 08:55:26.783194] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:38.463 [2024-07-15 08:55:26.783221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:16:38.463 [2024-07-15 08:55:26.783412] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:38.463 [2024-07-15 08:55:26.783436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:16:38.463 [2024-07-15 08:55:26.783622] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:38.463 [2024-07-15 08:55:26.783646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:16:38.463 [2024-07-15 08:55:26.783831] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:38.463 [2024-07-15 08:55:26.783854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:16:38.463 passed 00:16:38.463 Test: blockdev nvme admin passthru ...passed 00:16:38.463 Test: blockdev copy ...passed 00:16:38.463 00:16:38.463 Run Summary: Type Total Ran Passed Failed Inactive 00:16:38.463 suites 1 1 n/a 0 0 00:16:38.463 tests 23 23 23 0 0 00:16:38.463 asserts 152 152 152 0 n/a 00:16:38.463 00:16:38.463 Elapsed time = 1.221 seconds 00:16:38.722 08:55:27 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:38.722 08:55:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:38.722 08:55:27 -- common/autotest_common.sh@10 -- # set +x 00:16:38.722 08:55:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:38.722 08:55:27 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:16:38.722 08:55:27 -- target/bdevio.sh@30 -- # nvmftestfini 00:16:38.722 08:55:27 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:38.722 08:55:27 -- nvmf/common.sh@116 -- # sync 00:16:38.722 08:55:27 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:38.722 08:55:27 -- nvmf/common.sh@119 -- # set +e 00:16:38.722 08:55:27 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:38.722 08:55:27 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:38.722 rmmod nvme_tcp 00:16:38.722 rmmod nvme_fabrics 00:16:38.722 rmmod nvme_keyring 00:16:38.722 08:55:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:38.722 08:55:27 -- nvmf/common.sh@123 -- # set -e 00:16:38.722 08:55:27 -- nvmf/common.sh@124 -- # return 0 00:16:38.722 08:55:27 -- nvmf/common.sh@477 -- # '[' -n 1509423 ']' 00:16:38.722 08:55:27 -- nvmf/common.sh@478 -- # killprocess 1509423 00:16:38.722 08:55:27 -- common/autotest_common.sh@926 -- # '[' -z 1509423 ']' 00:16:38.722 08:55:27 -- common/autotest_common.sh@930 -- # kill -0 1509423 00:16:38.722 08:55:27 -- common/autotest_common.sh@931 -- # uname 00:16:38.722 08:55:27 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:16:38.722 08:55:27 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1509423 00:16:38.722 08:55:27 -- common/autotest_common.sh@932 -- # process_name=reactor_3 00:16:38.722 08:55:27 -- common/autotest_common.sh@936 -- # '[' reactor_3 = sudo ']' 00:16:38.722 08:55:27 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1509423' 00:16:38.722 killing process with pid 1509423 00:16:38.722 08:55:27 -- common/autotest_common.sh@945 -- # kill 1509423 00:16:38.722 08:55:27 -- common/autotest_common.sh@950 -- # wait 1509423 00:16:38.981 08:55:27 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:38.981 08:55:27 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:38.981 08:55:27 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:38.981 08:55:27 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:38.981 08:55:27 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:38.981 08:55:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:38.981 08:55:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:38.981 08:55:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:41.530 08:55:29 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:41.530 00:16:41.530 real 0m6.878s 00:16:41.530 user 0m12.925s 00:16:41.530 sys 0m1.983s 00:16:41.530 08:55:29 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:16:41.530 08:55:29 -- common/autotest_common.sh@10 -- # set +x 00:16:41.530 ************************************ 00:16:41.530 END TEST nvmf_bdevio 00:16:41.530 ************************************ 00:16:41.530 08:55:29 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:16:41.530 08:55:29 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:16:41.530 08:55:29 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:16:41.530 08:55:29 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:16:41.530 08:55:29 -- common/autotest_common.sh@10 -- # set +x 00:16:41.530 ************************************ 00:16:41.530 START TEST nvmf_bdevio_no_huge 00:16:41.530 ************************************ 00:16:41.530 08:55:29 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:16:41.530 * Looking for test storage... 00:16:41.530 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:41.531 08:55:29 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:41.531 08:55:29 -- nvmf/common.sh@7 -- # uname -s 00:16:41.531 08:55:29 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:41.531 08:55:29 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:41.531 08:55:29 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:41.531 08:55:29 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:41.531 08:55:29 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:41.531 08:55:29 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:41.531 08:55:29 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:41.531 08:55:29 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:41.531 08:55:29 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:41.531 08:55:29 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:41.531 08:55:29 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:41.531 08:55:29 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:41.531 08:55:29 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:41.531 08:55:29 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:41.531 08:55:29 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:41.531 08:55:29 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:41.531 08:55:29 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:41.531 08:55:29 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:41.531 08:55:29 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:41.531 08:55:29 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:41.531 08:55:29 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:41.531 08:55:29 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:41.531 08:55:29 -- paths/export.sh@5 -- # export PATH 00:16:41.531 08:55:29 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:41.531 08:55:29 -- nvmf/common.sh@46 -- # : 0 00:16:41.531 08:55:29 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:41.531 08:55:29 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:41.531 08:55:29 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:41.531 08:55:29 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:41.531 08:55:29 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:41.531 08:55:29 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:41.531 08:55:29 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:41.531 08:55:29 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:41.531 08:55:29 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:41.531 08:55:29 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:41.531 08:55:29 -- target/bdevio.sh@14 -- # nvmftestinit 00:16:41.531 08:55:29 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:41.531 08:55:29 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:41.531 08:55:29 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:41.531 08:55:29 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:41.531 08:55:29 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:41.531 08:55:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:41.531 08:55:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:41.531 08:55:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:41.531 08:55:29 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:41.531 08:55:29 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:41.531 08:55:29 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:41.531 08:55:29 -- common/autotest_common.sh@10 -- # set +x 00:16:42.960 08:55:31 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:42.960 08:55:31 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:42.960 08:55:31 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:42.960 08:55:31 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:42.960 08:55:31 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:42.960 08:55:31 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:42.960 08:55:31 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:42.960 08:55:31 -- nvmf/common.sh@294 -- # net_devs=() 00:16:42.960 08:55:31 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:42.960 08:55:31 -- nvmf/common.sh@295 -- # e810=() 00:16:42.960 08:55:31 -- nvmf/common.sh@295 -- # local -ga e810 00:16:42.960 08:55:31 -- nvmf/common.sh@296 -- # x722=() 00:16:42.960 08:55:31 -- nvmf/common.sh@296 -- # local -ga x722 00:16:42.960 08:55:31 -- nvmf/common.sh@297 -- # mlx=() 00:16:42.960 08:55:31 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:42.960 08:55:31 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:42.960 08:55:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:42.960 08:55:31 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:42.960 08:55:31 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:42.960 08:55:31 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:42.960 08:55:31 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:42.960 08:55:31 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:42.960 08:55:31 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:42.960 08:55:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:42.960 08:55:31 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:42.960 08:55:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:42.960 08:55:31 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:42.960 08:55:31 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:42.960 08:55:31 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:42.960 08:55:31 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:42.960 08:55:31 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:42.960 08:55:31 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:42.960 08:55:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:42.960 08:55:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:42.960 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:42.960 08:55:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:42.960 08:55:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:42.960 08:55:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:42.960 08:55:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:42.960 08:55:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:42.960 08:55:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:42.960 08:55:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:42.960 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:42.960 08:55:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:42.960 08:55:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:42.960 08:55:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:42.960 08:55:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:42.960 08:55:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:42.960 08:55:31 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:42.960 08:55:31 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:42.960 08:55:31 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:42.960 08:55:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:42.960 08:55:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:42.960 08:55:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:42.960 08:55:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:42.960 08:55:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:42.960 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:42.960 08:55:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:42.960 08:55:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:42.960 08:55:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:42.960 08:55:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:42.960 08:55:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:42.960 08:55:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:42.960 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:42.960 08:55:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:42.960 08:55:31 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:42.960 08:55:31 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:42.960 08:55:31 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:42.960 08:55:31 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:42.960 08:55:31 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:42.960 08:55:31 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:42.960 08:55:31 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:42.960 08:55:31 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:42.960 08:55:31 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:42.960 08:55:31 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:42.960 08:55:31 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:42.960 08:55:31 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:42.960 08:55:31 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:42.960 08:55:31 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:42.960 08:55:31 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:42.960 08:55:31 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:42.960 08:55:31 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:42.960 08:55:31 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:42.960 08:55:31 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:42.960 08:55:31 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:42.960 08:55:31 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:42.960 08:55:31 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:43.218 08:55:31 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:43.218 08:55:31 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:43.218 08:55:31 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:43.218 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:43.218 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.174 ms 00:16:43.218 00:16:43.218 --- 10.0.0.2 ping statistics --- 00:16:43.218 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:43.218 rtt min/avg/max/mdev = 0.174/0.174/0.174/0.000 ms 00:16:43.218 08:55:31 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:43.218 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:43.218 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.140 ms 00:16:43.218 00:16:43.218 --- 10.0.0.1 ping statistics --- 00:16:43.218 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:43.218 rtt min/avg/max/mdev = 0.140/0.140/0.140/0.000 ms 00:16:43.218 08:55:31 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:43.218 08:55:31 -- nvmf/common.sh@410 -- # return 0 00:16:43.218 08:55:31 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:43.218 08:55:31 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:43.218 08:55:31 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:43.218 08:55:31 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:43.218 08:55:31 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:43.218 08:55:31 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:43.218 08:55:31 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:43.218 08:55:31 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:16:43.218 08:55:31 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:43.218 08:55:31 -- common/autotest_common.sh@712 -- # xtrace_disable 00:16:43.218 08:55:31 -- common/autotest_common.sh@10 -- # set +x 00:16:43.218 08:55:31 -- nvmf/common.sh@469 -- # nvmfpid=1511676 00:16:43.218 08:55:31 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:16:43.218 08:55:31 -- nvmf/common.sh@470 -- # waitforlisten 1511676 00:16:43.218 08:55:31 -- common/autotest_common.sh@819 -- # '[' -z 1511676 ']' 00:16:43.218 08:55:31 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:43.218 08:55:31 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:43.218 08:55:31 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:43.218 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:43.218 08:55:31 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:43.218 08:55:31 -- common/autotest_common.sh@10 -- # set +x 00:16:43.218 [2024-07-15 08:55:31.610384] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:16:43.218 [2024-07-15 08:55:31.610466] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:16:43.218 [2024-07-15 08:55:31.681745] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:43.476 [2024-07-15 08:55:31.786769] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:43.476 [2024-07-15 08:55:31.786910] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:43.476 [2024-07-15 08:55:31.786928] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:43.476 [2024-07-15 08:55:31.786940] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:43.476 [2024-07-15 08:55:31.787039] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:16:43.476 [2024-07-15 08:55:31.787107] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:16:43.476 [2024-07-15 08:55:31.787168] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:16:43.476 [2024-07-15 08:55:31.787171] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:44.405 08:55:32 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:44.405 08:55:32 -- common/autotest_common.sh@852 -- # return 0 00:16:44.405 08:55:32 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:44.405 08:55:32 -- common/autotest_common.sh@718 -- # xtrace_disable 00:16:44.405 08:55:32 -- common/autotest_common.sh@10 -- # set +x 00:16:44.405 08:55:32 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:44.405 08:55:32 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:44.405 08:55:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:44.405 08:55:32 -- common/autotest_common.sh@10 -- # set +x 00:16:44.405 [2024-07-15 08:55:32.608018] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:44.405 08:55:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:44.405 08:55:32 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:44.405 08:55:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:44.405 08:55:32 -- common/autotest_common.sh@10 -- # set +x 00:16:44.405 Malloc0 00:16:44.405 08:55:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:44.405 08:55:32 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:16:44.405 08:55:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:44.405 08:55:32 -- common/autotest_common.sh@10 -- # set +x 00:16:44.405 08:55:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:44.405 08:55:32 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:44.405 08:55:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:44.405 08:55:32 -- common/autotest_common.sh@10 -- # set +x 00:16:44.405 08:55:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:44.405 08:55:32 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:44.405 08:55:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:44.405 08:55:32 -- common/autotest_common.sh@10 -- # set +x 00:16:44.405 [2024-07-15 08:55:32.645952] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:44.405 08:55:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:44.405 08:55:32 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:16:44.405 08:55:32 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:16:44.405 08:55:32 -- nvmf/common.sh@520 -- # config=() 00:16:44.405 08:55:32 -- nvmf/common.sh@520 -- # local subsystem config 00:16:44.405 08:55:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:44.405 08:55:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:44.405 { 00:16:44.405 "params": { 00:16:44.405 "name": "Nvme$subsystem", 00:16:44.405 "trtype": "$TEST_TRANSPORT", 00:16:44.405 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:44.405 "adrfam": "ipv4", 00:16:44.405 "trsvcid": "$NVMF_PORT", 00:16:44.405 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:44.405 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:44.405 "hdgst": ${hdgst:-false}, 00:16:44.405 "ddgst": ${ddgst:-false} 00:16:44.405 }, 00:16:44.405 "method": "bdev_nvme_attach_controller" 00:16:44.405 } 00:16:44.405 EOF 00:16:44.405 )") 00:16:44.405 08:55:32 -- nvmf/common.sh@542 -- # cat 00:16:44.405 08:55:32 -- nvmf/common.sh@544 -- # jq . 00:16:44.405 08:55:32 -- nvmf/common.sh@545 -- # IFS=, 00:16:44.405 08:55:32 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:44.405 "params": { 00:16:44.405 "name": "Nvme1", 00:16:44.405 "trtype": "tcp", 00:16:44.405 "traddr": "10.0.0.2", 00:16:44.405 "adrfam": "ipv4", 00:16:44.405 "trsvcid": "4420", 00:16:44.405 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:44.405 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:44.405 "hdgst": false, 00:16:44.405 "ddgst": false 00:16:44.405 }, 00:16:44.405 "method": "bdev_nvme_attach_controller" 00:16:44.405 }' 00:16:44.405 [2024-07-15 08:55:32.684718] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:16:44.405 [2024-07-15 08:55:32.684808] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid1511835 ] 00:16:44.405 [2024-07-15 08:55:32.748494] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:44.405 [2024-07-15 08:55:32.857524] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:44.405 [2024-07-15 08:55:32.857572] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:44.405 [2024-07-15 08:55:32.857575] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:44.662 [2024-07-15 08:55:33.130776] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:16:44.662 [2024-07-15 08:55:33.130824] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:16:44.662 I/O targets: 00:16:44.662 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:16:44.662 00:16:44.662 00:16:44.662 CUnit - A unit testing framework for C - Version 2.1-3 00:16:44.662 http://cunit.sourceforge.net/ 00:16:44.662 00:16:44.662 00:16:44.662 Suite: bdevio tests on: Nvme1n1 00:16:44.662 Test: blockdev write read block ...passed 00:16:44.919 Test: blockdev write zeroes read block ...passed 00:16:44.919 Test: blockdev write zeroes read no split ...passed 00:16:44.919 Test: blockdev write zeroes read split ...passed 00:16:44.919 Test: blockdev write zeroes read split partial ...passed 00:16:44.919 Test: blockdev reset ...[2024-07-15 08:55:33.343297] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:16:44.919 [2024-07-15 08:55:33.343424] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x553b00 (9): Bad file descriptor 00:16:44.919 [2024-07-15 08:55:33.400865] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:16:44.919 passed 00:16:44.919 Test: blockdev write read 8 blocks ...passed 00:16:44.919 Test: blockdev write read size > 128k ...passed 00:16:44.919 Test: blockdev write read invalid size ...passed 00:16:45.176 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:16:45.176 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:16:45.176 Test: blockdev write read max offset ...passed 00:16:45.176 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:16:45.176 Test: blockdev writev readv 8 blocks ...passed 00:16:45.176 Test: blockdev writev readv 30 x 1block ...passed 00:16:45.176 Test: blockdev writev readv block ...passed 00:16:45.176 Test: blockdev writev readv size > 128k ...passed 00:16:45.176 Test: blockdev writev readv size > 128k in two iovs ...passed 00:16:45.176 Test: blockdev comparev and writev ...[2024-07-15 08:55:33.700625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:45.176 [2024-07-15 08:55:33.700661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:16:45.176 [2024-07-15 08:55:33.700685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:45.176 [2024-07-15 08:55:33.700702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:16:45.176 [2024-07-15 08:55:33.701068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:45.176 [2024-07-15 08:55:33.701092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:16:45.176 [2024-07-15 08:55:33.701123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:45.176 [2024-07-15 08:55:33.701141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:16:45.176 [2024-07-15 08:55:33.701490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:45.176 [2024-07-15 08:55:33.701513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:16:45.176 [2024-07-15 08:55:33.701534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:45.176 [2024-07-15 08:55:33.701550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:16:45.176 [2024-07-15 08:55:33.701919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:45.176 [2024-07-15 08:55:33.701943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:16:45.176 [2024-07-15 08:55:33.701964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:45.176 [2024-07-15 08:55:33.701981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:16:45.433 passed 00:16:45.433 Test: blockdev nvme passthru rw ...passed 00:16:45.433 Test: blockdev nvme passthru vendor specific ...[2024-07-15 08:55:33.785172] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:45.433 [2024-07-15 08:55:33.785199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:16:45.433 [2024-07-15 08:55:33.785367] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:45.433 [2024-07-15 08:55:33.785391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:16:45.433 [2024-07-15 08:55:33.785557] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:45.433 [2024-07-15 08:55:33.785580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:16:45.433 [2024-07-15 08:55:33.785741] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:45.433 [2024-07-15 08:55:33.785765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:16:45.433 passed 00:16:45.433 Test: blockdev nvme admin passthru ...passed 00:16:45.433 Test: blockdev copy ...passed 00:16:45.433 00:16:45.433 Run Summary: Type Total Ran Passed Failed Inactive 00:16:45.433 suites 1 1 n/a 0 0 00:16:45.433 tests 23 23 23 0 0 00:16:45.433 asserts 152 152 152 0 n/a 00:16:45.433 00:16:45.433 Elapsed time = 1.430 seconds 00:16:45.691 08:55:34 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:45.691 08:55:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:45.691 08:55:34 -- common/autotest_common.sh@10 -- # set +x 00:16:45.691 08:55:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:45.691 08:55:34 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:16:45.691 08:55:34 -- target/bdevio.sh@30 -- # nvmftestfini 00:16:45.691 08:55:34 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:45.691 08:55:34 -- nvmf/common.sh@116 -- # sync 00:16:45.691 08:55:34 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:45.691 08:55:34 -- nvmf/common.sh@119 -- # set +e 00:16:45.691 08:55:34 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:45.691 08:55:34 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:45.691 rmmod nvme_tcp 00:16:45.949 rmmod nvme_fabrics 00:16:45.949 rmmod nvme_keyring 00:16:45.949 08:55:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:45.949 08:55:34 -- nvmf/common.sh@123 -- # set -e 00:16:45.949 08:55:34 -- nvmf/common.sh@124 -- # return 0 00:16:45.949 08:55:34 -- nvmf/common.sh@477 -- # '[' -n 1511676 ']' 00:16:45.949 08:55:34 -- nvmf/common.sh@478 -- # killprocess 1511676 00:16:45.949 08:55:34 -- common/autotest_common.sh@926 -- # '[' -z 1511676 ']' 00:16:45.949 08:55:34 -- common/autotest_common.sh@930 -- # kill -0 1511676 00:16:45.949 08:55:34 -- common/autotest_common.sh@931 -- # uname 00:16:45.949 08:55:34 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:16:45.949 08:55:34 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1511676 00:16:45.949 08:55:34 -- common/autotest_common.sh@932 -- # process_name=reactor_3 00:16:45.949 08:55:34 -- common/autotest_common.sh@936 -- # '[' reactor_3 = sudo ']' 00:16:45.949 08:55:34 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1511676' 00:16:45.949 killing process with pid 1511676 00:16:45.949 08:55:34 -- common/autotest_common.sh@945 -- # kill 1511676 00:16:45.949 08:55:34 -- common/autotest_common.sh@950 -- # wait 1511676 00:16:46.208 08:55:34 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:46.208 08:55:34 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:46.208 08:55:34 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:46.208 08:55:34 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:46.208 08:55:34 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:46.208 08:55:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:46.208 08:55:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:46.208 08:55:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:48.744 08:55:36 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:48.744 00:16:48.744 real 0m7.247s 00:16:48.744 user 0m14.824s 00:16:48.744 sys 0m2.433s 00:16:48.744 08:55:36 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:16:48.744 08:55:36 -- common/autotest_common.sh@10 -- # set +x 00:16:48.744 ************************************ 00:16:48.744 END TEST nvmf_bdevio_no_huge 00:16:48.744 ************************************ 00:16:48.744 08:55:36 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:16:48.744 08:55:36 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:16:48.744 08:55:36 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:16:48.744 08:55:36 -- common/autotest_common.sh@10 -- # set +x 00:16:48.744 ************************************ 00:16:48.744 START TEST nvmf_tls 00:16:48.744 ************************************ 00:16:48.744 08:55:36 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:16:48.744 * Looking for test storage... 00:16:48.744 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:48.744 08:55:36 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:48.744 08:55:36 -- nvmf/common.sh@7 -- # uname -s 00:16:48.744 08:55:36 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:48.744 08:55:36 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:48.744 08:55:36 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:48.744 08:55:36 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:48.744 08:55:36 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:48.744 08:55:36 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:48.744 08:55:36 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:48.744 08:55:36 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:48.744 08:55:36 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:48.744 08:55:36 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:48.744 08:55:36 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:48.744 08:55:36 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:48.744 08:55:36 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:48.744 08:55:36 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:48.744 08:55:36 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:48.744 08:55:36 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:48.744 08:55:36 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:48.744 08:55:36 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:48.744 08:55:36 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:48.744 08:55:36 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:48.744 08:55:36 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:48.744 08:55:36 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:48.744 08:55:36 -- paths/export.sh@5 -- # export PATH 00:16:48.744 08:55:36 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:48.744 08:55:36 -- nvmf/common.sh@46 -- # : 0 00:16:48.744 08:55:36 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:48.744 08:55:36 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:48.744 08:55:36 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:48.744 08:55:36 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:48.744 08:55:36 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:48.744 08:55:36 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:48.744 08:55:36 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:48.744 08:55:36 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:48.744 08:55:36 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:48.744 08:55:36 -- target/tls.sh@71 -- # nvmftestinit 00:16:48.744 08:55:36 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:48.744 08:55:36 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:48.744 08:55:36 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:48.744 08:55:36 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:48.744 08:55:36 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:48.744 08:55:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:48.744 08:55:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:48.744 08:55:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:48.744 08:55:36 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:48.744 08:55:36 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:48.744 08:55:36 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:48.744 08:55:36 -- common/autotest_common.sh@10 -- # set +x 00:16:50.645 08:55:38 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:50.645 08:55:38 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:50.645 08:55:38 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:50.645 08:55:38 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:50.645 08:55:38 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:50.645 08:55:38 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:50.645 08:55:38 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:50.645 08:55:38 -- nvmf/common.sh@294 -- # net_devs=() 00:16:50.645 08:55:38 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:50.645 08:55:38 -- nvmf/common.sh@295 -- # e810=() 00:16:50.645 08:55:38 -- nvmf/common.sh@295 -- # local -ga e810 00:16:50.645 08:55:38 -- nvmf/common.sh@296 -- # x722=() 00:16:50.645 08:55:38 -- nvmf/common.sh@296 -- # local -ga x722 00:16:50.645 08:55:38 -- nvmf/common.sh@297 -- # mlx=() 00:16:50.645 08:55:38 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:50.645 08:55:38 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:50.645 08:55:38 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:50.645 08:55:38 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:50.645 08:55:38 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:50.645 08:55:38 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:50.645 08:55:38 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:50.645 08:55:38 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:50.645 08:55:38 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:50.645 08:55:38 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:50.645 08:55:38 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:50.645 08:55:38 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:50.645 08:55:38 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:50.645 08:55:38 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:50.645 08:55:38 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:50.645 08:55:38 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:50.645 08:55:38 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:50.645 08:55:38 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:50.645 08:55:38 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:50.645 08:55:38 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:50.645 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:50.645 08:55:38 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:50.645 08:55:38 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:50.645 08:55:38 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:50.645 08:55:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:50.645 08:55:38 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:50.645 08:55:38 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:50.645 08:55:38 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:50.645 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:50.645 08:55:38 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:50.645 08:55:38 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:50.645 08:55:38 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:50.645 08:55:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:50.645 08:55:38 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:50.645 08:55:38 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:50.645 08:55:38 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:50.645 08:55:38 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:50.645 08:55:38 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:50.645 08:55:38 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:50.645 08:55:38 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:50.645 08:55:38 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:50.645 08:55:38 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:50.645 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:50.645 08:55:38 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:50.645 08:55:38 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:50.645 08:55:38 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:50.645 08:55:38 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:50.645 08:55:38 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:50.645 08:55:38 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:50.645 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:50.645 08:55:38 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:50.645 08:55:38 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:50.645 08:55:38 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:50.645 08:55:38 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:50.645 08:55:38 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:50.645 08:55:38 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:50.645 08:55:38 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:50.645 08:55:38 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:50.645 08:55:38 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:50.645 08:55:38 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:50.645 08:55:38 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:50.645 08:55:38 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:50.645 08:55:38 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:50.645 08:55:38 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:50.645 08:55:38 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:50.645 08:55:38 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:50.645 08:55:38 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:50.645 08:55:38 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:50.645 08:55:38 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:50.645 08:55:38 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:50.645 08:55:38 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:50.645 08:55:38 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:50.645 08:55:38 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:50.645 08:55:38 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:50.645 08:55:38 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:50.645 08:55:38 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:50.645 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:50.645 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.120 ms 00:16:50.645 00:16:50.645 --- 10.0.0.2 ping statistics --- 00:16:50.645 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:50.645 rtt min/avg/max/mdev = 0.120/0.120/0.120/0.000 ms 00:16:50.645 08:55:38 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:50.645 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:50.645 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.082 ms 00:16:50.645 00:16:50.645 --- 10.0.0.1 ping statistics --- 00:16:50.645 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:50.645 rtt min/avg/max/mdev = 0.082/0.082/0.082/0.000 ms 00:16:50.645 08:55:38 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:50.645 08:55:38 -- nvmf/common.sh@410 -- # return 0 00:16:50.645 08:55:38 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:50.645 08:55:38 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:50.645 08:55:38 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:50.645 08:55:38 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:50.645 08:55:38 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:50.645 08:55:38 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:50.645 08:55:38 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:50.645 08:55:38 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:16:50.645 08:55:38 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:50.645 08:55:38 -- common/autotest_common.sh@712 -- # xtrace_disable 00:16:50.645 08:55:38 -- common/autotest_common.sh@10 -- # set +x 00:16:50.645 08:55:38 -- nvmf/common.sh@469 -- # nvmfpid=1514039 00:16:50.645 08:55:38 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:16:50.645 08:55:38 -- nvmf/common.sh@470 -- # waitforlisten 1514039 00:16:50.645 08:55:38 -- common/autotest_common.sh@819 -- # '[' -z 1514039 ']' 00:16:50.645 08:55:38 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:50.645 08:55:38 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:50.645 08:55:38 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:50.645 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:50.645 08:55:38 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:50.645 08:55:38 -- common/autotest_common.sh@10 -- # set +x 00:16:50.645 [2024-07-15 08:55:39.035325] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:16:50.646 [2024-07-15 08:55:39.035412] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:50.646 EAL: No free 2048 kB hugepages reported on node 1 00:16:50.646 [2024-07-15 08:55:39.103057] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:50.904 [2024-07-15 08:55:39.209485] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:50.904 [2024-07-15 08:55:39.209659] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:50.904 [2024-07-15 08:55:39.209679] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:50.904 [2024-07-15 08:55:39.209695] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:50.904 [2024-07-15 08:55:39.209726] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:51.469 08:55:39 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:51.469 08:55:39 -- common/autotest_common.sh@852 -- # return 0 00:16:51.469 08:55:39 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:51.469 08:55:39 -- common/autotest_common.sh@718 -- # xtrace_disable 00:16:51.469 08:55:39 -- common/autotest_common.sh@10 -- # set +x 00:16:51.727 08:55:40 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:51.727 08:55:40 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:16:51.727 08:55:40 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:16:51.985 true 00:16:51.985 08:55:40 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:51.985 08:55:40 -- target/tls.sh@82 -- # jq -r .tls_version 00:16:52.242 08:55:40 -- target/tls.sh@82 -- # version=0 00:16:52.242 08:55:40 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:16:52.242 08:55:40 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:16:52.242 08:55:40 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:52.243 08:55:40 -- target/tls.sh@90 -- # jq -r .tls_version 00:16:52.500 08:55:41 -- target/tls.sh@90 -- # version=13 00:16:52.500 08:55:41 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:16:52.500 08:55:41 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:16:52.757 08:55:41 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:52.757 08:55:41 -- target/tls.sh@98 -- # jq -r .tls_version 00:16:53.014 08:55:41 -- target/tls.sh@98 -- # version=7 00:16:53.014 08:55:41 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:16:53.014 08:55:41 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:53.014 08:55:41 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:16:53.271 08:55:41 -- target/tls.sh@105 -- # ktls=false 00:16:53.271 08:55:41 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:16:53.271 08:55:41 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:16:53.528 08:55:42 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:53.528 08:55:42 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:16:53.786 08:55:42 -- target/tls.sh@113 -- # ktls=true 00:16:53.786 08:55:42 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:16:53.786 08:55:42 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:16:54.045 08:55:42 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:54.045 08:55:42 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:16:54.303 08:55:42 -- target/tls.sh@121 -- # ktls=false 00:16:54.303 08:55:42 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:16:54.303 08:55:42 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:16:54.303 08:55:42 -- target/tls.sh@49 -- # local key hash crc 00:16:54.303 08:55:42 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:16:54.303 08:55:42 -- target/tls.sh@51 -- # hash=01 00:16:54.303 08:55:42 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:16:54.303 08:55:42 -- target/tls.sh@52 -- # gzip -1 -c 00:16:54.303 08:55:42 -- target/tls.sh@52 -- # tail -c8 00:16:54.303 08:55:42 -- target/tls.sh@52 -- # head -c 4 00:16:54.303 08:55:42 -- target/tls.sh@52 -- # crc='p$H�' 00:16:54.303 08:55:42 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:16:54.303 08:55:42 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:16:54.303 08:55:42 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:16:54.303 08:55:42 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:16:54.303 08:55:42 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:16:54.303 08:55:42 -- target/tls.sh@49 -- # local key hash crc 00:16:54.303 08:55:42 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:16:54.303 08:55:42 -- target/tls.sh@51 -- # hash=01 00:16:54.303 08:55:42 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:16:54.303 08:55:42 -- target/tls.sh@52 -- # gzip -1 -c 00:16:54.303 08:55:42 -- target/tls.sh@52 -- # tail -c8 00:16:54.303 08:55:42 -- target/tls.sh@52 -- # head -c 4 00:16:54.303 08:55:42 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:16:54.303 08:55:42 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:16:54.303 08:55:42 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:16:54.303 08:55:42 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:16:54.303 08:55:42 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:16:54.303 08:55:42 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:54.303 08:55:42 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:16:54.303 08:55:42 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:16:54.303 08:55:42 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:16:54.303 08:55:42 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:54.303 08:55:42 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:16:54.303 08:55:42 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:16:54.560 08:55:43 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:16:55.124 08:55:43 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:55.124 08:55:43 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:55.124 08:55:43 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:16:55.124 [2024-07-15 08:55:43.612597] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:55.124 08:55:43 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:16:55.380 08:55:43 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:16:55.638 [2024-07-15 08:55:44.077845] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:16:55.638 [2024-07-15 08:55:44.078111] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:55.638 08:55:44 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:16:55.896 malloc0 00:16:55.896 08:55:44 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:16:56.153 08:55:44 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:56.411 08:55:44 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:56.411 EAL: No free 2048 kB hugepages reported on node 1 00:17:06.430 Initializing NVMe Controllers 00:17:06.430 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:17:06.430 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:17:06.430 Initialization complete. Launching workers. 00:17:06.430 ======================================================== 00:17:06.430 Latency(us) 00:17:06.430 Device Information : IOPS MiB/s Average min max 00:17:06.430 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7763.84 30.33 8245.96 1181.13 13211.77 00:17:06.430 ======================================================== 00:17:06.430 Total : 7763.84 30.33 8245.96 1181.13 13211.77 00:17:06.430 00:17:06.430 08:55:54 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:06.430 08:55:54 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:06.430 08:55:54 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:06.430 08:55:54 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:06.430 08:55:54 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:06.430 08:55:54 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:06.430 08:55:54 -- target/tls.sh@28 -- # bdevperf_pid=1516009 00:17:06.430 08:55:54 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:06.430 08:55:54 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:06.430 08:55:54 -- target/tls.sh@31 -- # waitforlisten 1516009 /var/tmp/bdevperf.sock 00:17:06.430 08:55:54 -- common/autotest_common.sh@819 -- # '[' -z 1516009 ']' 00:17:06.430 08:55:54 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:06.430 08:55:54 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:06.430 08:55:54 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:06.430 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:06.430 08:55:54 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:06.430 08:55:54 -- common/autotest_common.sh@10 -- # set +x 00:17:06.430 [2024-07-15 08:55:54.966337] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:17:06.430 [2024-07-15 08:55:54.966413] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1516009 ] 00:17:06.688 EAL: No free 2048 kB hugepages reported on node 1 00:17:06.688 [2024-07-15 08:55:55.022568] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:06.688 [2024-07-15 08:55:55.125565] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:07.619 08:55:55 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:07.619 08:55:55 -- common/autotest_common.sh@852 -- # return 0 00:17:07.619 08:55:55 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:07.619 [2024-07-15 08:55:56.112763] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:07.876 TLSTESTn1 00:17:07.876 08:55:56 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:07.876 Running I/O for 10 seconds... 00:17:17.834 00:17:17.834 Latency(us) 00:17:17.834 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:17.834 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:17.834 Verification LBA range: start 0x0 length 0x2000 00:17:17.834 TLSTESTn1 : 10.03 2129.83 8.32 0.00 0.00 59990.69 8641.04 70293.43 00:17:17.834 =================================================================================================================== 00:17:17.834 Total : 2129.83 8.32 0.00 0.00 59990.69 8641.04 70293.43 00:17:17.834 0 00:17:17.834 08:56:06 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:17.834 08:56:06 -- target/tls.sh@45 -- # killprocess 1516009 00:17:17.834 08:56:06 -- common/autotest_common.sh@926 -- # '[' -z 1516009 ']' 00:17:17.834 08:56:06 -- common/autotest_common.sh@930 -- # kill -0 1516009 00:17:17.834 08:56:06 -- common/autotest_common.sh@931 -- # uname 00:17:17.834 08:56:06 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:18.091 08:56:06 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1516009 00:17:18.091 08:56:06 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:17:18.091 08:56:06 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:17:18.091 08:56:06 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1516009' 00:17:18.091 killing process with pid 1516009 00:17:18.091 08:56:06 -- common/autotest_common.sh@945 -- # kill 1516009 00:17:18.091 Received shutdown signal, test time was about 10.000000 seconds 00:17:18.091 00:17:18.091 Latency(us) 00:17:18.091 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:18.091 =================================================================================================================== 00:17:18.091 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:18.091 08:56:06 -- common/autotest_common.sh@950 -- # wait 1516009 00:17:18.348 08:56:06 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:18.348 08:56:06 -- common/autotest_common.sh@640 -- # local es=0 00:17:18.348 08:56:06 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:18.348 08:56:06 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:17:18.348 08:56:06 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:18.348 08:56:06 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:17:18.348 08:56:06 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:18.348 08:56:06 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:18.348 08:56:06 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:18.348 08:56:06 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:18.348 08:56:06 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:18.348 08:56:06 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:17:18.348 08:56:06 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:18.348 08:56:06 -- target/tls.sh@28 -- # bdevperf_pid=1517381 00:17:18.348 08:56:06 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:18.348 08:56:06 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:18.348 08:56:06 -- target/tls.sh@31 -- # waitforlisten 1517381 /var/tmp/bdevperf.sock 00:17:18.348 08:56:06 -- common/autotest_common.sh@819 -- # '[' -z 1517381 ']' 00:17:18.348 08:56:06 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:18.348 08:56:06 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:18.348 08:56:06 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:18.348 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:18.348 08:56:06 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:18.348 08:56:06 -- common/autotest_common.sh@10 -- # set +x 00:17:18.348 [2024-07-15 08:56:06.695631] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:17:18.348 [2024-07-15 08:56:06.695726] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1517381 ] 00:17:18.348 EAL: No free 2048 kB hugepages reported on node 1 00:17:18.348 [2024-07-15 08:56:06.757200] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:18.348 [2024-07-15 08:56:06.859138] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:19.278 08:56:07 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:19.278 08:56:07 -- common/autotest_common.sh@852 -- # return 0 00:17:19.278 08:56:07 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:19.534 [2024-07-15 08:56:07.928273] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:19.534 [2024-07-15 08:56:07.939973] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:19.534 [2024-07-15 08:56:07.941077] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15c3870 (107): Transport endpoint is not connected 00:17:19.534 [2024-07-15 08:56:07.942068] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15c3870 (9): Bad file descriptor 00:17:19.534 [2024-07-15 08:56:07.943067] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:19.534 [2024-07-15 08:56:07.943088] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:19.534 [2024-07-15 08:56:07.943101] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:19.534 request: 00:17:19.534 { 00:17:19.534 "name": "TLSTEST", 00:17:19.534 "trtype": "tcp", 00:17:19.534 "traddr": "10.0.0.2", 00:17:19.534 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:19.534 "adrfam": "ipv4", 00:17:19.534 "trsvcid": "4420", 00:17:19.534 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:19.534 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:17:19.534 "method": "bdev_nvme_attach_controller", 00:17:19.534 "req_id": 1 00:17:19.534 } 00:17:19.534 Got JSON-RPC error response 00:17:19.534 response: 00:17:19.534 { 00:17:19.534 "code": -32602, 00:17:19.534 "message": "Invalid parameters" 00:17:19.534 } 00:17:19.534 08:56:07 -- target/tls.sh@36 -- # killprocess 1517381 00:17:19.534 08:56:07 -- common/autotest_common.sh@926 -- # '[' -z 1517381 ']' 00:17:19.534 08:56:07 -- common/autotest_common.sh@930 -- # kill -0 1517381 00:17:19.534 08:56:07 -- common/autotest_common.sh@931 -- # uname 00:17:19.534 08:56:07 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:19.534 08:56:07 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1517381 00:17:19.534 08:56:07 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:17:19.534 08:56:07 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:17:19.535 08:56:07 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1517381' 00:17:19.535 killing process with pid 1517381 00:17:19.535 08:56:07 -- common/autotest_common.sh@945 -- # kill 1517381 00:17:19.535 Received shutdown signal, test time was about 10.000000 seconds 00:17:19.535 00:17:19.535 Latency(us) 00:17:19.535 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:19.535 =================================================================================================================== 00:17:19.535 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:19.535 08:56:07 -- common/autotest_common.sh@950 -- # wait 1517381 00:17:19.792 08:56:08 -- target/tls.sh@37 -- # return 1 00:17:19.792 08:56:08 -- common/autotest_common.sh@643 -- # es=1 00:17:19.792 08:56:08 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:17:19.792 08:56:08 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:17:19.792 08:56:08 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:17:19.792 08:56:08 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:19.792 08:56:08 -- common/autotest_common.sh@640 -- # local es=0 00:17:19.792 08:56:08 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:19.792 08:56:08 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:17:19.792 08:56:08 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:19.792 08:56:08 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:17:19.792 08:56:08 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:19.792 08:56:08 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:19.792 08:56:08 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:19.792 08:56:08 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:19.792 08:56:08 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:17:19.792 08:56:08 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:19.792 08:56:08 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:19.792 08:56:08 -- target/tls.sh@28 -- # bdevperf_pid=1517650 00:17:19.792 08:56:08 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:19.792 08:56:08 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:19.792 08:56:08 -- target/tls.sh@31 -- # waitforlisten 1517650 /var/tmp/bdevperf.sock 00:17:19.792 08:56:08 -- common/autotest_common.sh@819 -- # '[' -z 1517650 ']' 00:17:19.792 08:56:08 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:19.792 08:56:08 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:19.792 08:56:08 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:19.792 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:19.792 08:56:08 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:19.792 08:56:08 -- common/autotest_common.sh@10 -- # set +x 00:17:19.792 [2024-07-15 08:56:08.269809] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:17:19.792 [2024-07-15 08:56:08.269903] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1517650 ] 00:17:19.792 EAL: No free 2048 kB hugepages reported on node 1 00:17:19.792 [2024-07-15 08:56:08.327766] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:20.050 [2024-07-15 08:56:08.433609] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:20.981 08:56:09 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:20.981 08:56:09 -- common/autotest_common.sh@852 -- # return 0 00:17:20.981 08:56:09 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:20.981 [2024-07-15 08:56:09.486286] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:20.981 [2024-07-15 08:56:09.493807] tcp.c: 866:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:17:20.981 [2024-07-15 08:56:09.493840] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:17:20.981 [2024-07-15 08:56:09.493901] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:20.981 [2024-07-15 08:56:09.494143] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xdef870 (107): Transport endpoint is not connected 00:17:20.981 [2024-07-15 08:56:09.495133] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xdef870 (9): Bad file descriptor 00:17:20.981 [2024-07-15 08:56:09.496132] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:20.981 [2024-07-15 08:56:09.496152] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:20.981 [2024-07-15 08:56:09.496165] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:20.981 request: 00:17:20.981 { 00:17:20.981 "name": "TLSTEST", 00:17:20.981 "trtype": "tcp", 00:17:20.981 "traddr": "10.0.0.2", 00:17:20.981 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:17:20.981 "adrfam": "ipv4", 00:17:20.981 "trsvcid": "4420", 00:17:20.981 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:20.981 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:17:20.981 "method": "bdev_nvme_attach_controller", 00:17:20.981 "req_id": 1 00:17:20.981 } 00:17:20.981 Got JSON-RPC error response 00:17:20.981 response: 00:17:20.981 { 00:17:20.981 "code": -32602, 00:17:20.981 "message": "Invalid parameters" 00:17:20.981 } 00:17:20.981 08:56:09 -- target/tls.sh@36 -- # killprocess 1517650 00:17:20.981 08:56:09 -- common/autotest_common.sh@926 -- # '[' -z 1517650 ']' 00:17:20.981 08:56:09 -- common/autotest_common.sh@930 -- # kill -0 1517650 00:17:20.981 08:56:09 -- common/autotest_common.sh@931 -- # uname 00:17:20.981 08:56:09 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:20.981 08:56:09 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1517650 00:17:21.240 08:56:09 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:17:21.240 08:56:09 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:17:21.240 08:56:09 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1517650' 00:17:21.240 killing process with pid 1517650 00:17:21.240 08:56:09 -- common/autotest_common.sh@945 -- # kill 1517650 00:17:21.240 Received shutdown signal, test time was about 10.000000 seconds 00:17:21.240 00:17:21.240 Latency(us) 00:17:21.240 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:21.240 =================================================================================================================== 00:17:21.240 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:21.240 08:56:09 -- common/autotest_common.sh@950 -- # wait 1517650 00:17:21.240 08:56:09 -- target/tls.sh@37 -- # return 1 00:17:21.240 08:56:09 -- common/autotest_common.sh@643 -- # es=1 00:17:21.240 08:56:09 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:17:21.240 08:56:09 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:17:21.240 08:56:09 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:17:21.240 08:56:09 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:21.240 08:56:09 -- common/autotest_common.sh@640 -- # local es=0 00:17:21.240 08:56:09 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:21.240 08:56:09 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:17:21.240 08:56:09 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:21.240 08:56:09 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:17:21.240 08:56:09 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:21.240 08:56:09 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:21.240 08:56:09 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:21.240 08:56:09 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:17:21.240 08:56:09 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:21.240 08:56:09 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:21.240 08:56:09 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:21.240 08:56:09 -- target/tls.sh@28 -- # bdevperf_pid=1517805 00:17:21.240 08:56:09 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:21.240 08:56:09 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:21.240 08:56:09 -- target/tls.sh@31 -- # waitforlisten 1517805 /var/tmp/bdevperf.sock 00:17:21.240 08:56:09 -- common/autotest_common.sh@819 -- # '[' -z 1517805 ']' 00:17:21.240 08:56:09 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:21.240 08:56:09 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:21.240 08:56:09 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:21.240 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:21.240 08:56:09 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:21.240 08:56:09 -- common/autotest_common.sh@10 -- # set +x 00:17:21.499 [2024-07-15 08:56:09.811036] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:17:21.499 [2024-07-15 08:56:09.811125] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1517805 ] 00:17:21.499 EAL: No free 2048 kB hugepages reported on node 1 00:17:21.499 [2024-07-15 08:56:09.883731] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:21.499 [2024-07-15 08:56:10.018699] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:22.432 08:56:10 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:22.432 08:56:10 -- common/autotest_common.sh@852 -- # return 0 00:17:22.432 08:56:10 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:22.690 [2024-07-15 08:56:11.126821] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:22.690 [2024-07-15 08:56:11.138115] tcp.c: 866:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:17:22.690 [2024-07-15 08:56:11.138166] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:17:22.690 [2024-07-15 08:56:11.138224] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:22.690 [2024-07-15 08:56:11.138821] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x162d870 (107): Transport endpoint is not connected 00:17:22.690 [2024-07-15 08:56:11.139810] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x162d870 (9): Bad file descriptor 00:17:22.690 [2024-07-15 08:56:11.140809] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:17:22.690 [2024-07-15 08:56:11.140829] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:22.690 [2024-07-15 08:56:11.140842] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:17:22.690 request: 00:17:22.690 { 00:17:22.690 "name": "TLSTEST", 00:17:22.690 "trtype": "tcp", 00:17:22.690 "traddr": "10.0.0.2", 00:17:22.690 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:22.690 "adrfam": "ipv4", 00:17:22.690 "trsvcid": "4420", 00:17:22.690 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:17:22.690 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:17:22.690 "method": "bdev_nvme_attach_controller", 00:17:22.690 "req_id": 1 00:17:22.690 } 00:17:22.690 Got JSON-RPC error response 00:17:22.690 response: 00:17:22.690 { 00:17:22.690 "code": -32602, 00:17:22.690 "message": "Invalid parameters" 00:17:22.690 } 00:17:22.690 08:56:11 -- target/tls.sh@36 -- # killprocess 1517805 00:17:22.690 08:56:11 -- common/autotest_common.sh@926 -- # '[' -z 1517805 ']' 00:17:22.690 08:56:11 -- common/autotest_common.sh@930 -- # kill -0 1517805 00:17:22.690 08:56:11 -- common/autotest_common.sh@931 -- # uname 00:17:22.690 08:56:11 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:22.690 08:56:11 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1517805 00:17:22.690 08:56:11 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:17:22.690 08:56:11 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:17:22.690 08:56:11 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1517805' 00:17:22.690 killing process with pid 1517805 00:17:22.690 08:56:11 -- common/autotest_common.sh@945 -- # kill 1517805 00:17:22.690 Received shutdown signal, test time was about 10.000000 seconds 00:17:22.690 00:17:22.690 Latency(us) 00:17:22.690 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:22.690 =================================================================================================================== 00:17:22.690 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:22.690 08:56:11 -- common/autotest_common.sh@950 -- # wait 1517805 00:17:22.948 08:56:11 -- target/tls.sh@37 -- # return 1 00:17:22.948 08:56:11 -- common/autotest_common.sh@643 -- # es=1 00:17:22.948 08:56:11 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:17:22.948 08:56:11 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:17:22.948 08:56:11 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:17:22.948 08:56:11 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:22.948 08:56:11 -- common/autotest_common.sh@640 -- # local es=0 00:17:22.948 08:56:11 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:22.948 08:56:11 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:17:22.948 08:56:11 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:22.948 08:56:11 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:17:22.948 08:56:11 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:22.948 08:56:11 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:22.948 08:56:11 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:22.948 08:56:11 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:22.948 08:56:11 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:22.948 08:56:11 -- target/tls.sh@23 -- # psk= 00:17:22.948 08:56:11 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:22.948 08:56:11 -- target/tls.sh@28 -- # bdevperf_pid=1517960 00:17:22.948 08:56:11 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:22.948 08:56:11 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:22.949 08:56:11 -- target/tls.sh@31 -- # waitforlisten 1517960 /var/tmp/bdevperf.sock 00:17:22.949 08:56:11 -- common/autotest_common.sh@819 -- # '[' -z 1517960 ']' 00:17:22.949 08:56:11 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:22.949 08:56:11 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:22.949 08:56:11 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:22.949 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:22.949 08:56:11 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:22.949 08:56:11 -- common/autotest_common.sh@10 -- # set +x 00:17:23.207 [2024-07-15 08:56:11.496814] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:17:23.207 [2024-07-15 08:56:11.496915] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1517960 ] 00:17:23.207 EAL: No free 2048 kB hugepages reported on node 1 00:17:23.207 [2024-07-15 08:56:11.559718] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:23.207 [2024-07-15 08:56:11.667902] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:24.139 08:56:12 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:24.139 08:56:12 -- common/autotest_common.sh@852 -- # return 0 00:17:24.139 08:56:12 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:17:24.397 [2024-07-15 08:56:12.743450] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:24.397 [2024-07-15 08:56:12.745268] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f98330 (9): Bad file descriptor 00:17:24.397 [2024-07-15 08:56:12.746265] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:24.397 [2024-07-15 08:56:12.746285] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:24.397 [2024-07-15 08:56:12.746307] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:24.397 request: 00:17:24.397 { 00:17:24.398 "name": "TLSTEST", 00:17:24.398 "trtype": "tcp", 00:17:24.398 "traddr": "10.0.0.2", 00:17:24.398 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:24.398 "adrfam": "ipv4", 00:17:24.398 "trsvcid": "4420", 00:17:24.398 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:24.398 "method": "bdev_nvme_attach_controller", 00:17:24.398 "req_id": 1 00:17:24.398 } 00:17:24.398 Got JSON-RPC error response 00:17:24.398 response: 00:17:24.398 { 00:17:24.398 "code": -32602, 00:17:24.398 "message": "Invalid parameters" 00:17:24.398 } 00:17:24.398 08:56:12 -- target/tls.sh@36 -- # killprocess 1517960 00:17:24.398 08:56:12 -- common/autotest_common.sh@926 -- # '[' -z 1517960 ']' 00:17:24.398 08:56:12 -- common/autotest_common.sh@930 -- # kill -0 1517960 00:17:24.398 08:56:12 -- common/autotest_common.sh@931 -- # uname 00:17:24.398 08:56:12 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:24.398 08:56:12 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1517960 00:17:24.398 08:56:12 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:17:24.398 08:56:12 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:17:24.398 08:56:12 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1517960' 00:17:24.398 killing process with pid 1517960 00:17:24.398 08:56:12 -- common/autotest_common.sh@945 -- # kill 1517960 00:17:24.398 Received shutdown signal, test time was about 10.000000 seconds 00:17:24.398 00:17:24.398 Latency(us) 00:17:24.398 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:24.398 =================================================================================================================== 00:17:24.398 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:24.398 08:56:12 -- common/autotest_common.sh@950 -- # wait 1517960 00:17:24.656 08:56:13 -- target/tls.sh@37 -- # return 1 00:17:24.656 08:56:13 -- common/autotest_common.sh@643 -- # es=1 00:17:24.656 08:56:13 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:17:24.656 08:56:13 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:17:24.656 08:56:13 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:17:24.656 08:56:13 -- target/tls.sh@167 -- # killprocess 1514039 00:17:24.656 08:56:13 -- common/autotest_common.sh@926 -- # '[' -z 1514039 ']' 00:17:24.656 08:56:13 -- common/autotest_common.sh@930 -- # kill -0 1514039 00:17:24.656 08:56:13 -- common/autotest_common.sh@931 -- # uname 00:17:24.656 08:56:13 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:24.656 08:56:13 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1514039 00:17:24.656 08:56:13 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:17:24.656 08:56:13 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:17:24.656 08:56:13 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1514039' 00:17:24.656 killing process with pid 1514039 00:17:24.656 08:56:13 -- common/autotest_common.sh@945 -- # kill 1514039 00:17:24.656 08:56:13 -- common/autotest_common.sh@950 -- # wait 1514039 00:17:24.913 08:56:13 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:17:24.913 08:56:13 -- target/tls.sh@49 -- # local key hash crc 00:17:24.913 08:56:13 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:17:24.913 08:56:13 -- target/tls.sh@51 -- # hash=02 00:17:24.913 08:56:13 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:17:24.913 08:56:13 -- target/tls.sh@52 -- # gzip -1 -c 00:17:24.913 08:56:13 -- target/tls.sh@52 -- # tail -c8 00:17:24.913 08:56:13 -- target/tls.sh@52 -- # head -c 4 00:17:24.913 08:56:13 -- target/tls.sh@52 -- # crc='�e�'\''' 00:17:24.913 08:56:13 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:24.913 08:56:13 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:17:24.913 08:56:13 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:24.913 08:56:13 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:24.914 08:56:13 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:24.914 08:56:13 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:24.914 08:56:13 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:24.914 08:56:13 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:17:24.914 08:56:13 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:24.914 08:56:13 -- common/autotest_common.sh@712 -- # xtrace_disable 00:17:24.914 08:56:13 -- common/autotest_common.sh@10 -- # set +x 00:17:24.914 08:56:13 -- nvmf/common.sh@469 -- # nvmfpid=1518248 00:17:24.914 08:56:13 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:24.914 08:56:13 -- nvmf/common.sh@470 -- # waitforlisten 1518248 00:17:24.914 08:56:13 -- common/autotest_common.sh@819 -- # '[' -z 1518248 ']' 00:17:24.914 08:56:13 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:24.914 08:56:13 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:24.914 08:56:13 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:24.914 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:24.914 08:56:13 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:24.914 08:56:13 -- common/autotest_common.sh@10 -- # set +x 00:17:24.914 [2024-07-15 08:56:13.401997] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:17:24.914 [2024-07-15 08:56:13.402085] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:24.914 EAL: No free 2048 kB hugepages reported on node 1 00:17:25.171 [2024-07-15 08:56:13.470228] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:25.171 [2024-07-15 08:56:13.582163] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:25.171 [2024-07-15 08:56:13.582356] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:25.171 [2024-07-15 08:56:13.582376] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:25.171 [2024-07-15 08:56:13.582390] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:25.171 [2024-07-15 08:56:13.582424] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:26.104 08:56:14 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:26.104 08:56:14 -- common/autotest_common.sh@852 -- # return 0 00:17:26.104 08:56:14 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:26.104 08:56:14 -- common/autotest_common.sh@718 -- # xtrace_disable 00:17:26.104 08:56:14 -- common/autotest_common.sh@10 -- # set +x 00:17:26.104 08:56:14 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:26.104 08:56:14 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:26.104 08:56:14 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:26.104 08:56:14 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:26.104 [2024-07-15 08:56:14.606621] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:26.104 08:56:14 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:26.362 08:56:14 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:26.620 [2024-07-15 08:56:15.079948] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:26.620 [2024-07-15 08:56:15.080236] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:26.620 08:56:15 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:26.885 malloc0 00:17:26.885 08:56:15 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:27.176 08:56:15 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:27.460 08:56:15 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:27.460 08:56:15 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:27.460 08:56:15 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:27.460 08:56:15 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:27.460 08:56:15 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:17:27.460 08:56:15 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:27.460 08:56:15 -- target/tls.sh@28 -- # bdevperf_pid=1518552 00:17:27.460 08:56:15 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:27.460 08:56:15 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:27.460 08:56:15 -- target/tls.sh@31 -- # waitforlisten 1518552 /var/tmp/bdevperf.sock 00:17:27.460 08:56:15 -- common/autotest_common.sh@819 -- # '[' -z 1518552 ']' 00:17:27.460 08:56:15 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:27.460 08:56:15 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:27.460 08:56:15 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:27.460 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:27.460 08:56:15 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:27.460 08:56:15 -- common/autotest_common.sh@10 -- # set +x 00:17:27.460 [2024-07-15 08:56:15.845600] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:17:27.460 [2024-07-15 08:56:15.845665] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1518552 ] 00:17:27.460 EAL: No free 2048 kB hugepages reported on node 1 00:17:27.460 [2024-07-15 08:56:15.902235] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:27.719 [2024-07-15 08:56:16.006535] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:28.652 08:56:16 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:28.652 08:56:16 -- common/autotest_common.sh@852 -- # return 0 00:17:28.653 08:56:16 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:28.653 [2024-07-15 08:56:17.101192] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:28.653 TLSTESTn1 00:17:28.653 08:56:17 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:28.911 Running I/O for 10 seconds... 00:17:38.876 00:17:38.876 Latency(us) 00:17:38.876 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:38.876 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:38.876 Verification LBA range: start 0x0 length 0x2000 00:17:38.876 TLSTESTn1 : 10.02 3360.31 13.13 0.00 0.00 38044.71 4708.88 43496.49 00:17:38.876 =================================================================================================================== 00:17:38.876 Total : 3360.31 13.13 0.00 0.00 38044.71 4708.88 43496.49 00:17:38.876 0 00:17:38.876 08:56:27 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:38.876 08:56:27 -- target/tls.sh@45 -- # killprocess 1518552 00:17:38.876 08:56:27 -- common/autotest_common.sh@926 -- # '[' -z 1518552 ']' 00:17:38.876 08:56:27 -- common/autotest_common.sh@930 -- # kill -0 1518552 00:17:38.876 08:56:27 -- common/autotest_common.sh@931 -- # uname 00:17:38.876 08:56:27 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:38.876 08:56:27 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1518552 00:17:38.876 08:56:27 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:17:38.876 08:56:27 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:17:38.876 08:56:27 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1518552' 00:17:38.876 killing process with pid 1518552 00:17:38.876 08:56:27 -- common/autotest_common.sh@945 -- # kill 1518552 00:17:38.876 Received shutdown signal, test time was about 10.000000 seconds 00:17:38.876 00:17:38.876 Latency(us) 00:17:38.876 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:38.876 =================================================================================================================== 00:17:38.876 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:38.876 08:56:27 -- common/autotest_common.sh@950 -- # wait 1518552 00:17:39.133 08:56:27 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:39.133 08:56:27 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:39.133 08:56:27 -- common/autotest_common.sh@640 -- # local es=0 00:17:39.133 08:56:27 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:39.133 08:56:27 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:17:39.134 08:56:27 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:39.134 08:56:27 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:17:39.134 08:56:27 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:39.134 08:56:27 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:39.134 08:56:27 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:39.134 08:56:27 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:39.134 08:56:27 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:39.134 08:56:27 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:17:39.134 08:56:27 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:39.134 08:56:27 -- target/tls.sh@28 -- # bdevperf_pid=1520040 00:17:39.134 08:56:27 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:39.134 08:56:27 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:39.134 08:56:27 -- target/tls.sh@31 -- # waitforlisten 1520040 /var/tmp/bdevperf.sock 00:17:39.134 08:56:27 -- common/autotest_common.sh@819 -- # '[' -z 1520040 ']' 00:17:39.134 08:56:27 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:39.134 08:56:27 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:39.134 08:56:27 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:39.134 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:39.134 08:56:27 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:39.134 08:56:27 -- common/autotest_common.sh@10 -- # set +x 00:17:39.392 [2024-07-15 08:56:27.686827] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:17:39.392 [2024-07-15 08:56:27.686932] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1520040 ] 00:17:39.392 EAL: No free 2048 kB hugepages reported on node 1 00:17:39.392 [2024-07-15 08:56:27.743273] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:39.392 [2024-07-15 08:56:27.843108] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:40.325 08:56:28 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:40.325 08:56:28 -- common/autotest_common.sh@852 -- # return 0 00:17:40.325 08:56:28 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:40.325 [2024-07-15 08:56:28.836922] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:40.325 [2024-07-15 08:56:28.836979] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:17:40.325 request: 00:17:40.325 { 00:17:40.325 "name": "TLSTEST", 00:17:40.325 "trtype": "tcp", 00:17:40.325 "traddr": "10.0.0.2", 00:17:40.325 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:40.325 "adrfam": "ipv4", 00:17:40.325 "trsvcid": "4420", 00:17:40.325 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:40.325 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:17:40.325 "method": "bdev_nvme_attach_controller", 00:17:40.325 "req_id": 1 00:17:40.325 } 00:17:40.325 Got JSON-RPC error response 00:17:40.325 response: 00:17:40.325 { 00:17:40.325 "code": -22, 00:17:40.325 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:17:40.325 } 00:17:40.325 08:56:28 -- target/tls.sh@36 -- # killprocess 1520040 00:17:40.325 08:56:28 -- common/autotest_common.sh@926 -- # '[' -z 1520040 ']' 00:17:40.325 08:56:28 -- common/autotest_common.sh@930 -- # kill -0 1520040 00:17:40.325 08:56:28 -- common/autotest_common.sh@931 -- # uname 00:17:40.325 08:56:28 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:40.325 08:56:28 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1520040 00:17:40.583 08:56:28 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:17:40.583 08:56:28 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:17:40.583 08:56:28 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1520040' 00:17:40.583 killing process with pid 1520040 00:17:40.583 08:56:28 -- common/autotest_common.sh@945 -- # kill 1520040 00:17:40.583 Received shutdown signal, test time was about 10.000000 seconds 00:17:40.583 00:17:40.583 Latency(us) 00:17:40.583 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:40.583 =================================================================================================================== 00:17:40.583 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:40.583 08:56:28 -- common/autotest_common.sh@950 -- # wait 1520040 00:17:40.841 08:56:29 -- target/tls.sh@37 -- # return 1 00:17:40.841 08:56:29 -- common/autotest_common.sh@643 -- # es=1 00:17:40.841 08:56:29 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:17:40.841 08:56:29 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:17:40.841 08:56:29 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:17:40.841 08:56:29 -- target/tls.sh@183 -- # killprocess 1518248 00:17:40.841 08:56:29 -- common/autotest_common.sh@926 -- # '[' -z 1518248 ']' 00:17:40.841 08:56:29 -- common/autotest_common.sh@930 -- # kill -0 1518248 00:17:40.841 08:56:29 -- common/autotest_common.sh@931 -- # uname 00:17:40.841 08:56:29 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:40.841 08:56:29 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1518248 00:17:40.841 08:56:29 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:17:40.841 08:56:29 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:17:40.841 08:56:29 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1518248' 00:17:40.841 killing process with pid 1518248 00:17:40.841 08:56:29 -- common/autotest_common.sh@945 -- # kill 1518248 00:17:40.841 08:56:29 -- common/autotest_common.sh@950 -- # wait 1518248 00:17:41.099 08:56:29 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:17:41.099 08:56:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:41.099 08:56:29 -- common/autotest_common.sh@712 -- # xtrace_disable 00:17:41.099 08:56:29 -- common/autotest_common.sh@10 -- # set +x 00:17:41.099 08:56:29 -- nvmf/common.sh@469 -- # nvmfpid=1520198 00:17:41.099 08:56:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:41.099 08:56:29 -- nvmf/common.sh@470 -- # waitforlisten 1520198 00:17:41.099 08:56:29 -- common/autotest_common.sh@819 -- # '[' -z 1520198 ']' 00:17:41.099 08:56:29 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:41.099 08:56:29 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:41.099 08:56:29 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:41.099 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:41.099 08:56:29 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:41.099 08:56:29 -- common/autotest_common.sh@10 -- # set +x 00:17:41.099 [2024-07-15 08:56:29.521717] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:17:41.099 [2024-07-15 08:56:29.521810] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:41.099 EAL: No free 2048 kB hugepages reported on node 1 00:17:41.099 [2024-07-15 08:56:29.589951] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:41.357 [2024-07-15 08:56:29.706240] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:41.357 [2024-07-15 08:56:29.706408] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:41.357 [2024-07-15 08:56:29.706425] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:41.357 [2024-07-15 08:56:29.706447] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:41.357 [2024-07-15 08:56:29.706480] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:41.921 08:56:30 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:41.921 08:56:30 -- common/autotest_common.sh@852 -- # return 0 00:17:41.921 08:56:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:41.921 08:56:30 -- common/autotest_common.sh@718 -- # xtrace_disable 00:17:41.921 08:56:30 -- common/autotest_common.sh@10 -- # set +x 00:17:42.179 08:56:30 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:42.179 08:56:30 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:42.179 08:56:30 -- common/autotest_common.sh@640 -- # local es=0 00:17:42.179 08:56:30 -- common/autotest_common.sh@642 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:42.179 08:56:30 -- common/autotest_common.sh@628 -- # local arg=setup_nvmf_tgt 00:17:42.179 08:56:30 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:42.179 08:56:30 -- common/autotest_common.sh@632 -- # type -t setup_nvmf_tgt 00:17:42.179 08:56:30 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:42.179 08:56:30 -- common/autotest_common.sh@643 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:42.179 08:56:30 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:42.179 08:56:30 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:42.437 [2024-07-15 08:56:30.755592] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:42.437 08:56:30 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:42.695 08:56:31 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:42.953 [2024-07-15 08:56:31.313102] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:42.953 [2024-07-15 08:56:31.313357] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:42.953 08:56:31 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:43.211 malloc0 00:17:43.211 08:56:31 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:43.470 08:56:31 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:43.728 [2024-07-15 08:56:32.129714] tcp.c:3549:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:17:43.728 [2024-07-15 08:56:32.129758] tcp.c:3618:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:17:43.728 [2024-07-15 08:56:32.129783] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:17:43.728 request: 00:17:43.728 { 00:17:43.728 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:43.728 "host": "nqn.2016-06.io.spdk:host1", 00:17:43.728 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:17:43.728 "method": "nvmf_subsystem_add_host", 00:17:43.728 "req_id": 1 00:17:43.728 } 00:17:43.728 Got JSON-RPC error response 00:17:43.728 response: 00:17:43.728 { 00:17:43.728 "code": -32603, 00:17:43.728 "message": "Internal error" 00:17:43.728 } 00:17:43.728 08:56:32 -- common/autotest_common.sh@643 -- # es=1 00:17:43.728 08:56:32 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:17:43.728 08:56:32 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:17:43.728 08:56:32 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:17:43.728 08:56:32 -- target/tls.sh@189 -- # killprocess 1520198 00:17:43.728 08:56:32 -- common/autotest_common.sh@926 -- # '[' -z 1520198 ']' 00:17:43.728 08:56:32 -- common/autotest_common.sh@930 -- # kill -0 1520198 00:17:43.728 08:56:32 -- common/autotest_common.sh@931 -- # uname 00:17:43.728 08:56:32 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:43.728 08:56:32 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1520198 00:17:43.728 08:56:32 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:17:43.728 08:56:32 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:17:43.728 08:56:32 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1520198' 00:17:43.728 killing process with pid 1520198 00:17:43.728 08:56:32 -- common/autotest_common.sh@945 -- # kill 1520198 00:17:43.728 08:56:32 -- common/autotest_common.sh@950 -- # wait 1520198 00:17:43.987 08:56:32 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:43.987 08:56:32 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:17:43.987 08:56:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:43.987 08:56:32 -- common/autotest_common.sh@712 -- # xtrace_disable 00:17:43.987 08:56:32 -- common/autotest_common.sh@10 -- # set +x 00:17:43.987 08:56:32 -- nvmf/common.sh@469 -- # nvmfpid=1520632 00:17:43.987 08:56:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:43.987 08:56:32 -- nvmf/common.sh@470 -- # waitforlisten 1520632 00:17:43.987 08:56:32 -- common/autotest_common.sh@819 -- # '[' -z 1520632 ']' 00:17:43.987 08:56:32 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:43.987 08:56:32 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:43.987 08:56:32 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:43.987 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:43.987 08:56:32 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:43.987 08:56:32 -- common/autotest_common.sh@10 -- # set +x 00:17:43.987 [2024-07-15 08:56:32.525178] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:17:43.987 [2024-07-15 08:56:32.525268] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:44.246 EAL: No free 2048 kB hugepages reported on node 1 00:17:44.246 [2024-07-15 08:56:32.594815] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:44.246 [2024-07-15 08:56:32.708572] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:44.246 [2024-07-15 08:56:32.708753] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:44.246 [2024-07-15 08:56:32.708775] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:44.246 [2024-07-15 08:56:32.708790] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:44.246 [2024-07-15 08:56:32.708821] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:45.178 08:56:33 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:45.178 08:56:33 -- common/autotest_common.sh@852 -- # return 0 00:17:45.178 08:56:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:45.178 08:56:33 -- common/autotest_common.sh@718 -- # xtrace_disable 00:17:45.178 08:56:33 -- common/autotest_common.sh@10 -- # set +x 00:17:45.178 08:56:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:45.178 08:56:33 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:45.178 08:56:33 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:45.178 08:56:33 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:45.178 [2024-07-15 08:56:33.689403] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:45.178 08:56:33 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:45.436 08:56:33 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:45.694 [2024-07-15 08:56:34.162683] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:45.694 [2024-07-15 08:56:34.162960] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:45.694 08:56:34 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:45.952 malloc0 00:17:45.952 08:56:34 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:46.210 08:56:34 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:46.468 08:56:34 -- target/tls.sh@197 -- # bdevperf_pid=1520939 00:17:46.468 08:56:34 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:46.468 08:56:34 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:46.468 08:56:34 -- target/tls.sh@200 -- # waitforlisten 1520939 /var/tmp/bdevperf.sock 00:17:46.468 08:56:34 -- common/autotest_common.sh@819 -- # '[' -z 1520939 ']' 00:17:46.468 08:56:34 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:46.468 08:56:34 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:46.468 08:56:34 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:46.468 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:46.468 08:56:34 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:46.468 08:56:34 -- common/autotest_common.sh@10 -- # set +x 00:17:46.468 [2024-07-15 08:56:34.929586] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:17:46.468 [2024-07-15 08:56:34.929670] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1520939 ] 00:17:46.468 EAL: No free 2048 kB hugepages reported on node 1 00:17:46.468 [2024-07-15 08:56:34.989586] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:46.726 [2024-07-15 08:56:35.100280] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:47.659 08:56:35 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:47.659 08:56:35 -- common/autotest_common.sh@852 -- # return 0 00:17:47.659 08:56:35 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:47.659 [2024-07-15 08:56:36.137252] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:47.917 TLSTESTn1 00:17:47.917 08:56:36 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:17:48.175 08:56:36 -- target/tls.sh@205 -- # tgtconf='{ 00:17:48.175 "subsystems": [ 00:17:48.175 { 00:17:48.175 "subsystem": "iobuf", 00:17:48.175 "config": [ 00:17:48.175 { 00:17:48.175 "method": "iobuf_set_options", 00:17:48.175 "params": { 00:17:48.175 "small_pool_count": 8192, 00:17:48.175 "large_pool_count": 1024, 00:17:48.175 "small_bufsize": 8192, 00:17:48.175 "large_bufsize": 135168 00:17:48.175 } 00:17:48.175 } 00:17:48.175 ] 00:17:48.175 }, 00:17:48.175 { 00:17:48.175 "subsystem": "sock", 00:17:48.175 "config": [ 00:17:48.175 { 00:17:48.175 "method": "sock_impl_set_options", 00:17:48.175 "params": { 00:17:48.175 "impl_name": "posix", 00:17:48.175 "recv_buf_size": 2097152, 00:17:48.175 "send_buf_size": 2097152, 00:17:48.175 "enable_recv_pipe": true, 00:17:48.175 "enable_quickack": false, 00:17:48.175 "enable_placement_id": 0, 00:17:48.175 "enable_zerocopy_send_server": true, 00:17:48.175 "enable_zerocopy_send_client": false, 00:17:48.175 "zerocopy_threshold": 0, 00:17:48.175 "tls_version": 0, 00:17:48.175 "enable_ktls": false 00:17:48.175 } 00:17:48.175 }, 00:17:48.175 { 00:17:48.175 "method": "sock_impl_set_options", 00:17:48.175 "params": { 00:17:48.175 "impl_name": "ssl", 00:17:48.175 "recv_buf_size": 4096, 00:17:48.175 "send_buf_size": 4096, 00:17:48.175 "enable_recv_pipe": true, 00:17:48.175 "enable_quickack": false, 00:17:48.175 "enable_placement_id": 0, 00:17:48.175 "enable_zerocopy_send_server": true, 00:17:48.175 "enable_zerocopy_send_client": false, 00:17:48.175 "zerocopy_threshold": 0, 00:17:48.175 "tls_version": 0, 00:17:48.175 "enable_ktls": false 00:17:48.175 } 00:17:48.175 } 00:17:48.175 ] 00:17:48.175 }, 00:17:48.175 { 00:17:48.175 "subsystem": "vmd", 00:17:48.175 "config": [] 00:17:48.175 }, 00:17:48.175 { 00:17:48.175 "subsystem": "accel", 00:17:48.175 "config": [ 00:17:48.175 { 00:17:48.175 "method": "accel_set_options", 00:17:48.175 "params": { 00:17:48.175 "small_cache_size": 128, 00:17:48.175 "large_cache_size": 16, 00:17:48.175 "task_count": 2048, 00:17:48.175 "sequence_count": 2048, 00:17:48.175 "buf_count": 2048 00:17:48.175 } 00:17:48.175 } 00:17:48.175 ] 00:17:48.175 }, 00:17:48.175 { 00:17:48.175 "subsystem": "bdev", 00:17:48.175 "config": [ 00:17:48.175 { 00:17:48.175 "method": "bdev_set_options", 00:17:48.175 "params": { 00:17:48.175 "bdev_io_pool_size": 65535, 00:17:48.175 "bdev_io_cache_size": 256, 00:17:48.175 "bdev_auto_examine": true, 00:17:48.175 "iobuf_small_cache_size": 128, 00:17:48.175 "iobuf_large_cache_size": 16 00:17:48.175 } 00:17:48.175 }, 00:17:48.175 { 00:17:48.175 "method": "bdev_raid_set_options", 00:17:48.175 "params": { 00:17:48.175 "process_window_size_kb": 1024 00:17:48.175 } 00:17:48.175 }, 00:17:48.175 { 00:17:48.175 "method": "bdev_iscsi_set_options", 00:17:48.175 "params": { 00:17:48.175 "timeout_sec": 30 00:17:48.175 } 00:17:48.175 }, 00:17:48.175 { 00:17:48.175 "method": "bdev_nvme_set_options", 00:17:48.175 "params": { 00:17:48.175 "action_on_timeout": "none", 00:17:48.175 "timeout_us": 0, 00:17:48.175 "timeout_admin_us": 0, 00:17:48.175 "keep_alive_timeout_ms": 10000, 00:17:48.175 "transport_retry_count": 4, 00:17:48.175 "arbitration_burst": 0, 00:17:48.175 "low_priority_weight": 0, 00:17:48.175 "medium_priority_weight": 0, 00:17:48.175 "high_priority_weight": 0, 00:17:48.175 "nvme_adminq_poll_period_us": 10000, 00:17:48.175 "nvme_ioq_poll_period_us": 0, 00:17:48.175 "io_queue_requests": 0, 00:17:48.175 "delay_cmd_submit": true, 00:17:48.175 "bdev_retry_count": 3, 00:17:48.175 "transport_ack_timeout": 0, 00:17:48.175 "ctrlr_loss_timeout_sec": 0, 00:17:48.175 "reconnect_delay_sec": 0, 00:17:48.175 "fast_io_fail_timeout_sec": 0, 00:17:48.175 "generate_uuids": false, 00:17:48.175 "transport_tos": 0, 00:17:48.175 "io_path_stat": false, 00:17:48.175 "allow_accel_sequence": false 00:17:48.175 } 00:17:48.175 }, 00:17:48.175 { 00:17:48.175 "method": "bdev_nvme_set_hotplug", 00:17:48.175 "params": { 00:17:48.175 "period_us": 100000, 00:17:48.175 "enable": false 00:17:48.175 } 00:17:48.175 }, 00:17:48.175 { 00:17:48.175 "method": "bdev_malloc_create", 00:17:48.175 "params": { 00:17:48.175 "name": "malloc0", 00:17:48.175 "num_blocks": 8192, 00:17:48.175 "block_size": 4096, 00:17:48.175 "physical_block_size": 4096, 00:17:48.175 "uuid": "e79aacd6-fb78-4616-8fe9-b05c18f11b99", 00:17:48.175 "optimal_io_boundary": 0 00:17:48.175 } 00:17:48.175 }, 00:17:48.175 { 00:17:48.175 "method": "bdev_wait_for_examine" 00:17:48.175 } 00:17:48.175 ] 00:17:48.175 }, 00:17:48.175 { 00:17:48.175 "subsystem": "nbd", 00:17:48.175 "config": [] 00:17:48.175 }, 00:17:48.175 { 00:17:48.175 "subsystem": "scheduler", 00:17:48.175 "config": [ 00:17:48.175 { 00:17:48.176 "method": "framework_set_scheduler", 00:17:48.176 "params": { 00:17:48.176 "name": "static" 00:17:48.176 } 00:17:48.176 } 00:17:48.176 ] 00:17:48.176 }, 00:17:48.176 { 00:17:48.176 "subsystem": "nvmf", 00:17:48.176 "config": [ 00:17:48.176 { 00:17:48.176 "method": "nvmf_set_config", 00:17:48.176 "params": { 00:17:48.176 "discovery_filter": "match_any", 00:17:48.176 "admin_cmd_passthru": { 00:17:48.176 "identify_ctrlr": false 00:17:48.176 } 00:17:48.176 } 00:17:48.176 }, 00:17:48.176 { 00:17:48.176 "method": "nvmf_set_max_subsystems", 00:17:48.176 "params": { 00:17:48.176 "max_subsystems": 1024 00:17:48.176 } 00:17:48.176 }, 00:17:48.176 { 00:17:48.176 "method": "nvmf_set_crdt", 00:17:48.176 "params": { 00:17:48.176 "crdt1": 0, 00:17:48.176 "crdt2": 0, 00:17:48.176 "crdt3": 0 00:17:48.176 } 00:17:48.176 }, 00:17:48.176 { 00:17:48.176 "method": "nvmf_create_transport", 00:17:48.176 "params": { 00:17:48.176 "trtype": "TCP", 00:17:48.176 "max_queue_depth": 128, 00:17:48.176 "max_io_qpairs_per_ctrlr": 127, 00:17:48.176 "in_capsule_data_size": 4096, 00:17:48.176 "max_io_size": 131072, 00:17:48.176 "io_unit_size": 131072, 00:17:48.176 "max_aq_depth": 128, 00:17:48.176 "num_shared_buffers": 511, 00:17:48.176 "buf_cache_size": 4294967295, 00:17:48.176 "dif_insert_or_strip": false, 00:17:48.176 "zcopy": false, 00:17:48.176 "c2h_success": false, 00:17:48.176 "sock_priority": 0, 00:17:48.176 "abort_timeout_sec": 1 00:17:48.176 } 00:17:48.176 }, 00:17:48.176 { 00:17:48.176 "method": "nvmf_create_subsystem", 00:17:48.176 "params": { 00:17:48.176 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:48.176 "allow_any_host": false, 00:17:48.176 "serial_number": "SPDK00000000000001", 00:17:48.176 "model_number": "SPDK bdev Controller", 00:17:48.176 "max_namespaces": 10, 00:17:48.176 "min_cntlid": 1, 00:17:48.176 "max_cntlid": 65519, 00:17:48.176 "ana_reporting": false 00:17:48.176 } 00:17:48.176 }, 00:17:48.176 { 00:17:48.176 "method": "nvmf_subsystem_add_host", 00:17:48.176 "params": { 00:17:48.176 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:48.176 "host": "nqn.2016-06.io.spdk:host1", 00:17:48.176 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:17:48.176 } 00:17:48.176 }, 00:17:48.176 { 00:17:48.176 "method": "nvmf_subsystem_add_ns", 00:17:48.176 "params": { 00:17:48.176 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:48.176 "namespace": { 00:17:48.176 "nsid": 1, 00:17:48.176 "bdev_name": "malloc0", 00:17:48.176 "nguid": "E79AACD6FB7846168FE9B05C18F11B99", 00:17:48.176 "uuid": "e79aacd6-fb78-4616-8fe9-b05c18f11b99" 00:17:48.176 } 00:17:48.176 } 00:17:48.176 }, 00:17:48.176 { 00:17:48.176 "method": "nvmf_subsystem_add_listener", 00:17:48.176 "params": { 00:17:48.176 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:48.176 "listen_address": { 00:17:48.176 "trtype": "TCP", 00:17:48.176 "adrfam": "IPv4", 00:17:48.176 "traddr": "10.0.0.2", 00:17:48.176 "trsvcid": "4420" 00:17:48.176 }, 00:17:48.176 "secure_channel": true 00:17:48.176 } 00:17:48.176 } 00:17:48.176 ] 00:17:48.176 } 00:17:48.176 ] 00:17:48.176 }' 00:17:48.176 08:56:36 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:17:48.437 08:56:36 -- target/tls.sh@206 -- # bdevperfconf='{ 00:17:48.437 "subsystems": [ 00:17:48.437 { 00:17:48.437 "subsystem": "iobuf", 00:17:48.437 "config": [ 00:17:48.437 { 00:17:48.437 "method": "iobuf_set_options", 00:17:48.437 "params": { 00:17:48.437 "small_pool_count": 8192, 00:17:48.437 "large_pool_count": 1024, 00:17:48.437 "small_bufsize": 8192, 00:17:48.437 "large_bufsize": 135168 00:17:48.437 } 00:17:48.437 } 00:17:48.437 ] 00:17:48.437 }, 00:17:48.437 { 00:17:48.437 "subsystem": "sock", 00:17:48.437 "config": [ 00:17:48.437 { 00:17:48.437 "method": "sock_impl_set_options", 00:17:48.437 "params": { 00:17:48.437 "impl_name": "posix", 00:17:48.437 "recv_buf_size": 2097152, 00:17:48.437 "send_buf_size": 2097152, 00:17:48.437 "enable_recv_pipe": true, 00:17:48.437 "enable_quickack": false, 00:17:48.437 "enable_placement_id": 0, 00:17:48.437 "enable_zerocopy_send_server": true, 00:17:48.437 "enable_zerocopy_send_client": false, 00:17:48.437 "zerocopy_threshold": 0, 00:17:48.437 "tls_version": 0, 00:17:48.437 "enable_ktls": false 00:17:48.437 } 00:17:48.437 }, 00:17:48.437 { 00:17:48.437 "method": "sock_impl_set_options", 00:17:48.437 "params": { 00:17:48.437 "impl_name": "ssl", 00:17:48.437 "recv_buf_size": 4096, 00:17:48.437 "send_buf_size": 4096, 00:17:48.437 "enable_recv_pipe": true, 00:17:48.437 "enable_quickack": false, 00:17:48.437 "enable_placement_id": 0, 00:17:48.437 "enable_zerocopy_send_server": true, 00:17:48.437 "enable_zerocopy_send_client": false, 00:17:48.437 "zerocopy_threshold": 0, 00:17:48.437 "tls_version": 0, 00:17:48.437 "enable_ktls": false 00:17:48.437 } 00:17:48.437 } 00:17:48.437 ] 00:17:48.437 }, 00:17:48.437 { 00:17:48.437 "subsystem": "vmd", 00:17:48.437 "config": [] 00:17:48.437 }, 00:17:48.437 { 00:17:48.437 "subsystem": "accel", 00:17:48.437 "config": [ 00:17:48.437 { 00:17:48.437 "method": "accel_set_options", 00:17:48.437 "params": { 00:17:48.437 "small_cache_size": 128, 00:17:48.437 "large_cache_size": 16, 00:17:48.437 "task_count": 2048, 00:17:48.437 "sequence_count": 2048, 00:17:48.437 "buf_count": 2048 00:17:48.437 } 00:17:48.437 } 00:17:48.437 ] 00:17:48.437 }, 00:17:48.437 { 00:17:48.438 "subsystem": "bdev", 00:17:48.438 "config": [ 00:17:48.438 { 00:17:48.438 "method": "bdev_set_options", 00:17:48.438 "params": { 00:17:48.438 "bdev_io_pool_size": 65535, 00:17:48.438 "bdev_io_cache_size": 256, 00:17:48.438 "bdev_auto_examine": true, 00:17:48.438 "iobuf_small_cache_size": 128, 00:17:48.438 "iobuf_large_cache_size": 16 00:17:48.438 } 00:17:48.438 }, 00:17:48.438 { 00:17:48.438 "method": "bdev_raid_set_options", 00:17:48.438 "params": { 00:17:48.438 "process_window_size_kb": 1024 00:17:48.438 } 00:17:48.438 }, 00:17:48.438 { 00:17:48.438 "method": "bdev_iscsi_set_options", 00:17:48.438 "params": { 00:17:48.438 "timeout_sec": 30 00:17:48.438 } 00:17:48.438 }, 00:17:48.438 { 00:17:48.438 "method": "bdev_nvme_set_options", 00:17:48.438 "params": { 00:17:48.438 "action_on_timeout": "none", 00:17:48.438 "timeout_us": 0, 00:17:48.438 "timeout_admin_us": 0, 00:17:48.438 "keep_alive_timeout_ms": 10000, 00:17:48.438 "transport_retry_count": 4, 00:17:48.438 "arbitration_burst": 0, 00:17:48.438 "low_priority_weight": 0, 00:17:48.438 "medium_priority_weight": 0, 00:17:48.438 "high_priority_weight": 0, 00:17:48.438 "nvme_adminq_poll_period_us": 10000, 00:17:48.438 "nvme_ioq_poll_period_us": 0, 00:17:48.438 "io_queue_requests": 512, 00:17:48.438 "delay_cmd_submit": true, 00:17:48.438 "bdev_retry_count": 3, 00:17:48.438 "transport_ack_timeout": 0, 00:17:48.438 "ctrlr_loss_timeout_sec": 0, 00:17:48.438 "reconnect_delay_sec": 0, 00:17:48.438 "fast_io_fail_timeout_sec": 0, 00:17:48.438 "generate_uuids": false, 00:17:48.438 "transport_tos": 0, 00:17:48.438 "io_path_stat": false, 00:17:48.438 "allow_accel_sequence": false 00:17:48.438 } 00:17:48.438 }, 00:17:48.438 { 00:17:48.438 "method": "bdev_nvme_attach_controller", 00:17:48.438 "params": { 00:17:48.438 "name": "TLSTEST", 00:17:48.438 "trtype": "TCP", 00:17:48.438 "adrfam": "IPv4", 00:17:48.438 "traddr": "10.0.0.2", 00:17:48.438 "trsvcid": "4420", 00:17:48.438 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:48.438 "prchk_reftag": false, 00:17:48.438 "prchk_guard": false, 00:17:48.438 "ctrlr_loss_timeout_sec": 0, 00:17:48.438 "reconnect_delay_sec": 0, 00:17:48.438 "fast_io_fail_timeout_sec": 0, 00:17:48.438 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:17:48.438 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:48.438 "hdgst": false, 00:17:48.438 "ddgst": false 00:17:48.438 } 00:17:48.438 }, 00:17:48.438 { 00:17:48.438 "method": "bdev_nvme_set_hotplug", 00:17:48.438 "params": { 00:17:48.438 "period_us": 100000, 00:17:48.438 "enable": false 00:17:48.438 } 00:17:48.438 }, 00:17:48.438 { 00:17:48.438 "method": "bdev_wait_for_examine" 00:17:48.438 } 00:17:48.438 ] 00:17:48.438 }, 00:17:48.438 { 00:17:48.438 "subsystem": "nbd", 00:17:48.438 "config": [] 00:17:48.438 } 00:17:48.438 ] 00:17:48.438 }' 00:17:48.438 08:56:36 -- target/tls.sh@208 -- # killprocess 1520939 00:17:48.438 08:56:36 -- common/autotest_common.sh@926 -- # '[' -z 1520939 ']' 00:17:48.438 08:56:36 -- common/autotest_common.sh@930 -- # kill -0 1520939 00:17:48.438 08:56:36 -- common/autotest_common.sh@931 -- # uname 00:17:48.438 08:56:36 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:48.438 08:56:36 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1520939 00:17:48.438 08:56:36 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:17:48.438 08:56:36 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:17:48.438 08:56:36 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1520939' 00:17:48.438 killing process with pid 1520939 00:17:48.438 08:56:36 -- common/autotest_common.sh@945 -- # kill 1520939 00:17:48.438 Received shutdown signal, test time was about 10.000000 seconds 00:17:48.438 00:17:48.438 Latency(us) 00:17:48.438 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:48.438 =================================================================================================================== 00:17:48.438 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:48.438 08:56:36 -- common/autotest_common.sh@950 -- # wait 1520939 00:17:48.727 08:56:37 -- target/tls.sh@209 -- # killprocess 1520632 00:17:48.727 08:56:37 -- common/autotest_common.sh@926 -- # '[' -z 1520632 ']' 00:17:48.727 08:56:37 -- common/autotest_common.sh@930 -- # kill -0 1520632 00:17:48.727 08:56:37 -- common/autotest_common.sh@931 -- # uname 00:17:48.727 08:56:37 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:48.727 08:56:37 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1520632 00:17:48.727 08:56:37 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:17:48.727 08:56:37 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:17:48.727 08:56:37 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1520632' 00:17:48.727 killing process with pid 1520632 00:17:48.727 08:56:37 -- common/autotest_common.sh@945 -- # kill 1520632 00:17:48.727 08:56:37 -- common/autotest_common.sh@950 -- # wait 1520632 00:17:48.987 08:56:37 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:17:48.987 08:56:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:48.987 08:56:37 -- target/tls.sh@212 -- # echo '{ 00:17:48.987 "subsystems": [ 00:17:48.987 { 00:17:48.987 "subsystem": "iobuf", 00:17:48.987 "config": [ 00:17:48.987 { 00:17:48.987 "method": "iobuf_set_options", 00:17:48.987 "params": { 00:17:48.987 "small_pool_count": 8192, 00:17:48.987 "large_pool_count": 1024, 00:17:48.987 "small_bufsize": 8192, 00:17:48.987 "large_bufsize": 135168 00:17:48.987 } 00:17:48.987 } 00:17:48.987 ] 00:17:48.987 }, 00:17:48.987 { 00:17:48.987 "subsystem": "sock", 00:17:48.987 "config": [ 00:17:48.987 { 00:17:48.987 "method": "sock_impl_set_options", 00:17:48.987 "params": { 00:17:48.987 "impl_name": "posix", 00:17:48.987 "recv_buf_size": 2097152, 00:17:48.987 "send_buf_size": 2097152, 00:17:48.987 "enable_recv_pipe": true, 00:17:48.987 "enable_quickack": false, 00:17:48.987 "enable_placement_id": 0, 00:17:48.987 "enable_zerocopy_send_server": true, 00:17:48.987 "enable_zerocopy_send_client": false, 00:17:48.987 "zerocopy_threshold": 0, 00:17:48.987 "tls_version": 0, 00:17:48.987 "enable_ktls": false 00:17:48.987 } 00:17:48.987 }, 00:17:48.987 { 00:17:48.987 "method": "sock_impl_set_options", 00:17:48.987 "params": { 00:17:48.987 "impl_name": "ssl", 00:17:48.987 "recv_buf_size": 4096, 00:17:48.987 "send_buf_size": 4096, 00:17:48.987 "enable_recv_pipe": true, 00:17:48.987 "enable_quickack": false, 00:17:48.987 "enable_placement_id": 0, 00:17:48.987 "enable_zerocopy_send_server": true, 00:17:48.987 "enable_zerocopy_send_client": false, 00:17:48.987 "zerocopy_threshold": 0, 00:17:48.987 "tls_version": 0, 00:17:48.987 "enable_ktls": false 00:17:48.987 } 00:17:48.987 } 00:17:48.987 ] 00:17:48.987 }, 00:17:48.987 { 00:17:48.987 "subsystem": "vmd", 00:17:48.987 "config": [] 00:17:48.987 }, 00:17:48.987 { 00:17:48.987 "subsystem": "accel", 00:17:48.987 "config": [ 00:17:48.987 { 00:17:48.987 "method": "accel_set_options", 00:17:48.987 "params": { 00:17:48.987 "small_cache_size": 128, 00:17:48.987 "large_cache_size": 16, 00:17:48.987 "task_count": 2048, 00:17:48.987 "sequence_count": 2048, 00:17:48.987 "buf_count": 2048 00:17:48.987 } 00:17:48.987 } 00:17:48.987 ] 00:17:48.987 }, 00:17:48.987 { 00:17:48.987 "subsystem": "bdev", 00:17:48.987 "config": [ 00:17:48.987 { 00:17:48.987 "method": "bdev_set_options", 00:17:48.987 "params": { 00:17:48.987 "bdev_io_pool_size": 65535, 00:17:48.987 "bdev_io_cache_size": 256, 00:17:48.987 "bdev_auto_examine": true, 00:17:48.987 "iobuf_small_cache_size": 128, 00:17:48.987 "iobuf_large_cache_size": 16 00:17:48.987 } 00:17:48.987 }, 00:17:48.987 { 00:17:48.987 "method": "bdev_raid_set_options", 00:17:48.987 "params": { 00:17:48.987 "process_window_size_kb": 1024 00:17:48.987 } 00:17:48.987 }, 00:17:48.987 { 00:17:48.987 "method": "bdev_iscsi_set_options", 00:17:48.987 "params": { 00:17:48.987 "timeout_sec": 30 00:17:48.987 } 00:17:48.987 }, 00:17:48.987 { 00:17:48.987 "method": "bdev_nvme_set_options", 00:17:48.987 "params": { 00:17:48.987 "action_on_timeout": "none", 00:17:48.987 "timeout_us": 0, 00:17:48.987 "timeout_admin_us": 0, 00:17:48.987 "keep_alive_timeout_ms": 10000, 00:17:48.987 "transport_retry_count": 4, 00:17:48.987 "arbitration_burst": 0, 00:17:48.987 "low_priority_weight": 0, 00:17:48.987 "medium_priority_weight": 0, 00:17:48.987 "high_priority_weight": 0, 00:17:48.987 "nvme_adminq_poll_period_us": 10000, 00:17:48.987 "nvme_ioq_poll_period_us": 0, 00:17:48.987 "io_queue_requests": 0, 00:17:48.987 "delay_cmd_submit": true, 00:17:48.987 "bdev_retry_count": 3, 00:17:48.987 "transport_ack_timeout": 0, 00:17:48.987 "ctrlr_loss_timeout_sec": 0, 00:17:48.987 "reconnect_delay_sec": 0, 00:17:48.987 "fast_io_fail_timeout_sec": 0, 00:17:48.987 "generate_uuids": false, 00:17:48.987 "transport_tos": 0, 00:17:48.987 "io_path_stat": false, 00:17:48.987 "allow_accel_sequence": false 00:17:48.987 } 00:17:48.987 }, 00:17:48.987 { 00:17:48.987 "method": "bdev_nvme_set_hotplug", 00:17:48.987 "params": { 00:17:48.987 "period_us": 100000, 00:17:48.987 "enable": false 00:17:48.987 } 00:17:48.987 }, 00:17:48.987 { 00:17:48.987 "method": "bdev_malloc_create", 00:17:48.987 "params": { 00:17:48.987 "name": "malloc0", 00:17:48.987 "num_blocks": 8192, 00:17:48.987 "block_size": 4096, 00:17:48.987 "physical_block_size": 4096, 00:17:48.987 "uuid": "e79aacd6-fb78-4616-8fe9-b05c18f11b99", 00:17:48.987 "optimal_io_boundary": 0 00:17:48.987 } 00:17:48.987 }, 00:17:48.987 { 00:17:48.987 "method": "bdev_wait_for_examine" 00:17:48.987 } 00:17:48.987 ] 00:17:48.987 }, 00:17:48.987 { 00:17:48.987 "subsystem": "nbd", 00:17:48.987 "config": [] 00:17:48.987 }, 00:17:48.987 { 00:17:48.987 "subsystem": "scheduler", 00:17:48.987 "config": [ 00:17:48.987 { 00:17:48.987 "method": "framework_set_scheduler", 00:17:48.987 "params": { 00:17:48.987 "name": "static" 00:17:48.987 } 00:17:48.987 } 00:17:48.987 ] 00:17:48.987 }, 00:17:48.987 { 00:17:48.987 "subsystem": "nvmf", 00:17:48.987 "config": [ 00:17:48.987 { 00:17:48.987 "method": "nvmf_set_config", 00:17:48.987 "params": { 00:17:48.987 "discovery_filter": "match_any", 00:17:48.987 "admin_cmd_passthru": { 00:17:48.987 "identify_ctrlr": false 00:17:48.987 } 00:17:48.987 } 00:17:48.987 }, 00:17:48.987 { 00:17:48.987 "method": "nvmf_set_max_subsystems", 00:17:48.987 "params": { 00:17:48.987 "max_subsystems": 1024 00:17:48.987 } 00:17:48.987 }, 00:17:48.987 { 00:17:48.987 "method": "nvmf_set_crdt", 00:17:48.987 "params": { 00:17:48.987 "crdt1": 0, 00:17:48.987 "crdt2": 0, 00:17:48.987 "crdt3": 0 00:17:48.987 } 00:17:48.987 }, 00:17:48.987 { 00:17:48.987 "method": "nvmf_create_transport", 00:17:48.987 "params": { 00:17:48.987 "trtype": "TCP", 00:17:48.987 "max_queue_depth": 128, 00:17:48.987 "max_io_qpairs_per_ctrlr": 127, 00:17:48.987 "in_capsule_data_size": 4096, 00:17:48.987 "max_io_size": 131072, 00:17:48.987 "io_unit_size": 131072, 00:17:48.987 "max_aq_depth": 128, 00:17:48.987 "num_shared_buffers": 511, 00:17:48.987 "buf_cache_size": 4294967295, 00:17:48.987 "dif_insert_or_strip": false, 00:17:48.987 "zcopy": false, 00:17:48.987 "c2h_success": false, 00:17:48.987 "sock_priority": 0, 00:17:48.987 "abort_timeout_sec": 1 00:17:48.987 } 00:17:48.987 }, 00:17:48.987 { 00:17:48.987 "method": "nvmf_create_subsystem", 00:17:48.987 "params": { 00:17:48.987 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:48.987 "allow_any_host": false, 00:17:48.987 "serial_number": "SPDK00000000000001", 00:17:48.987 "model_number": "SPDK bdev Controller", 00:17:48.987 "max_namespaces": 10, 00:17:48.987 "min_cntlid": 1, 00:17:48.987 "max_cntlid": 65519, 00:17:48.987 "ana_reporting": false 00:17:48.987 } 00:17:48.987 }, 00:17:48.988 { 00:17:48.988 "method": "nvmf_subsystem_add_host", 00:17:48.988 "params": { 00:17:48.988 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:48.988 "host": "nqn.2016-06.io.spdk:host1", 00:17:48.988 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:17:48.988 } 00:17:48.988 }, 00:17:48.988 { 00:17:48.988 "method": "nvmf_subsystem_add_ns", 00:17:48.988 "params": { 00:17:48.988 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:48.988 "namespace": { 00:17:48.988 "nsid": 1, 00:17:48.988 "bdev_name": "malloc0", 00:17:48.988 "nguid": "E79AACD6FB7846168FE9B05C18F11B99", 00:17:48.988 "uuid": "e79aacd6-fb78-4616-8fe9-b05c18f11b99" 00:17:48.988 } 00:17:48.988 } 00:17:48.988 }, 00:17:48.988 { 00:17:48.988 "method": "nvmf_subsystem_add_listener", 00:17:48.988 "params": { 00:17:48.988 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:48.988 "listen_address": { 00:17:48.988 "trtype": "TCP", 00:17:48.988 "adrfam": "IPv4", 00:17:48.988 "traddr": "10.0.0.2", 00:17:48.988 "trsvcid": "4420" 00:17:48.988 }, 00:17:48.988 "secure_channel": true 00:17:48.988 } 00:17:48.988 } 00:17:48.988 ] 00:17:48.988 } 00:17:48.988 ] 00:17:48.988 }' 00:17:48.988 08:56:37 -- common/autotest_common.sh@712 -- # xtrace_disable 00:17:48.988 08:56:37 -- common/autotest_common.sh@10 -- # set +x 00:17:48.988 08:56:37 -- nvmf/common.sh@469 -- # nvmfpid=1521231 00:17:48.988 08:56:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:17:48.988 08:56:37 -- nvmf/common.sh@470 -- # waitforlisten 1521231 00:17:48.988 08:56:37 -- common/autotest_common.sh@819 -- # '[' -z 1521231 ']' 00:17:48.988 08:56:37 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:48.988 08:56:37 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:48.988 08:56:37 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:48.988 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:48.988 08:56:37 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:48.988 08:56:37 -- common/autotest_common.sh@10 -- # set +x 00:17:48.988 [2024-07-15 08:56:37.487835] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:17:48.988 [2024-07-15 08:56:37.487946] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:48.988 EAL: No free 2048 kB hugepages reported on node 1 00:17:49.247 [2024-07-15 08:56:37.554648] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:49.247 [2024-07-15 08:56:37.662386] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:49.247 [2024-07-15 08:56:37.662531] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:49.247 [2024-07-15 08:56:37.662548] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:49.247 [2024-07-15 08:56:37.662560] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:49.247 [2024-07-15 08:56:37.662587] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:49.506 [2024-07-15 08:56:37.891111] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:49.506 [2024-07-15 08:56:37.923166] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:49.506 [2024-07-15 08:56:37.923401] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:50.074 08:56:38 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:50.074 08:56:38 -- common/autotest_common.sh@852 -- # return 0 00:17:50.074 08:56:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:50.074 08:56:38 -- common/autotest_common.sh@718 -- # xtrace_disable 00:17:50.074 08:56:38 -- common/autotest_common.sh@10 -- # set +x 00:17:50.074 08:56:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:50.074 08:56:38 -- target/tls.sh@216 -- # bdevperf_pid=1521386 00:17:50.074 08:56:38 -- target/tls.sh@217 -- # waitforlisten 1521386 /var/tmp/bdevperf.sock 00:17:50.074 08:56:38 -- common/autotest_common.sh@819 -- # '[' -z 1521386 ']' 00:17:50.074 08:56:38 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:50.074 08:56:38 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:17:50.074 08:56:38 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:50.074 08:56:38 -- target/tls.sh@213 -- # echo '{ 00:17:50.074 "subsystems": [ 00:17:50.074 { 00:17:50.074 "subsystem": "iobuf", 00:17:50.074 "config": [ 00:17:50.074 { 00:17:50.074 "method": "iobuf_set_options", 00:17:50.074 "params": { 00:17:50.074 "small_pool_count": 8192, 00:17:50.074 "large_pool_count": 1024, 00:17:50.074 "small_bufsize": 8192, 00:17:50.074 "large_bufsize": 135168 00:17:50.074 } 00:17:50.074 } 00:17:50.074 ] 00:17:50.074 }, 00:17:50.074 { 00:17:50.074 "subsystem": "sock", 00:17:50.074 "config": [ 00:17:50.074 { 00:17:50.074 "method": "sock_impl_set_options", 00:17:50.074 "params": { 00:17:50.074 "impl_name": "posix", 00:17:50.074 "recv_buf_size": 2097152, 00:17:50.074 "send_buf_size": 2097152, 00:17:50.074 "enable_recv_pipe": true, 00:17:50.074 "enable_quickack": false, 00:17:50.074 "enable_placement_id": 0, 00:17:50.074 "enable_zerocopy_send_server": true, 00:17:50.074 "enable_zerocopy_send_client": false, 00:17:50.074 "zerocopy_threshold": 0, 00:17:50.074 "tls_version": 0, 00:17:50.074 "enable_ktls": false 00:17:50.074 } 00:17:50.074 }, 00:17:50.074 { 00:17:50.074 "method": "sock_impl_set_options", 00:17:50.074 "params": { 00:17:50.074 "impl_name": "ssl", 00:17:50.074 "recv_buf_size": 4096, 00:17:50.074 "send_buf_size": 4096, 00:17:50.074 "enable_recv_pipe": true, 00:17:50.074 "enable_quickack": false, 00:17:50.074 "enable_placement_id": 0, 00:17:50.074 "enable_zerocopy_send_server": true, 00:17:50.074 "enable_zerocopy_send_client": false, 00:17:50.074 "zerocopy_threshold": 0, 00:17:50.074 "tls_version": 0, 00:17:50.074 "enable_ktls": false 00:17:50.074 } 00:17:50.074 } 00:17:50.074 ] 00:17:50.074 }, 00:17:50.074 { 00:17:50.074 "subsystem": "vmd", 00:17:50.074 "config": [] 00:17:50.074 }, 00:17:50.074 { 00:17:50.074 "subsystem": "accel", 00:17:50.074 "config": [ 00:17:50.074 { 00:17:50.074 "method": "accel_set_options", 00:17:50.074 "params": { 00:17:50.074 "small_cache_size": 128, 00:17:50.074 "large_cache_size": 16, 00:17:50.074 "task_count": 2048, 00:17:50.074 "sequence_count": 2048, 00:17:50.074 "buf_count": 2048 00:17:50.074 } 00:17:50.074 } 00:17:50.074 ] 00:17:50.074 }, 00:17:50.074 { 00:17:50.074 "subsystem": "bdev", 00:17:50.074 "config": [ 00:17:50.074 { 00:17:50.074 "method": "bdev_set_options", 00:17:50.074 "params": { 00:17:50.074 "bdev_io_pool_size": 65535, 00:17:50.074 "bdev_io_cache_size": 256, 00:17:50.074 "bdev_auto_examine": true, 00:17:50.074 "iobuf_small_cache_size": 128, 00:17:50.074 "iobuf_large_cache_size": 16 00:17:50.074 } 00:17:50.074 }, 00:17:50.074 { 00:17:50.074 "method": "bdev_raid_set_options", 00:17:50.074 "params": { 00:17:50.074 "process_window_size_kb": 1024 00:17:50.074 } 00:17:50.074 }, 00:17:50.075 { 00:17:50.075 "method": "bdev_iscsi_set_options", 00:17:50.075 "params": { 00:17:50.075 "timeout_sec": 30 00:17:50.075 } 00:17:50.075 }, 00:17:50.075 { 00:17:50.075 "method": "bdev_nvme_set_options", 00:17:50.075 "params": { 00:17:50.075 "action_on_timeout": "none", 00:17:50.075 "timeout_us": 0, 00:17:50.075 "timeout_admin_us": 0, 00:17:50.075 "keep_alive_timeout_ms": 10000, 00:17:50.075 "transport_retry_count": 4, 00:17:50.075 "arbitration_burst": 0, 00:17:50.075 "low_priority_weight": 0, 00:17:50.075 "medium_priority_weight": 0, 00:17:50.075 "high_priority_weight": 0, 00:17:50.075 "nvme_adminq_poll_period_us": 10000, 00:17:50.075 "nvme_ioq_poll_period_us": 0, 00:17:50.075 "io_queue_requests": 512, 00:17:50.075 "delay_cmd_submit": true, 00:17:50.075 "bdev_retry_count": 3, 00:17:50.075 "transport_ack_timeout": 0, 00:17:50.075 "ctrlr_loss_timeout_sec": 0, 00:17:50.075 "reconnect_delay_sec": 0, 00:17:50.075 "fast_io_fail_timeout_sec": 0, 00:17:50.075 "generate_uuids": false, 00:17:50.075 "transport_tos": 0, 00:17:50.075 "io_path_stat": false, 00:17:50.075 "allow_accel_sequence": false 00:17:50.075 } 00:17:50.075 }, 00:17:50.075 { 00:17:50.075 "method": "bdev_nvme_attach_controller", 00:17:50.075 "params": { 00:17:50.075 "name": "TLSTEST", 00:17:50.075 "trtype": "TCP", 00:17:50.075 "adrfam": "IPv4", 00:17:50.075 "traddr": "10.0.0.2", 00:17:50.075 "trsvcid": "4420", 00:17:50.075 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:50.075 "prchk_reftag": false, 00:17:50.075 "prchk_guard": false, 00:17:50.075 "ctrlr_loss_timeout_sec": 0, 00:17:50.075 "reconnect_delay_sec": 0, 00:17:50.075 "fast_io_fail_timeout_sec": 0, 00:17:50.075 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:17:50.075 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:50.075 "hdgst": false, 00:17:50.075 "ddgst": false 00:17:50.075 } 00:17:50.075 }, 00:17:50.075 { 00:17:50.075 "method": "bdev_nvme_set_hotplug", 00:17:50.075 "params": { 00:17:50.075 "period_us": 100000, 00:17:50.075 "enable": false 00:17:50.075 } 00:17:50.075 }, 00:17:50.075 { 00:17:50.075 "method": "bdev_wait_for_examine" 00:17:50.075 } 00:17:50.075 ] 00:17:50.075 }, 00:17:50.075 { 00:17:50.075 "subsystem": "nbd", 00:17:50.075 "config": [] 00:17:50.075 } 00:17:50.075 ] 00:17:50.075 }' 00:17:50.075 08:56:38 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:50.075 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:50.075 08:56:38 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:50.075 08:56:38 -- common/autotest_common.sh@10 -- # set +x 00:17:50.075 [2024-07-15 08:56:38.542215] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:17:50.075 [2024-07-15 08:56:38.542289] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1521386 ] 00:17:50.075 EAL: No free 2048 kB hugepages reported on node 1 00:17:50.075 [2024-07-15 08:56:38.599303] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:50.333 [2024-07-15 08:56:38.709373] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:50.333 [2024-07-15 08:56:38.870322] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:51.267 08:56:39 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:51.267 08:56:39 -- common/autotest_common.sh@852 -- # return 0 00:17:51.267 08:56:39 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:51.267 Running I/O for 10 seconds... 00:18:01.226 00:18:01.226 Latency(us) 00:18:01.226 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:01.226 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:01.226 Verification LBA range: start 0x0 length 0x2000 00:18:01.226 TLSTESTn1 : 10.02 3064.73 11.97 0.00 0.00 41710.52 7524.50 48156.82 00:18:01.226 =================================================================================================================== 00:18:01.226 Total : 3064.73 11.97 0.00 0.00 41710.52 7524.50 48156.82 00:18:01.226 0 00:18:01.226 08:56:49 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:01.226 08:56:49 -- target/tls.sh@223 -- # killprocess 1521386 00:18:01.226 08:56:49 -- common/autotest_common.sh@926 -- # '[' -z 1521386 ']' 00:18:01.226 08:56:49 -- common/autotest_common.sh@930 -- # kill -0 1521386 00:18:01.226 08:56:49 -- common/autotest_common.sh@931 -- # uname 00:18:01.226 08:56:49 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:01.226 08:56:49 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1521386 00:18:01.226 08:56:49 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:18:01.226 08:56:49 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:18:01.226 08:56:49 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1521386' 00:18:01.226 killing process with pid 1521386 00:18:01.226 08:56:49 -- common/autotest_common.sh@945 -- # kill 1521386 00:18:01.226 Received shutdown signal, test time was about 10.000000 seconds 00:18:01.226 00:18:01.226 Latency(us) 00:18:01.226 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:01.226 =================================================================================================================== 00:18:01.226 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:01.226 08:56:49 -- common/autotest_common.sh@950 -- # wait 1521386 00:18:01.483 08:56:49 -- target/tls.sh@224 -- # killprocess 1521231 00:18:01.483 08:56:49 -- common/autotest_common.sh@926 -- # '[' -z 1521231 ']' 00:18:01.483 08:56:49 -- common/autotest_common.sh@930 -- # kill -0 1521231 00:18:01.483 08:56:49 -- common/autotest_common.sh@931 -- # uname 00:18:01.483 08:56:49 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:01.483 08:56:49 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1521231 00:18:01.483 08:56:49 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:18:01.483 08:56:49 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:18:01.483 08:56:49 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1521231' 00:18:01.483 killing process with pid 1521231 00:18:01.483 08:56:49 -- common/autotest_common.sh@945 -- # kill 1521231 00:18:01.483 08:56:49 -- common/autotest_common.sh@950 -- # wait 1521231 00:18:01.741 08:56:50 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:18:01.741 08:56:50 -- target/tls.sh@227 -- # cleanup 00:18:01.741 08:56:50 -- target/tls.sh@15 -- # process_shm --id 0 00:18:01.741 08:56:50 -- common/autotest_common.sh@796 -- # type=--id 00:18:01.741 08:56:50 -- common/autotest_common.sh@797 -- # id=0 00:18:01.741 08:56:50 -- common/autotest_common.sh@798 -- # '[' --id = --pid ']' 00:18:01.741 08:56:50 -- common/autotest_common.sh@802 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:01.741 08:56:50 -- common/autotest_common.sh@802 -- # shm_files=nvmf_trace.0 00:18:01.741 08:56:50 -- common/autotest_common.sh@804 -- # [[ -z nvmf_trace.0 ]] 00:18:01.741 08:56:50 -- common/autotest_common.sh@808 -- # for n in $shm_files 00:18:01.741 08:56:50 -- common/autotest_common.sh@809 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:01.741 nvmf_trace.0 00:18:01.999 08:56:50 -- common/autotest_common.sh@811 -- # return 0 00:18:01.999 08:56:50 -- target/tls.sh@16 -- # killprocess 1521386 00:18:01.999 08:56:50 -- common/autotest_common.sh@926 -- # '[' -z 1521386 ']' 00:18:01.999 08:56:50 -- common/autotest_common.sh@930 -- # kill -0 1521386 00:18:01.999 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (1521386) - No such process 00:18:01.999 08:56:50 -- common/autotest_common.sh@953 -- # echo 'Process with pid 1521386 is not found' 00:18:01.999 Process with pid 1521386 is not found 00:18:01.999 08:56:50 -- target/tls.sh@17 -- # nvmftestfini 00:18:01.999 08:56:50 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:01.999 08:56:50 -- nvmf/common.sh@116 -- # sync 00:18:01.999 08:56:50 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:01.999 08:56:50 -- nvmf/common.sh@119 -- # set +e 00:18:01.999 08:56:50 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:01.999 08:56:50 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:01.999 rmmod nvme_tcp 00:18:01.999 rmmod nvme_fabrics 00:18:01.999 rmmod nvme_keyring 00:18:01.999 08:56:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:01.999 08:56:50 -- nvmf/common.sh@123 -- # set -e 00:18:01.999 08:56:50 -- nvmf/common.sh@124 -- # return 0 00:18:01.999 08:56:50 -- nvmf/common.sh@477 -- # '[' -n 1521231 ']' 00:18:01.999 08:56:50 -- nvmf/common.sh@478 -- # killprocess 1521231 00:18:01.999 08:56:50 -- common/autotest_common.sh@926 -- # '[' -z 1521231 ']' 00:18:01.999 08:56:50 -- common/autotest_common.sh@930 -- # kill -0 1521231 00:18:01.999 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (1521231) - No such process 00:18:01.999 08:56:50 -- common/autotest_common.sh@953 -- # echo 'Process with pid 1521231 is not found' 00:18:01.999 Process with pid 1521231 is not found 00:18:01.999 08:56:50 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:01.999 08:56:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:01.999 08:56:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:01.999 08:56:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:01.999 08:56:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:01.999 08:56:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:01.999 08:56:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:01.999 08:56:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:03.897 08:56:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:03.897 08:56:52 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:03.897 00:18:03.897 real 1m15.586s 00:18:03.897 user 1m53.746s 00:18:03.897 sys 0m25.793s 00:18:03.897 08:56:52 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:18:03.897 08:56:52 -- common/autotest_common.sh@10 -- # set +x 00:18:03.897 ************************************ 00:18:03.897 END TEST nvmf_tls 00:18:03.897 ************************************ 00:18:03.897 08:56:52 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:18:03.897 08:56:52 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:18:03.897 08:56:52 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:18:03.897 08:56:52 -- common/autotest_common.sh@10 -- # set +x 00:18:03.897 ************************************ 00:18:03.897 START TEST nvmf_fips 00:18:03.897 ************************************ 00:18:03.897 08:56:52 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:18:04.156 * Looking for test storage... 00:18:04.156 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:18:04.156 08:56:52 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:04.156 08:56:52 -- nvmf/common.sh@7 -- # uname -s 00:18:04.156 08:56:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:04.156 08:56:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:04.156 08:56:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:04.156 08:56:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:04.156 08:56:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:04.156 08:56:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:04.156 08:56:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:04.156 08:56:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:04.156 08:56:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:04.156 08:56:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:04.156 08:56:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:04.156 08:56:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:04.156 08:56:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:04.156 08:56:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:04.156 08:56:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:04.156 08:56:52 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:04.156 08:56:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:04.156 08:56:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:04.156 08:56:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:04.156 08:56:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:04.157 08:56:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:04.157 08:56:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:04.157 08:56:52 -- paths/export.sh@5 -- # export PATH 00:18:04.157 08:56:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:04.157 08:56:52 -- nvmf/common.sh@46 -- # : 0 00:18:04.157 08:56:52 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:04.157 08:56:52 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:04.157 08:56:52 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:04.157 08:56:52 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:04.157 08:56:52 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:04.157 08:56:52 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:04.157 08:56:52 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:04.157 08:56:52 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:04.157 08:56:52 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:04.157 08:56:52 -- fips/fips.sh@89 -- # check_openssl_version 00:18:04.157 08:56:52 -- fips/fips.sh@83 -- # local target=3.0.0 00:18:04.157 08:56:52 -- fips/fips.sh@85 -- # openssl version 00:18:04.157 08:56:52 -- fips/fips.sh@85 -- # awk '{print $2}' 00:18:04.157 08:56:52 -- fips/fips.sh@85 -- # ge 3.0.9 3.0.0 00:18:04.157 08:56:52 -- scripts/common.sh@375 -- # cmp_versions 3.0.9 '>=' 3.0.0 00:18:04.157 08:56:52 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:04.157 08:56:52 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:04.157 08:56:52 -- scripts/common.sh@335 -- # IFS=.-: 00:18:04.157 08:56:52 -- scripts/common.sh@335 -- # read -ra ver1 00:18:04.157 08:56:52 -- scripts/common.sh@336 -- # IFS=.-: 00:18:04.157 08:56:52 -- scripts/common.sh@336 -- # read -ra ver2 00:18:04.157 08:56:52 -- scripts/common.sh@337 -- # local 'op=>=' 00:18:04.157 08:56:52 -- scripts/common.sh@339 -- # ver1_l=3 00:18:04.157 08:56:52 -- scripts/common.sh@340 -- # ver2_l=3 00:18:04.157 08:56:52 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:04.157 08:56:52 -- scripts/common.sh@343 -- # case "$op" in 00:18:04.157 08:56:52 -- scripts/common.sh@347 -- # : 1 00:18:04.157 08:56:52 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:04.157 08:56:52 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:04.157 08:56:52 -- scripts/common.sh@364 -- # decimal 3 00:18:04.157 08:56:52 -- scripts/common.sh@352 -- # local d=3 00:18:04.157 08:56:52 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:18:04.157 08:56:52 -- scripts/common.sh@354 -- # echo 3 00:18:04.157 08:56:52 -- scripts/common.sh@364 -- # ver1[v]=3 00:18:04.157 08:56:52 -- scripts/common.sh@365 -- # decimal 3 00:18:04.157 08:56:52 -- scripts/common.sh@352 -- # local d=3 00:18:04.157 08:56:52 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:18:04.157 08:56:52 -- scripts/common.sh@354 -- # echo 3 00:18:04.157 08:56:52 -- scripts/common.sh@365 -- # ver2[v]=3 00:18:04.157 08:56:52 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:04.157 08:56:52 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:04.157 08:56:52 -- scripts/common.sh@363 -- # (( v++ )) 00:18:04.157 08:56:52 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:04.157 08:56:52 -- scripts/common.sh@364 -- # decimal 0 00:18:04.157 08:56:52 -- scripts/common.sh@352 -- # local d=0 00:18:04.157 08:56:52 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:18:04.157 08:56:52 -- scripts/common.sh@354 -- # echo 0 00:18:04.157 08:56:52 -- scripts/common.sh@364 -- # ver1[v]=0 00:18:04.157 08:56:52 -- scripts/common.sh@365 -- # decimal 0 00:18:04.157 08:56:52 -- scripts/common.sh@352 -- # local d=0 00:18:04.157 08:56:52 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:18:04.157 08:56:52 -- scripts/common.sh@354 -- # echo 0 00:18:04.157 08:56:52 -- scripts/common.sh@365 -- # ver2[v]=0 00:18:04.157 08:56:52 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:04.157 08:56:52 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:04.157 08:56:52 -- scripts/common.sh@363 -- # (( v++ )) 00:18:04.157 08:56:52 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:04.157 08:56:52 -- scripts/common.sh@364 -- # decimal 9 00:18:04.157 08:56:52 -- scripts/common.sh@352 -- # local d=9 00:18:04.157 08:56:52 -- scripts/common.sh@353 -- # [[ 9 =~ ^[0-9]+$ ]] 00:18:04.157 08:56:52 -- scripts/common.sh@354 -- # echo 9 00:18:04.157 08:56:52 -- scripts/common.sh@364 -- # ver1[v]=9 00:18:04.157 08:56:52 -- scripts/common.sh@365 -- # decimal 0 00:18:04.157 08:56:52 -- scripts/common.sh@352 -- # local d=0 00:18:04.157 08:56:52 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:18:04.157 08:56:52 -- scripts/common.sh@354 -- # echo 0 00:18:04.157 08:56:52 -- scripts/common.sh@365 -- # ver2[v]=0 00:18:04.157 08:56:52 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:04.157 08:56:52 -- scripts/common.sh@366 -- # return 0 00:18:04.157 08:56:52 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:18:04.157 08:56:52 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:18:04.157 08:56:52 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:18:04.157 08:56:52 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:18:04.157 08:56:52 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:18:04.157 08:56:52 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:18:04.157 08:56:52 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:18:04.157 08:56:52 -- fips/fips.sh@105 -- # export OPENSSL_FORCE_FIPS_MODE=build_openssl_config 00:18:04.157 08:56:52 -- fips/fips.sh@105 -- # OPENSSL_FORCE_FIPS_MODE=build_openssl_config 00:18:04.157 08:56:52 -- fips/fips.sh@114 -- # build_openssl_config 00:18:04.157 08:56:52 -- fips/fips.sh@37 -- # cat 00:18:04.157 08:56:52 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:18:04.157 08:56:52 -- fips/fips.sh@58 -- # cat - 00:18:04.157 08:56:52 -- fips/fips.sh@115 -- # export OPENSSL_CONF=spdk_fips.conf 00:18:04.157 08:56:52 -- fips/fips.sh@115 -- # OPENSSL_CONF=spdk_fips.conf 00:18:04.157 08:56:52 -- fips/fips.sh@117 -- # mapfile -t providers 00:18:04.157 08:56:52 -- fips/fips.sh@117 -- # OPENSSL_CONF=spdk_fips.conf 00:18:04.157 08:56:52 -- fips/fips.sh@117 -- # openssl list -providers 00:18:04.157 08:56:52 -- fips/fips.sh@117 -- # grep name 00:18:04.157 08:56:52 -- fips/fips.sh@121 -- # (( 2 != 2 )) 00:18:04.157 08:56:52 -- fips/fips.sh@121 -- # [[ name: openssl base provider != *base* ]] 00:18:04.157 08:56:52 -- fips/fips.sh@121 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:18:04.157 08:56:52 -- fips/fips.sh@128 -- # NOT openssl md5 /dev/fd/62 00:18:04.157 08:56:52 -- fips/fips.sh@128 -- # : 00:18:04.157 08:56:52 -- common/autotest_common.sh@640 -- # local es=0 00:18:04.157 08:56:52 -- common/autotest_common.sh@642 -- # valid_exec_arg openssl md5 /dev/fd/62 00:18:04.157 08:56:52 -- common/autotest_common.sh@628 -- # local arg=openssl 00:18:04.157 08:56:52 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:18:04.157 08:56:52 -- common/autotest_common.sh@632 -- # type -t openssl 00:18:04.157 08:56:52 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:18:04.157 08:56:52 -- common/autotest_common.sh@634 -- # type -P openssl 00:18:04.157 08:56:52 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:18:04.157 08:56:52 -- common/autotest_common.sh@634 -- # arg=/usr/bin/openssl 00:18:04.157 08:56:52 -- common/autotest_common.sh@634 -- # [[ -x /usr/bin/openssl ]] 00:18:04.157 08:56:52 -- common/autotest_common.sh@643 -- # openssl md5 /dev/fd/62 00:18:04.157 Error setting digest 00:18:04.157 00B240893A7F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:373:Global default library context, Algorithm (MD5 : 97), Properties () 00:18:04.157 00B240893A7F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:254: 00:18:04.157 08:56:52 -- common/autotest_common.sh@643 -- # es=1 00:18:04.157 08:56:52 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:18:04.157 08:56:52 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:18:04.157 08:56:52 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:18:04.157 08:56:52 -- fips/fips.sh@131 -- # nvmftestinit 00:18:04.157 08:56:52 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:04.157 08:56:52 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:04.157 08:56:52 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:04.157 08:56:52 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:04.157 08:56:52 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:04.157 08:56:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:04.157 08:56:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:04.157 08:56:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:04.157 08:56:52 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:04.157 08:56:52 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:04.157 08:56:52 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:04.157 08:56:52 -- common/autotest_common.sh@10 -- # set +x 00:18:06.060 08:56:54 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:06.060 08:56:54 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:06.061 08:56:54 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:06.061 08:56:54 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:06.061 08:56:54 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:06.061 08:56:54 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:06.061 08:56:54 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:06.061 08:56:54 -- nvmf/common.sh@294 -- # net_devs=() 00:18:06.061 08:56:54 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:06.061 08:56:54 -- nvmf/common.sh@295 -- # e810=() 00:18:06.061 08:56:54 -- nvmf/common.sh@295 -- # local -ga e810 00:18:06.061 08:56:54 -- nvmf/common.sh@296 -- # x722=() 00:18:06.061 08:56:54 -- nvmf/common.sh@296 -- # local -ga x722 00:18:06.061 08:56:54 -- nvmf/common.sh@297 -- # mlx=() 00:18:06.061 08:56:54 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:06.061 08:56:54 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:06.061 08:56:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:06.061 08:56:54 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:06.061 08:56:54 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:06.061 08:56:54 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:06.061 08:56:54 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:06.061 08:56:54 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:06.061 08:56:54 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:06.061 08:56:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:06.061 08:56:54 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:06.061 08:56:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:06.061 08:56:54 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:06.061 08:56:54 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:06.061 08:56:54 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:06.061 08:56:54 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:06.061 08:56:54 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:06.061 08:56:54 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:06.061 08:56:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:06.061 08:56:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:06.061 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:06.061 08:56:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:06.061 08:56:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:06.061 08:56:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:06.061 08:56:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:06.061 08:56:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:06.061 08:56:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:06.061 08:56:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:06.061 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:06.061 08:56:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:06.061 08:56:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:06.061 08:56:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:06.061 08:56:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:06.061 08:56:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:06.061 08:56:54 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:06.061 08:56:54 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:06.061 08:56:54 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:06.061 08:56:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:06.061 08:56:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:06.061 08:56:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:06.061 08:56:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:06.061 08:56:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:06.061 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:06.061 08:56:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:06.061 08:56:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:06.061 08:56:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:06.061 08:56:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:06.061 08:56:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:06.061 08:56:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:06.061 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:06.061 08:56:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:06.061 08:56:54 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:06.061 08:56:54 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:06.061 08:56:54 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:06.061 08:56:54 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:06.061 08:56:54 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:06.061 08:56:54 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:06.061 08:56:54 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:06.061 08:56:54 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:06.061 08:56:54 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:06.061 08:56:54 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:06.061 08:56:54 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:06.061 08:56:54 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:06.061 08:56:54 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:06.061 08:56:54 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:06.061 08:56:54 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:06.061 08:56:54 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:06.061 08:56:54 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:06.061 08:56:54 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:06.061 08:56:54 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:06.061 08:56:54 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:06.061 08:56:54 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:06.320 08:56:54 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:06.320 08:56:54 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:06.320 08:56:54 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:06.320 08:56:54 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:06.320 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:06.320 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.254 ms 00:18:06.320 00:18:06.320 --- 10.0.0.2 ping statistics --- 00:18:06.320 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:06.320 rtt min/avg/max/mdev = 0.254/0.254/0.254/0.000 ms 00:18:06.320 08:56:54 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:06.320 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:06.320 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.138 ms 00:18:06.320 00:18:06.320 --- 10.0.0.1 ping statistics --- 00:18:06.320 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:06.320 rtt min/avg/max/mdev = 0.138/0.138/0.138/0.000 ms 00:18:06.320 08:56:54 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:06.320 08:56:54 -- nvmf/common.sh@410 -- # return 0 00:18:06.320 08:56:54 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:06.320 08:56:54 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:06.320 08:56:54 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:06.320 08:56:54 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:06.320 08:56:54 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:06.320 08:56:54 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:06.320 08:56:54 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:06.320 08:56:54 -- fips/fips.sh@132 -- # nvmfappstart -m 0x2 00:18:06.320 08:56:54 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:06.320 08:56:54 -- common/autotest_common.sh@712 -- # xtrace_disable 00:18:06.320 08:56:54 -- common/autotest_common.sh@10 -- # set +x 00:18:06.320 08:56:54 -- nvmf/common.sh@469 -- # nvmfpid=1524841 00:18:06.320 08:56:54 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:06.320 08:56:54 -- nvmf/common.sh@470 -- # waitforlisten 1524841 00:18:06.320 08:56:54 -- common/autotest_common.sh@819 -- # '[' -z 1524841 ']' 00:18:06.320 08:56:54 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:06.320 08:56:54 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:06.320 08:56:54 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:06.320 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:06.320 08:56:54 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:06.320 08:56:54 -- common/autotest_common.sh@10 -- # set +x 00:18:06.320 [2024-07-15 08:56:54.769646] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:18:06.320 [2024-07-15 08:56:54.769743] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:06.320 EAL: No free 2048 kB hugepages reported on node 1 00:18:06.320 [2024-07-15 08:56:54.835752] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:06.580 [2024-07-15 08:56:54.945453] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:06.580 [2024-07-15 08:56:54.945601] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:06.580 [2024-07-15 08:56:54.945620] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:06.580 [2024-07-15 08:56:54.945633] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:06.580 [2024-07-15 08:56:54.945667] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:07.146 08:56:55 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:07.146 08:56:55 -- common/autotest_common.sh@852 -- # return 0 00:18:07.146 08:56:55 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:07.146 08:56:55 -- common/autotest_common.sh@718 -- # xtrace_disable 00:18:07.146 08:56:55 -- common/autotest_common.sh@10 -- # set +x 00:18:07.405 08:56:55 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:07.405 08:56:55 -- fips/fips.sh@134 -- # trap cleanup EXIT 00:18:07.405 08:56:55 -- fips/fips.sh@137 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:18:07.405 08:56:55 -- fips/fips.sh@138 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:07.405 08:56:55 -- fips/fips.sh@139 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:18:07.405 08:56:55 -- fips/fips.sh@140 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:07.405 08:56:55 -- fips/fips.sh@142 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:07.405 08:56:55 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:07.405 08:56:55 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:07.405 [2024-07-15 08:56:55.926595] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:07.405 [2024-07-15 08:56:55.942571] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:07.405 [2024-07-15 08:56:55.942815] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:07.663 malloc0 00:18:07.663 08:56:55 -- fips/fips.sh@145 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:07.663 08:56:55 -- fips/fips.sh@148 -- # bdevperf_pid=1525008 00:18:07.663 08:56:55 -- fips/fips.sh@146 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:07.663 08:56:55 -- fips/fips.sh@149 -- # waitforlisten 1525008 /var/tmp/bdevperf.sock 00:18:07.663 08:56:55 -- common/autotest_common.sh@819 -- # '[' -z 1525008 ']' 00:18:07.663 08:56:55 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:07.663 08:56:55 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:07.663 08:56:55 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:07.663 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:07.663 08:56:55 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:07.663 08:56:55 -- common/autotest_common.sh@10 -- # set +x 00:18:07.663 [2024-07-15 08:56:56.057235] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:18:07.664 [2024-07-15 08:56:56.057319] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1525008 ] 00:18:07.664 EAL: No free 2048 kB hugepages reported on node 1 00:18:07.664 [2024-07-15 08:56:56.114688] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:07.922 [2024-07-15 08:56:56.218762] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:08.488 08:56:57 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:08.488 08:56:57 -- common/autotest_common.sh@852 -- # return 0 00:18:08.488 08:56:57 -- fips/fips.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:08.747 [2024-07-15 08:56:57.222449] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:09.004 TLSTESTn1 00:18:09.004 08:56:57 -- fips/fips.sh@155 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:09.004 Running I/O for 10 seconds... 00:18:18.998 00:18:18.998 Latency(us) 00:18:18.998 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:18.998 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:18.998 Verification LBA range: start 0x0 length 0x2000 00:18:18.998 TLSTESTn1 : 10.02 3263.90 12.75 0.00 0.00 39167.70 5097.24 46797.56 00:18:18.998 =================================================================================================================== 00:18:18.998 Total : 3263.90 12.75 0.00 0.00 39167.70 5097.24 46797.56 00:18:18.998 0 00:18:18.999 08:57:07 -- fips/fips.sh@1 -- # cleanup 00:18:18.999 08:57:07 -- fips/fips.sh@15 -- # process_shm --id 0 00:18:18.999 08:57:07 -- common/autotest_common.sh@796 -- # type=--id 00:18:18.999 08:57:07 -- common/autotest_common.sh@797 -- # id=0 00:18:18.999 08:57:07 -- common/autotest_common.sh@798 -- # '[' --id = --pid ']' 00:18:18.999 08:57:07 -- common/autotest_common.sh@802 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:18.999 08:57:07 -- common/autotest_common.sh@802 -- # shm_files=nvmf_trace.0 00:18:18.999 08:57:07 -- common/autotest_common.sh@804 -- # [[ -z nvmf_trace.0 ]] 00:18:18.999 08:57:07 -- common/autotest_common.sh@808 -- # for n in $shm_files 00:18:18.999 08:57:07 -- common/autotest_common.sh@809 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:18.999 nvmf_trace.0 00:18:18.999 08:57:07 -- common/autotest_common.sh@811 -- # return 0 00:18:18.999 08:57:07 -- fips/fips.sh@16 -- # killprocess 1525008 00:18:18.999 08:57:07 -- common/autotest_common.sh@926 -- # '[' -z 1525008 ']' 00:18:18.999 08:57:07 -- common/autotest_common.sh@930 -- # kill -0 1525008 00:18:18.999 08:57:07 -- common/autotest_common.sh@931 -- # uname 00:18:18.999 08:57:07 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:18.999 08:57:07 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1525008 00:18:19.257 08:57:07 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:18:19.257 08:57:07 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:18:19.257 08:57:07 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1525008' 00:18:19.257 killing process with pid 1525008 00:18:19.257 08:57:07 -- common/autotest_common.sh@945 -- # kill 1525008 00:18:19.257 Received shutdown signal, test time was about 10.000000 seconds 00:18:19.257 00:18:19.257 Latency(us) 00:18:19.257 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:19.257 =================================================================================================================== 00:18:19.257 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:19.257 08:57:07 -- common/autotest_common.sh@950 -- # wait 1525008 00:18:19.515 08:57:07 -- fips/fips.sh@17 -- # nvmftestfini 00:18:19.515 08:57:07 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:19.515 08:57:07 -- nvmf/common.sh@116 -- # sync 00:18:19.515 08:57:07 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:19.515 08:57:07 -- nvmf/common.sh@119 -- # set +e 00:18:19.515 08:57:07 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:19.515 08:57:07 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:19.515 rmmod nvme_tcp 00:18:19.515 rmmod nvme_fabrics 00:18:19.515 rmmod nvme_keyring 00:18:19.515 08:57:07 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:19.515 08:57:07 -- nvmf/common.sh@123 -- # set -e 00:18:19.515 08:57:07 -- nvmf/common.sh@124 -- # return 0 00:18:19.515 08:57:07 -- nvmf/common.sh@477 -- # '[' -n 1524841 ']' 00:18:19.515 08:57:07 -- nvmf/common.sh@478 -- # killprocess 1524841 00:18:19.515 08:57:07 -- common/autotest_common.sh@926 -- # '[' -z 1524841 ']' 00:18:19.515 08:57:07 -- common/autotest_common.sh@930 -- # kill -0 1524841 00:18:19.515 08:57:07 -- common/autotest_common.sh@931 -- # uname 00:18:19.515 08:57:07 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:19.515 08:57:07 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1524841 00:18:19.515 08:57:07 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:18:19.515 08:57:07 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:18:19.515 08:57:07 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1524841' 00:18:19.515 killing process with pid 1524841 00:18:19.515 08:57:07 -- common/autotest_common.sh@945 -- # kill 1524841 00:18:19.515 08:57:07 -- common/autotest_common.sh@950 -- # wait 1524841 00:18:19.775 08:57:08 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:19.775 08:57:08 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:19.775 08:57:08 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:19.775 08:57:08 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:19.775 08:57:08 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:19.775 08:57:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:19.775 08:57:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:19.775 08:57:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:21.678 08:57:10 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:21.678 08:57:10 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:21.678 00:18:21.678 real 0m17.778s 00:18:21.678 user 0m22.445s 00:18:21.678 sys 0m6.675s 00:18:21.678 08:57:10 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:18:21.678 08:57:10 -- common/autotest_common.sh@10 -- # set +x 00:18:21.678 ************************************ 00:18:21.678 END TEST nvmf_fips 00:18:21.678 ************************************ 00:18:21.936 08:57:10 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:18:21.936 08:57:10 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:18:21.937 08:57:10 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:18:21.937 08:57:10 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:18:21.937 08:57:10 -- common/autotest_common.sh@10 -- # set +x 00:18:21.937 ************************************ 00:18:21.937 START TEST nvmf_fuzz 00:18:21.937 ************************************ 00:18:21.937 08:57:10 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:18:21.937 * Looking for test storage... 00:18:21.937 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:21.937 08:57:10 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:21.937 08:57:10 -- nvmf/common.sh@7 -- # uname -s 00:18:21.937 08:57:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:21.937 08:57:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:21.937 08:57:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:21.937 08:57:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:21.937 08:57:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:21.937 08:57:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:21.937 08:57:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:21.937 08:57:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:21.937 08:57:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:21.937 08:57:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:21.937 08:57:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:21.937 08:57:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:21.937 08:57:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:21.937 08:57:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:21.937 08:57:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:21.937 08:57:10 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:21.937 08:57:10 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:21.937 08:57:10 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:21.937 08:57:10 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:21.937 08:57:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:21.937 08:57:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:21.937 08:57:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:21.937 08:57:10 -- paths/export.sh@5 -- # export PATH 00:18:21.937 08:57:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:21.937 08:57:10 -- nvmf/common.sh@46 -- # : 0 00:18:21.937 08:57:10 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:21.937 08:57:10 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:21.937 08:57:10 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:21.937 08:57:10 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:21.937 08:57:10 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:21.937 08:57:10 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:21.937 08:57:10 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:21.937 08:57:10 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:21.937 08:57:10 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:18:21.937 08:57:10 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:21.937 08:57:10 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:21.937 08:57:10 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:21.937 08:57:10 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:21.937 08:57:10 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:21.937 08:57:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:21.937 08:57:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:21.937 08:57:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:21.937 08:57:10 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:21.937 08:57:10 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:21.937 08:57:10 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:21.937 08:57:10 -- common/autotest_common.sh@10 -- # set +x 00:18:23.839 08:57:12 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:23.839 08:57:12 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:23.839 08:57:12 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:23.839 08:57:12 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:23.839 08:57:12 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:23.839 08:57:12 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:23.839 08:57:12 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:23.839 08:57:12 -- nvmf/common.sh@294 -- # net_devs=() 00:18:23.839 08:57:12 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:23.839 08:57:12 -- nvmf/common.sh@295 -- # e810=() 00:18:23.839 08:57:12 -- nvmf/common.sh@295 -- # local -ga e810 00:18:23.839 08:57:12 -- nvmf/common.sh@296 -- # x722=() 00:18:23.839 08:57:12 -- nvmf/common.sh@296 -- # local -ga x722 00:18:23.839 08:57:12 -- nvmf/common.sh@297 -- # mlx=() 00:18:23.839 08:57:12 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:23.839 08:57:12 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:23.839 08:57:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:23.839 08:57:12 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:23.839 08:57:12 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:23.839 08:57:12 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:23.839 08:57:12 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:23.839 08:57:12 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:23.839 08:57:12 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:23.839 08:57:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:23.839 08:57:12 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:23.839 08:57:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:23.839 08:57:12 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:23.839 08:57:12 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:23.839 08:57:12 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:23.840 08:57:12 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:23.840 08:57:12 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:23.840 08:57:12 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:23.840 08:57:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:23.840 08:57:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:23.840 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:23.840 08:57:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:23.840 08:57:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:23.840 08:57:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:23.840 08:57:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:23.840 08:57:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:23.840 08:57:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:23.840 08:57:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:23.840 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:23.840 08:57:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:23.840 08:57:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:23.840 08:57:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:23.840 08:57:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:23.840 08:57:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:23.840 08:57:12 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:23.840 08:57:12 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:23.840 08:57:12 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:23.840 08:57:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:23.840 08:57:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:23.840 08:57:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:23.840 08:57:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:23.840 08:57:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:23.840 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:23.840 08:57:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:23.840 08:57:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:23.840 08:57:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:23.840 08:57:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:23.840 08:57:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:23.840 08:57:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:23.840 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:23.840 08:57:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:23.840 08:57:12 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:23.840 08:57:12 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:23.840 08:57:12 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:23.840 08:57:12 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:23.840 08:57:12 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:23.840 08:57:12 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:23.840 08:57:12 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:23.840 08:57:12 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:23.840 08:57:12 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:23.840 08:57:12 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:23.840 08:57:12 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:23.840 08:57:12 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:23.840 08:57:12 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:23.840 08:57:12 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:23.840 08:57:12 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:23.840 08:57:12 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:23.840 08:57:12 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:23.840 08:57:12 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:23.840 08:57:12 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:23.840 08:57:12 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:23.840 08:57:12 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:23.840 08:57:12 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:23.840 08:57:12 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:23.840 08:57:12 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:23.840 08:57:12 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:23.840 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:23.840 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.145 ms 00:18:23.840 00:18:23.840 --- 10.0.0.2 ping statistics --- 00:18:23.840 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:23.840 rtt min/avg/max/mdev = 0.145/0.145/0.145/0.000 ms 00:18:23.840 08:57:12 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:23.840 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:23.840 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.094 ms 00:18:23.840 00:18:23.840 --- 10.0.0.1 ping statistics --- 00:18:23.840 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:23.840 rtt min/avg/max/mdev = 0.094/0.094/0.094/0.000 ms 00:18:23.840 08:57:12 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:23.840 08:57:12 -- nvmf/common.sh@410 -- # return 0 00:18:23.840 08:57:12 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:23.840 08:57:12 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:23.840 08:57:12 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:23.840 08:57:12 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:23.840 08:57:12 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:23.840 08:57:12 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:23.840 08:57:12 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:23.840 08:57:12 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=1528936 00:18:23.840 08:57:12 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:18:23.840 08:57:12 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 1528936 00:18:23.840 08:57:12 -- common/autotest_common.sh@819 -- # '[' -z 1528936 ']' 00:18:23.840 08:57:12 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:18:23.840 08:57:12 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:23.840 08:57:12 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:23.840 08:57:12 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:23.840 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:23.840 08:57:12 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:23.840 08:57:12 -- common/autotest_common.sh@10 -- # set +x 00:18:24.775 08:57:13 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:24.775 08:57:13 -- common/autotest_common.sh@852 -- # return 0 00:18:24.775 08:57:13 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:24.775 08:57:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:24.775 08:57:13 -- common/autotest_common.sh@10 -- # set +x 00:18:24.775 08:57:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:24.775 08:57:13 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:18:24.775 08:57:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:24.775 08:57:13 -- common/autotest_common.sh@10 -- # set +x 00:18:24.775 Malloc0 00:18:24.775 08:57:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:24.775 08:57:13 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:24.775 08:57:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:24.775 08:57:13 -- common/autotest_common.sh@10 -- # set +x 00:18:24.775 08:57:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:24.775 08:57:13 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:24.775 08:57:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:24.775 08:57:13 -- common/autotest_common.sh@10 -- # set +x 00:18:24.775 08:57:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:24.775 08:57:13 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:24.775 08:57:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:24.775 08:57:13 -- common/autotest_common.sh@10 -- # set +x 00:18:24.775 08:57:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:24.775 08:57:13 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:18:24.775 08:57:13 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:18:56.853 Fuzzing completed. Shutting down the fuzz application 00:18:56.853 00:18:56.853 Dumping successful admin opcodes: 00:18:56.853 8, 9, 10, 24, 00:18:56.853 Dumping successful io opcodes: 00:18:56.853 0, 9, 00:18:56.853 NS: 0x200003aeff00 I/O qp, Total commands completed: 457558, total successful commands: 2656, random_seed: 3341679552 00:18:56.853 NS: 0x200003aeff00 admin qp, Total commands completed: 56976, total successful commands: 453, random_seed: 3190460864 00:18:56.853 08:57:44 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:18:57.112 Fuzzing completed. Shutting down the fuzz application 00:18:57.112 00:18:57.112 Dumping successful admin opcodes: 00:18:57.112 24, 00:18:57.112 Dumping successful io opcodes: 00:18:57.112 00:18:57.112 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 1219600464 00:18:57.112 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 1219729647 00:18:57.112 08:57:45 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:57.112 08:57:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:57.112 08:57:45 -- common/autotest_common.sh@10 -- # set +x 00:18:57.112 08:57:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:57.112 08:57:45 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:18:57.112 08:57:45 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:18:57.112 08:57:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:57.112 08:57:45 -- nvmf/common.sh@116 -- # sync 00:18:57.112 08:57:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:57.112 08:57:45 -- nvmf/common.sh@119 -- # set +e 00:18:57.112 08:57:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:57.112 08:57:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:57.112 rmmod nvme_tcp 00:18:57.112 rmmod nvme_fabrics 00:18:57.112 rmmod nvme_keyring 00:18:57.372 08:57:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:57.372 08:57:45 -- nvmf/common.sh@123 -- # set -e 00:18:57.372 08:57:45 -- nvmf/common.sh@124 -- # return 0 00:18:57.372 08:57:45 -- nvmf/common.sh@477 -- # '[' -n 1528936 ']' 00:18:57.372 08:57:45 -- nvmf/common.sh@478 -- # killprocess 1528936 00:18:57.372 08:57:45 -- common/autotest_common.sh@926 -- # '[' -z 1528936 ']' 00:18:57.372 08:57:45 -- common/autotest_common.sh@930 -- # kill -0 1528936 00:18:57.372 08:57:45 -- common/autotest_common.sh@931 -- # uname 00:18:57.372 08:57:45 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:57.372 08:57:45 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1528936 00:18:57.372 08:57:45 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:18:57.372 08:57:45 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:18:57.372 08:57:45 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1528936' 00:18:57.372 killing process with pid 1528936 00:18:57.372 08:57:45 -- common/autotest_common.sh@945 -- # kill 1528936 00:18:57.372 08:57:45 -- common/autotest_common.sh@950 -- # wait 1528936 00:18:57.632 08:57:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:57.632 08:57:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:57.632 08:57:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:57.632 08:57:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:57.632 08:57:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:57.632 08:57:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:57.632 08:57:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:57.632 08:57:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:59.536 08:57:48 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:59.536 08:57:48 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:18:59.536 00:18:59.537 real 0m37.840s 00:18:59.537 user 0m52.257s 00:18:59.537 sys 0m15.223s 00:18:59.537 08:57:48 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:18:59.537 08:57:48 -- common/autotest_common.sh@10 -- # set +x 00:18:59.537 ************************************ 00:18:59.537 END TEST nvmf_fuzz 00:18:59.537 ************************************ 00:18:59.795 08:57:48 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:18:59.795 08:57:48 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:18:59.795 08:57:48 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:18:59.795 08:57:48 -- common/autotest_common.sh@10 -- # set +x 00:18:59.795 ************************************ 00:18:59.795 START TEST nvmf_multiconnection 00:18:59.795 ************************************ 00:18:59.795 08:57:48 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:18:59.795 * Looking for test storage... 00:18:59.795 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:59.795 08:57:48 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:59.795 08:57:48 -- nvmf/common.sh@7 -- # uname -s 00:18:59.795 08:57:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:59.795 08:57:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:59.795 08:57:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:59.795 08:57:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:59.795 08:57:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:59.795 08:57:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:59.795 08:57:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:59.795 08:57:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:59.795 08:57:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:59.795 08:57:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:59.795 08:57:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:59.795 08:57:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:59.795 08:57:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:59.795 08:57:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:59.795 08:57:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:59.795 08:57:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:59.795 08:57:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:59.795 08:57:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:59.795 08:57:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:59.795 08:57:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:59.795 08:57:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:59.795 08:57:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:59.795 08:57:48 -- paths/export.sh@5 -- # export PATH 00:18:59.795 08:57:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:59.795 08:57:48 -- nvmf/common.sh@46 -- # : 0 00:18:59.795 08:57:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:59.795 08:57:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:59.795 08:57:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:59.795 08:57:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:59.795 08:57:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:59.795 08:57:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:59.795 08:57:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:59.795 08:57:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:59.795 08:57:48 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:59.795 08:57:48 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:59.795 08:57:48 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:18:59.795 08:57:48 -- target/multiconnection.sh@16 -- # nvmftestinit 00:18:59.795 08:57:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:59.795 08:57:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:59.795 08:57:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:59.795 08:57:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:59.795 08:57:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:59.795 08:57:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:59.795 08:57:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:59.795 08:57:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:59.795 08:57:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:59.795 08:57:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:59.795 08:57:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:59.795 08:57:48 -- common/autotest_common.sh@10 -- # set +x 00:19:01.729 08:57:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:01.729 08:57:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:01.729 08:57:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:01.729 08:57:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:01.729 08:57:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:01.729 08:57:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:01.729 08:57:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:01.729 08:57:50 -- nvmf/common.sh@294 -- # net_devs=() 00:19:01.729 08:57:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:01.729 08:57:50 -- nvmf/common.sh@295 -- # e810=() 00:19:01.729 08:57:50 -- nvmf/common.sh@295 -- # local -ga e810 00:19:01.729 08:57:50 -- nvmf/common.sh@296 -- # x722=() 00:19:01.729 08:57:50 -- nvmf/common.sh@296 -- # local -ga x722 00:19:01.729 08:57:50 -- nvmf/common.sh@297 -- # mlx=() 00:19:01.729 08:57:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:01.729 08:57:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:01.729 08:57:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:01.729 08:57:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:01.729 08:57:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:01.729 08:57:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:01.729 08:57:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:01.729 08:57:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:01.729 08:57:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:01.729 08:57:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:01.729 08:57:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:01.729 08:57:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:01.729 08:57:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:01.729 08:57:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:01.729 08:57:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:01.729 08:57:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:01.729 08:57:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:01.729 08:57:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:01.729 08:57:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:01.729 08:57:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:01.729 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:01.729 08:57:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:01.729 08:57:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:01.729 08:57:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:01.729 08:57:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:01.729 08:57:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:01.729 08:57:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:01.729 08:57:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:01.729 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:01.729 08:57:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:01.729 08:57:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:01.729 08:57:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:01.729 08:57:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:01.729 08:57:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:01.729 08:57:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:01.729 08:57:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:01.729 08:57:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:01.729 08:57:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:01.729 08:57:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:01.729 08:57:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:01.729 08:57:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:01.729 08:57:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:01.729 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:01.729 08:57:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:01.729 08:57:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:01.729 08:57:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:01.729 08:57:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:01.729 08:57:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:01.729 08:57:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:01.729 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:01.729 08:57:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:01.729 08:57:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:01.729 08:57:50 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:01.729 08:57:50 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:01.729 08:57:50 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:01.729 08:57:50 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:01.729 08:57:50 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:01.729 08:57:50 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:01.729 08:57:50 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:01.729 08:57:50 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:01.729 08:57:50 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:01.729 08:57:50 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:01.729 08:57:50 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:01.729 08:57:50 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:01.729 08:57:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:01.729 08:57:50 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:01.729 08:57:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:01.729 08:57:50 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:01.729 08:57:50 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:01.729 08:57:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:01.729 08:57:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:01.729 08:57:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:01.729 08:57:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:01.729 08:57:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:01.729 08:57:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:01.729 08:57:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:01.729 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:01.729 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.127 ms 00:19:01.729 00:19:01.729 --- 10.0.0.2 ping statistics --- 00:19:01.729 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:01.729 rtt min/avg/max/mdev = 0.127/0.127/0.127/0.000 ms 00:19:01.729 08:57:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:01.729 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:01.729 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.129 ms 00:19:01.729 00:19:01.729 --- 10.0.0.1 ping statistics --- 00:19:01.729 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:01.729 rtt min/avg/max/mdev = 0.129/0.129/0.129/0.000 ms 00:19:01.729 08:57:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:01.729 08:57:50 -- nvmf/common.sh@410 -- # return 0 00:19:01.729 08:57:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:01.729 08:57:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:01.729 08:57:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:01.729 08:57:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:01.729 08:57:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:01.729 08:57:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:01.729 08:57:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:01.729 08:57:50 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:19:01.729 08:57:50 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:01.729 08:57:50 -- common/autotest_common.sh@712 -- # xtrace_disable 00:19:01.729 08:57:50 -- common/autotest_common.sh@10 -- # set +x 00:19:01.729 08:57:50 -- nvmf/common.sh@469 -- # nvmfpid=1534818 00:19:01.729 08:57:50 -- nvmf/common.sh@470 -- # waitforlisten 1534818 00:19:01.729 08:57:50 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:01.729 08:57:50 -- common/autotest_common.sh@819 -- # '[' -z 1534818 ']' 00:19:01.729 08:57:50 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:01.729 08:57:50 -- common/autotest_common.sh@824 -- # local max_retries=100 00:19:01.729 08:57:50 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:01.729 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:01.729 08:57:50 -- common/autotest_common.sh@828 -- # xtrace_disable 00:19:01.729 08:57:50 -- common/autotest_common.sh@10 -- # set +x 00:19:01.729 [2024-07-15 08:57:50.206476] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:19:01.729 [2024-07-15 08:57:50.206560] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:01.729 EAL: No free 2048 kB hugepages reported on node 1 00:19:01.989 [2024-07-15 08:57:50.276903] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:01.989 [2024-07-15 08:57:50.387171] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:01.989 [2024-07-15 08:57:50.387324] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:01.989 [2024-07-15 08:57:50.387342] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:01.989 [2024-07-15 08:57:50.387353] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:01.989 [2024-07-15 08:57:50.387408] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:01.989 [2024-07-15 08:57:50.387470] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:01.989 [2024-07-15 08:57:50.387533] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:01.989 [2024-07-15 08:57:50.387535] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:02.927 08:57:51 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:19:02.927 08:57:51 -- common/autotest_common.sh@852 -- # return 0 00:19:02.927 08:57:51 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:02.927 08:57:51 -- common/autotest_common.sh@718 -- # xtrace_disable 00:19:02.927 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:02.927 08:57:51 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:02.927 08:57:51 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:02.927 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:02.927 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:02.927 [2024-07-15 08:57:51.209500] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:02.927 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:02.927 08:57:51 -- target/multiconnection.sh@21 -- # seq 1 11 00:19:02.927 08:57:51 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:02.927 08:57:51 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:19:02.927 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:02.927 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:02.927 Malloc1 00:19:02.927 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:02.927 08:57:51 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:19:02.927 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:02.927 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:02.927 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:02.927 08:57:51 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:19:02.927 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:02.927 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:02.927 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:02.927 08:57:51 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:02.927 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:02.927 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:02.927 [2024-07-15 08:57:51.264633] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:02.927 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:02.927 08:57:51 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:02.927 08:57:51 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:19:02.927 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:02.928 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:02.928 Malloc2 00:19:02.928 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:02.928 08:57:51 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:19:02.928 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:02.928 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:02.928 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:02.928 08:57:51 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:19:02.928 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:02.928 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:02.928 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:02.928 08:57:51 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:19:02.928 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:02.928 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:02.928 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:02.928 08:57:51 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:02.928 08:57:51 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:19:02.928 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:02.928 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:02.928 Malloc3 00:19:02.928 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:02.928 08:57:51 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:19:02.928 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:02.928 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:02.928 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:02.928 08:57:51 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:19:02.928 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:02.928 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:02.928 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:02.928 08:57:51 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:19:02.928 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:02.928 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:02.928 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:02.928 08:57:51 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:02.928 08:57:51 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:19:02.928 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:02.928 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:02.928 Malloc4 00:19:02.928 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:02.928 08:57:51 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:19:02.928 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:02.928 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:02.928 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:02.928 08:57:51 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:19:02.928 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:02.928 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:02.928 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:02.928 08:57:51 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:19:02.928 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:02.928 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:02.928 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:02.928 08:57:51 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:02.928 08:57:51 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:19:02.928 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:02.928 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:02.928 Malloc5 00:19:02.928 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:02.928 08:57:51 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:19:02.928 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:02.928 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:02.928 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:02.928 08:57:51 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:19:02.928 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:02.928 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:02.928 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:02.928 08:57:51 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:19:02.928 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:02.928 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:02.928 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:02.928 08:57:51 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:02.928 08:57:51 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:19:02.928 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:02.928 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:03.188 Malloc6 00:19:03.188 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:03.188 08:57:51 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:19:03.188 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:03.188 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:03.188 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:03.188 08:57:51 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:19:03.188 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:03.188 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:03.188 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:03.188 08:57:51 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:19:03.188 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:03.188 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:03.188 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:03.188 08:57:51 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:03.188 08:57:51 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:19:03.188 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:03.188 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:03.188 Malloc7 00:19:03.188 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:03.188 08:57:51 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:19:03.188 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:03.188 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:03.188 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:03.188 08:57:51 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:19:03.188 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:03.188 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:03.188 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:03.188 08:57:51 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:19:03.188 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:03.188 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:03.188 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:03.188 08:57:51 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:03.188 08:57:51 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:19:03.188 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:03.188 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:03.188 Malloc8 00:19:03.188 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:03.188 08:57:51 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:19:03.188 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:03.188 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:03.188 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:03.188 08:57:51 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:19:03.188 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:03.188 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:03.188 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:03.188 08:57:51 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:19:03.188 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:03.188 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:03.188 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:03.188 08:57:51 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:03.188 08:57:51 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:19:03.188 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:03.188 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:03.188 Malloc9 00:19:03.188 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:03.188 08:57:51 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:19:03.188 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:03.188 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:03.188 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:03.188 08:57:51 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:19:03.188 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:03.188 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:03.188 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:03.188 08:57:51 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:19:03.188 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:03.188 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:03.188 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:03.188 08:57:51 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:03.188 08:57:51 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:19:03.188 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:03.188 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:03.188 Malloc10 00:19:03.188 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:03.188 08:57:51 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:19:03.188 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:03.188 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:03.188 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:03.188 08:57:51 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:19:03.188 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:03.188 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:03.188 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:03.188 08:57:51 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:19:03.188 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:03.188 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:03.188 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:03.188 08:57:51 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:03.188 08:57:51 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:19:03.188 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:03.188 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:03.188 Malloc11 00:19:03.188 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:03.188 08:57:51 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:19:03.188 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:03.188 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:03.449 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:03.449 08:57:51 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:19:03.449 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:03.449 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:03.449 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:03.449 08:57:51 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:19:03.449 08:57:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:03.449 08:57:51 -- common/autotest_common.sh@10 -- # set +x 00:19:03.449 08:57:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:03.449 08:57:51 -- target/multiconnection.sh@28 -- # seq 1 11 00:19:03.449 08:57:51 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:03.449 08:57:51 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:04.019 08:57:52 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:19:04.019 08:57:52 -- common/autotest_common.sh@1177 -- # local i=0 00:19:04.019 08:57:52 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:19:04.019 08:57:52 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:19:04.019 08:57:52 -- common/autotest_common.sh@1184 -- # sleep 2 00:19:05.923 08:57:54 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:19:05.923 08:57:54 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:19:05.923 08:57:54 -- common/autotest_common.sh@1186 -- # grep -c SPDK1 00:19:05.923 08:57:54 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:19:05.923 08:57:54 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:19:05.923 08:57:54 -- common/autotest_common.sh@1187 -- # return 0 00:19:05.923 08:57:54 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:05.923 08:57:54 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:19:06.860 08:57:55 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:19:06.860 08:57:55 -- common/autotest_common.sh@1177 -- # local i=0 00:19:06.860 08:57:55 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:19:06.860 08:57:55 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:19:06.860 08:57:55 -- common/autotest_common.sh@1184 -- # sleep 2 00:19:08.766 08:57:57 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:19:08.766 08:57:57 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:19:08.766 08:57:57 -- common/autotest_common.sh@1186 -- # grep -c SPDK2 00:19:08.766 08:57:57 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:19:08.766 08:57:57 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:19:08.766 08:57:57 -- common/autotest_common.sh@1187 -- # return 0 00:19:08.766 08:57:57 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:08.766 08:57:57 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:19:09.333 08:57:57 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:19:09.333 08:57:57 -- common/autotest_common.sh@1177 -- # local i=0 00:19:09.333 08:57:57 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:19:09.333 08:57:57 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:19:09.333 08:57:57 -- common/autotest_common.sh@1184 -- # sleep 2 00:19:11.290 08:57:59 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:19:11.290 08:57:59 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:19:11.290 08:57:59 -- common/autotest_common.sh@1186 -- # grep -c SPDK3 00:19:11.290 08:57:59 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:19:11.290 08:57:59 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:19:11.290 08:57:59 -- common/autotest_common.sh@1187 -- # return 0 00:19:11.290 08:57:59 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:11.290 08:57:59 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:19:11.855 08:58:00 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:19:11.855 08:58:00 -- common/autotest_common.sh@1177 -- # local i=0 00:19:11.855 08:58:00 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:19:11.855 08:58:00 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:19:11.855 08:58:00 -- common/autotest_common.sh@1184 -- # sleep 2 00:19:14.375 08:58:02 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:19:14.375 08:58:02 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:19:14.375 08:58:02 -- common/autotest_common.sh@1186 -- # grep -c SPDK4 00:19:14.375 08:58:02 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:19:14.375 08:58:02 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:19:14.375 08:58:02 -- common/autotest_common.sh@1187 -- # return 0 00:19:14.375 08:58:02 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:14.375 08:58:02 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:19:14.939 08:58:03 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:19:14.939 08:58:03 -- common/autotest_common.sh@1177 -- # local i=0 00:19:14.939 08:58:03 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:19:14.939 08:58:03 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:19:14.939 08:58:03 -- common/autotest_common.sh@1184 -- # sleep 2 00:19:16.831 08:58:05 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:19:16.831 08:58:05 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:19:16.831 08:58:05 -- common/autotest_common.sh@1186 -- # grep -c SPDK5 00:19:16.831 08:58:05 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:19:16.831 08:58:05 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:19:16.831 08:58:05 -- common/autotest_common.sh@1187 -- # return 0 00:19:16.831 08:58:05 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:16.831 08:58:05 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:19:17.763 08:58:05 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:19:17.763 08:58:05 -- common/autotest_common.sh@1177 -- # local i=0 00:19:17.763 08:58:05 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:19:17.763 08:58:05 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:19:17.763 08:58:05 -- common/autotest_common.sh@1184 -- # sleep 2 00:19:19.659 08:58:07 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:19:19.659 08:58:07 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:19:19.659 08:58:07 -- common/autotest_common.sh@1186 -- # grep -c SPDK6 00:19:19.659 08:58:07 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:19:19.659 08:58:07 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:19:19.659 08:58:07 -- common/autotest_common.sh@1187 -- # return 0 00:19:19.659 08:58:07 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:19.659 08:58:07 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:19:20.632 08:58:08 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:19:20.632 08:58:08 -- common/autotest_common.sh@1177 -- # local i=0 00:19:20.632 08:58:08 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:19:20.632 08:58:08 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:19:20.632 08:58:08 -- common/autotest_common.sh@1184 -- # sleep 2 00:19:22.531 08:58:10 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:19:22.531 08:58:10 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:19:22.531 08:58:10 -- common/autotest_common.sh@1186 -- # grep -c SPDK7 00:19:22.531 08:58:10 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:19:22.531 08:58:10 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:19:22.531 08:58:10 -- common/autotest_common.sh@1187 -- # return 0 00:19:22.531 08:58:10 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:22.531 08:58:10 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:19:23.464 08:58:11 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:19:23.464 08:58:11 -- common/autotest_common.sh@1177 -- # local i=0 00:19:23.464 08:58:11 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:19:23.464 08:58:11 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:19:23.464 08:58:11 -- common/autotest_common.sh@1184 -- # sleep 2 00:19:25.361 08:58:13 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:19:25.361 08:58:13 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:19:25.361 08:58:13 -- common/autotest_common.sh@1186 -- # grep -c SPDK8 00:19:25.361 08:58:13 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:19:25.361 08:58:13 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:19:25.361 08:58:13 -- common/autotest_common.sh@1187 -- # return 0 00:19:25.361 08:58:13 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:25.361 08:58:13 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:19:26.291 08:58:14 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:19:26.291 08:58:14 -- common/autotest_common.sh@1177 -- # local i=0 00:19:26.291 08:58:14 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:19:26.291 08:58:14 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:19:26.291 08:58:14 -- common/autotest_common.sh@1184 -- # sleep 2 00:19:28.188 08:58:16 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:19:28.188 08:58:16 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:19:28.188 08:58:16 -- common/autotest_common.sh@1186 -- # grep -c SPDK9 00:19:28.188 08:58:16 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:19:28.188 08:58:16 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:19:28.188 08:58:16 -- common/autotest_common.sh@1187 -- # return 0 00:19:28.188 08:58:16 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:28.188 08:58:16 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:19:29.119 08:58:17 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:19:29.119 08:58:17 -- common/autotest_common.sh@1177 -- # local i=0 00:19:29.119 08:58:17 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:19:29.119 08:58:17 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:19:29.119 08:58:17 -- common/autotest_common.sh@1184 -- # sleep 2 00:19:31.014 08:58:19 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:19:31.014 08:58:19 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:19:31.014 08:58:19 -- common/autotest_common.sh@1186 -- # grep -c SPDK10 00:19:31.272 08:58:19 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:19:31.272 08:58:19 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:19:31.272 08:58:19 -- common/autotest_common.sh@1187 -- # return 0 00:19:31.272 08:58:19 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:31.272 08:58:19 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:19:32.205 08:58:20 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:19:32.205 08:58:20 -- common/autotest_common.sh@1177 -- # local i=0 00:19:32.205 08:58:20 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:19:32.205 08:58:20 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:19:32.205 08:58:20 -- common/autotest_common.sh@1184 -- # sleep 2 00:19:34.103 08:58:22 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:19:34.103 08:58:22 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:19:34.103 08:58:22 -- common/autotest_common.sh@1186 -- # grep -c SPDK11 00:19:34.103 08:58:22 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:19:34.103 08:58:22 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:19:34.103 08:58:22 -- common/autotest_common.sh@1187 -- # return 0 00:19:34.103 08:58:22 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:19:34.103 [global] 00:19:34.103 thread=1 00:19:34.103 invalidate=1 00:19:34.103 rw=read 00:19:34.103 time_based=1 00:19:34.103 runtime=10 00:19:34.103 ioengine=libaio 00:19:34.103 direct=1 00:19:34.103 bs=262144 00:19:34.103 iodepth=64 00:19:34.103 norandommap=1 00:19:34.103 numjobs=1 00:19:34.103 00:19:34.103 [job0] 00:19:34.103 filename=/dev/nvme0n1 00:19:34.103 [job1] 00:19:34.103 filename=/dev/nvme10n1 00:19:34.103 [job2] 00:19:34.103 filename=/dev/nvme1n1 00:19:34.103 [job3] 00:19:34.103 filename=/dev/nvme2n1 00:19:34.103 [job4] 00:19:34.103 filename=/dev/nvme3n1 00:19:34.103 [job5] 00:19:34.103 filename=/dev/nvme4n1 00:19:34.103 [job6] 00:19:34.103 filename=/dev/nvme5n1 00:19:34.103 [job7] 00:19:34.103 filename=/dev/nvme6n1 00:19:34.103 [job8] 00:19:34.103 filename=/dev/nvme7n1 00:19:34.103 [job9] 00:19:34.103 filename=/dev/nvme8n1 00:19:34.103 [job10] 00:19:34.103 filename=/dev/nvme9n1 00:19:34.103 Could not set queue depth (nvme0n1) 00:19:34.103 Could not set queue depth (nvme10n1) 00:19:34.103 Could not set queue depth (nvme1n1) 00:19:34.103 Could not set queue depth (nvme2n1) 00:19:34.103 Could not set queue depth (nvme3n1) 00:19:34.103 Could not set queue depth (nvme4n1) 00:19:34.103 Could not set queue depth (nvme5n1) 00:19:34.103 Could not set queue depth (nvme6n1) 00:19:34.103 Could not set queue depth (nvme7n1) 00:19:34.103 Could not set queue depth (nvme8n1) 00:19:34.103 Could not set queue depth (nvme9n1) 00:19:34.361 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:34.361 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:34.361 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:34.361 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:34.361 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:34.361 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:34.361 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:34.361 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:34.361 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:34.361 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:34.361 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:34.361 fio-3.35 00:19:34.361 Starting 11 threads 00:19:46.587 00:19:46.587 job0: (groupid=0, jobs=1): err= 0: pid=1539343: Mon Jul 15 08:58:33 2024 00:19:46.587 read: IOPS=587, BW=147MiB/s (154MB/s)(1484MiB/10106msec) 00:19:46.587 slat (usec): min=9, max=133151, avg=1449.40, stdev=5439.92 00:19:46.587 clat (usec): min=1676, max=264887, avg=107416.92, stdev=54915.73 00:19:46.587 lat (usec): min=1728, max=277740, avg=108866.33, stdev=55714.20 00:19:46.587 clat percentiles (msec): 00:19:46.587 | 1.00th=[ 4], 5.00th=[ 11], 10.00th=[ 17], 20.00th=[ 46], 00:19:46.587 | 30.00th=[ 92], 40.00th=[ 104], 50.00th=[ 114], 60.00th=[ 130], 00:19:46.587 | 70.00th=[ 142], 80.00th=[ 153], 90.00th=[ 165], 95.00th=[ 180], 00:19:46.587 | 99.00th=[ 236], 99.50th=[ 262], 99.90th=[ 266], 99.95th=[ 266], 00:19:46.587 | 99.99th=[ 266] 00:19:46.587 bw ( KiB/s): min=96063, max=246784, per=9.03%, avg=150339.15, stdev=47708.54, samples=20 00:19:46.587 iops : min= 375, max= 964, avg=587.25, stdev=186.38, samples=20 00:19:46.587 lat (msec) : 2=0.07%, 4=0.99%, 10=3.82%, 20=6.67%, 50=9.08% 00:19:46.587 lat (msec) : 100=16.16%, 250=62.52%, 500=0.69% 00:19:46.587 cpu : usr=0.26%, sys=1.96%, ctx=1258, majf=0, minf=4097 00:19:46.587 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:19:46.587 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:46.587 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:46.587 issued rwts: total=5936,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:46.587 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:46.587 job1: (groupid=0, jobs=1): err= 0: pid=1539367: Mon Jul 15 08:58:33 2024 00:19:46.587 read: IOPS=574, BW=144MiB/s (151MB/s)(1451MiB/10103msec) 00:19:46.587 slat (usec): min=14, max=217362, avg=1602.81, stdev=5815.89 00:19:46.587 clat (msec): min=2, max=366, avg=109.68, stdev=48.09 00:19:46.587 lat (msec): min=2, max=366, avg=111.28, stdev=48.76 00:19:46.587 clat percentiles (msec): 00:19:46.587 | 1.00th=[ 8], 5.00th=[ 32], 10.00th=[ 53], 20.00th=[ 69], 00:19:46.587 | 30.00th=[ 90], 40.00th=[ 102], 50.00th=[ 111], 60.00th=[ 122], 00:19:46.587 | 70.00th=[ 133], 80.00th=[ 146], 90.00th=[ 159], 95.00th=[ 174], 00:19:46.587 | 99.00th=[ 266], 99.50th=[ 342], 99.90th=[ 363], 99.95th=[ 368], 00:19:46.587 | 99.99th=[ 368] 00:19:46.587 bw ( KiB/s): min=47104, max=238080, per=8.82%, avg=146955.35, stdev=49293.46, samples=20 00:19:46.587 iops : min= 184, max= 930, avg=574.00, stdev=192.56, samples=20 00:19:46.587 lat (msec) : 4=0.09%, 10=2.41%, 20=0.95%, 50=5.41%, 100=30.34% 00:19:46.587 lat (msec) : 250=59.29%, 500=1.52% 00:19:46.587 cpu : usr=0.31%, sys=1.94%, ctx=1037, majf=0, minf=4097 00:19:46.587 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:19:46.587 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:46.587 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:46.587 issued rwts: total=5805,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:46.587 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:46.587 job2: (groupid=0, jobs=1): err= 0: pid=1539404: Mon Jul 15 08:58:33 2024 00:19:46.587 read: IOPS=467, BW=117MiB/s (123MB/s)(1182MiB/10110msec) 00:19:46.587 slat (usec): min=14, max=93140, avg=1948.39, stdev=6293.29 00:19:46.587 clat (msec): min=2, max=337, avg=134.74, stdev=41.85 00:19:46.587 lat (msec): min=2, max=337, avg=136.69, stdev=42.48 00:19:46.587 clat percentiles (msec): 00:19:46.587 | 1.00th=[ 20], 5.00th=[ 74], 10.00th=[ 96], 20.00th=[ 108], 00:19:46.587 | 30.00th=[ 115], 40.00th=[ 125], 50.00th=[ 132], 60.00th=[ 140], 00:19:46.587 | 70.00th=[ 150], 80.00th=[ 159], 90.00th=[ 182], 95.00th=[ 218], 00:19:46.587 | 99.00th=[ 264], 99.50th=[ 284], 99.90th=[ 321], 99.95th=[ 334], 00:19:46.587 | 99.99th=[ 338] 00:19:46.587 bw ( KiB/s): min=69632, max=171008, per=7.17%, avg=119435.95, stdev=24701.02, samples=20 00:19:46.587 iops : min= 272, max= 668, avg=466.50, stdev=96.45, samples=20 00:19:46.587 lat (msec) : 4=0.02%, 10=0.27%, 20=0.76%, 50=1.65%, 100=9.96% 00:19:46.587 lat (msec) : 250=86.23%, 500=1.10% 00:19:46.587 cpu : usr=0.36%, sys=1.62%, ctx=966, majf=0, minf=4097 00:19:46.587 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:19:46.587 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:46.587 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:46.587 issued rwts: total=4729,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:46.587 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:46.587 job3: (groupid=0, jobs=1): err= 0: pid=1539427: Mon Jul 15 08:58:33 2024 00:19:46.587 read: IOPS=513, BW=128MiB/s (135MB/s)(1292MiB/10059msec) 00:19:46.587 slat (usec): min=9, max=108971, avg=1803.37, stdev=5774.67 00:19:46.587 clat (msec): min=5, max=302, avg=122.64, stdev=56.74 00:19:46.587 lat (msec): min=5, max=344, avg=124.44, stdev=57.62 00:19:46.587 clat percentiles (msec): 00:19:46.587 | 1.00th=[ 10], 5.00th=[ 31], 10.00th=[ 37], 20.00th=[ 74], 00:19:46.587 | 30.00th=[ 93], 40.00th=[ 114], 50.00th=[ 132], 60.00th=[ 144], 00:19:46.587 | 70.00th=[ 153], 80.00th=[ 163], 90.00th=[ 182], 95.00th=[ 228], 00:19:46.587 | 99.00th=[ 268], 99.50th=[ 279], 99.90th=[ 296], 99.95th=[ 296], 00:19:46.587 | 99.99th=[ 305] 00:19:46.587 bw ( KiB/s): min=67072, max=267776, per=7.85%, avg=130695.35, stdev=55853.31, samples=20 00:19:46.587 iops : min= 262, max= 1046, avg=510.50, stdev=218.15, samples=20 00:19:46.587 lat (msec) : 10=1.01%, 20=1.95%, 50=10.29%, 100=21.28%, 250=62.74% 00:19:46.587 lat (msec) : 500=2.73% 00:19:46.587 cpu : usr=0.40%, sys=1.62%, ctx=1008, majf=0, minf=4097 00:19:46.587 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:19:46.587 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:46.587 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:46.587 issued rwts: total=5169,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:46.587 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:46.587 job4: (groupid=0, jobs=1): err= 0: pid=1539440: Mon Jul 15 08:58:33 2024 00:19:46.587 read: IOPS=576, BW=144MiB/s (151MB/s)(1451MiB/10076msec) 00:19:46.587 slat (usec): min=14, max=114232, avg=1674.36, stdev=4864.43 00:19:46.587 clat (msec): min=5, max=272, avg=109.31, stdev=40.10 00:19:46.587 lat (msec): min=5, max=272, avg=110.99, stdev=40.76 00:19:46.587 clat percentiles (msec): 00:19:46.587 | 1.00th=[ 12], 5.00th=[ 34], 10.00th=[ 51], 20.00th=[ 82], 00:19:46.587 | 30.00th=[ 93], 40.00th=[ 103], 50.00th=[ 112], 60.00th=[ 121], 00:19:46.587 | 70.00th=[ 132], 80.00th=[ 144], 90.00th=[ 157], 95.00th=[ 167], 00:19:46.587 | 99.00th=[ 197], 99.50th=[ 218], 99.90th=[ 257], 99.95th=[ 257], 00:19:46.587 | 99.99th=[ 271] 00:19:46.587 bw ( KiB/s): min=99328, max=231936, per=8.82%, avg=146979.65, stdev=41765.82, samples=20 00:19:46.587 iops : min= 388, max= 906, avg=574.10, stdev=163.14, samples=20 00:19:46.587 lat (msec) : 10=0.88%, 20=1.19%, 50=7.67%, 100=27.39%, 250=62.74% 00:19:46.587 lat (msec) : 500=0.14% 00:19:46.587 cpu : usr=0.37%, sys=1.80%, ctx=1138, majf=0, minf=4097 00:19:46.587 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:19:46.587 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:46.587 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:46.587 issued rwts: total=5805,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:46.587 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:46.587 job5: (groupid=0, jobs=1): err= 0: pid=1539463: Mon Jul 15 08:58:33 2024 00:19:46.587 read: IOPS=532, BW=133MiB/s (140MB/s)(1345MiB/10101msec) 00:19:46.587 slat (usec): min=9, max=157922, avg=1550.35, stdev=5439.81 00:19:46.587 clat (usec): min=1965, max=423688, avg=118517.13, stdev=48219.71 00:19:46.587 lat (usec): min=1980, max=423706, avg=120067.49, stdev=48821.54 00:19:46.587 clat percentiles (msec): 00:19:46.587 | 1.00th=[ 6], 5.00th=[ 27], 10.00th=[ 55], 20.00th=[ 91], 00:19:46.587 | 30.00th=[ 102], 40.00th=[ 111], 50.00th=[ 120], 60.00th=[ 128], 00:19:46.587 | 70.00th=[ 140], 80.00th=[ 153], 90.00th=[ 163], 95.00th=[ 186], 00:19:46.587 | 99.00th=[ 279], 99.50th=[ 284], 99.90th=[ 288], 99.95th=[ 330], 00:19:46.587 | 99.99th=[ 426] 00:19:46.587 bw ( KiB/s): min=79872, max=285184, per=8.17%, avg=136102.80, stdev=46423.33, samples=20 00:19:46.587 iops : min= 312, max= 1114, avg=531.65, stdev=181.34, samples=20 00:19:46.587 lat (msec) : 2=0.02%, 4=0.45%, 10=1.88%, 20=1.84%, 50=4.89% 00:19:46.587 lat (msec) : 100=18.42%, 250=69.87%, 500=2.64% 00:19:46.587 cpu : usr=0.32%, sys=1.82%, ctx=1155, majf=0, minf=4097 00:19:46.587 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:19:46.587 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:46.587 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:46.587 issued rwts: total=5380,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:46.587 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:46.587 job6: (groupid=0, jobs=1): err= 0: pid=1539464: Mon Jul 15 08:58:33 2024 00:19:46.587 read: IOPS=773, BW=193MiB/s (203MB/s)(1939MiB/10020msec) 00:19:46.587 slat (usec): min=10, max=92683, avg=1071.96, stdev=3782.20 00:19:46.587 clat (usec): min=1674, max=239230, avg=81570.50, stdev=53115.93 00:19:46.587 lat (usec): min=1694, max=239254, avg=82642.46, stdev=53827.13 00:19:46.587 clat percentiles (msec): 00:19:46.587 | 1.00th=[ 5], 5.00th=[ 14], 10.00th=[ 21], 20.00th=[ 33], 00:19:46.587 | 30.00th=[ 38], 40.00th=[ 47], 50.00th=[ 71], 60.00th=[ 100], 00:19:46.587 | 70.00th=[ 120], 80.00th=[ 140], 90.00th=[ 155], 95.00th=[ 165], 00:19:46.587 | 99.00th=[ 194], 99.50th=[ 215], 99.90th=[ 218], 99.95th=[ 220], 00:19:46.587 | 99.99th=[ 241] 00:19:46.587 bw ( KiB/s): min=83968, max=440832, per=11.82%, avg=196895.65, stdev=109861.43, samples=20 00:19:46.587 iops : min= 328, max= 1722, avg=769.10, stdev=429.16, samples=20 00:19:46.587 lat (msec) : 2=0.05%, 4=0.77%, 10=2.42%, 20=6.72%, 50=33.16% 00:19:46.587 lat (msec) : 100=17.38%, 250=39.49% 00:19:46.587 cpu : usr=0.36%, sys=2.50%, ctx=1663, majf=0, minf=4097 00:19:46.587 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:19:46.588 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:46.588 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:46.588 issued rwts: total=7754,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:46.588 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:46.588 job7: (groupid=0, jobs=1): err= 0: pid=1539465: Mon Jul 15 08:58:33 2024 00:19:46.588 read: IOPS=546, BW=137MiB/s (143MB/s)(1382MiB/10108msec) 00:19:46.588 slat (usec): min=14, max=154401, avg=1487.95, stdev=5741.44 00:19:46.588 clat (usec): min=1399, max=358169, avg=115458.18, stdev=61376.97 00:19:46.588 lat (usec): min=1421, max=358193, avg=116946.13, stdev=62198.38 00:19:46.588 clat percentiles (msec): 00:19:46.588 | 1.00th=[ 4], 5.00th=[ 12], 10.00th=[ 25], 20.00th=[ 46], 00:19:46.588 | 30.00th=[ 102], 40.00th=[ 114], 50.00th=[ 125], 60.00th=[ 134], 00:19:46.588 | 70.00th=[ 146], 80.00th=[ 155], 90.00th=[ 174], 95.00th=[ 211], 00:19:46.588 | 99.00th=[ 284], 99.50th=[ 342], 99.90th=[ 347], 99.95th=[ 347], 00:19:46.588 | 99.99th=[ 359] 00:19:46.588 bw ( KiB/s): min=73216, max=268288, per=8.40%, avg=139860.05, stdev=41838.28, samples=20 00:19:46.588 iops : min= 286, max= 1048, avg=546.30, stdev=163.40, samples=20 00:19:46.588 lat (msec) : 2=0.20%, 4=1.05%, 10=3.37%, 20=2.26%, 50=13.84% 00:19:46.588 lat (msec) : 100=8.83%, 250=68.01%, 500=2.44% 00:19:46.588 cpu : usr=0.38%, sys=1.83%, ctx=1262, majf=0, minf=4097 00:19:46.588 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:19:46.588 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:46.588 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:46.588 issued rwts: total=5527,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:46.588 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:46.588 job8: (groupid=0, jobs=1): err= 0: pid=1539472: Mon Jul 15 08:58:33 2024 00:19:46.588 read: IOPS=577, BW=144MiB/s (151MB/s)(1457MiB/10082msec) 00:19:46.588 slat (usec): min=14, max=54357, avg=1588.39, stdev=4543.31 00:19:46.588 clat (usec): min=1196, max=221098, avg=109064.08, stdev=40513.64 00:19:46.588 lat (usec): min=1221, max=221136, avg=110652.46, stdev=41194.45 00:19:46.588 clat percentiles (msec): 00:19:46.588 | 1.00th=[ 10], 5.00th=[ 32], 10.00th=[ 46], 20.00th=[ 79], 00:19:46.588 | 30.00th=[ 95], 40.00th=[ 107], 50.00th=[ 115], 60.00th=[ 123], 00:19:46.588 | 70.00th=[ 133], 80.00th=[ 146], 90.00th=[ 157], 95.00th=[ 165], 00:19:46.588 | 99.00th=[ 188], 99.50th=[ 194], 99.90th=[ 209], 99.95th=[ 222], 00:19:46.588 | 99.99th=[ 222] 00:19:46.588 bw ( KiB/s): min=99640, max=264192, per=8.86%, avg=147522.80, stdev=45466.53, samples=20 00:19:46.588 iops : min= 389, max= 1032, avg=576.25, stdev=177.62, samples=20 00:19:46.588 lat (msec) : 2=0.02%, 4=0.14%, 10=0.88%, 20=1.60%, 50=8.79% 00:19:46.588 lat (msec) : 100=22.42%, 250=66.17% 00:19:46.588 cpu : usr=0.33%, sys=1.96%, ctx=1243, majf=0, minf=3721 00:19:46.588 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:19:46.588 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:46.588 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:46.588 issued rwts: total=5826,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:46.588 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:46.588 job9: (groupid=0, jobs=1): err= 0: pid=1539473: Mon Jul 15 08:58:33 2024 00:19:46.588 read: IOPS=701, BW=175MiB/s (184MB/s)(1765MiB/10060msec) 00:19:46.588 slat (usec): min=9, max=126445, avg=1130.47, stdev=4973.52 00:19:46.588 clat (usec): min=1111, max=335660, avg=89966.69, stdev=59995.68 00:19:46.588 lat (usec): min=1138, max=335703, avg=91097.16, stdev=60838.21 00:19:46.588 clat percentiles (msec): 00:19:46.588 | 1.00th=[ 3], 5.00th=[ 8], 10.00th=[ 14], 20.00th=[ 31], 00:19:46.588 | 30.00th=[ 39], 40.00th=[ 66], 50.00th=[ 91], 60.00th=[ 113], 00:19:46.588 | 70.00th=[ 128], 80.00th=[ 144], 90.00th=[ 161], 95.00th=[ 186], 00:19:46.588 | 99.00th=[ 257], 99.50th=[ 271], 99.90th=[ 284], 99.95th=[ 296], 00:19:46.588 | 99.99th=[ 338] 00:19:46.588 bw ( KiB/s): min=62976, max=372224, per=10.75%, avg=179122.05, stdev=78082.33, samples=20 00:19:46.588 iops : min= 246, max= 1454, avg=699.65, stdev=304.96, samples=20 00:19:46.588 lat (msec) : 2=0.20%, 4=2.15%, 10=4.97%, 20=6.12%, 50=21.27% 00:19:46.588 lat (msec) : 100=19.74%, 250=44.19%, 500=1.36% 00:19:46.588 cpu : usr=0.29%, sys=2.46%, ctx=1591, majf=0, minf=4097 00:19:46.588 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:19:46.588 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:46.588 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:46.588 issued rwts: total=7061,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:46.588 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:46.588 job10: (groupid=0, jobs=1): err= 0: pid=1539474: Mon Jul 15 08:58:33 2024 00:19:46.588 read: IOPS=677, BW=169MiB/s (178MB/s)(1697MiB/10020msec) 00:19:46.588 slat (usec): min=12, max=73034, avg=1107.67, stdev=3739.04 00:19:46.588 clat (msec): min=2, max=304, avg=93.29, stdev=50.52 00:19:46.588 lat (msec): min=2, max=304, avg=94.40, stdev=51.04 00:19:46.588 clat percentiles (msec): 00:19:46.588 | 1.00th=[ 6], 5.00th=[ 25], 10.00th=[ 31], 20.00th=[ 35], 00:19:46.588 | 30.00th=[ 54], 40.00th=[ 74], 50.00th=[ 99], 60.00th=[ 112], 00:19:46.588 | 70.00th=[ 132], 80.00th=[ 144], 90.00th=[ 157], 95.00th=[ 163], 00:19:46.588 | 99.00th=[ 192], 99.50th=[ 222], 99.90th=[ 284], 99.95th=[ 292], 00:19:46.588 | 99.99th=[ 305] 00:19:46.588 bw ( KiB/s): min=100662, max=428032, per=10.34%, avg=172149.90, stdev=88146.67, samples=20 00:19:46.588 iops : min= 393, max= 1672, avg=672.45, stdev=344.33, samples=20 00:19:46.588 lat (msec) : 4=0.43%, 10=2.09%, 20=1.36%, 50=23.97%, 100=23.48% 00:19:46.588 lat (msec) : 250=48.39%, 500=0.28% 00:19:46.588 cpu : usr=0.36%, sys=2.26%, ctx=1446, majf=0, minf=4097 00:19:46.588 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:19:46.588 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:46.588 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:46.588 issued rwts: total=6788,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:46.588 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:46.588 00:19:46.588 Run status group 0 (all jobs): 00:19:46.588 READ: bw=1627MiB/s (1706MB/s), 117MiB/s-193MiB/s (123MB/s-203MB/s), io=16.1GiB (17.2GB), run=10020-10110msec 00:19:46.588 00:19:46.588 Disk stats (read/write): 00:19:46.588 nvme0n1: ios=11669/0, merge=0/0, ticks=1232295/0, in_queue=1232295, util=97.05% 00:19:46.588 nvme10n1: ios=11394/0, merge=0/0, ticks=1232819/0, in_queue=1232819, util=97.29% 00:19:46.588 nvme1n1: ios=9289/0, merge=0/0, ticks=1234760/0, in_queue=1234760, util=97.60% 00:19:46.588 nvme2n1: ios=10088/0, merge=0/0, ticks=1235809/0, in_queue=1235809, util=97.73% 00:19:46.588 nvme3n1: ios=11389/0, merge=0/0, ticks=1226132/0, in_queue=1226132, util=97.86% 00:19:46.588 nvme4n1: ios=10509/0, merge=0/0, ticks=1237380/0, in_queue=1237380, util=98.21% 00:19:46.588 nvme5n1: ios=15143/0, merge=0/0, ticks=1229672/0, in_queue=1229672, util=98.38% 00:19:46.588 nvme6n1: ios=10860/0, merge=0/0, ticks=1234723/0, in_queue=1234723, util=98.53% 00:19:46.588 nvme7n1: ios=11450/0, merge=0/0, ticks=1226944/0, in_queue=1226944, util=98.95% 00:19:46.588 nvme8n1: ios=13873/0, merge=0/0, ticks=1234727/0, in_queue=1234727, util=99.10% 00:19:46.588 nvme9n1: ios=13292/0, merge=0/0, ticks=1239704/0, in_queue=1239704, util=99.22% 00:19:46.588 08:58:33 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:19:46.588 [global] 00:19:46.588 thread=1 00:19:46.588 invalidate=1 00:19:46.588 rw=randwrite 00:19:46.588 time_based=1 00:19:46.588 runtime=10 00:19:46.588 ioengine=libaio 00:19:46.588 direct=1 00:19:46.588 bs=262144 00:19:46.588 iodepth=64 00:19:46.588 norandommap=1 00:19:46.588 numjobs=1 00:19:46.588 00:19:46.588 [job0] 00:19:46.588 filename=/dev/nvme0n1 00:19:46.588 [job1] 00:19:46.588 filename=/dev/nvme10n1 00:19:46.588 [job2] 00:19:46.588 filename=/dev/nvme1n1 00:19:46.588 [job3] 00:19:46.588 filename=/dev/nvme2n1 00:19:46.588 [job4] 00:19:46.588 filename=/dev/nvme3n1 00:19:46.588 [job5] 00:19:46.588 filename=/dev/nvme4n1 00:19:46.588 [job6] 00:19:46.588 filename=/dev/nvme5n1 00:19:46.588 [job7] 00:19:46.588 filename=/dev/nvme6n1 00:19:46.588 [job8] 00:19:46.588 filename=/dev/nvme7n1 00:19:46.588 [job9] 00:19:46.588 filename=/dev/nvme8n1 00:19:46.588 [job10] 00:19:46.588 filename=/dev/nvme9n1 00:19:46.588 Could not set queue depth (nvme0n1) 00:19:46.588 Could not set queue depth (nvme10n1) 00:19:46.588 Could not set queue depth (nvme1n1) 00:19:46.588 Could not set queue depth (nvme2n1) 00:19:46.588 Could not set queue depth (nvme3n1) 00:19:46.588 Could not set queue depth (nvme4n1) 00:19:46.588 Could not set queue depth (nvme5n1) 00:19:46.588 Could not set queue depth (nvme6n1) 00:19:46.588 Could not set queue depth (nvme7n1) 00:19:46.588 Could not set queue depth (nvme8n1) 00:19:46.588 Could not set queue depth (nvme9n1) 00:19:46.588 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:46.588 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:46.588 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:46.588 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:46.588 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:46.588 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:46.588 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:46.588 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:46.588 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:46.588 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:46.588 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:46.588 fio-3.35 00:19:46.588 Starting 11 threads 00:19:56.617 00:19:56.617 job0: (groupid=0, jobs=1): err= 0: pid=1540563: Mon Jul 15 08:58:44 2024 00:19:56.617 write: IOPS=499, BW=125MiB/s (131MB/s)(1270MiB/10164msec); 0 zone resets 00:19:56.617 slat (usec): min=19, max=44617, avg=1575.08, stdev=3817.71 00:19:56.617 clat (msec): min=4, max=328, avg=126.43, stdev=59.08 00:19:56.617 lat (msec): min=4, max=328, avg=128.01, stdev=59.87 00:19:56.617 clat percentiles (msec): 00:19:56.617 | 1.00th=[ 19], 5.00th=[ 41], 10.00th=[ 44], 20.00th=[ 70], 00:19:56.617 | 30.00th=[ 93], 40.00th=[ 109], 50.00th=[ 128], 60.00th=[ 146], 00:19:56.617 | 70.00th=[ 161], 80.00th=[ 176], 90.00th=[ 194], 95.00th=[ 226], 00:19:56.617 | 99.00th=[ 288], 99.50th=[ 313], 99.90th=[ 326], 99.95th=[ 330], 00:19:56.617 | 99.99th=[ 330] 00:19:56.617 bw ( KiB/s): min=61317, max=230400, per=8.42%, avg=128404.90, stdev=48117.14, samples=20 00:19:56.617 iops : min= 239, max= 900, avg=501.40, stdev=187.97, samples=20 00:19:56.617 lat (msec) : 10=0.30%, 20=0.96%, 50=12.07%, 100=19.30%, 250=64.93% 00:19:56.617 lat (msec) : 500=2.44% 00:19:56.617 cpu : usr=1.64%, sys=1.65%, ctx=2288, majf=0, minf=1 00:19:56.617 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:19:56.617 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:56.617 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:56.617 issued rwts: total=0,5079,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:56.617 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:56.617 job1: (groupid=0, jobs=1): err= 0: pid=1540617: Mon Jul 15 08:58:44 2024 00:19:56.617 write: IOPS=504, BW=126MiB/s (132MB/s)(1280MiB/10148msec); 0 zone resets 00:19:56.617 slat (usec): min=21, max=44104, avg=1315.55, stdev=3368.60 00:19:56.617 clat (msec): min=3, max=322, avg=125.49, stdev=55.45 00:19:56.617 lat (msec): min=3, max=323, avg=126.81, stdev=56.17 00:19:56.617 clat percentiles (msec): 00:19:56.617 | 1.00th=[ 10], 5.00th=[ 28], 10.00th=[ 43], 20.00th=[ 78], 00:19:56.617 | 30.00th=[ 103], 40.00th=[ 117], 50.00th=[ 132], 60.00th=[ 144], 00:19:56.617 | 70.00th=[ 155], 80.00th=[ 165], 90.00th=[ 182], 95.00th=[ 218], 00:19:56.617 | 99.00th=[ 284], 99.50th=[ 296], 99.90th=[ 313], 99.95th=[ 321], 00:19:56.617 | 99.99th=[ 326] 00:19:56.617 bw ( KiB/s): min=63488, max=225731, per=8.49%, avg=129476.45, stdev=37161.82, samples=20 00:19:56.617 iops : min= 248, max= 881, avg=505.55, stdev=145.05, samples=20 00:19:56.617 lat (msec) : 4=0.04%, 10=1.05%, 20=2.32%, 50=7.93%, 100=17.37% 00:19:56.617 lat (msec) : 250=68.86%, 500=2.42% 00:19:56.617 cpu : usr=1.56%, sys=1.73%, ctx=2927, majf=0, minf=1 00:19:56.617 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:19:56.617 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:56.617 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:56.617 issued rwts: total=0,5119,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:56.617 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:56.617 job2: (groupid=0, jobs=1): err= 0: pid=1540679: Mon Jul 15 08:58:44 2024 00:19:56.617 write: IOPS=423, BW=106MiB/s (111MB/s)(1072MiB/10129msec); 0 zone resets 00:19:56.617 slat (usec): min=23, max=84157, avg=1234.17, stdev=4227.35 00:19:56.617 clat (msec): min=2, max=417, avg=149.93, stdev=77.92 00:19:56.617 lat (msec): min=2, max=417, avg=151.16, stdev=78.95 00:19:56.617 clat percentiles (msec): 00:19:56.617 | 1.00th=[ 22], 5.00th=[ 39], 10.00th=[ 55], 20.00th=[ 84], 00:19:56.617 | 30.00th=[ 112], 40.00th=[ 136], 50.00th=[ 150], 60.00th=[ 161], 00:19:56.617 | 70.00th=[ 171], 80.00th=[ 184], 90.00th=[ 234], 95.00th=[ 330], 00:19:56.617 | 99.00th=[ 393], 99.50th=[ 405], 99.90th=[ 414], 99.95th=[ 414], 00:19:56.617 | 99.99th=[ 418] 00:19:56.617 bw ( KiB/s): min=43944, max=158525, per=7.09%, avg=108116.45, stdev=30902.12, samples=20 00:19:56.617 iops : min= 171, max= 619, avg=422.10, stdev=120.84, samples=20 00:19:56.617 lat (msec) : 4=0.09%, 10=0.09%, 20=0.47%, 50=7.79%, 100=17.92% 00:19:56.617 lat (msec) : 250=65.31%, 500=8.33% 00:19:56.617 cpu : usr=1.29%, sys=1.59%, ctx=3084, majf=0, minf=1 00:19:56.617 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.5% 00:19:56.617 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:56.617 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:56.617 issued rwts: total=0,4286,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:56.617 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:56.617 job3: (groupid=0, jobs=1): err= 0: pid=1540682: Mon Jul 15 08:58:44 2024 00:19:56.617 write: IOPS=562, BW=141MiB/s (147MB/s)(1423MiB/10125msec); 0 zone resets 00:19:56.617 slat (usec): min=18, max=95669, avg=1012.02, stdev=3464.17 00:19:56.617 clat (msec): min=2, max=414, avg=112.78, stdev=71.83 00:19:56.617 lat (msec): min=2, max=414, avg=113.79, stdev=72.74 00:19:56.617 clat percentiles (msec): 00:19:56.617 | 1.00th=[ 11], 5.00th=[ 23], 10.00th=[ 36], 20.00th=[ 52], 00:19:56.617 | 30.00th=[ 71], 40.00th=[ 86], 50.00th=[ 104], 60.00th=[ 116], 00:19:56.617 | 70.00th=[ 144], 80.00th=[ 159], 90.00th=[ 182], 95.00th=[ 230], 00:19:56.617 | 99.00th=[ 388], 99.50th=[ 405], 99.90th=[ 414], 99.95th=[ 414], 00:19:56.617 | 99.99th=[ 414] 00:19:56.617 bw ( KiB/s): min=42922, max=243200, per=9.45%, avg=144126.55, stdev=54044.12, samples=20 00:19:56.617 iops : min= 167, max= 950, avg=562.85, stdev=211.13, samples=20 00:19:56.617 lat (msec) : 4=0.04%, 10=0.91%, 20=2.86%, 50=14.69%, 100=29.76% 00:19:56.617 lat (msec) : 250=47.29%, 500=4.44% 00:19:56.617 cpu : usr=1.79%, sys=1.78%, ctx=3781, majf=0, minf=1 00:19:56.617 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:19:56.617 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:56.617 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:56.617 issued rwts: total=0,5692,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:56.617 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:56.617 job4: (groupid=0, jobs=1): err= 0: pid=1540683: Mon Jul 15 08:58:44 2024 00:19:56.617 write: IOPS=584, BW=146MiB/s (153MB/s)(1469MiB/10059msec); 0 zone resets 00:19:56.617 slat (usec): min=16, max=83326, avg=1259.74, stdev=3704.53 00:19:56.617 clat (usec): min=1126, max=323194, avg=108230.74, stdev=54418.16 00:19:56.617 lat (usec): min=1159, max=323387, avg=109490.48, stdev=54974.32 00:19:56.617 clat percentiles (msec): 00:19:56.617 | 1.00th=[ 6], 5.00th=[ 35], 10.00th=[ 43], 20.00th=[ 58], 00:19:56.617 | 30.00th=[ 75], 40.00th=[ 88], 50.00th=[ 108], 60.00th=[ 117], 00:19:56.617 | 70.00th=[ 134], 80.00th=[ 153], 90.00th=[ 176], 95.00th=[ 199], 00:19:56.617 | 99.00th=[ 266], 99.50th=[ 284], 99.90th=[ 300], 99.95th=[ 313], 00:19:56.617 | 99.99th=[ 326] 00:19:56.617 bw ( KiB/s): min=84992, max=247278, per=9.76%, avg=148778.75, stdev=45782.81, samples=20 00:19:56.617 iops : min= 332, max= 965, avg=581.00, stdev=178.79, samples=20 00:19:56.617 lat (msec) : 2=0.07%, 4=0.49%, 10=1.38%, 20=1.36%, 50=13.26% 00:19:56.617 lat (msec) : 100=28.70%, 250=52.90%, 500=1.84% 00:19:56.617 cpu : usr=1.52%, sys=1.90%, ctx=2827, majf=0, minf=1 00:19:56.617 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:19:56.617 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:56.617 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:56.617 issued rwts: total=0,5875,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:56.617 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:56.617 job5: (groupid=0, jobs=1): err= 0: pid=1540684: Mon Jul 15 08:58:44 2024 00:19:56.617 write: IOPS=650, BW=163MiB/s (171MB/s)(1637MiB/10060msec); 0 zone resets 00:19:56.617 slat (usec): min=23, max=126252, avg=1200.80, stdev=3409.26 00:19:56.617 clat (usec): min=1779, max=327405, avg=97073.81, stdev=63925.71 00:19:56.617 lat (usec): min=1826, max=327501, avg=98274.61, stdev=64639.29 00:19:56.617 clat percentiles (msec): 00:19:56.617 | 1.00th=[ 8], 5.00th=[ 24], 10.00th=[ 40], 20.00th=[ 44], 00:19:56.617 | 30.00th=[ 47], 40.00th=[ 56], 50.00th=[ 81], 60.00th=[ 107], 00:19:56.617 | 70.00th=[ 125], 80.00th=[ 153], 90.00th=[ 190], 95.00th=[ 213], 00:19:56.617 | 99.00th=[ 300], 99.50th=[ 313], 99.90th=[ 326], 99.95th=[ 326], 00:19:56.617 | 99.99th=[ 330] 00:19:56.617 bw ( KiB/s): min=55296, max=341504, per=10.89%, avg=166129.45, stdev=86259.32, samples=20 00:19:56.617 iops : min= 216, max= 1334, avg=648.70, stdev=336.98, samples=20 00:19:56.617 lat (msec) : 2=0.03%, 4=0.29%, 10=1.19%, 20=2.32%, 50=32.88% 00:19:56.617 lat (msec) : 100=21.39%, 250=39.40%, 500=2.50% 00:19:56.617 cpu : usr=1.96%, sys=2.37%, ctx=2746, majf=0, minf=1 00:19:56.617 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:19:56.618 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:56.618 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:56.618 issued rwts: total=0,6549,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:56.618 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:56.618 job6: (groupid=0, jobs=1): err= 0: pid=1540685: Mon Jul 15 08:58:44 2024 00:19:56.618 write: IOPS=565, BW=141MiB/s (148MB/s)(1423MiB/10055msec); 0 zone resets 00:19:56.618 slat (usec): min=16, max=58772, avg=1343.54, stdev=3571.39 00:19:56.618 clat (usec): min=1467, max=296259, avg=111685.45, stdev=66741.64 00:19:56.618 lat (msec): min=2, max=296, avg=113.03, stdev=67.60 00:19:56.618 clat percentiles (msec): 00:19:56.618 | 1.00th=[ 7], 5.00th=[ 13], 10.00th=[ 27], 20.00th=[ 43], 00:19:56.618 | 30.00th=[ 63], 40.00th=[ 83], 50.00th=[ 112], 60.00th=[ 134], 00:19:56.618 | 70.00th=[ 153], 80.00th=[ 171], 90.00th=[ 199], 95.00th=[ 228], 00:19:56.618 | 99.00th=[ 271], 99.50th=[ 275], 99.90th=[ 288], 99.95th=[ 292], 00:19:56.618 | 99.99th=[ 296] 00:19:56.618 bw ( KiB/s): min=66427, max=257024, per=9.45%, avg=144077.10, stdev=55598.53, samples=20 00:19:56.618 iops : min= 259, max= 1004, avg=562.65, stdev=217.19, samples=20 00:19:56.618 lat (msec) : 2=0.02%, 4=0.19%, 10=3.06%, 20=4.60%, 50=17.99% 00:19:56.618 lat (msec) : 100=17.52%, 250=54.37%, 500=2.25% 00:19:56.618 cpu : usr=1.83%, sys=2.07%, ctx=2851, majf=0, minf=1 00:19:56.618 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:19:56.618 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:56.618 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:56.618 issued rwts: total=0,5691,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:56.618 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:56.618 job7: (groupid=0, jobs=1): err= 0: pid=1540686: Mon Jul 15 08:58:44 2024 00:19:56.618 write: IOPS=425, BW=106MiB/s (111MB/s)(1077MiB/10133msec); 0 zone resets 00:19:56.618 slat (usec): min=16, max=104050, avg=1685.35, stdev=5351.46 00:19:56.618 clat (usec): min=1365, max=442673, avg=148812.40, stdev=89977.08 00:19:56.618 lat (usec): min=1406, max=442715, avg=150497.75, stdev=91271.86 00:19:56.618 clat percentiles (msec): 00:19:56.618 | 1.00th=[ 5], 5.00th=[ 12], 10.00th=[ 24], 20.00th=[ 60], 00:19:56.618 | 30.00th=[ 99], 40.00th=[ 133], 50.00th=[ 159], 60.00th=[ 171], 00:19:56.618 | 70.00th=[ 194], 80.00th=[ 211], 90.00th=[ 255], 95.00th=[ 284], 00:19:56.618 | 99.00th=[ 409], 99.50th=[ 414], 99.90th=[ 443], 99.95th=[ 443], 00:19:56.618 | 99.99th=[ 443] 00:19:56.618 bw ( KiB/s): min=43094, max=231984, per=7.12%, avg=108615.70, stdev=48917.12, samples=20 00:19:56.618 iops : min= 168, max= 906, avg=424.20, stdev=191.14, samples=20 00:19:56.618 lat (msec) : 2=0.12%, 4=0.49%, 10=3.46%, 20=4.06%, 50=9.15% 00:19:56.618 lat (msec) : 100=13.42%, 250=58.32%, 500=10.98% 00:19:56.618 cpu : usr=1.22%, sys=1.43%, ctx=2582, majf=0, minf=1 00:19:56.618 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.5% 00:19:56.618 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:56.618 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:56.618 issued rwts: total=0,4307,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:56.618 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:56.618 job8: (groupid=0, jobs=1): err= 0: pid=1540689: Mon Jul 15 08:58:44 2024 00:19:56.618 write: IOPS=674, BW=169MiB/s (177MB/s)(1702MiB/10100msec); 0 zone resets 00:19:56.618 slat (usec): min=15, max=96271, avg=761.33, stdev=2620.74 00:19:56.618 clat (usec): min=1361, max=272087, avg=94126.65, stdev=56300.82 00:19:56.618 lat (usec): min=1392, max=272118, avg=94887.98, stdev=56762.23 00:19:56.618 clat percentiles (msec): 00:19:56.618 | 1.00th=[ 5], 5.00th=[ 15], 10.00th=[ 31], 20.00th=[ 48], 00:19:56.618 | 30.00th=[ 54], 40.00th=[ 64], 50.00th=[ 82], 60.00th=[ 107], 00:19:56.618 | 70.00th=[ 120], 80.00th=[ 150], 90.00th=[ 176], 95.00th=[ 197], 00:19:56.618 | 99.00th=[ 243], 99.50th=[ 259], 99.90th=[ 268], 99.95th=[ 268], 00:19:56.618 | 99.99th=[ 271] 00:19:56.618 bw ( KiB/s): min=92160, max=321667, per=11.33%, avg=172804.10, stdev=60076.17, samples=20 00:19:56.618 iops : min= 360, max= 1256, avg=674.85, stdev=234.56, samples=20 00:19:56.618 lat (msec) : 2=0.16%, 4=0.63%, 10=2.81%, 20=2.82%, 50=17.17% 00:19:56.618 lat (msec) : 100=34.37%, 250=41.39%, 500=0.66% 00:19:56.618 cpu : usr=1.85%, sys=2.18%, ctx=4350, majf=0, minf=1 00:19:56.618 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:19:56.618 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:56.618 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:56.618 issued rwts: total=0,6809,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:56.618 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:56.618 job9: (groupid=0, jobs=1): err= 0: pid=1540692: Mon Jul 15 08:58:44 2024 00:19:56.618 write: IOPS=478, BW=120MiB/s (126MB/s)(1213MiB/10133msec); 0 zone resets 00:19:56.618 slat (usec): min=19, max=89443, avg=1403.31, stdev=4601.48 00:19:56.618 clat (usec): min=1648, max=423313, avg=132142.09, stdev=86047.84 00:19:56.618 lat (usec): min=1685, max=423356, avg=133545.40, stdev=87233.98 00:19:56.618 clat percentiles (msec): 00:19:56.618 | 1.00th=[ 5], 5.00th=[ 17], 10.00th=[ 31], 20.00th=[ 45], 00:19:56.618 | 30.00th=[ 74], 40.00th=[ 101], 50.00th=[ 134], 60.00th=[ 155], 00:19:56.618 | 70.00th=[ 169], 80.00th=[ 192], 90.00th=[ 236], 95.00th=[ 275], 00:19:56.618 | 99.00th=[ 397], 99.50th=[ 409], 99.90th=[ 422], 99.95th=[ 422], 00:19:56.618 | 99.99th=[ 422] 00:19:56.618 bw ( KiB/s): min=40878, max=251392, per=8.04%, avg=122580.80, stdev=56755.25, samples=20 00:19:56.618 iops : min= 159, max= 982, avg=478.70, stdev=221.80, samples=20 00:19:56.618 lat (msec) : 2=0.06%, 4=0.62%, 10=1.65%, 20=3.54%, 50=15.68% 00:19:56.618 lat (msec) : 100=18.49%, 250=52.74%, 500=7.21% 00:19:56.618 cpu : usr=1.58%, sys=1.59%, ctx=3023, majf=0, minf=1 00:19:56.618 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:19:56.618 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:56.618 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:56.618 issued rwts: total=0,4852,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:56.618 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:56.618 job10: (groupid=0, jobs=1): err= 0: pid=1540693: Mon Jul 15 08:58:44 2024 00:19:56.618 write: IOPS=619, BW=155MiB/s (162MB/s)(1574MiB/10159msec); 0 zone resets 00:19:56.618 slat (usec): min=16, max=107983, avg=1039.71, stdev=3798.51 00:19:56.618 clat (usec): min=1357, max=406723, avg=102209.55, stdev=74593.33 00:19:56.618 lat (usec): min=1438, max=406809, avg=103249.26, stdev=75508.23 00:19:56.618 clat percentiles (msec): 00:19:56.618 | 1.00th=[ 7], 5.00th=[ 17], 10.00th=[ 27], 20.00th=[ 41], 00:19:56.618 | 30.00th=[ 42], 40.00th=[ 50], 50.00th=[ 85], 60.00th=[ 114], 00:19:56.618 | 70.00th=[ 144], 80.00th=[ 167], 90.00th=[ 207], 95.00th=[ 239], 00:19:56.618 | 99.00th=[ 317], 99.50th=[ 363], 99.90th=[ 397], 99.95th=[ 397], 00:19:56.618 | 99.99th=[ 405] 00:19:56.618 bw ( KiB/s): min=41042, max=387321, per=10.45%, avg=159429.45, stdev=86244.90, samples=20 00:19:56.618 iops : min= 160, max= 1512, avg=622.65, stdev=336.77, samples=20 00:19:56.618 lat (msec) : 2=0.05%, 4=0.29%, 10=2.14%, 20=4.40%, 50=33.84% 00:19:56.618 lat (msec) : 100=13.39%, 250=41.93%, 500=3.96% 00:19:56.618 cpu : usr=1.78%, sys=2.37%, ctx=3660, majf=0, minf=1 00:19:56.618 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:19:56.618 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:56.618 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:56.618 issued rwts: total=0,6294,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:56.618 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:56.618 00:19:56.618 Run status group 0 (all jobs): 00:19:56.618 WRITE: bw=1489MiB/s (1562MB/s), 106MiB/s-169MiB/s (111MB/s-177MB/s), io=14.8GiB (15.9GB), run=10055-10164msec 00:19:56.618 00:19:56.618 Disk stats (read/write): 00:19:56.618 nvme0n1: ios=49/10038, merge=0/0, ticks=35/1221888, in_queue=1221923, util=95.74% 00:19:56.618 nvme10n1: ios=40/10112, merge=0/0, ticks=410/1227613, in_queue=1228023, util=99.49% 00:19:56.618 nvme1n1: ios=0/8447, merge=0/0, ticks=0/1236285, in_queue=1236285, util=96.39% 00:19:56.618 nvme2n1: ios=0/11268, merge=0/0, ticks=0/1239673, in_queue=1239673, util=96.71% 00:19:56.618 nvme3n1: ios=35/11636, merge=0/0, ticks=2763/1216451, in_queue=1219214, util=100.00% 00:19:56.618 nvme4n1: ios=29/12976, merge=0/0, ticks=241/1228095, in_queue=1228336, util=99.42% 00:19:56.618 nvme5n1: ios=27/11271, merge=0/0, ticks=272/1228849, in_queue=1229121, util=100.00% 00:19:56.618 nvme6n1: ios=0/8493, merge=0/0, ticks=0/1226021, in_queue=1226021, util=98.01% 00:19:56.618 nvme7n1: ios=0/13494, merge=0/0, ticks=0/1235585, in_queue=1235585, util=98.70% 00:19:56.618 nvme8n1: ios=28/9583, merge=0/0, ticks=410/1228971, in_queue=1229381, util=100.00% 00:19:56.618 nvme9n1: ios=0/12469, merge=0/0, ticks=0/1228860, in_queue=1228860, util=99.11% 00:19:56.618 08:58:44 -- target/multiconnection.sh@36 -- # sync 00:19:56.618 08:58:44 -- target/multiconnection.sh@37 -- # seq 1 11 00:19:56.618 08:58:44 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:56.618 08:58:44 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:56.618 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:19:56.618 08:58:44 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:19:56.618 08:58:44 -- common/autotest_common.sh@1198 -- # local i=0 00:19:56.618 08:58:44 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:19:56.618 08:58:44 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK1 00:19:56.618 08:58:44 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:19:56.618 08:58:44 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK1 00:19:56.618 08:58:44 -- common/autotest_common.sh@1210 -- # return 0 00:19:56.618 08:58:44 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:56.618 08:58:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:56.618 08:58:44 -- common/autotest_common.sh@10 -- # set +x 00:19:56.618 08:58:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:56.618 08:58:44 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:56.618 08:58:44 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:19:56.618 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:19:56.618 08:58:44 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:19:56.618 08:58:44 -- common/autotest_common.sh@1198 -- # local i=0 00:19:56.618 08:58:44 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:19:56.618 08:58:44 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK2 00:19:56.618 08:58:44 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:19:56.618 08:58:44 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK2 00:19:56.618 08:58:44 -- common/autotest_common.sh@1210 -- # return 0 00:19:56.618 08:58:44 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:19:56.618 08:58:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:56.618 08:58:44 -- common/autotest_common.sh@10 -- # set +x 00:19:56.618 08:58:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:56.618 08:58:44 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:56.618 08:58:44 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:19:56.619 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:19:56.619 08:58:45 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:19:56.619 08:58:45 -- common/autotest_common.sh@1198 -- # local i=0 00:19:56.619 08:58:45 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:19:56.619 08:58:45 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK3 00:19:56.619 08:58:45 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:19:56.619 08:58:45 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK3 00:19:56.619 08:58:45 -- common/autotest_common.sh@1210 -- # return 0 00:19:56.619 08:58:45 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:19:56.619 08:58:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:56.619 08:58:45 -- common/autotest_common.sh@10 -- # set +x 00:19:56.619 08:58:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:56.619 08:58:45 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:56.619 08:58:45 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:19:56.877 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:19:56.877 08:58:45 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:19:56.877 08:58:45 -- common/autotest_common.sh@1198 -- # local i=0 00:19:56.877 08:58:45 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:19:56.877 08:58:45 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK4 00:19:56.877 08:58:45 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:19:56.877 08:58:45 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK4 00:19:56.877 08:58:45 -- common/autotest_common.sh@1210 -- # return 0 00:19:56.877 08:58:45 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:19:56.877 08:58:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:56.877 08:58:45 -- common/autotest_common.sh@10 -- # set +x 00:19:57.135 08:58:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:57.135 08:58:45 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:57.135 08:58:45 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:19:57.135 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:19:57.135 08:58:45 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:19:57.135 08:58:45 -- common/autotest_common.sh@1198 -- # local i=0 00:19:57.135 08:58:45 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:19:57.135 08:58:45 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK5 00:19:57.135 08:58:45 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:19:57.135 08:58:45 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK5 00:19:57.136 08:58:45 -- common/autotest_common.sh@1210 -- # return 0 00:19:57.136 08:58:45 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:19:57.136 08:58:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:57.136 08:58:45 -- common/autotest_common.sh@10 -- # set +x 00:19:57.136 08:58:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:57.136 08:58:45 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:57.136 08:58:45 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:19:57.394 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:19:57.394 08:58:45 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:19:57.394 08:58:45 -- common/autotest_common.sh@1198 -- # local i=0 00:19:57.394 08:58:45 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:19:57.394 08:58:45 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK6 00:19:57.394 08:58:45 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:19:57.394 08:58:45 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK6 00:19:57.394 08:58:45 -- common/autotest_common.sh@1210 -- # return 0 00:19:57.394 08:58:45 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:19:57.394 08:58:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:57.394 08:58:45 -- common/autotest_common.sh@10 -- # set +x 00:19:57.394 08:58:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:57.394 08:58:45 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:57.394 08:58:45 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:19:57.653 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:19:57.653 08:58:46 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:19:57.653 08:58:46 -- common/autotest_common.sh@1198 -- # local i=0 00:19:57.653 08:58:46 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:19:57.653 08:58:46 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK7 00:19:57.653 08:58:46 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:19:57.653 08:58:46 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK7 00:19:57.653 08:58:46 -- common/autotest_common.sh@1210 -- # return 0 00:19:57.653 08:58:46 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:19:57.653 08:58:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:57.653 08:58:46 -- common/autotest_common.sh@10 -- # set +x 00:19:57.653 08:58:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:57.653 08:58:46 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:57.653 08:58:46 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:19:57.653 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:19:57.653 08:58:46 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:19:57.653 08:58:46 -- common/autotest_common.sh@1198 -- # local i=0 00:19:57.653 08:58:46 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:19:57.653 08:58:46 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK8 00:19:57.653 08:58:46 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:19:57.653 08:58:46 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK8 00:19:57.653 08:58:46 -- common/autotest_common.sh@1210 -- # return 0 00:19:57.653 08:58:46 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:19:57.653 08:58:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:57.653 08:58:46 -- common/autotest_common.sh@10 -- # set +x 00:19:57.653 08:58:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:57.653 08:58:46 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:57.653 08:58:46 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:19:57.912 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:19:57.912 08:58:46 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:19:57.912 08:58:46 -- common/autotest_common.sh@1198 -- # local i=0 00:19:57.912 08:58:46 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:19:57.912 08:58:46 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK9 00:19:57.912 08:58:46 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:19:57.912 08:58:46 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK9 00:19:57.912 08:58:46 -- common/autotest_common.sh@1210 -- # return 0 00:19:57.912 08:58:46 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:19:57.912 08:58:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:57.912 08:58:46 -- common/autotest_common.sh@10 -- # set +x 00:19:57.912 08:58:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:57.912 08:58:46 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:57.912 08:58:46 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:19:57.912 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:19:57.912 08:58:46 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:19:57.912 08:58:46 -- common/autotest_common.sh@1198 -- # local i=0 00:19:57.912 08:58:46 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:19:57.912 08:58:46 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK10 00:19:57.912 08:58:46 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:19:57.912 08:58:46 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK10 00:19:57.912 08:58:46 -- common/autotest_common.sh@1210 -- # return 0 00:19:57.912 08:58:46 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:19:57.912 08:58:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:57.913 08:58:46 -- common/autotest_common.sh@10 -- # set +x 00:19:57.913 08:58:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:57.913 08:58:46 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:57.913 08:58:46 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:19:58.171 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:19:58.171 08:58:46 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:19:58.172 08:58:46 -- common/autotest_common.sh@1198 -- # local i=0 00:19:58.172 08:58:46 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:19:58.172 08:58:46 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK11 00:19:58.172 08:58:46 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:19:58.172 08:58:46 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK11 00:19:58.172 08:58:46 -- common/autotest_common.sh@1210 -- # return 0 00:19:58.172 08:58:46 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:19:58.172 08:58:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:58.172 08:58:46 -- common/autotest_common.sh@10 -- # set +x 00:19:58.172 08:58:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:58.172 08:58:46 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:19:58.172 08:58:46 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:19:58.172 08:58:46 -- target/multiconnection.sh@47 -- # nvmftestfini 00:19:58.172 08:58:46 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:58.172 08:58:46 -- nvmf/common.sh@116 -- # sync 00:19:58.172 08:58:46 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:58.172 08:58:46 -- nvmf/common.sh@119 -- # set +e 00:19:58.172 08:58:46 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:58.172 08:58:46 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:58.172 rmmod nvme_tcp 00:19:58.172 rmmod nvme_fabrics 00:19:58.172 rmmod nvme_keyring 00:19:58.172 08:58:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:58.172 08:58:46 -- nvmf/common.sh@123 -- # set -e 00:19:58.172 08:58:46 -- nvmf/common.sh@124 -- # return 0 00:19:58.172 08:58:46 -- nvmf/common.sh@477 -- # '[' -n 1534818 ']' 00:19:58.172 08:58:46 -- nvmf/common.sh@478 -- # killprocess 1534818 00:19:58.172 08:58:46 -- common/autotest_common.sh@926 -- # '[' -z 1534818 ']' 00:19:58.172 08:58:46 -- common/autotest_common.sh@930 -- # kill -0 1534818 00:19:58.172 08:58:46 -- common/autotest_common.sh@931 -- # uname 00:19:58.172 08:58:46 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:19:58.172 08:58:46 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1534818 00:19:58.172 08:58:46 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:19:58.172 08:58:46 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:19:58.172 08:58:46 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1534818' 00:19:58.172 killing process with pid 1534818 00:19:58.172 08:58:46 -- common/autotest_common.sh@945 -- # kill 1534818 00:19:58.172 08:58:46 -- common/autotest_common.sh@950 -- # wait 1534818 00:19:58.740 08:58:47 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:58.740 08:58:47 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:58.740 08:58:47 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:58.740 08:58:47 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:58.740 08:58:47 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:58.740 08:58:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:58.740 08:58:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:58.740 08:58:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:01.273 08:58:49 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:01.273 00:20:01.273 real 1m1.100s 00:20:01.273 user 3m25.613s 00:20:01.273 sys 0m25.156s 00:20:01.273 08:58:49 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:20:01.273 08:58:49 -- common/autotest_common.sh@10 -- # set +x 00:20:01.273 ************************************ 00:20:01.273 END TEST nvmf_multiconnection 00:20:01.273 ************************************ 00:20:01.273 08:58:49 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:20:01.273 08:58:49 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:20:01.273 08:58:49 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:20:01.273 08:58:49 -- common/autotest_common.sh@10 -- # set +x 00:20:01.273 ************************************ 00:20:01.273 START TEST nvmf_initiator_timeout 00:20:01.273 ************************************ 00:20:01.273 08:58:49 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:20:01.273 * Looking for test storage... 00:20:01.273 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:01.273 08:58:49 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:01.273 08:58:49 -- nvmf/common.sh@7 -- # uname -s 00:20:01.273 08:58:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:01.273 08:58:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:01.273 08:58:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:01.273 08:58:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:01.273 08:58:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:01.273 08:58:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:01.273 08:58:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:01.273 08:58:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:01.273 08:58:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:01.273 08:58:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:01.273 08:58:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:01.273 08:58:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:01.273 08:58:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:01.273 08:58:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:01.273 08:58:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:01.273 08:58:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:01.273 08:58:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:01.273 08:58:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:01.273 08:58:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:01.273 08:58:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:01.273 08:58:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:01.274 08:58:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:01.274 08:58:49 -- paths/export.sh@5 -- # export PATH 00:20:01.274 08:58:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:01.274 08:58:49 -- nvmf/common.sh@46 -- # : 0 00:20:01.274 08:58:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:01.274 08:58:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:01.274 08:58:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:01.274 08:58:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:01.274 08:58:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:01.274 08:58:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:01.274 08:58:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:01.274 08:58:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:01.274 08:58:49 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:20:01.274 08:58:49 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:20:01.274 08:58:49 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:20:01.274 08:58:49 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:01.274 08:58:49 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:01.274 08:58:49 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:01.274 08:58:49 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:01.274 08:58:49 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:01.274 08:58:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:01.274 08:58:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:01.274 08:58:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:01.274 08:58:49 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:01.274 08:58:49 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:01.274 08:58:49 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:01.274 08:58:49 -- common/autotest_common.sh@10 -- # set +x 00:20:02.652 08:58:51 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:02.652 08:58:51 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:02.652 08:58:51 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:02.652 08:58:51 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:02.652 08:58:51 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:02.652 08:58:51 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:02.652 08:58:51 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:02.652 08:58:51 -- nvmf/common.sh@294 -- # net_devs=() 00:20:02.652 08:58:51 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:02.652 08:58:51 -- nvmf/common.sh@295 -- # e810=() 00:20:02.652 08:58:51 -- nvmf/common.sh@295 -- # local -ga e810 00:20:02.652 08:58:51 -- nvmf/common.sh@296 -- # x722=() 00:20:02.652 08:58:51 -- nvmf/common.sh@296 -- # local -ga x722 00:20:02.652 08:58:51 -- nvmf/common.sh@297 -- # mlx=() 00:20:02.652 08:58:51 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:02.652 08:58:51 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:02.652 08:58:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:02.652 08:58:51 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:02.652 08:58:51 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:02.652 08:58:51 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:02.652 08:58:51 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:02.652 08:58:51 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:02.652 08:58:51 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:02.652 08:58:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:02.652 08:58:51 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:02.652 08:58:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:02.652 08:58:51 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:02.652 08:58:51 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:02.652 08:58:51 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:02.652 08:58:51 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:02.652 08:58:51 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:02.652 08:58:51 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:02.652 08:58:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:02.652 08:58:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:02.652 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:02.652 08:58:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:02.652 08:58:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:02.652 08:58:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:02.652 08:58:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:02.652 08:58:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:02.652 08:58:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:02.652 08:58:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:02.652 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:02.652 08:58:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:02.652 08:58:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:02.652 08:58:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:02.652 08:58:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:02.652 08:58:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:02.652 08:58:51 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:02.652 08:58:51 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:02.652 08:58:51 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:02.652 08:58:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:02.652 08:58:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:02.652 08:58:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:02.652 08:58:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:02.652 08:58:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:02.652 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:02.652 08:58:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:02.652 08:58:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:02.652 08:58:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:02.652 08:58:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:02.652 08:58:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:02.652 08:58:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:02.652 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:02.652 08:58:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:02.652 08:58:51 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:02.652 08:58:51 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:02.652 08:58:51 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:02.652 08:58:51 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:02.652 08:58:51 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:02.652 08:58:51 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:02.652 08:58:51 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:02.652 08:58:51 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:02.652 08:58:51 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:02.652 08:58:51 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:02.653 08:58:51 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:02.653 08:58:51 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:02.653 08:58:51 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:02.653 08:58:51 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:02.653 08:58:51 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:02.653 08:58:51 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:02.653 08:58:51 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:02.913 08:58:51 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:02.913 08:58:51 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:02.913 08:58:51 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:02.913 08:58:51 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:02.913 08:58:51 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:02.913 08:58:51 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:02.913 08:58:51 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:02.913 08:58:51 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:02.913 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:02.913 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.193 ms 00:20:02.913 00:20:02.913 --- 10.0.0.2 ping statistics --- 00:20:02.913 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:02.913 rtt min/avg/max/mdev = 0.193/0.193/0.193/0.000 ms 00:20:02.913 08:58:51 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:02.913 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:02.913 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.113 ms 00:20:02.913 00:20:02.913 --- 10.0.0.1 ping statistics --- 00:20:02.913 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:02.913 rtt min/avg/max/mdev = 0.113/0.113/0.113/0.000 ms 00:20:02.913 08:58:51 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:02.913 08:58:51 -- nvmf/common.sh@410 -- # return 0 00:20:02.913 08:58:51 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:02.913 08:58:51 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:02.913 08:58:51 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:02.913 08:58:51 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:02.913 08:58:51 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:02.913 08:58:51 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:02.913 08:58:51 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:02.913 08:58:51 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:20:02.913 08:58:51 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:02.913 08:58:51 -- common/autotest_common.sh@712 -- # xtrace_disable 00:20:02.913 08:58:51 -- common/autotest_common.sh@10 -- # set +x 00:20:02.913 08:58:51 -- nvmf/common.sh@469 -- # nvmfpid=1544059 00:20:02.913 08:58:51 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:20:02.913 08:58:51 -- nvmf/common.sh@470 -- # waitforlisten 1544059 00:20:02.913 08:58:51 -- common/autotest_common.sh@819 -- # '[' -z 1544059 ']' 00:20:02.913 08:58:51 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:02.913 08:58:51 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:02.913 08:58:51 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:02.913 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:02.913 08:58:51 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:02.913 08:58:51 -- common/autotest_common.sh@10 -- # set +x 00:20:02.913 [2024-07-15 08:58:51.381416] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:20:02.913 [2024-07-15 08:58:51.381493] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:02.913 EAL: No free 2048 kB hugepages reported on node 1 00:20:02.913 [2024-07-15 08:58:51.444355] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:03.173 [2024-07-15 08:58:51.555202] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:03.173 [2024-07-15 08:58:51.555344] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:03.173 [2024-07-15 08:58:51.555359] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:03.173 [2024-07-15 08:58:51.555371] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:03.173 [2024-07-15 08:58:51.555426] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:03.173 [2024-07-15 08:58:51.555506] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:03.173 [2024-07-15 08:58:51.555562] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:03.173 [2024-07-15 08:58:51.555564] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:04.111 08:58:52 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:04.111 08:58:52 -- common/autotest_common.sh@852 -- # return 0 00:20:04.111 08:58:52 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:04.111 08:58:52 -- common/autotest_common.sh@718 -- # xtrace_disable 00:20:04.111 08:58:52 -- common/autotest_common.sh@10 -- # set +x 00:20:04.111 08:58:52 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:04.111 08:58:52 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:20:04.111 08:58:52 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:20:04.111 08:58:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:04.111 08:58:52 -- common/autotest_common.sh@10 -- # set +x 00:20:04.111 Malloc0 00:20:04.111 08:58:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:04.111 08:58:52 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:20:04.111 08:58:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:04.111 08:58:52 -- common/autotest_common.sh@10 -- # set +x 00:20:04.111 Delay0 00:20:04.111 08:58:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:04.111 08:58:52 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:20:04.111 08:58:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:04.111 08:58:52 -- common/autotest_common.sh@10 -- # set +x 00:20:04.111 [2024-07-15 08:58:52.390326] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:04.111 08:58:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:04.111 08:58:52 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:20:04.111 08:58:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:04.111 08:58:52 -- common/autotest_common.sh@10 -- # set +x 00:20:04.111 08:58:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:04.111 08:58:52 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:20:04.111 08:58:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:04.111 08:58:52 -- common/autotest_common.sh@10 -- # set +x 00:20:04.111 08:58:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:04.111 08:58:52 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:20:04.111 08:58:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:04.111 08:58:52 -- common/autotest_common.sh@10 -- # set +x 00:20:04.111 [2024-07-15 08:58:52.418564] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:04.111 08:58:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:04.111 08:58:52 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:20:04.681 08:58:53 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:20:04.681 08:58:53 -- common/autotest_common.sh@1177 -- # local i=0 00:20:04.681 08:58:53 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:20:04.681 08:58:53 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:20:04.681 08:58:53 -- common/autotest_common.sh@1184 -- # sleep 2 00:20:06.579 08:58:55 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:20:06.579 08:58:55 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:20:06.579 08:58:55 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:20:06.579 08:58:55 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:20:06.579 08:58:55 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:20:06.579 08:58:55 -- common/autotest_common.sh@1187 -- # return 0 00:20:06.579 08:58:55 -- target/initiator_timeout.sh@35 -- # fio_pid=1544502 00:20:06.579 08:58:55 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:20:06.579 08:58:55 -- target/initiator_timeout.sh@37 -- # sleep 3 00:20:06.579 [global] 00:20:06.579 thread=1 00:20:06.579 invalidate=1 00:20:06.579 rw=write 00:20:06.579 time_based=1 00:20:06.580 runtime=60 00:20:06.580 ioengine=libaio 00:20:06.580 direct=1 00:20:06.580 bs=4096 00:20:06.580 iodepth=1 00:20:06.580 norandommap=0 00:20:06.580 numjobs=1 00:20:06.580 00:20:06.580 verify_dump=1 00:20:06.580 verify_backlog=512 00:20:06.580 verify_state_save=0 00:20:06.580 do_verify=1 00:20:06.580 verify=crc32c-intel 00:20:06.580 [job0] 00:20:06.580 filename=/dev/nvme0n1 00:20:06.580 Could not set queue depth (nvme0n1) 00:20:06.837 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:06.837 fio-3.35 00:20:06.837 Starting 1 thread 00:20:10.125 08:58:58 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:20:10.125 08:58:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:10.125 08:58:58 -- common/autotest_common.sh@10 -- # set +x 00:20:10.125 true 00:20:10.125 08:58:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:10.125 08:58:58 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:20:10.125 08:58:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:10.125 08:58:58 -- common/autotest_common.sh@10 -- # set +x 00:20:10.125 true 00:20:10.125 08:58:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:10.125 08:58:58 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:20:10.125 08:58:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:10.125 08:58:58 -- common/autotest_common.sh@10 -- # set +x 00:20:10.125 true 00:20:10.125 08:58:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:10.125 08:58:58 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:20:10.125 08:58:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:10.125 08:58:58 -- common/autotest_common.sh@10 -- # set +x 00:20:10.125 true 00:20:10.125 08:58:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:10.125 08:58:58 -- target/initiator_timeout.sh@45 -- # sleep 3 00:20:12.691 08:59:01 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:20:12.691 08:59:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:12.692 08:59:01 -- common/autotest_common.sh@10 -- # set +x 00:20:12.692 true 00:20:12.692 08:59:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:12.692 08:59:01 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:20:12.692 08:59:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:12.692 08:59:01 -- common/autotest_common.sh@10 -- # set +x 00:20:12.692 true 00:20:12.692 08:59:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:12.692 08:59:01 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:20:12.692 08:59:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:12.692 08:59:01 -- common/autotest_common.sh@10 -- # set +x 00:20:12.692 true 00:20:12.692 08:59:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:12.692 08:59:01 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:20:12.692 08:59:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:12.692 08:59:01 -- common/autotest_common.sh@10 -- # set +x 00:20:12.692 true 00:20:12.692 08:59:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:12.692 08:59:01 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:20:12.692 08:59:01 -- target/initiator_timeout.sh@54 -- # wait 1544502 00:21:08.922 00:21:08.922 job0: (groupid=0, jobs=1): err= 0: pid=1544575: Mon Jul 15 08:59:55 2024 00:21:08.922 read: IOPS=40, BW=164KiB/s (168kB/s)(9828KiB/60003msec) 00:21:08.922 slat (nsec): min=5271, max=54243, avg=11923.90, stdev=8621.06 00:21:08.922 clat (usec): min=283, max=40964k, avg=24130.11, stdev=826404.15 00:21:08.922 lat (usec): min=289, max=40964k, avg=24142.04, stdev=826404.38 00:21:08.922 clat percentiles (usec): 00:21:08.922 | 1.00th=[ 297], 5.00th=[ 306], 10.00th=[ 314], 00:21:08.922 | 20.00th=[ 326], 30.00th=[ 343], 40.00th=[ 359], 00:21:08.922 | 50.00th=[ 371], 60.00th=[ 383], 70.00th=[ 408], 00:21:08.922 | 80.00th=[ 474], 90.00th=[ 41157], 95.00th=[ 41157], 00:21:08.922 | 99.00th=[ 42206], 99.50th=[ 42206], 99.90th=[ 42206], 00:21:08.922 | 99.95th=[ 42730], 99.99th=[17112761] 00:21:08.922 write: IOPS=42, BW=171KiB/s (175kB/s)(10.0MiB/60003msec); 0 zone resets 00:21:08.922 slat (usec): min=6, max=7640, avg=17.91, stdev=201.76 00:21:08.922 clat (usec): min=197, max=972, avg=242.67, stdev=28.60 00:21:08.922 lat (usec): min=205, max=7921, avg=260.58, stdev=206.22 00:21:08.922 clat percentiles (usec): 00:21:08.922 | 1.00th=[ 208], 5.00th=[ 215], 10.00th=[ 219], 20.00th=[ 225], 00:21:08.922 | 30.00th=[ 229], 40.00th=[ 233], 50.00th=[ 239], 60.00th=[ 245], 00:21:08.922 | 70.00th=[ 253], 80.00th=[ 260], 90.00th=[ 269], 95.00th=[ 281], 00:21:08.922 | 99.00th=[ 302], 99.50th=[ 310], 99.90th=[ 562], 99.95th=[ 807], 00:21:08.922 | 99.99th=[ 971] 00:21:08.922 bw ( KiB/s): min= 1304, max= 8192, per=100.00%, avg=5120.00, stdev=3064.50, samples=4 00:21:08.922 iops : min= 326, max= 2048, avg=1280.00, stdev=766.12, samples=4 00:21:08.922 lat (usec) : 250=34.30%, 500=56.45%, 750=0.54%, 1000=0.12% 00:21:08.922 lat (msec) : 2=0.04%, 50=8.53%, >=2000=0.02% 00:21:08.922 cpu : usr=0.06%, sys=0.15%, ctx=5020, majf=0, minf=2 00:21:08.922 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:21:08.922 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:08.922 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:08.922 issued rwts: total=2457,2560,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:08.922 latency : target=0, window=0, percentile=100.00%, depth=1 00:21:08.922 00:21:08.922 Run status group 0 (all jobs): 00:21:08.922 READ: bw=164KiB/s (168kB/s), 164KiB/s-164KiB/s (168kB/s-168kB/s), io=9828KiB (10.1MB), run=60003-60003msec 00:21:08.922 WRITE: bw=171KiB/s (175kB/s), 171KiB/s-171KiB/s (175kB/s-175kB/s), io=10.0MiB (10.5MB), run=60003-60003msec 00:21:08.922 00:21:08.922 Disk stats (read/write): 00:21:08.922 nvme0n1: ios=2506/2560, merge=0/0, ticks=19458/587, in_queue=20045, util=99.99% 00:21:08.922 08:59:55 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:21:08.922 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:21:08.922 08:59:55 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:21:08.922 08:59:55 -- common/autotest_common.sh@1198 -- # local i=0 00:21:08.922 08:59:55 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:21:08.922 08:59:55 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:21:08.922 08:59:55 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:21:08.922 08:59:55 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:21:08.922 08:59:55 -- common/autotest_common.sh@1210 -- # return 0 00:21:08.922 08:59:55 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:21:08.922 08:59:55 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:21:08.922 nvmf hotplug test: fio successful as expected 00:21:08.922 08:59:55 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:08.922 08:59:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:08.922 08:59:55 -- common/autotest_common.sh@10 -- # set +x 00:21:08.922 08:59:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:08.922 08:59:55 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:21:08.922 08:59:55 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:21:08.922 08:59:55 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:21:08.922 08:59:55 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:08.923 08:59:55 -- nvmf/common.sh@116 -- # sync 00:21:08.923 08:59:55 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:08.923 08:59:55 -- nvmf/common.sh@119 -- # set +e 00:21:08.923 08:59:55 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:08.923 08:59:55 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:08.923 rmmod nvme_tcp 00:21:08.923 rmmod nvme_fabrics 00:21:08.923 rmmod nvme_keyring 00:21:08.923 08:59:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:08.923 08:59:55 -- nvmf/common.sh@123 -- # set -e 00:21:08.923 08:59:55 -- nvmf/common.sh@124 -- # return 0 00:21:08.923 08:59:55 -- nvmf/common.sh@477 -- # '[' -n 1544059 ']' 00:21:08.923 08:59:55 -- nvmf/common.sh@478 -- # killprocess 1544059 00:21:08.923 08:59:55 -- common/autotest_common.sh@926 -- # '[' -z 1544059 ']' 00:21:08.923 08:59:55 -- common/autotest_common.sh@930 -- # kill -0 1544059 00:21:08.923 08:59:55 -- common/autotest_common.sh@931 -- # uname 00:21:08.923 08:59:55 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:21:08.923 08:59:55 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1544059 00:21:08.923 08:59:55 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:21:08.923 08:59:55 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:21:08.923 08:59:55 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1544059' 00:21:08.923 killing process with pid 1544059 00:21:08.923 08:59:55 -- common/autotest_common.sh@945 -- # kill 1544059 00:21:08.923 08:59:55 -- common/autotest_common.sh@950 -- # wait 1544059 00:21:08.923 08:59:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:08.923 08:59:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:08.923 08:59:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:08.923 08:59:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:08.923 08:59:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:08.923 08:59:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:08.923 08:59:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:08.923 08:59:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:09.492 08:59:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:09.492 00:21:09.492 real 1m8.709s 00:21:09.492 user 4m13.252s 00:21:09.492 sys 0m6.614s 00:21:09.492 08:59:57 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:21:09.492 08:59:57 -- common/autotest_common.sh@10 -- # set +x 00:21:09.492 ************************************ 00:21:09.492 END TEST nvmf_initiator_timeout 00:21:09.492 ************************************ 00:21:09.492 08:59:57 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:21:09.492 08:59:57 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:21:09.492 08:59:57 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:21:09.492 08:59:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:09.492 08:59:57 -- common/autotest_common.sh@10 -- # set +x 00:21:12.025 08:59:59 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:12.025 08:59:59 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:12.025 08:59:59 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:12.025 08:59:59 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:12.025 08:59:59 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:12.025 08:59:59 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:12.025 08:59:59 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:12.025 08:59:59 -- nvmf/common.sh@294 -- # net_devs=() 00:21:12.025 08:59:59 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:12.025 08:59:59 -- nvmf/common.sh@295 -- # e810=() 00:21:12.025 08:59:59 -- nvmf/common.sh@295 -- # local -ga e810 00:21:12.025 08:59:59 -- nvmf/common.sh@296 -- # x722=() 00:21:12.025 08:59:59 -- nvmf/common.sh@296 -- # local -ga x722 00:21:12.025 08:59:59 -- nvmf/common.sh@297 -- # mlx=() 00:21:12.025 08:59:59 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:12.025 08:59:59 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:12.025 08:59:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:12.025 08:59:59 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:12.025 08:59:59 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:12.025 08:59:59 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:12.025 08:59:59 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:12.025 08:59:59 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:12.025 08:59:59 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:12.025 08:59:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:12.025 08:59:59 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:12.025 08:59:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:12.025 08:59:59 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:12.025 08:59:59 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:12.025 08:59:59 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:12.025 08:59:59 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:12.025 08:59:59 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:12.025 08:59:59 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:12.025 08:59:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:12.025 08:59:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:12.025 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:12.025 08:59:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:12.025 08:59:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:12.025 08:59:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:12.025 08:59:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:12.025 08:59:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:12.025 08:59:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:12.025 08:59:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:12.025 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:12.025 08:59:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:12.025 08:59:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:12.025 08:59:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:12.025 08:59:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:12.025 08:59:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:12.025 08:59:59 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:12.025 08:59:59 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:12.025 08:59:59 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:12.025 08:59:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:12.025 08:59:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:12.025 08:59:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:12.025 09:00:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:12.025 09:00:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:12.025 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:12.025 09:00:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:12.025 09:00:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:12.025 09:00:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:12.025 09:00:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:12.025 09:00:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:12.025 09:00:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:12.025 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:12.025 09:00:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:12.025 09:00:00 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:12.025 09:00:00 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:12.025 09:00:00 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:21:12.025 09:00:00 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:12.025 09:00:00 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:21:12.025 09:00:00 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:21:12.025 09:00:00 -- common/autotest_common.sh@10 -- # set +x 00:21:12.025 ************************************ 00:21:12.025 START TEST nvmf_perf_adq 00:21:12.025 ************************************ 00:21:12.025 09:00:00 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:12.025 * Looking for test storage... 00:21:12.025 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:12.025 09:00:00 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:12.025 09:00:00 -- nvmf/common.sh@7 -- # uname -s 00:21:12.025 09:00:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:12.025 09:00:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:12.025 09:00:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:12.025 09:00:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:12.025 09:00:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:12.025 09:00:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:12.025 09:00:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:12.025 09:00:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:12.025 09:00:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:12.025 09:00:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:12.025 09:00:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:12.025 09:00:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:12.025 09:00:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:12.025 09:00:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:12.025 09:00:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:12.025 09:00:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:12.025 09:00:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:12.025 09:00:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:12.025 09:00:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:12.025 09:00:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:12.026 09:00:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:12.026 09:00:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:12.026 09:00:00 -- paths/export.sh@5 -- # export PATH 00:21:12.026 09:00:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:12.026 09:00:00 -- nvmf/common.sh@46 -- # : 0 00:21:12.026 09:00:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:12.026 09:00:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:12.026 09:00:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:12.026 09:00:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:12.026 09:00:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:12.026 09:00:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:12.026 09:00:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:12.026 09:00:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:12.026 09:00:00 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:21:12.026 09:00:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:12.026 09:00:00 -- common/autotest_common.sh@10 -- # set +x 00:21:13.920 09:00:01 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:13.920 09:00:01 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:13.920 09:00:01 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:13.920 09:00:01 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:13.920 09:00:01 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:13.920 09:00:01 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:13.920 09:00:01 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:13.920 09:00:01 -- nvmf/common.sh@294 -- # net_devs=() 00:21:13.920 09:00:01 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:13.920 09:00:01 -- nvmf/common.sh@295 -- # e810=() 00:21:13.920 09:00:01 -- nvmf/common.sh@295 -- # local -ga e810 00:21:13.920 09:00:01 -- nvmf/common.sh@296 -- # x722=() 00:21:13.920 09:00:01 -- nvmf/common.sh@296 -- # local -ga x722 00:21:13.920 09:00:01 -- nvmf/common.sh@297 -- # mlx=() 00:21:13.920 09:00:01 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:13.920 09:00:01 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:13.920 09:00:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:13.920 09:00:01 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:13.920 09:00:01 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:13.920 09:00:01 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:13.920 09:00:01 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:13.920 09:00:01 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:13.920 09:00:01 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:13.920 09:00:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:13.920 09:00:01 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:13.920 09:00:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:13.920 09:00:01 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:13.920 09:00:01 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:13.920 09:00:01 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:13.920 09:00:01 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:13.920 09:00:01 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:13.920 09:00:01 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:13.920 09:00:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:13.920 09:00:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:13.920 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:13.920 09:00:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:13.920 09:00:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:13.920 09:00:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:13.920 09:00:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:13.920 09:00:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:13.920 09:00:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:13.920 09:00:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:13.920 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:13.920 09:00:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:13.920 09:00:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:13.920 09:00:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:13.920 09:00:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:13.920 09:00:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:13.920 09:00:01 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:13.920 09:00:01 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:13.920 09:00:01 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:13.920 09:00:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:13.920 09:00:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:13.920 09:00:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:13.920 09:00:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:13.920 09:00:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:13.921 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:13.921 09:00:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:13.921 09:00:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:13.921 09:00:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:13.921 09:00:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:13.921 09:00:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:13.921 09:00:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:13.921 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:13.921 09:00:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:13.921 09:00:01 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:13.921 09:00:01 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:13.921 09:00:01 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:21:13.921 09:00:01 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:21:13.921 09:00:01 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:21:13.921 09:00:01 -- target/perf_adq.sh@52 -- # rmmod ice 00:21:14.177 09:00:02 -- target/perf_adq.sh@53 -- # modprobe ice 00:21:16.080 09:00:04 -- target/perf_adq.sh@54 -- # sleep 5 00:21:21.346 09:00:09 -- target/perf_adq.sh@67 -- # nvmftestinit 00:21:21.346 09:00:09 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:21.346 09:00:09 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:21.346 09:00:09 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:21.346 09:00:09 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:21.346 09:00:09 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:21.346 09:00:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:21.346 09:00:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:21.346 09:00:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:21.346 09:00:09 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:21.346 09:00:09 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:21.346 09:00:09 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:21.346 09:00:09 -- common/autotest_common.sh@10 -- # set +x 00:21:21.346 09:00:09 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:21.346 09:00:09 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:21.346 09:00:09 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:21.346 09:00:09 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:21.346 09:00:09 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:21.346 09:00:09 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:21.346 09:00:09 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:21.346 09:00:09 -- nvmf/common.sh@294 -- # net_devs=() 00:21:21.346 09:00:09 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:21.346 09:00:09 -- nvmf/common.sh@295 -- # e810=() 00:21:21.346 09:00:09 -- nvmf/common.sh@295 -- # local -ga e810 00:21:21.346 09:00:09 -- nvmf/common.sh@296 -- # x722=() 00:21:21.346 09:00:09 -- nvmf/common.sh@296 -- # local -ga x722 00:21:21.346 09:00:09 -- nvmf/common.sh@297 -- # mlx=() 00:21:21.346 09:00:09 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:21.346 09:00:09 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:21.346 09:00:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:21.346 09:00:09 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:21.346 09:00:09 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:21.346 09:00:09 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:21.346 09:00:09 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:21.346 09:00:09 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:21.346 09:00:09 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:21.346 09:00:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:21.346 09:00:09 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:21.346 09:00:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:21.346 09:00:09 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:21.346 09:00:09 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:21.346 09:00:09 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:21.346 09:00:09 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:21.346 09:00:09 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:21.346 09:00:09 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:21.346 09:00:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:21.346 09:00:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:21.346 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:21.346 09:00:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:21.346 09:00:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:21.346 09:00:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:21.346 09:00:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:21.346 09:00:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:21.346 09:00:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:21.346 09:00:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:21.346 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:21.346 09:00:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:21.346 09:00:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:21.346 09:00:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:21.346 09:00:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:21.346 09:00:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:21.346 09:00:09 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:21.346 09:00:09 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:21.346 09:00:09 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:21.346 09:00:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:21.346 09:00:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:21.346 09:00:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:21.346 09:00:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:21.346 09:00:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:21.346 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:21.346 09:00:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:21.346 09:00:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:21.346 09:00:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:21.346 09:00:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:21.346 09:00:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:21.346 09:00:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:21.346 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:21.346 09:00:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:21.346 09:00:09 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:21.346 09:00:09 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:21.346 09:00:09 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:21.346 09:00:09 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:21.346 09:00:09 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:21.346 09:00:09 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:21.346 09:00:09 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:21.346 09:00:09 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:21.346 09:00:09 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:21.346 09:00:09 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:21.346 09:00:09 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:21.346 09:00:09 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:21.346 09:00:09 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:21.346 09:00:09 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:21.346 09:00:09 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:21.346 09:00:09 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:21.346 09:00:09 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:21.346 09:00:09 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:21.346 09:00:09 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:21.346 09:00:09 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:21.346 09:00:09 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:21.346 09:00:09 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:21.346 09:00:09 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:21.346 09:00:09 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:21.346 09:00:09 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:21.346 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:21.346 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.203 ms 00:21:21.346 00:21:21.346 --- 10.0.0.2 ping statistics --- 00:21:21.346 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:21.346 rtt min/avg/max/mdev = 0.203/0.203/0.203/0.000 ms 00:21:21.346 09:00:09 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:21.346 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:21.346 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.165 ms 00:21:21.346 00:21:21.346 --- 10.0.0.1 ping statistics --- 00:21:21.346 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:21.346 rtt min/avg/max/mdev = 0.165/0.165/0.165/0.000 ms 00:21:21.346 09:00:09 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:21.346 09:00:09 -- nvmf/common.sh@410 -- # return 0 00:21:21.346 09:00:09 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:21.346 09:00:09 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:21.347 09:00:09 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:21.347 09:00:09 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:21.347 09:00:09 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:21.347 09:00:09 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:21.347 09:00:09 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:21.347 09:00:09 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:21:21.347 09:00:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:21.347 09:00:09 -- common/autotest_common.sh@712 -- # xtrace_disable 00:21:21.347 09:00:09 -- common/autotest_common.sh@10 -- # set +x 00:21:21.347 09:00:09 -- nvmf/common.sh@469 -- # nvmfpid=1557006 00:21:21.347 09:00:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:21:21.347 09:00:09 -- nvmf/common.sh@470 -- # waitforlisten 1557006 00:21:21.347 09:00:09 -- common/autotest_common.sh@819 -- # '[' -z 1557006 ']' 00:21:21.347 09:00:09 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:21.347 09:00:09 -- common/autotest_common.sh@824 -- # local max_retries=100 00:21:21.347 09:00:09 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:21.347 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:21.347 09:00:09 -- common/autotest_common.sh@828 -- # xtrace_disable 00:21:21.347 09:00:09 -- common/autotest_common.sh@10 -- # set +x 00:21:21.347 [2024-07-15 09:00:09.804439] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:21:21.347 [2024-07-15 09:00:09.804515] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:21.347 EAL: No free 2048 kB hugepages reported on node 1 00:21:21.347 [2024-07-15 09:00:09.873419] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:21.606 [2024-07-15 09:00:09.992460] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:21.606 [2024-07-15 09:00:09.992629] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:21.606 [2024-07-15 09:00:09.992657] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:21.606 [2024-07-15 09:00:09.992673] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:21.606 [2024-07-15 09:00:09.992762] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:21.606 [2024-07-15 09:00:09.992813] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:21.606 [2024-07-15 09:00:09.992948] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:21.606 [2024-07-15 09:00:09.992952] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:22.203 09:00:10 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:21:22.203 09:00:10 -- common/autotest_common.sh@852 -- # return 0 00:21:22.203 09:00:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:22.203 09:00:10 -- common/autotest_common.sh@718 -- # xtrace_disable 00:21:22.203 09:00:10 -- common/autotest_common.sh@10 -- # set +x 00:21:22.461 09:00:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:22.461 09:00:10 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:21:22.461 09:00:10 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:21:22.461 09:00:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:22.461 09:00:10 -- common/autotest_common.sh@10 -- # set +x 00:21:22.461 09:00:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:22.461 09:00:10 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:21:22.461 09:00:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:22.461 09:00:10 -- common/autotest_common.sh@10 -- # set +x 00:21:22.461 09:00:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:22.461 09:00:10 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:21:22.461 09:00:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:22.461 09:00:10 -- common/autotest_common.sh@10 -- # set +x 00:21:22.461 [2024-07-15 09:00:10.860502] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:22.461 09:00:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:22.461 09:00:10 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:21:22.461 09:00:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:22.462 09:00:10 -- common/autotest_common.sh@10 -- # set +x 00:21:22.462 Malloc1 00:21:22.462 09:00:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:22.462 09:00:10 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:22.462 09:00:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:22.462 09:00:10 -- common/autotest_common.sh@10 -- # set +x 00:21:22.462 09:00:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:22.462 09:00:10 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:21:22.462 09:00:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:22.462 09:00:10 -- common/autotest_common.sh@10 -- # set +x 00:21:22.462 09:00:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:22.462 09:00:10 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:22.462 09:00:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:22.462 09:00:10 -- common/autotest_common.sh@10 -- # set +x 00:21:22.462 [2024-07-15 09:00:10.911574] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:22.462 09:00:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:22.462 09:00:10 -- target/perf_adq.sh@73 -- # perfpid=1557170 00:21:22.462 09:00:10 -- target/perf_adq.sh@74 -- # sleep 2 00:21:22.462 09:00:10 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:21:22.462 EAL: No free 2048 kB hugepages reported on node 1 00:21:24.994 09:00:12 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:21:24.994 09:00:12 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:21:24.994 09:00:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:24.994 09:00:12 -- target/perf_adq.sh@76 -- # wc -l 00:21:24.994 09:00:12 -- common/autotest_common.sh@10 -- # set +x 00:21:24.994 09:00:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:24.994 09:00:12 -- target/perf_adq.sh@76 -- # count=4 00:21:24.994 09:00:12 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:21:24.994 09:00:12 -- target/perf_adq.sh@81 -- # wait 1557170 00:21:33.112 Initializing NVMe Controllers 00:21:33.112 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:21:33.112 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:21:33.112 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:21:33.112 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:21:33.112 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:21:33.112 Initialization complete. Launching workers. 00:21:33.112 ======================================================== 00:21:33.112 Latency(us) 00:21:33.112 Device Information : IOPS MiB/s Average min max 00:21:33.112 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 10111.33 39.50 6331.67 3775.29 8901.69 00:21:33.112 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 11519.93 45.00 5557.37 1144.42 8506.17 00:21:33.112 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 11616.23 45.38 5508.99 1315.91 9264.32 00:21:33.112 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 11859.61 46.33 5396.57 1350.38 8785.78 00:21:33.112 ======================================================== 00:21:33.112 Total : 45107.10 176.20 5676.20 1144.42 9264.32 00:21:33.112 00:21:33.112 09:00:21 -- target/perf_adq.sh@82 -- # nvmftestfini 00:21:33.112 09:00:21 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:33.112 09:00:21 -- nvmf/common.sh@116 -- # sync 00:21:33.112 09:00:21 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:33.112 09:00:21 -- nvmf/common.sh@119 -- # set +e 00:21:33.112 09:00:21 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:33.112 09:00:21 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:33.112 rmmod nvme_tcp 00:21:33.112 rmmod nvme_fabrics 00:21:33.112 rmmod nvme_keyring 00:21:33.112 09:00:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:33.112 09:00:21 -- nvmf/common.sh@123 -- # set -e 00:21:33.112 09:00:21 -- nvmf/common.sh@124 -- # return 0 00:21:33.112 09:00:21 -- nvmf/common.sh@477 -- # '[' -n 1557006 ']' 00:21:33.112 09:00:21 -- nvmf/common.sh@478 -- # killprocess 1557006 00:21:33.112 09:00:21 -- common/autotest_common.sh@926 -- # '[' -z 1557006 ']' 00:21:33.112 09:00:21 -- common/autotest_common.sh@930 -- # kill -0 1557006 00:21:33.113 09:00:21 -- common/autotest_common.sh@931 -- # uname 00:21:33.113 09:00:21 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:21:33.113 09:00:21 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1557006 00:21:33.113 09:00:21 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:21:33.113 09:00:21 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:21:33.113 09:00:21 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1557006' 00:21:33.113 killing process with pid 1557006 00:21:33.113 09:00:21 -- common/autotest_common.sh@945 -- # kill 1557006 00:21:33.113 09:00:21 -- common/autotest_common.sh@950 -- # wait 1557006 00:21:33.113 09:00:21 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:33.113 09:00:21 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:33.113 09:00:21 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:33.113 09:00:21 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:33.113 09:00:21 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:33.113 09:00:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:33.113 09:00:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:33.113 09:00:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:35.014 09:00:23 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:35.014 09:00:23 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:21:35.014 09:00:23 -- target/perf_adq.sh@52 -- # rmmod ice 00:21:35.945 09:00:24 -- target/perf_adq.sh@53 -- # modprobe ice 00:21:37.845 09:00:26 -- target/perf_adq.sh@54 -- # sleep 5 00:21:43.104 09:00:31 -- target/perf_adq.sh@87 -- # nvmftestinit 00:21:43.104 09:00:31 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:43.104 09:00:31 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:43.104 09:00:31 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:43.104 09:00:31 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:43.104 09:00:31 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:43.104 09:00:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:43.104 09:00:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:43.104 09:00:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:43.104 09:00:31 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:43.104 09:00:31 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:43.104 09:00:31 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:43.104 09:00:31 -- common/autotest_common.sh@10 -- # set +x 00:21:43.104 09:00:31 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:43.104 09:00:31 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:43.104 09:00:31 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:43.104 09:00:31 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:43.104 09:00:31 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:43.104 09:00:31 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:43.104 09:00:31 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:43.104 09:00:31 -- nvmf/common.sh@294 -- # net_devs=() 00:21:43.104 09:00:31 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:43.104 09:00:31 -- nvmf/common.sh@295 -- # e810=() 00:21:43.104 09:00:31 -- nvmf/common.sh@295 -- # local -ga e810 00:21:43.104 09:00:31 -- nvmf/common.sh@296 -- # x722=() 00:21:43.104 09:00:31 -- nvmf/common.sh@296 -- # local -ga x722 00:21:43.104 09:00:31 -- nvmf/common.sh@297 -- # mlx=() 00:21:43.104 09:00:31 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:43.104 09:00:31 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:43.104 09:00:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:43.104 09:00:31 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:43.104 09:00:31 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:43.104 09:00:31 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:43.104 09:00:31 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:43.104 09:00:31 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:43.104 09:00:31 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:43.104 09:00:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:43.104 09:00:31 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:43.104 09:00:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:43.104 09:00:31 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:43.104 09:00:31 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:43.104 09:00:31 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:43.104 09:00:31 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:43.104 09:00:31 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:43.104 09:00:31 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:43.104 09:00:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:43.104 09:00:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:43.104 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:43.104 09:00:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:43.104 09:00:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:43.104 09:00:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:43.104 09:00:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:43.104 09:00:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:43.104 09:00:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:43.104 09:00:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:43.104 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:43.104 09:00:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:43.104 09:00:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:43.104 09:00:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:43.104 09:00:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:43.104 09:00:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:43.104 09:00:31 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:43.104 09:00:31 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:43.104 09:00:31 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:43.104 09:00:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:43.104 09:00:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:43.104 09:00:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:43.104 09:00:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:43.104 09:00:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:43.104 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:43.104 09:00:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:43.104 09:00:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:43.104 09:00:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:43.104 09:00:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:43.104 09:00:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:43.104 09:00:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:43.104 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:43.104 09:00:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:43.104 09:00:31 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:43.104 09:00:31 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:43.104 09:00:31 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:43.104 09:00:31 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:43.104 09:00:31 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:43.104 09:00:31 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:43.104 09:00:31 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:43.104 09:00:31 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:43.104 09:00:31 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:43.104 09:00:31 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:43.104 09:00:31 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:43.104 09:00:31 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:43.104 09:00:31 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:43.104 09:00:31 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:43.104 09:00:31 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:43.104 09:00:31 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:43.104 09:00:31 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:43.104 09:00:31 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:43.104 09:00:31 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:43.104 09:00:31 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:43.104 09:00:31 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:43.104 09:00:31 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:43.104 09:00:31 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:43.104 09:00:31 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:43.104 09:00:31 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:43.104 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:43.104 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.144 ms 00:21:43.104 00:21:43.104 --- 10.0.0.2 ping statistics --- 00:21:43.104 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:43.104 rtt min/avg/max/mdev = 0.144/0.144/0.144/0.000 ms 00:21:43.104 09:00:31 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:43.104 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:43.104 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.200 ms 00:21:43.104 00:21:43.104 --- 10.0.0.1 ping statistics --- 00:21:43.104 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:43.104 rtt min/avg/max/mdev = 0.200/0.200/0.200/0.000 ms 00:21:43.104 09:00:31 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:43.104 09:00:31 -- nvmf/common.sh@410 -- # return 0 00:21:43.104 09:00:31 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:43.104 09:00:31 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:43.104 09:00:31 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:43.104 09:00:31 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:43.105 09:00:31 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:43.105 09:00:31 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:43.105 09:00:31 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:43.105 09:00:31 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:21:43.105 09:00:31 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:21:43.105 09:00:31 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:21:43.105 09:00:31 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:21:43.105 net.core.busy_poll = 1 00:21:43.105 09:00:31 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:21:43.105 net.core.busy_read = 1 00:21:43.105 09:00:31 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:21:43.105 09:00:31 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:21:43.105 09:00:31 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:21:43.105 09:00:31 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:21:43.105 09:00:31 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:21:43.105 09:00:31 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:21:43.105 09:00:31 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:43.105 09:00:31 -- common/autotest_common.sh@712 -- # xtrace_disable 00:21:43.105 09:00:31 -- common/autotest_common.sh@10 -- # set +x 00:21:43.105 09:00:31 -- nvmf/common.sh@469 -- # nvmfpid=1559905 00:21:43.105 09:00:31 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:21:43.105 09:00:31 -- nvmf/common.sh@470 -- # waitforlisten 1559905 00:21:43.105 09:00:31 -- common/autotest_common.sh@819 -- # '[' -z 1559905 ']' 00:21:43.105 09:00:31 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:43.105 09:00:31 -- common/autotest_common.sh@824 -- # local max_retries=100 00:21:43.105 09:00:31 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:43.105 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:43.105 09:00:31 -- common/autotest_common.sh@828 -- # xtrace_disable 00:21:43.105 09:00:31 -- common/autotest_common.sh@10 -- # set +x 00:21:43.105 [2024-07-15 09:00:31.463081] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:21:43.105 [2024-07-15 09:00:31.463170] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:43.105 EAL: No free 2048 kB hugepages reported on node 1 00:21:43.105 [2024-07-15 09:00:31.529100] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:43.105 [2024-07-15 09:00:31.638543] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:43.105 [2024-07-15 09:00:31.638705] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:43.105 [2024-07-15 09:00:31.638722] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:43.105 [2024-07-15 09:00:31.638734] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:43.105 [2024-07-15 09:00:31.638791] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:43.105 [2024-07-15 09:00:31.638849] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:43.105 [2024-07-15 09:00:31.638916] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:43.105 [2024-07-15 09:00:31.638919] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:43.363 09:00:31 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:21:43.363 09:00:31 -- common/autotest_common.sh@852 -- # return 0 00:21:43.363 09:00:31 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:43.363 09:00:31 -- common/autotest_common.sh@718 -- # xtrace_disable 00:21:43.363 09:00:31 -- common/autotest_common.sh@10 -- # set +x 00:21:43.363 09:00:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:43.363 09:00:31 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:21:43.363 09:00:31 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:21:43.363 09:00:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:43.363 09:00:31 -- common/autotest_common.sh@10 -- # set +x 00:21:43.363 09:00:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:43.363 09:00:31 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:21:43.363 09:00:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:43.363 09:00:31 -- common/autotest_common.sh@10 -- # set +x 00:21:43.363 09:00:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:43.363 09:00:31 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:21:43.363 09:00:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:43.363 09:00:31 -- common/autotest_common.sh@10 -- # set +x 00:21:43.363 [2024-07-15 09:00:31.817804] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:43.363 09:00:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:43.363 09:00:31 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:21:43.363 09:00:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:43.363 09:00:31 -- common/autotest_common.sh@10 -- # set +x 00:21:43.363 Malloc1 00:21:43.363 09:00:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:43.363 09:00:31 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:43.363 09:00:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:43.363 09:00:31 -- common/autotest_common.sh@10 -- # set +x 00:21:43.363 09:00:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:43.363 09:00:31 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:21:43.363 09:00:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:43.363 09:00:31 -- common/autotest_common.sh@10 -- # set +x 00:21:43.363 09:00:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:43.363 09:00:31 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:43.363 09:00:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:43.363 09:00:31 -- common/autotest_common.sh@10 -- # set +x 00:21:43.363 [2024-07-15 09:00:31.871343] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:43.363 09:00:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:43.363 09:00:31 -- target/perf_adq.sh@94 -- # perfpid=1560002 00:21:43.363 09:00:31 -- target/perf_adq.sh@95 -- # sleep 2 00:21:43.363 09:00:31 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:21:43.363 EAL: No free 2048 kB hugepages reported on node 1 00:21:45.891 09:00:33 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:21:45.891 09:00:33 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:21:45.891 09:00:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:45.891 09:00:33 -- target/perf_adq.sh@97 -- # wc -l 00:21:45.891 09:00:33 -- common/autotest_common.sh@10 -- # set +x 00:21:45.891 09:00:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:45.891 09:00:33 -- target/perf_adq.sh@97 -- # count=2 00:21:45.891 09:00:33 -- target/perf_adq.sh@98 -- # [[ 2 -lt 2 ]] 00:21:45.891 09:00:33 -- target/perf_adq.sh@103 -- # wait 1560002 00:21:54.097 Initializing NVMe Controllers 00:21:54.097 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:21:54.097 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:21:54.097 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:21:54.097 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:21:54.097 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:21:54.097 Initialization complete. Launching workers. 00:21:54.097 ======================================================== 00:21:54.097 Latency(us) 00:21:54.097 Device Information : IOPS MiB/s Average min max 00:21:54.097 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 14441.63 56.41 4432.18 1091.56 45053.77 00:21:54.097 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 5178.47 20.23 12362.04 2047.84 58666.82 00:21:54.097 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 4623.58 18.06 13845.40 1730.07 61177.80 00:21:54.097 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 4619.58 18.05 13882.05 1503.99 62997.51 00:21:54.097 ======================================================== 00:21:54.097 Total : 28863.25 112.75 8875.26 1091.56 62997.51 00:21:54.097 00:21:54.097 09:00:42 -- target/perf_adq.sh@104 -- # nvmftestfini 00:21:54.097 09:00:42 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:54.097 09:00:42 -- nvmf/common.sh@116 -- # sync 00:21:54.097 09:00:42 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:54.097 09:00:42 -- nvmf/common.sh@119 -- # set +e 00:21:54.097 09:00:42 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:54.097 09:00:42 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:54.097 rmmod nvme_tcp 00:21:54.097 rmmod nvme_fabrics 00:21:54.097 rmmod nvme_keyring 00:21:54.097 09:00:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:54.097 09:00:42 -- nvmf/common.sh@123 -- # set -e 00:21:54.097 09:00:42 -- nvmf/common.sh@124 -- # return 0 00:21:54.097 09:00:42 -- nvmf/common.sh@477 -- # '[' -n 1559905 ']' 00:21:54.097 09:00:42 -- nvmf/common.sh@478 -- # killprocess 1559905 00:21:54.097 09:00:42 -- common/autotest_common.sh@926 -- # '[' -z 1559905 ']' 00:21:54.097 09:00:42 -- common/autotest_common.sh@930 -- # kill -0 1559905 00:21:54.097 09:00:42 -- common/autotest_common.sh@931 -- # uname 00:21:54.097 09:00:42 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:21:54.097 09:00:42 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1559905 00:21:54.097 09:00:42 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:21:54.097 09:00:42 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:21:54.097 09:00:42 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1559905' 00:21:54.097 killing process with pid 1559905 00:21:54.097 09:00:42 -- common/autotest_common.sh@945 -- # kill 1559905 00:21:54.097 09:00:42 -- common/autotest_common.sh@950 -- # wait 1559905 00:21:54.097 09:00:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:54.097 09:00:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:54.097 09:00:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:54.097 09:00:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:54.097 09:00:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:54.097 09:00:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:54.097 09:00:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:54.097 09:00:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:57.383 09:00:45 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:57.384 09:00:45 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:21:57.384 00:21:57.384 real 0m45.474s 00:21:57.384 user 2m39.037s 00:21:57.384 sys 0m10.909s 00:21:57.384 09:00:45 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:21:57.384 09:00:45 -- common/autotest_common.sh@10 -- # set +x 00:21:57.384 ************************************ 00:21:57.384 END TEST nvmf_perf_adq 00:21:57.384 ************************************ 00:21:57.384 09:00:45 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:21:57.384 09:00:45 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:21:57.384 09:00:45 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:21:57.384 09:00:45 -- common/autotest_common.sh@10 -- # set +x 00:21:57.384 ************************************ 00:21:57.384 START TEST nvmf_shutdown 00:21:57.384 ************************************ 00:21:57.384 09:00:45 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:21:57.384 * Looking for test storage... 00:21:57.384 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:57.384 09:00:45 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:57.384 09:00:45 -- nvmf/common.sh@7 -- # uname -s 00:21:57.384 09:00:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:57.384 09:00:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:57.384 09:00:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:57.384 09:00:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:57.384 09:00:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:57.384 09:00:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:57.384 09:00:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:57.384 09:00:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:57.384 09:00:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:57.384 09:00:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:57.384 09:00:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:57.384 09:00:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:57.384 09:00:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:57.384 09:00:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:57.384 09:00:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:57.384 09:00:45 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:57.384 09:00:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:57.384 09:00:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:57.384 09:00:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:57.384 09:00:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:57.384 09:00:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:57.384 09:00:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:57.384 09:00:45 -- paths/export.sh@5 -- # export PATH 00:21:57.384 09:00:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:57.384 09:00:45 -- nvmf/common.sh@46 -- # : 0 00:21:57.384 09:00:45 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:57.384 09:00:45 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:57.384 09:00:45 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:57.384 09:00:45 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:57.384 09:00:45 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:57.384 09:00:45 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:57.384 09:00:45 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:57.384 09:00:45 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:57.384 09:00:45 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:21:57.384 09:00:45 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:21:57.384 09:00:45 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:21:57.384 09:00:45 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:21:57.384 09:00:45 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:21:57.384 09:00:45 -- common/autotest_common.sh@10 -- # set +x 00:21:57.384 ************************************ 00:21:57.384 START TEST nvmf_shutdown_tc1 00:21:57.384 ************************************ 00:21:57.384 09:00:45 -- common/autotest_common.sh@1104 -- # nvmf_shutdown_tc1 00:21:57.384 09:00:45 -- target/shutdown.sh@74 -- # starttarget 00:21:57.384 09:00:45 -- target/shutdown.sh@15 -- # nvmftestinit 00:21:57.384 09:00:45 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:57.384 09:00:45 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:57.384 09:00:45 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:57.384 09:00:45 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:57.384 09:00:45 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:57.384 09:00:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:57.384 09:00:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:57.384 09:00:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:57.384 09:00:45 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:57.384 09:00:45 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:57.384 09:00:45 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:57.384 09:00:45 -- common/autotest_common.sh@10 -- # set +x 00:21:59.287 09:00:47 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:59.287 09:00:47 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:59.287 09:00:47 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:59.287 09:00:47 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:59.287 09:00:47 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:59.287 09:00:47 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:59.287 09:00:47 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:59.287 09:00:47 -- nvmf/common.sh@294 -- # net_devs=() 00:21:59.287 09:00:47 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:59.287 09:00:47 -- nvmf/common.sh@295 -- # e810=() 00:21:59.287 09:00:47 -- nvmf/common.sh@295 -- # local -ga e810 00:21:59.287 09:00:47 -- nvmf/common.sh@296 -- # x722=() 00:21:59.287 09:00:47 -- nvmf/common.sh@296 -- # local -ga x722 00:21:59.287 09:00:47 -- nvmf/common.sh@297 -- # mlx=() 00:21:59.287 09:00:47 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:59.287 09:00:47 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:59.287 09:00:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:59.287 09:00:47 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:59.288 09:00:47 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:59.288 09:00:47 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:59.288 09:00:47 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:59.288 09:00:47 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:59.288 09:00:47 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:59.288 09:00:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:59.288 09:00:47 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:59.288 09:00:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:59.288 09:00:47 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:59.288 09:00:47 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:59.288 09:00:47 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:59.288 09:00:47 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:59.288 09:00:47 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:59.288 09:00:47 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:59.288 09:00:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:59.288 09:00:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:59.288 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:59.288 09:00:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:59.288 09:00:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:59.288 09:00:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:59.288 09:00:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:59.288 09:00:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:59.288 09:00:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:59.288 09:00:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:59.288 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:59.288 09:00:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:59.288 09:00:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:59.288 09:00:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:59.288 09:00:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:59.288 09:00:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:59.288 09:00:47 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:59.288 09:00:47 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:59.288 09:00:47 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:59.288 09:00:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:59.288 09:00:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:59.288 09:00:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:59.288 09:00:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:59.288 09:00:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:59.288 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:59.288 09:00:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:59.288 09:00:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:59.288 09:00:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:59.288 09:00:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:59.288 09:00:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:59.288 09:00:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:59.288 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:59.288 09:00:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:59.288 09:00:47 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:59.288 09:00:47 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:59.288 09:00:47 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:59.288 09:00:47 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:59.288 09:00:47 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:59.288 09:00:47 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:59.288 09:00:47 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:59.288 09:00:47 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:59.288 09:00:47 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:59.288 09:00:47 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:59.288 09:00:47 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:59.288 09:00:47 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:59.288 09:00:47 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:59.288 09:00:47 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:59.288 09:00:47 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:59.288 09:00:47 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:59.288 09:00:47 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:59.288 09:00:47 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:59.288 09:00:47 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:59.288 09:00:47 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:59.288 09:00:47 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:59.288 09:00:47 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:59.288 09:00:47 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:59.288 09:00:47 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:59.288 09:00:47 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:59.288 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:59.288 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.322 ms 00:21:59.288 00:21:59.288 --- 10.0.0.2 ping statistics --- 00:21:59.288 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:59.288 rtt min/avg/max/mdev = 0.322/0.322/0.322/0.000 ms 00:21:59.288 09:00:47 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:59.288 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:59.288 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.180 ms 00:21:59.288 00:21:59.288 --- 10.0.0.1 ping statistics --- 00:21:59.288 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:59.288 rtt min/avg/max/mdev = 0.180/0.180/0.180/0.000 ms 00:21:59.288 09:00:47 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:59.288 09:00:47 -- nvmf/common.sh@410 -- # return 0 00:21:59.288 09:00:47 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:59.288 09:00:47 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:59.288 09:00:47 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:59.288 09:00:47 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:59.288 09:00:47 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:59.288 09:00:47 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:59.288 09:00:47 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:59.288 09:00:47 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:21:59.288 09:00:47 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:59.288 09:00:47 -- common/autotest_common.sh@712 -- # xtrace_disable 00:21:59.288 09:00:47 -- common/autotest_common.sh@10 -- # set +x 00:21:59.288 09:00:47 -- nvmf/common.sh@469 -- # nvmfpid=1563349 00:21:59.288 09:00:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:21:59.288 09:00:47 -- nvmf/common.sh@470 -- # waitforlisten 1563349 00:21:59.288 09:00:47 -- common/autotest_common.sh@819 -- # '[' -z 1563349 ']' 00:21:59.288 09:00:47 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:59.288 09:00:47 -- common/autotest_common.sh@824 -- # local max_retries=100 00:21:59.288 09:00:47 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:59.288 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:59.288 09:00:47 -- common/autotest_common.sh@828 -- # xtrace_disable 00:21:59.288 09:00:47 -- common/autotest_common.sh@10 -- # set +x 00:21:59.288 [2024-07-15 09:00:47.750753] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:21:59.288 [2024-07-15 09:00:47.750813] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:59.288 EAL: No free 2048 kB hugepages reported on node 1 00:21:59.288 [2024-07-15 09:00:47.815264] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:59.547 [2024-07-15 09:00:47.928446] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:59.547 [2024-07-15 09:00:47.928585] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:59.547 [2024-07-15 09:00:47.928602] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:59.547 [2024-07-15 09:00:47.928614] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:59.547 [2024-07-15 09:00:47.928678] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:59.547 [2024-07-15 09:00:47.928743] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:59.547 [2024-07-15 09:00:47.928807] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:21:59.547 [2024-07-15 09:00:47.928810] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:00.480 09:00:48 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:22:00.480 09:00:48 -- common/autotest_common.sh@852 -- # return 0 00:22:00.480 09:00:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:00.480 09:00:48 -- common/autotest_common.sh@718 -- # xtrace_disable 00:22:00.480 09:00:48 -- common/autotest_common.sh@10 -- # set +x 00:22:00.480 09:00:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:00.480 09:00:48 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:00.480 09:00:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:00.480 09:00:48 -- common/autotest_common.sh@10 -- # set +x 00:22:00.480 [2024-07-15 09:00:48.724426] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:00.480 09:00:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:00.480 09:00:48 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:00.480 09:00:48 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:00.480 09:00:48 -- common/autotest_common.sh@712 -- # xtrace_disable 00:22:00.480 09:00:48 -- common/autotest_common.sh@10 -- # set +x 00:22:00.480 09:00:48 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:00.480 09:00:48 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:00.480 09:00:48 -- target/shutdown.sh@28 -- # cat 00:22:00.480 09:00:48 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:00.480 09:00:48 -- target/shutdown.sh@28 -- # cat 00:22:00.480 09:00:48 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:00.480 09:00:48 -- target/shutdown.sh@28 -- # cat 00:22:00.480 09:00:48 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:00.480 09:00:48 -- target/shutdown.sh@28 -- # cat 00:22:00.480 09:00:48 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:00.480 09:00:48 -- target/shutdown.sh@28 -- # cat 00:22:00.480 09:00:48 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:00.480 09:00:48 -- target/shutdown.sh@28 -- # cat 00:22:00.480 09:00:48 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:00.480 09:00:48 -- target/shutdown.sh@28 -- # cat 00:22:00.480 09:00:48 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:00.480 09:00:48 -- target/shutdown.sh@28 -- # cat 00:22:00.480 09:00:48 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:00.480 09:00:48 -- target/shutdown.sh@28 -- # cat 00:22:00.480 09:00:48 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:00.480 09:00:48 -- target/shutdown.sh@28 -- # cat 00:22:00.480 09:00:48 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:00.480 09:00:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:00.480 09:00:48 -- common/autotest_common.sh@10 -- # set +x 00:22:00.480 Malloc1 00:22:00.480 [2024-07-15 09:00:48.803737] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:00.480 Malloc2 00:22:00.480 Malloc3 00:22:00.480 Malloc4 00:22:00.480 Malloc5 00:22:00.739 Malloc6 00:22:00.739 Malloc7 00:22:00.739 Malloc8 00:22:00.739 Malloc9 00:22:00.739 Malloc10 00:22:00.739 09:00:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:00.739 09:00:49 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:00.739 09:00:49 -- common/autotest_common.sh@718 -- # xtrace_disable 00:22:00.739 09:00:49 -- common/autotest_common.sh@10 -- # set +x 00:22:00.739 09:00:49 -- target/shutdown.sh@78 -- # perfpid=1563538 00:22:00.739 09:00:49 -- target/shutdown.sh@79 -- # waitforlisten 1563538 /var/tmp/bdevperf.sock 00:22:00.739 09:00:49 -- common/autotest_common.sh@819 -- # '[' -z 1563538 ']' 00:22:00.739 09:00:49 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:00.739 09:00:49 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:00.739 09:00:49 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:22:00.739 09:00:49 -- common/autotest_common.sh@824 -- # local max_retries=100 00:22:00.739 09:00:49 -- nvmf/common.sh@520 -- # config=() 00:22:00.739 09:00:49 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:00.739 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:00.739 09:00:49 -- nvmf/common.sh@520 -- # local subsystem config 00:22:00.739 09:00:49 -- common/autotest_common.sh@828 -- # xtrace_disable 00:22:00.739 09:00:49 -- common/autotest_common.sh@10 -- # set +x 00:22:00.739 09:00:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:00.739 09:00:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:00.739 { 00:22:00.739 "params": { 00:22:00.739 "name": "Nvme$subsystem", 00:22:00.739 "trtype": "$TEST_TRANSPORT", 00:22:00.739 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:00.739 "adrfam": "ipv4", 00:22:00.739 "trsvcid": "$NVMF_PORT", 00:22:00.740 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:00.740 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:00.740 "hdgst": ${hdgst:-false}, 00:22:00.740 "ddgst": ${ddgst:-false} 00:22:00.740 }, 00:22:00.740 "method": "bdev_nvme_attach_controller" 00:22:00.740 } 00:22:00.740 EOF 00:22:00.740 )") 00:22:00.740 09:00:49 -- nvmf/common.sh@542 -- # cat 00:22:00.740 09:00:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:00.740 09:00:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:00.740 { 00:22:00.740 "params": { 00:22:00.740 "name": "Nvme$subsystem", 00:22:00.740 "trtype": "$TEST_TRANSPORT", 00:22:00.740 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:00.740 "adrfam": "ipv4", 00:22:00.740 "trsvcid": "$NVMF_PORT", 00:22:00.740 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:00.740 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:00.740 "hdgst": ${hdgst:-false}, 00:22:00.740 "ddgst": ${ddgst:-false} 00:22:00.740 }, 00:22:00.740 "method": "bdev_nvme_attach_controller" 00:22:00.740 } 00:22:00.740 EOF 00:22:00.740 )") 00:22:00.740 09:00:49 -- nvmf/common.sh@542 -- # cat 00:22:00.997 09:00:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:00.997 09:00:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:00.997 { 00:22:00.997 "params": { 00:22:00.997 "name": "Nvme$subsystem", 00:22:00.997 "trtype": "$TEST_TRANSPORT", 00:22:00.997 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:00.997 "adrfam": "ipv4", 00:22:00.997 "trsvcid": "$NVMF_PORT", 00:22:00.997 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:00.997 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:00.997 "hdgst": ${hdgst:-false}, 00:22:00.997 "ddgst": ${ddgst:-false} 00:22:00.997 }, 00:22:00.997 "method": "bdev_nvme_attach_controller" 00:22:00.997 } 00:22:00.997 EOF 00:22:00.997 )") 00:22:00.997 09:00:49 -- nvmf/common.sh@542 -- # cat 00:22:00.997 09:00:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:00.997 09:00:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:00.997 { 00:22:00.997 "params": { 00:22:00.997 "name": "Nvme$subsystem", 00:22:00.997 "trtype": "$TEST_TRANSPORT", 00:22:00.997 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:00.997 "adrfam": "ipv4", 00:22:00.997 "trsvcid": "$NVMF_PORT", 00:22:00.997 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:00.997 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:00.997 "hdgst": ${hdgst:-false}, 00:22:00.997 "ddgst": ${ddgst:-false} 00:22:00.997 }, 00:22:00.997 "method": "bdev_nvme_attach_controller" 00:22:00.997 } 00:22:00.997 EOF 00:22:00.997 )") 00:22:00.997 09:00:49 -- nvmf/common.sh@542 -- # cat 00:22:00.997 09:00:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:00.998 09:00:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:00.998 { 00:22:00.998 "params": { 00:22:00.998 "name": "Nvme$subsystem", 00:22:00.998 "trtype": "$TEST_TRANSPORT", 00:22:00.998 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:00.998 "adrfam": "ipv4", 00:22:00.998 "trsvcid": "$NVMF_PORT", 00:22:00.998 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:00.998 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:00.998 "hdgst": ${hdgst:-false}, 00:22:00.998 "ddgst": ${ddgst:-false} 00:22:00.998 }, 00:22:00.998 "method": "bdev_nvme_attach_controller" 00:22:00.998 } 00:22:00.998 EOF 00:22:00.998 )") 00:22:00.998 09:00:49 -- nvmf/common.sh@542 -- # cat 00:22:00.998 09:00:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:00.998 09:00:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:00.998 { 00:22:00.998 "params": { 00:22:00.998 "name": "Nvme$subsystem", 00:22:00.998 "trtype": "$TEST_TRANSPORT", 00:22:00.998 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:00.998 "adrfam": "ipv4", 00:22:00.998 "trsvcid": "$NVMF_PORT", 00:22:00.998 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:00.998 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:00.998 "hdgst": ${hdgst:-false}, 00:22:00.998 "ddgst": ${ddgst:-false} 00:22:00.998 }, 00:22:00.998 "method": "bdev_nvme_attach_controller" 00:22:00.998 } 00:22:00.998 EOF 00:22:00.998 )") 00:22:00.998 09:00:49 -- nvmf/common.sh@542 -- # cat 00:22:00.998 09:00:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:00.998 09:00:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:00.998 { 00:22:00.998 "params": { 00:22:00.998 "name": "Nvme$subsystem", 00:22:00.998 "trtype": "$TEST_TRANSPORT", 00:22:00.998 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:00.998 "adrfam": "ipv4", 00:22:00.998 "trsvcid": "$NVMF_PORT", 00:22:00.998 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:00.998 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:00.998 "hdgst": ${hdgst:-false}, 00:22:00.998 "ddgst": ${ddgst:-false} 00:22:00.998 }, 00:22:00.998 "method": "bdev_nvme_attach_controller" 00:22:00.998 } 00:22:00.998 EOF 00:22:00.998 )") 00:22:00.998 09:00:49 -- nvmf/common.sh@542 -- # cat 00:22:00.998 09:00:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:00.998 09:00:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:00.998 { 00:22:00.998 "params": { 00:22:00.998 "name": "Nvme$subsystem", 00:22:00.998 "trtype": "$TEST_TRANSPORT", 00:22:00.998 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:00.998 "adrfam": "ipv4", 00:22:00.998 "trsvcid": "$NVMF_PORT", 00:22:00.998 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:00.998 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:00.998 "hdgst": ${hdgst:-false}, 00:22:00.998 "ddgst": ${ddgst:-false} 00:22:00.998 }, 00:22:00.998 "method": "bdev_nvme_attach_controller" 00:22:00.998 } 00:22:00.998 EOF 00:22:00.998 )") 00:22:00.998 09:00:49 -- nvmf/common.sh@542 -- # cat 00:22:00.998 09:00:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:00.998 09:00:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:00.998 { 00:22:00.998 "params": { 00:22:00.998 "name": "Nvme$subsystem", 00:22:00.998 "trtype": "$TEST_TRANSPORT", 00:22:00.998 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:00.998 "adrfam": "ipv4", 00:22:00.998 "trsvcid": "$NVMF_PORT", 00:22:00.998 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:00.998 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:00.998 "hdgst": ${hdgst:-false}, 00:22:00.998 "ddgst": ${ddgst:-false} 00:22:00.998 }, 00:22:00.998 "method": "bdev_nvme_attach_controller" 00:22:00.998 } 00:22:00.998 EOF 00:22:00.998 )") 00:22:00.998 09:00:49 -- nvmf/common.sh@542 -- # cat 00:22:00.998 09:00:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:00.998 09:00:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:00.998 { 00:22:00.998 "params": { 00:22:00.998 "name": "Nvme$subsystem", 00:22:00.998 "trtype": "$TEST_TRANSPORT", 00:22:00.998 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:00.998 "adrfam": "ipv4", 00:22:00.998 "trsvcid": "$NVMF_PORT", 00:22:00.998 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:00.998 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:00.998 "hdgst": ${hdgst:-false}, 00:22:00.998 "ddgst": ${ddgst:-false} 00:22:00.998 }, 00:22:00.998 "method": "bdev_nvme_attach_controller" 00:22:00.998 } 00:22:00.998 EOF 00:22:00.998 )") 00:22:00.998 09:00:49 -- nvmf/common.sh@542 -- # cat 00:22:00.998 09:00:49 -- nvmf/common.sh@544 -- # jq . 00:22:00.998 09:00:49 -- nvmf/common.sh@545 -- # IFS=, 00:22:00.998 09:00:49 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:00.998 "params": { 00:22:00.998 "name": "Nvme1", 00:22:00.998 "trtype": "tcp", 00:22:00.998 "traddr": "10.0.0.2", 00:22:00.998 "adrfam": "ipv4", 00:22:00.998 "trsvcid": "4420", 00:22:00.998 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:00.998 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:00.998 "hdgst": false, 00:22:00.998 "ddgst": false 00:22:00.998 }, 00:22:00.998 "method": "bdev_nvme_attach_controller" 00:22:00.998 },{ 00:22:00.998 "params": { 00:22:00.998 "name": "Nvme2", 00:22:00.998 "trtype": "tcp", 00:22:00.998 "traddr": "10.0.0.2", 00:22:00.998 "adrfam": "ipv4", 00:22:00.998 "trsvcid": "4420", 00:22:00.998 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:00.998 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:00.998 "hdgst": false, 00:22:00.998 "ddgst": false 00:22:00.998 }, 00:22:00.998 "method": "bdev_nvme_attach_controller" 00:22:00.998 },{ 00:22:00.998 "params": { 00:22:00.998 "name": "Nvme3", 00:22:00.998 "trtype": "tcp", 00:22:00.998 "traddr": "10.0.0.2", 00:22:00.998 "adrfam": "ipv4", 00:22:00.998 "trsvcid": "4420", 00:22:00.998 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:00.998 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:00.998 "hdgst": false, 00:22:00.998 "ddgst": false 00:22:00.998 }, 00:22:00.998 "method": "bdev_nvme_attach_controller" 00:22:00.998 },{ 00:22:00.998 "params": { 00:22:00.998 "name": "Nvme4", 00:22:00.998 "trtype": "tcp", 00:22:00.998 "traddr": "10.0.0.2", 00:22:00.998 "adrfam": "ipv4", 00:22:00.998 "trsvcid": "4420", 00:22:00.998 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:00.998 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:00.998 "hdgst": false, 00:22:00.998 "ddgst": false 00:22:00.998 }, 00:22:00.998 "method": "bdev_nvme_attach_controller" 00:22:00.998 },{ 00:22:00.998 "params": { 00:22:00.998 "name": "Nvme5", 00:22:00.998 "trtype": "tcp", 00:22:00.998 "traddr": "10.0.0.2", 00:22:00.998 "adrfam": "ipv4", 00:22:00.998 "trsvcid": "4420", 00:22:00.998 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:00.998 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:00.998 "hdgst": false, 00:22:00.998 "ddgst": false 00:22:00.998 }, 00:22:00.998 "method": "bdev_nvme_attach_controller" 00:22:00.998 },{ 00:22:00.998 "params": { 00:22:00.998 "name": "Nvme6", 00:22:00.998 "trtype": "tcp", 00:22:00.998 "traddr": "10.0.0.2", 00:22:00.998 "adrfam": "ipv4", 00:22:00.998 "trsvcid": "4420", 00:22:00.998 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:00.998 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:00.998 "hdgst": false, 00:22:00.998 "ddgst": false 00:22:00.998 }, 00:22:00.998 "method": "bdev_nvme_attach_controller" 00:22:00.998 },{ 00:22:00.998 "params": { 00:22:00.998 "name": "Nvme7", 00:22:00.998 "trtype": "tcp", 00:22:00.998 "traddr": "10.0.0.2", 00:22:00.998 "adrfam": "ipv4", 00:22:00.998 "trsvcid": "4420", 00:22:00.998 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:00.998 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:00.998 "hdgst": false, 00:22:00.998 "ddgst": false 00:22:00.998 }, 00:22:00.998 "method": "bdev_nvme_attach_controller" 00:22:00.998 },{ 00:22:00.998 "params": { 00:22:00.998 "name": "Nvme8", 00:22:00.998 "trtype": "tcp", 00:22:00.998 "traddr": "10.0.0.2", 00:22:00.998 "adrfam": "ipv4", 00:22:00.998 "trsvcid": "4420", 00:22:00.998 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:00.998 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:00.998 "hdgst": false, 00:22:00.998 "ddgst": false 00:22:00.998 }, 00:22:00.998 "method": "bdev_nvme_attach_controller" 00:22:00.998 },{ 00:22:00.998 "params": { 00:22:00.998 "name": "Nvme9", 00:22:00.998 "trtype": "tcp", 00:22:00.998 "traddr": "10.0.0.2", 00:22:00.998 "adrfam": "ipv4", 00:22:00.998 "trsvcid": "4420", 00:22:00.998 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:00.998 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:00.998 "hdgst": false, 00:22:00.998 "ddgst": false 00:22:00.998 }, 00:22:00.998 "method": "bdev_nvme_attach_controller" 00:22:00.998 },{ 00:22:00.998 "params": { 00:22:00.998 "name": "Nvme10", 00:22:00.998 "trtype": "tcp", 00:22:00.998 "traddr": "10.0.0.2", 00:22:00.998 "adrfam": "ipv4", 00:22:00.998 "trsvcid": "4420", 00:22:00.998 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:00.998 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:00.998 "hdgst": false, 00:22:00.998 "ddgst": false 00:22:00.998 }, 00:22:00.998 "method": "bdev_nvme_attach_controller" 00:22:00.998 }' 00:22:00.998 [2024-07-15 09:00:49.315481] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:22:00.998 [2024-07-15 09:00:49.315554] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:22:00.998 EAL: No free 2048 kB hugepages reported on node 1 00:22:00.998 [2024-07-15 09:00:49.379519] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:00.998 [2024-07-15 09:00:49.487287] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:02.893 09:00:50 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:22:02.893 09:00:50 -- common/autotest_common.sh@852 -- # return 0 00:22:02.893 09:00:50 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:02.893 09:00:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:02.893 09:00:50 -- common/autotest_common.sh@10 -- # set +x 00:22:02.893 09:00:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:02.893 09:00:50 -- target/shutdown.sh@83 -- # kill -9 1563538 00:22:02.893 09:00:50 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:22:02.893 09:00:50 -- target/shutdown.sh@87 -- # sleep 1 00:22:03.824 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 1563538 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:22:03.824 09:00:52 -- target/shutdown.sh@88 -- # kill -0 1563349 00:22:03.824 09:00:52 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:22:03.824 09:00:52 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:03.824 09:00:52 -- nvmf/common.sh@520 -- # config=() 00:22:03.824 09:00:52 -- nvmf/common.sh@520 -- # local subsystem config 00:22:03.824 09:00:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:03.824 09:00:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:03.824 { 00:22:03.824 "params": { 00:22:03.824 "name": "Nvme$subsystem", 00:22:03.824 "trtype": "$TEST_TRANSPORT", 00:22:03.824 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:03.824 "adrfam": "ipv4", 00:22:03.824 "trsvcid": "$NVMF_PORT", 00:22:03.824 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:03.824 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:03.824 "hdgst": ${hdgst:-false}, 00:22:03.824 "ddgst": ${ddgst:-false} 00:22:03.824 }, 00:22:03.824 "method": "bdev_nvme_attach_controller" 00:22:03.824 } 00:22:03.824 EOF 00:22:03.824 )") 00:22:03.824 09:00:52 -- nvmf/common.sh@542 -- # cat 00:22:03.824 09:00:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:03.824 09:00:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:03.824 { 00:22:03.824 "params": { 00:22:03.824 "name": "Nvme$subsystem", 00:22:03.824 "trtype": "$TEST_TRANSPORT", 00:22:03.824 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:03.824 "adrfam": "ipv4", 00:22:03.824 "trsvcid": "$NVMF_PORT", 00:22:03.824 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:03.825 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:03.825 "hdgst": ${hdgst:-false}, 00:22:03.825 "ddgst": ${ddgst:-false} 00:22:03.825 }, 00:22:03.825 "method": "bdev_nvme_attach_controller" 00:22:03.825 } 00:22:03.825 EOF 00:22:03.825 )") 00:22:03.825 09:00:52 -- nvmf/common.sh@542 -- # cat 00:22:03.825 09:00:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:03.825 09:00:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:03.825 { 00:22:03.825 "params": { 00:22:03.825 "name": "Nvme$subsystem", 00:22:03.825 "trtype": "$TEST_TRANSPORT", 00:22:03.825 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:03.825 "adrfam": "ipv4", 00:22:03.825 "trsvcid": "$NVMF_PORT", 00:22:03.825 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:03.825 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:03.825 "hdgst": ${hdgst:-false}, 00:22:03.825 "ddgst": ${ddgst:-false} 00:22:03.825 }, 00:22:03.825 "method": "bdev_nvme_attach_controller" 00:22:03.825 } 00:22:03.825 EOF 00:22:03.825 )") 00:22:03.825 09:00:52 -- nvmf/common.sh@542 -- # cat 00:22:03.825 09:00:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:03.825 09:00:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:03.825 { 00:22:03.825 "params": { 00:22:03.825 "name": "Nvme$subsystem", 00:22:03.825 "trtype": "$TEST_TRANSPORT", 00:22:03.825 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:03.825 "adrfam": "ipv4", 00:22:03.825 "trsvcid": "$NVMF_PORT", 00:22:03.825 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:03.825 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:03.825 "hdgst": ${hdgst:-false}, 00:22:03.825 "ddgst": ${ddgst:-false} 00:22:03.825 }, 00:22:03.825 "method": "bdev_nvme_attach_controller" 00:22:03.825 } 00:22:03.825 EOF 00:22:03.825 )") 00:22:03.825 09:00:52 -- nvmf/common.sh@542 -- # cat 00:22:03.825 09:00:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:03.825 09:00:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:03.825 { 00:22:03.825 "params": { 00:22:03.825 "name": "Nvme$subsystem", 00:22:03.825 "trtype": "$TEST_TRANSPORT", 00:22:03.825 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:03.825 "adrfam": "ipv4", 00:22:03.825 "trsvcid": "$NVMF_PORT", 00:22:03.825 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:03.825 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:03.825 "hdgst": ${hdgst:-false}, 00:22:03.825 "ddgst": ${ddgst:-false} 00:22:03.825 }, 00:22:03.825 "method": "bdev_nvme_attach_controller" 00:22:03.825 } 00:22:03.825 EOF 00:22:03.825 )") 00:22:03.825 09:00:52 -- nvmf/common.sh@542 -- # cat 00:22:03.825 09:00:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:03.825 09:00:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:03.825 { 00:22:03.825 "params": { 00:22:03.825 "name": "Nvme$subsystem", 00:22:03.825 "trtype": "$TEST_TRANSPORT", 00:22:03.825 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:03.825 "adrfam": "ipv4", 00:22:03.825 "trsvcid": "$NVMF_PORT", 00:22:03.825 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:03.825 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:03.825 "hdgst": ${hdgst:-false}, 00:22:03.825 "ddgst": ${ddgst:-false} 00:22:03.825 }, 00:22:03.825 "method": "bdev_nvme_attach_controller" 00:22:03.825 } 00:22:03.825 EOF 00:22:03.825 )") 00:22:03.825 09:00:52 -- nvmf/common.sh@542 -- # cat 00:22:03.825 09:00:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:03.825 09:00:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:03.825 { 00:22:03.825 "params": { 00:22:03.825 "name": "Nvme$subsystem", 00:22:03.825 "trtype": "$TEST_TRANSPORT", 00:22:03.825 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:03.825 "adrfam": "ipv4", 00:22:03.825 "trsvcid": "$NVMF_PORT", 00:22:03.825 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:03.825 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:03.825 "hdgst": ${hdgst:-false}, 00:22:03.825 "ddgst": ${ddgst:-false} 00:22:03.825 }, 00:22:03.825 "method": "bdev_nvme_attach_controller" 00:22:03.825 } 00:22:03.825 EOF 00:22:03.825 )") 00:22:03.825 09:00:52 -- nvmf/common.sh@542 -- # cat 00:22:03.825 09:00:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:03.825 09:00:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:03.825 { 00:22:03.825 "params": { 00:22:03.825 "name": "Nvme$subsystem", 00:22:03.825 "trtype": "$TEST_TRANSPORT", 00:22:03.825 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:03.825 "adrfam": "ipv4", 00:22:03.825 "trsvcid": "$NVMF_PORT", 00:22:03.825 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:03.825 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:03.825 "hdgst": ${hdgst:-false}, 00:22:03.825 "ddgst": ${ddgst:-false} 00:22:03.825 }, 00:22:03.825 "method": "bdev_nvme_attach_controller" 00:22:03.825 } 00:22:03.825 EOF 00:22:03.825 )") 00:22:03.825 09:00:52 -- nvmf/common.sh@542 -- # cat 00:22:03.825 09:00:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:03.825 09:00:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:03.825 { 00:22:03.825 "params": { 00:22:03.825 "name": "Nvme$subsystem", 00:22:03.825 "trtype": "$TEST_TRANSPORT", 00:22:03.825 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:03.825 "adrfam": "ipv4", 00:22:03.825 "trsvcid": "$NVMF_PORT", 00:22:03.825 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:03.825 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:03.825 "hdgst": ${hdgst:-false}, 00:22:03.825 "ddgst": ${ddgst:-false} 00:22:03.825 }, 00:22:03.825 "method": "bdev_nvme_attach_controller" 00:22:03.825 } 00:22:03.825 EOF 00:22:03.825 )") 00:22:03.825 09:00:52 -- nvmf/common.sh@542 -- # cat 00:22:03.825 09:00:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:03.825 09:00:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:03.825 { 00:22:03.825 "params": { 00:22:03.825 "name": "Nvme$subsystem", 00:22:03.825 "trtype": "$TEST_TRANSPORT", 00:22:03.825 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:03.825 "adrfam": "ipv4", 00:22:03.825 "trsvcid": "$NVMF_PORT", 00:22:03.825 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:03.825 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:03.825 "hdgst": ${hdgst:-false}, 00:22:03.825 "ddgst": ${ddgst:-false} 00:22:03.825 }, 00:22:03.825 "method": "bdev_nvme_attach_controller" 00:22:03.825 } 00:22:03.825 EOF 00:22:03.825 )") 00:22:03.825 09:00:52 -- nvmf/common.sh@542 -- # cat 00:22:03.825 09:00:52 -- nvmf/common.sh@544 -- # jq . 00:22:03.825 09:00:52 -- nvmf/common.sh@545 -- # IFS=, 00:22:03.825 09:00:52 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:03.825 "params": { 00:22:03.825 "name": "Nvme1", 00:22:03.825 "trtype": "tcp", 00:22:03.825 "traddr": "10.0.0.2", 00:22:03.825 "adrfam": "ipv4", 00:22:03.825 "trsvcid": "4420", 00:22:03.825 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:03.825 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:03.825 "hdgst": false, 00:22:03.825 "ddgst": false 00:22:03.825 }, 00:22:03.825 "method": "bdev_nvme_attach_controller" 00:22:03.825 },{ 00:22:03.825 "params": { 00:22:03.825 "name": "Nvme2", 00:22:03.825 "trtype": "tcp", 00:22:03.825 "traddr": "10.0.0.2", 00:22:03.825 "adrfam": "ipv4", 00:22:03.825 "trsvcid": "4420", 00:22:03.825 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:03.825 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:03.825 "hdgst": false, 00:22:03.825 "ddgst": false 00:22:03.825 }, 00:22:03.826 "method": "bdev_nvme_attach_controller" 00:22:03.826 },{ 00:22:03.826 "params": { 00:22:03.826 "name": "Nvme3", 00:22:03.826 "trtype": "tcp", 00:22:03.826 "traddr": "10.0.0.2", 00:22:03.826 "adrfam": "ipv4", 00:22:03.826 "trsvcid": "4420", 00:22:03.826 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:03.826 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:03.826 "hdgst": false, 00:22:03.826 "ddgst": false 00:22:03.826 }, 00:22:03.826 "method": "bdev_nvme_attach_controller" 00:22:03.826 },{ 00:22:03.826 "params": { 00:22:03.826 "name": "Nvme4", 00:22:03.826 "trtype": "tcp", 00:22:03.826 "traddr": "10.0.0.2", 00:22:03.826 "adrfam": "ipv4", 00:22:03.826 "trsvcid": "4420", 00:22:03.826 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:03.826 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:03.826 "hdgst": false, 00:22:03.826 "ddgst": false 00:22:03.826 }, 00:22:03.826 "method": "bdev_nvme_attach_controller" 00:22:03.826 },{ 00:22:03.826 "params": { 00:22:03.826 "name": "Nvme5", 00:22:03.826 "trtype": "tcp", 00:22:03.826 "traddr": "10.0.0.2", 00:22:03.826 "adrfam": "ipv4", 00:22:03.826 "trsvcid": "4420", 00:22:03.826 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:03.826 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:03.826 "hdgst": false, 00:22:03.826 "ddgst": false 00:22:03.826 }, 00:22:03.826 "method": "bdev_nvme_attach_controller" 00:22:03.826 },{ 00:22:03.826 "params": { 00:22:03.826 "name": "Nvme6", 00:22:03.826 "trtype": "tcp", 00:22:03.826 "traddr": "10.0.0.2", 00:22:03.826 "adrfam": "ipv4", 00:22:03.826 "trsvcid": "4420", 00:22:03.826 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:03.826 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:03.826 "hdgst": false, 00:22:03.826 "ddgst": false 00:22:03.826 }, 00:22:03.826 "method": "bdev_nvme_attach_controller" 00:22:03.826 },{ 00:22:03.826 "params": { 00:22:03.826 "name": "Nvme7", 00:22:03.826 "trtype": "tcp", 00:22:03.826 "traddr": "10.0.0.2", 00:22:03.826 "adrfam": "ipv4", 00:22:03.826 "trsvcid": "4420", 00:22:03.826 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:03.826 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:03.826 "hdgst": false, 00:22:03.826 "ddgst": false 00:22:03.826 }, 00:22:03.826 "method": "bdev_nvme_attach_controller" 00:22:03.826 },{ 00:22:03.826 "params": { 00:22:03.826 "name": "Nvme8", 00:22:03.826 "trtype": "tcp", 00:22:03.826 "traddr": "10.0.0.2", 00:22:03.826 "adrfam": "ipv4", 00:22:03.826 "trsvcid": "4420", 00:22:03.826 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:03.826 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:03.826 "hdgst": false, 00:22:03.826 "ddgst": false 00:22:03.826 }, 00:22:03.826 "method": "bdev_nvme_attach_controller" 00:22:03.826 },{ 00:22:03.826 "params": { 00:22:03.826 "name": "Nvme9", 00:22:03.826 "trtype": "tcp", 00:22:03.826 "traddr": "10.0.0.2", 00:22:03.826 "adrfam": "ipv4", 00:22:03.826 "trsvcid": "4420", 00:22:03.826 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:03.826 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:03.826 "hdgst": false, 00:22:03.826 "ddgst": false 00:22:03.826 }, 00:22:03.826 "method": "bdev_nvme_attach_controller" 00:22:03.826 },{ 00:22:03.826 "params": { 00:22:03.826 "name": "Nvme10", 00:22:03.826 "trtype": "tcp", 00:22:03.826 "traddr": "10.0.0.2", 00:22:03.826 "adrfam": "ipv4", 00:22:03.826 "trsvcid": "4420", 00:22:03.826 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:03.826 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:03.826 "hdgst": false, 00:22:03.826 "ddgst": false 00:22:03.826 }, 00:22:03.826 "method": "bdev_nvme_attach_controller" 00:22:03.826 }' 00:22:03.826 [2024-07-15 09:00:52.044199] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:22:03.826 [2024-07-15 09:00:52.044286] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1563965 ] 00:22:03.826 EAL: No free 2048 kB hugepages reported on node 1 00:22:03.826 [2024-07-15 09:00:52.109689] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:03.826 [2024-07-15 09:00:52.220613] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:05.200 Running I/O for 1 seconds... 00:22:06.575 00:22:06.575 Latency(us) 00:22:06.575 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:06.575 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:06.575 Verification LBA range: start 0x0 length 0x400 00:22:06.575 Nvme1n1 : 1.06 334.23 20.89 0.00 0.00 184374.89 51652.08 175539.39 00:22:06.575 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:06.575 Verification LBA range: start 0x0 length 0x400 00:22:06.575 Nvme2n1 : 1.09 398.74 24.92 0.00 0.00 156946.25 15340.28 124275.67 00:22:06.575 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:06.575 Verification LBA range: start 0x0 length 0x400 00:22:06.575 Nvme3n1 : 1.07 405.56 25.35 0.00 0.00 152490.38 20971.52 135149.80 00:22:06.575 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:06.575 Verification LBA range: start 0x0 length 0x400 00:22:06.575 Nvme4n1 : 1.10 440.06 27.50 0.00 0.00 140191.36 19029.71 116508.44 00:22:06.575 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:06.575 Verification LBA range: start 0x0 length 0x400 00:22:06.575 Nvme5n1 : 1.09 366.81 22.93 0.00 0.00 165922.08 25049.32 147577.36 00:22:06.575 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:06.575 Verification LBA range: start 0x0 length 0x400 00:22:06.575 Nvme6n1 : 1.08 400.61 25.04 0.00 0.00 151581.67 16796.63 116508.44 00:22:06.575 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:06.575 Verification LBA range: start 0x0 length 0x400 00:22:06.575 Nvme7n1 : 1.14 423.99 26.50 0.00 0.00 137719.07 17961.72 118061.89 00:22:06.575 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:06.575 Verification LBA range: start 0x0 length 0x400 00:22:06.575 Nvme8n1 : 1.09 397.42 24.84 0.00 0.00 150725.31 16408.27 119615.34 00:22:06.575 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:06.575 Verification LBA range: start 0x0 length 0x400 00:22:06.575 Nvme9n1 : 1.10 378.25 23.64 0.00 0.00 156629.17 8835.22 149130.81 00:22:06.575 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:06.575 Verification LBA range: start 0x0 length 0x400 00:22:06.575 Nvme10n1 : 1.10 393.57 24.60 0.00 0.00 151233.52 7718.68 126605.84 00:22:06.575 =================================================================================================================== 00:22:06.575 Total : 3939.26 246.20 0.00 0.00 153777.15 7718.68 175539.39 00:22:06.575 09:00:54 -- target/shutdown.sh@93 -- # stoptarget 00:22:06.575 09:00:54 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:06.575 09:00:54 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:06.575 09:00:55 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:06.575 09:00:55 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:06.575 09:00:55 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:06.575 09:00:55 -- nvmf/common.sh@116 -- # sync 00:22:06.575 09:00:55 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:06.575 09:00:55 -- nvmf/common.sh@119 -- # set +e 00:22:06.575 09:00:55 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:06.575 09:00:55 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:06.575 rmmod nvme_tcp 00:22:06.575 rmmod nvme_fabrics 00:22:06.575 rmmod nvme_keyring 00:22:06.575 09:00:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:06.575 09:00:55 -- nvmf/common.sh@123 -- # set -e 00:22:06.575 09:00:55 -- nvmf/common.sh@124 -- # return 0 00:22:06.575 09:00:55 -- nvmf/common.sh@477 -- # '[' -n 1563349 ']' 00:22:06.575 09:00:55 -- nvmf/common.sh@478 -- # killprocess 1563349 00:22:06.575 09:00:55 -- common/autotest_common.sh@926 -- # '[' -z 1563349 ']' 00:22:06.575 09:00:55 -- common/autotest_common.sh@930 -- # kill -0 1563349 00:22:06.575 09:00:55 -- common/autotest_common.sh@931 -- # uname 00:22:06.575 09:00:55 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:22:06.575 09:00:55 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1563349 00:22:06.575 09:00:55 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:22:06.575 09:00:55 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:22:06.575 09:00:55 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1563349' 00:22:06.575 killing process with pid 1563349 00:22:06.575 09:00:55 -- common/autotest_common.sh@945 -- # kill 1563349 00:22:06.575 09:00:55 -- common/autotest_common.sh@950 -- # wait 1563349 00:22:07.142 09:00:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:07.142 09:00:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:07.142 09:00:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:07.142 09:00:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:07.142 09:00:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:07.142 09:00:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:07.142 09:00:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:07.142 09:00:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:09.676 09:00:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:09.676 00:22:09.676 real 0m12.089s 00:22:09.676 user 0m34.715s 00:22:09.676 sys 0m3.366s 00:22:09.676 09:00:57 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:22:09.676 09:00:57 -- common/autotest_common.sh@10 -- # set +x 00:22:09.676 ************************************ 00:22:09.676 END TEST nvmf_shutdown_tc1 00:22:09.676 ************************************ 00:22:09.676 09:00:57 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:22:09.676 09:00:57 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:22:09.676 09:00:57 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:22:09.676 09:00:57 -- common/autotest_common.sh@10 -- # set +x 00:22:09.676 ************************************ 00:22:09.676 START TEST nvmf_shutdown_tc2 00:22:09.676 ************************************ 00:22:09.676 09:00:57 -- common/autotest_common.sh@1104 -- # nvmf_shutdown_tc2 00:22:09.676 09:00:57 -- target/shutdown.sh@98 -- # starttarget 00:22:09.676 09:00:57 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:09.676 09:00:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:09.676 09:00:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:09.676 09:00:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:09.676 09:00:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:09.676 09:00:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:09.676 09:00:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:09.676 09:00:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:09.676 09:00:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:09.676 09:00:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:09.676 09:00:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:09.676 09:00:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:09.676 09:00:57 -- common/autotest_common.sh@10 -- # set +x 00:22:09.676 09:00:57 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:09.676 09:00:57 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:09.676 09:00:57 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:09.676 09:00:57 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:09.676 09:00:57 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:09.676 09:00:57 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:09.676 09:00:57 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:09.676 09:00:57 -- nvmf/common.sh@294 -- # net_devs=() 00:22:09.676 09:00:57 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:09.676 09:00:57 -- nvmf/common.sh@295 -- # e810=() 00:22:09.676 09:00:57 -- nvmf/common.sh@295 -- # local -ga e810 00:22:09.676 09:00:57 -- nvmf/common.sh@296 -- # x722=() 00:22:09.676 09:00:57 -- nvmf/common.sh@296 -- # local -ga x722 00:22:09.676 09:00:57 -- nvmf/common.sh@297 -- # mlx=() 00:22:09.676 09:00:57 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:09.676 09:00:57 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:09.676 09:00:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:09.676 09:00:57 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:09.676 09:00:57 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:09.676 09:00:57 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:09.676 09:00:57 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:09.676 09:00:57 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:09.676 09:00:57 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:09.676 09:00:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:09.676 09:00:57 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:09.676 09:00:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:09.676 09:00:57 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:09.676 09:00:57 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:09.676 09:00:57 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:09.676 09:00:57 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:09.676 09:00:57 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:09.676 09:00:57 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:09.676 09:00:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:09.676 09:00:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:09.676 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:09.676 09:00:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:09.676 09:00:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:09.676 09:00:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:09.676 09:00:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:09.676 09:00:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:09.676 09:00:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:09.676 09:00:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:09.676 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:09.676 09:00:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:09.676 09:00:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:09.676 09:00:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:09.676 09:00:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:09.676 09:00:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:09.676 09:00:57 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:09.676 09:00:57 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:09.676 09:00:57 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:09.676 09:00:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:09.676 09:00:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:09.676 09:00:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:09.676 09:00:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:09.676 09:00:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:09.676 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:09.676 09:00:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:09.676 09:00:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:09.676 09:00:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:09.676 09:00:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:09.676 09:00:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:09.676 09:00:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:09.676 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:09.676 09:00:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:09.676 09:00:57 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:09.676 09:00:57 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:09.676 09:00:57 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:09.676 09:00:57 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:09.676 09:00:57 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:09.676 09:00:57 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:09.676 09:00:57 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:09.676 09:00:57 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:09.676 09:00:57 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:09.676 09:00:57 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:09.676 09:00:57 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:09.676 09:00:57 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:09.677 09:00:57 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:09.677 09:00:57 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:09.677 09:00:57 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:09.677 09:00:57 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:09.677 09:00:57 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:09.677 09:00:57 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:09.677 09:00:57 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:09.677 09:00:57 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:09.677 09:00:57 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:09.677 09:00:57 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:09.677 09:00:57 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:09.677 09:00:57 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:09.677 09:00:57 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:09.677 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:09.677 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.129 ms 00:22:09.677 00:22:09.677 --- 10.0.0.2 ping statistics --- 00:22:09.677 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:09.677 rtt min/avg/max/mdev = 0.129/0.129/0.129/0.000 ms 00:22:09.677 09:00:57 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:09.677 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:09.677 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.120 ms 00:22:09.677 00:22:09.677 --- 10.0.0.1 ping statistics --- 00:22:09.677 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:09.677 rtt min/avg/max/mdev = 0.120/0.120/0.120/0.000 ms 00:22:09.677 09:00:57 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:09.677 09:00:57 -- nvmf/common.sh@410 -- # return 0 00:22:09.677 09:00:57 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:09.677 09:00:57 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:09.677 09:00:57 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:09.677 09:00:57 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:09.677 09:00:57 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:09.677 09:00:57 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:09.677 09:00:57 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:09.677 09:00:57 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:09.677 09:00:57 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:09.677 09:00:57 -- common/autotest_common.sh@712 -- # xtrace_disable 00:22:09.677 09:00:57 -- common/autotest_common.sh@10 -- # set +x 00:22:09.677 09:00:57 -- nvmf/common.sh@469 -- # nvmfpid=1564755 00:22:09.677 09:00:57 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:09.677 09:00:57 -- nvmf/common.sh@470 -- # waitforlisten 1564755 00:22:09.677 09:00:57 -- common/autotest_common.sh@819 -- # '[' -z 1564755 ']' 00:22:09.677 09:00:57 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:09.677 09:00:57 -- common/autotest_common.sh@824 -- # local max_retries=100 00:22:09.677 09:00:57 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:09.677 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:09.677 09:00:57 -- common/autotest_common.sh@828 -- # xtrace_disable 00:22:09.677 09:00:57 -- common/autotest_common.sh@10 -- # set +x 00:22:09.677 [2024-07-15 09:00:57.918892] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:22:09.677 [2024-07-15 09:00:57.918970] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:09.677 EAL: No free 2048 kB hugepages reported on node 1 00:22:09.677 [2024-07-15 09:00:57.990046] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:09.677 [2024-07-15 09:00:58.106361] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:09.677 [2024-07-15 09:00:58.106501] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:09.677 [2024-07-15 09:00:58.106518] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:09.677 [2024-07-15 09:00:58.106530] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:09.677 [2024-07-15 09:00:58.106612] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:09.677 [2024-07-15 09:00:58.106661] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:09.677 [2024-07-15 09:00:58.106754] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:09.677 [2024-07-15 09:00:58.106756] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:10.610 09:00:58 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:22:10.610 09:00:58 -- common/autotest_common.sh@852 -- # return 0 00:22:10.610 09:00:58 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:10.610 09:00:58 -- common/autotest_common.sh@718 -- # xtrace_disable 00:22:10.610 09:00:58 -- common/autotest_common.sh@10 -- # set +x 00:22:10.610 09:00:58 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:10.610 09:00:58 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:10.610 09:00:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:10.610 09:00:58 -- common/autotest_common.sh@10 -- # set +x 00:22:10.610 [2024-07-15 09:00:58.930528] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:10.610 09:00:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:10.610 09:00:58 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:10.610 09:00:58 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:10.610 09:00:58 -- common/autotest_common.sh@712 -- # xtrace_disable 00:22:10.610 09:00:58 -- common/autotest_common.sh@10 -- # set +x 00:22:10.610 09:00:58 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:10.610 09:00:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:10.610 09:00:58 -- target/shutdown.sh@28 -- # cat 00:22:10.610 09:00:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:10.610 09:00:58 -- target/shutdown.sh@28 -- # cat 00:22:10.610 09:00:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:10.610 09:00:58 -- target/shutdown.sh@28 -- # cat 00:22:10.610 09:00:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:10.610 09:00:58 -- target/shutdown.sh@28 -- # cat 00:22:10.610 09:00:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:10.610 09:00:58 -- target/shutdown.sh@28 -- # cat 00:22:10.610 09:00:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:10.610 09:00:58 -- target/shutdown.sh@28 -- # cat 00:22:10.610 09:00:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:10.610 09:00:58 -- target/shutdown.sh@28 -- # cat 00:22:10.610 09:00:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:10.610 09:00:58 -- target/shutdown.sh@28 -- # cat 00:22:10.610 09:00:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:10.610 09:00:58 -- target/shutdown.sh@28 -- # cat 00:22:10.610 09:00:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:10.610 09:00:58 -- target/shutdown.sh@28 -- # cat 00:22:10.610 09:00:58 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:10.610 09:00:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:10.610 09:00:58 -- common/autotest_common.sh@10 -- # set +x 00:22:10.610 Malloc1 00:22:10.610 [2024-07-15 09:00:59.019969] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:10.610 Malloc2 00:22:10.610 Malloc3 00:22:10.610 Malloc4 00:22:10.867 Malloc5 00:22:10.867 Malloc6 00:22:10.867 Malloc7 00:22:10.867 Malloc8 00:22:10.867 Malloc9 00:22:11.125 Malloc10 00:22:11.125 09:00:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:11.125 09:00:59 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:11.125 09:00:59 -- common/autotest_common.sh@718 -- # xtrace_disable 00:22:11.125 09:00:59 -- common/autotest_common.sh@10 -- # set +x 00:22:11.125 09:00:59 -- target/shutdown.sh@102 -- # perfpid=1564948 00:22:11.125 09:00:59 -- target/shutdown.sh@103 -- # waitforlisten 1564948 /var/tmp/bdevperf.sock 00:22:11.125 09:00:59 -- common/autotest_common.sh@819 -- # '[' -z 1564948 ']' 00:22:11.125 09:00:59 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:11.125 09:00:59 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:11.125 09:00:59 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:11.125 09:00:59 -- common/autotest_common.sh@824 -- # local max_retries=100 00:22:11.125 09:00:59 -- nvmf/common.sh@520 -- # config=() 00:22:11.125 09:00:59 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:11.125 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:11.125 09:00:59 -- nvmf/common.sh@520 -- # local subsystem config 00:22:11.125 09:00:59 -- common/autotest_common.sh@828 -- # xtrace_disable 00:22:11.125 09:00:59 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:11.125 09:00:59 -- common/autotest_common.sh@10 -- # set +x 00:22:11.125 09:00:59 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:11.125 { 00:22:11.125 "params": { 00:22:11.125 "name": "Nvme$subsystem", 00:22:11.125 "trtype": "$TEST_TRANSPORT", 00:22:11.125 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:11.125 "adrfam": "ipv4", 00:22:11.125 "trsvcid": "$NVMF_PORT", 00:22:11.125 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:11.125 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:11.125 "hdgst": ${hdgst:-false}, 00:22:11.126 "ddgst": ${ddgst:-false} 00:22:11.126 }, 00:22:11.126 "method": "bdev_nvme_attach_controller" 00:22:11.126 } 00:22:11.126 EOF 00:22:11.126 )") 00:22:11.126 09:00:59 -- nvmf/common.sh@542 -- # cat 00:22:11.126 09:00:59 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:11.126 09:00:59 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:11.126 { 00:22:11.126 "params": { 00:22:11.126 "name": "Nvme$subsystem", 00:22:11.126 "trtype": "$TEST_TRANSPORT", 00:22:11.126 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:11.126 "adrfam": "ipv4", 00:22:11.126 "trsvcid": "$NVMF_PORT", 00:22:11.126 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:11.126 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:11.126 "hdgst": ${hdgst:-false}, 00:22:11.126 "ddgst": ${ddgst:-false} 00:22:11.126 }, 00:22:11.126 "method": "bdev_nvme_attach_controller" 00:22:11.126 } 00:22:11.126 EOF 00:22:11.126 )") 00:22:11.126 09:00:59 -- nvmf/common.sh@542 -- # cat 00:22:11.126 09:00:59 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:11.126 09:00:59 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:11.126 { 00:22:11.126 "params": { 00:22:11.126 "name": "Nvme$subsystem", 00:22:11.126 "trtype": "$TEST_TRANSPORT", 00:22:11.126 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:11.126 "adrfam": "ipv4", 00:22:11.126 "trsvcid": "$NVMF_PORT", 00:22:11.126 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:11.126 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:11.126 "hdgst": ${hdgst:-false}, 00:22:11.126 "ddgst": ${ddgst:-false} 00:22:11.126 }, 00:22:11.126 "method": "bdev_nvme_attach_controller" 00:22:11.126 } 00:22:11.126 EOF 00:22:11.126 )") 00:22:11.126 09:00:59 -- nvmf/common.sh@542 -- # cat 00:22:11.126 09:00:59 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:11.126 09:00:59 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:11.126 { 00:22:11.126 "params": { 00:22:11.126 "name": "Nvme$subsystem", 00:22:11.126 "trtype": "$TEST_TRANSPORT", 00:22:11.126 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:11.126 "adrfam": "ipv4", 00:22:11.126 "trsvcid": "$NVMF_PORT", 00:22:11.126 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:11.126 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:11.126 "hdgst": ${hdgst:-false}, 00:22:11.126 "ddgst": ${ddgst:-false} 00:22:11.126 }, 00:22:11.126 "method": "bdev_nvme_attach_controller" 00:22:11.126 } 00:22:11.126 EOF 00:22:11.126 )") 00:22:11.126 09:00:59 -- nvmf/common.sh@542 -- # cat 00:22:11.126 09:00:59 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:11.126 09:00:59 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:11.126 { 00:22:11.126 "params": { 00:22:11.126 "name": "Nvme$subsystem", 00:22:11.126 "trtype": "$TEST_TRANSPORT", 00:22:11.126 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:11.126 "adrfam": "ipv4", 00:22:11.126 "trsvcid": "$NVMF_PORT", 00:22:11.126 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:11.126 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:11.126 "hdgst": ${hdgst:-false}, 00:22:11.126 "ddgst": ${ddgst:-false} 00:22:11.126 }, 00:22:11.126 "method": "bdev_nvme_attach_controller" 00:22:11.126 } 00:22:11.126 EOF 00:22:11.126 )") 00:22:11.126 09:00:59 -- nvmf/common.sh@542 -- # cat 00:22:11.126 09:00:59 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:11.126 09:00:59 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:11.126 { 00:22:11.126 "params": { 00:22:11.126 "name": "Nvme$subsystem", 00:22:11.126 "trtype": "$TEST_TRANSPORT", 00:22:11.126 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:11.126 "adrfam": "ipv4", 00:22:11.126 "trsvcid": "$NVMF_PORT", 00:22:11.126 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:11.126 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:11.126 "hdgst": ${hdgst:-false}, 00:22:11.126 "ddgst": ${ddgst:-false} 00:22:11.126 }, 00:22:11.126 "method": "bdev_nvme_attach_controller" 00:22:11.126 } 00:22:11.126 EOF 00:22:11.126 )") 00:22:11.126 09:00:59 -- nvmf/common.sh@542 -- # cat 00:22:11.126 09:00:59 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:11.126 09:00:59 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:11.126 { 00:22:11.126 "params": { 00:22:11.126 "name": "Nvme$subsystem", 00:22:11.126 "trtype": "$TEST_TRANSPORT", 00:22:11.126 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:11.126 "adrfam": "ipv4", 00:22:11.126 "trsvcid": "$NVMF_PORT", 00:22:11.126 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:11.126 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:11.126 "hdgst": ${hdgst:-false}, 00:22:11.126 "ddgst": ${ddgst:-false} 00:22:11.126 }, 00:22:11.126 "method": "bdev_nvme_attach_controller" 00:22:11.126 } 00:22:11.126 EOF 00:22:11.126 )") 00:22:11.126 09:00:59 -- nvmf/common.sh@542 -- # cat 00:22:11.126 09:00:59 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:11.126 09:00:59 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:11.126 { 00:22:11.126 "params": { 00:22:11.126 "name": "Nvme$subsystem", 00:22:11.126 "trtype": "$TEST_TRANSPORT", 00:22:11.126 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:11.126 "adrfam": "ipv4", 00:22:11.126 "trsvcid": "$NVMF_PORT", 00:22:11.126 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:11.126 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:11.126 "hdgst": ${hdgst:-false}, 00:22:11.126 "ddgst": ${ddgst:-false} 00:22:11.126 }, 00:22:11.126 "method": "bdev_nvme_attach_controller" 00:22:11.126 } 00:22:11.126 EOF 00:22:11.126 )") 00:22:11.126 09:00:59 -- nvmf/common.sh@542 -- # cat 00:22:11.126 09:00:59 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:11.126 09:00:59 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:11.126 { 00:22:11.126 "params": { 00:22:11.126 "name": "Nvme$subsystem", 00:22:11.126 "trtype": "$TEST_TRANSPORT", 00:22:11.126 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:11.126 "adrfam": "ipv4", 00:22:11.126 "trsvcid": "$NVMF_PORT", 00:22:11.126 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:11.126 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:11.126 "hdgst": ${hdgst:-false}, 00:22:11.126 "ddgst": ${ddgst:-false} 00:22:11.126 }, 00:22:11.126 "method": "bdev_nvme_attach_controller" 00:22:11.126 } 00:22:11.126 EOF 00:22:11.126 )") 00:22:11.126 09:00:59 -- nvmf/common.sh@542 -- # cat 00:22:11.126 09:00:59 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:11.126 09:00:59 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:11.126 { 00:22:11.126 "params": { 00:22:11.126 "name": "Nvme$subsystem", 00:22:11.126 "trtype": "$TEST_TRANSPORT", 00:22:11.126 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:11.126 "adrfam": "ipv4", 00:22:11.126 "trsvcid": "$NVMF_PORT", 00:22:11.126 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:11.126 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:11.126 "hdgst": ${hdgst:-false}, 00:22:11.126 "ddgst": ${ddgst:-false} 00:22:11.126 }, 00:22:11.126 "method": "bdev_nvme_attach_controller" 00:22:11.126 } 00:22:11.126 EOF 00:22:11.126 )") 00:22:11.126 09:00:59 -- nvmf/common.sh@542 -- # cat 00:22:11.126 09:00:59 -- nvmf/common.sh@544 -- # jq . 00:22:11.126 09:00:59 -- nvmf/common.sh@545 -- # IFS=, 00:22:11.126 09:00:59 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:11.126 "params": { 00:22:11.126 "name": "Nvme1", 00:22:11.126 "trtype": "tcp", 00:22:11.126 "traddr": "10.0.0.2", 00:22:11.126 "adrfam": "ipv4", 00:22:11.126 "trsvcid": "4420", 00:22:11.126 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:11.126 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:11.126 "hdgst": false, 00:22:11.126 "ddgst": false 00:22:11.126 }, 00:22:11.126 "method": "bdev_nvme_attach_controller" 00:22:11.126 },{ 00:22:11.126 "params": { 00:22:11.126 "name": "Nvme2", 00:22:11.126 "trtype": "tcp", 00:22:11.126 "traddr": "10.0.0.2", 00:22:11.126 "adrfam": "ipv4", 00:22:11.126 "trsvcid": "4420", 00:22:11.126 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:11.126 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:11.126 "hdgst": false, 00:22:11.126 "ddgst": false 00:22:11.126 }, 00:22:11.126 "method": "bdev_nvme_attach_controller" 00:22:11.126 },{ 00:22:11.126 "params": { 00:22:11.126 "name": "Nvme3", 00:22:11.126 "trtype": "tcp", 00:22:11.126 "traddr": "10.0.0.2", 00:22:11.126 "adrfam": "ipv4", 00:22:11.126 "trsvcid": "4420", 00:22:11.126 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:11.126 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:11.126 "hdgst": false, 00:22:11.126 "ddgst": false 00:22:11.126 }, 00:22:11.126 "method": "bdev_nvme_attach_controller" 00:22:11.126 },{ 00:22:11.126 "params": { 00:22:11.126 "name": "Nvme4", 00:22:11.126 "trtype": "tcp", 00:22:11.126 "traddr": "10.0.0.2", 00:22:11.126 "adrfam": "ipv4", 00:22:11.126 "trsvcid": "4420", 00:22:11.126 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:11.126 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:11.126 "hdgst": false, 00:22:11.126 "ddgst": false 00:22:11.126 }, 00:22:11.126 "method": "bdev_nvme_attach_controller" 00:22:11.126 },{ 00:22:11.126 "params": { 00:22:11.126 "name": "Nvme5", 00:22:11.126 "trtype": "tcp", 00:22:11.126 "traddr": "10.0.0.2", 00:22:11.126 "adrfam": "ipv4", 00:22:11.126 "trsvcid": "4420", 00:22:11.126 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:11.126 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:11.126 "hdgst": false, 00:22:11.126 "ddgst": false 00:22:11.126 }, 00:22:11.126 "method": "bdev_nvme_attach_controller" 00:22:11.126 },{ 00:22:11.126 "params": { 00:22:11.126 "name": "Nvme6", 00:22:11.126 "trtype": "tcp", 00:22:11.126 "traddr": "10.0.0.2", 00:22:11.126 "adrfam": "ipv4", 00:22:11.126 "trsvcid": "4420", 00:22:11.127 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:11.127 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:11.127 "hdgst": false, 00:22:11.127 "ddgst": false 00:22:11.127 }, 00:22:11.127 "method": "bdev_nvme_attach_controller" 00:22:11.127 },{ 00:22:11.127 "params": { 00:22:11.127 "name": "Nvme7", 00:22:11.127 "trtype": "tcp", 00:22:11.127 "traddr": "10.0.0.2", 00:22:11.127 "adrfam": "ipv4", 00:22:11.127 "trsvcid": "4420", 00:22:11.127 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:11.127 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:11.127 "hdgst": false, 00:22:11.127 "ddgst": false 00:22:11.127 }, 00:22:11.127 "method": "bdev_nvme_attach_controller" 00:22:11.127 },{ 00:22:11.127 "params": { 00:22:11.127 "name": "Nvme8", 00:22:11.127 "trtype": "tcp", 00:22:11.127 "traddr": "10.0.0.2", 00:22:11.127 "adrfam": "ipv4", 00:22:11.127 "trsvcid": "4420", 00:22:11.127 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:11.127 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:11.127 "hdgst": false, 00:22:11.127 "ddgst": false 00:22:11.127 }, 00:22:11.127 "method": "bdev_nvme_attach_controller" 00:22:11.127 },{ 00:22:11.127 "params": { 00:22:11.127 "name": "Nvme9", 00:22:11.127 "trtype": "tcp", 00:22:11.127 "traddr": "10.0.0.2", 00:22:11.127 "adrfam": "ipv4", 00:22:11.127 "trsvcid": "4420", 00:22:11.127 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:11.127 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:11.127 "hdgst": false, 00:22:11.127 "ddgst": false 00:22:11.127 }, 00:22:11.127 "method": "bdev_nvme_attach_controller" 00:22:11.127 },{ 00:22:11.127 "params": { 00:22:11.127 "name": "Nvme10", 00:22:11.127 "trtype": "tcp", 00:22:11.127 "traddr": "10.0.0.2", 00:22:11.127 "adrfam": "ipv4", 00:22:11.127 "trsvcid": "4420", 00:22:11.127 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:11.127 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:11.127 "hdgst": false, 00:22:11.127 "ddgst": false 00:22:11.127 }, 00:22:11.127 "method": "bdev_nvme_attach_controller" 00:22:11.127 }' 00:22:11.127 [2024-07-15 09:00:59.520564] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:22:11.127 [2024-07-15 09:00:59.520641] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1564948 ] 00:22:11.127 EAL: No free 2048 kB hugepages reported on node 1 00:22:11.127 [2024-07-15 09:00:59.584512] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:11.384 [2024-07-15 09:00:59.692930] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:13.316 Running I/O for 10 seconds... 00:22:13.573 09:01:01 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:22:13.573 09:01:01 -- common/autotest_common.sh@852 -- # return 0 00:22:13.573 09:01:01 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:13.573 09:01:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:13.573 09:01:01 -- common/autotest_common.sh@10 -- # set +x 00:22:13.573 09:01:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:13.573 09:01:01 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:13.573 09:01:01 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:13.573 09:01:01 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:22:13.573 09:01:01 -- target/shutdown.sh@57 -- # local ret=1 00:22:13.573 09:01:01 -- target/shutdown.sh@58 -- # local i 00:22:13.573 09:01:01 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:22:13.573 09:01:01 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:13.573 09:01:01 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:13.573 09:01:01 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:13.573 09:01:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:13.573 09:01:01 -- common/autotest_common.sh@10 -- # set +x 00:22:13.573 09:01:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:13.573 09:01:02 -- target/shutdown.sh@60 -- # read_io_count=167 00:22:13.573 09:01:02 -- target/shutdown.sh@63 -- # '[' 167 -ge 100 ']' 00:22:13.574 09:01:02 -- target/shutdown.sh@64 -- # ret=0 00:22:13.574 09:01:02 -- target/shutdown.sh@65 -- # break 00:22:13.574 09:01:02 -- target/shutdown.sh@69 -- # return 0 00:22:13.574 09:01:02 -- target/shutdown.sh@109 -- # killprocess 1564948 00:22:13.574 09:01:02 -- common/autotest_common.sh@926 -- # '[' -z 1564948 ']' 00:22:13.574 09:01:02 -- common/autotest_common.sh@930 -- # kill -0 1564948 00:22:13.574 09:01:02 -- common/autotest_common.sh@931 -- # uname 00:22:13.574 09:01:02 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:22:13.574 09:01:02 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1564948 00:22:13.574 09:01:02 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:22:13.574 09:01:02 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:22:13.574 09:01:02 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1564948' 00:22:13.574 killing process with pid 1564948 00:22:13.574 09:01:02 -- common/autotest_common.sh@945 -- # kill 1564948 00:22:13.574 09:01:02 -- common/autotest_common.sh@950 -- # wait 1564948 00:22:13.831 Received shutdown signal, test time was about 0.704327 seconds 00:22:13.831 00:22:13.831 Latency(us) 00:22:13.831 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:13.831 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:13.831 Verification LBA range: start 0x0 length 0x400 00:22:13.831 Nvme1n1 : 0.63 364.56 22.79 0.00 0.00 170315.25 20000.62 165441.99 00:22:13.831 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:13.831 Verification LBA range: start 0x0 length 0x400 00:22:13.831 Nvme2n1 : 0.66 413.93 25.87 0.00 0.00 148742.27 19126.80 123498.95 00:22:13.831 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:13.831 Verification LBA range: start 0x0 length 0x400 00:22:13.831 Nvme3n1 : 0.66 415.20 25.95 0.00 0.00 147019.63 15146.10 121945.51 00:22:13.831 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:13.831 Verification LBA range: start 0x0 length 0x400 00:22:13.831 Nvme4n1 : 0.65 417.38 26.09 0.00 0.00 145259.42 6602.15 121168.78 00:22:13.831 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:13.831 Verification LBA range: start 0x0 length 0x400 00:22:13.831 Nvme5n1 : 0.66 411.64 25.73 0.00 0.00 144342.15 15631.55 118061.89 00:22:13.831 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:13.831 Verification LBA range: start 0x0 length 0x400 00:22:13.831 Nvme6n1 : 0.70 388.29 24.27 0.00 0.00 143223.11 16990.81 118061.89 00:22:13.831 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:13.831 Verification LBA range: start 0x0 length 0x400 00:22:13.831 Nvme7n1 : 0.70 386.64 24.16 0.00 0.00 141941.66 14466.47 119615.34 00:22:13.831 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:13.832 Verification LBA range: start 0x0 length 0x400 00:22:13.832 Nvme8n1 : 0.62 366.25 22.89 0.00 0.00 154311.09 22719.15 121168.78 00:22:13.832 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:13.832 Verification LBA range: start 0x0 length 0x400 00:22:13.832 Nvme9n1 : 0.63 362.00 22.63 0.00 0.00 154503.57 15825.73 125829.12 00:22:13.832 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:13.832 Verification LBA range: start 0x0 length 0x400 00:22:13.832 Nvme10n1 : 0.63 360.01 22.50 0.00 0.00 153572.27 20583.16 127382.57 00:22:13.832 =================================================================================================================== 00:22:13.832 Total : 3885.90 242.87 0.00 0.00 149779.79 6602.15 165441.99 00:22:14.089 09:01:02 -- target/shutdown.sh@112 -- # sleep 1 00:22:15.021 09:01:03 -- target/shutdown.sh@113 -- # kill -0 1564755 00:22:15.021 09:01:03 -- target/shutdown.sh@115 -- # stoptarget 00:22:15.021 09:01:03 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:15.021 09:01:03 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:15.021 09:01:03 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:15.021 09:01:03 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:15.021 09:01:03 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:15.021 09:01:03 -- nvmf/common.sh@116 -- # sync 00:22:15.021 09:01:03 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:15.021 09:01:03 -- nvmf/common.sh@119 -- # set +e 00:22:15.021 09:01:03 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:15.021 09:01:03 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:15.021 rmmod nvme_tcp 00:22:15.021 rmmod nvme_fabrics 00:22:15.021 rmmod nvme_keyring 00:22:15.021 09:01:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:15.021 09:01:03 -- nvmf/common.sh@123 -- # set -e 00:22:15.021 09:01:03 -- nvmf/common.sh@124 -- # return 0 00:22:15.021 09:01:03 -- nvmf/common.sh@477 -- # '[' -n 1564755 ']' 00:22:15.021 09:01:03 -- nvmf/common.sh@478 -- # killprocess 1564755 00:22:15.021 09:01:03 -- common/autotest_common.sh@926 -- # '[' -z 1564755 ']' 00:22:15.021 09:01:03 -- common/autotest_common.sh@930 -- # kill -0 1564755 00:22:15.021 09:01:03 -- common/autotest_common.sh@931 -- # uname 00:22:15.021 09:01:03 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:22:15.021 09:01:03 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1564755 00:22:15.278 09:01:03 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:22:15.278 09:01:03 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:22:15.278 09:01:03 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1564755' 00:22:15.278 killing process with pid 1564755 00:22:15.278 09:01:03 -- common/autotest_common.sh@945 -- # kill 1564755 00:22:15.278 09:01:03 -- common/autotest_common.sh@950 -- # wait 1564755 00:22:15.841 09:01:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:15.841 09:01:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:15.841 09:01:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:15.841 09:01:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:15.841 09:01:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:15.841 09:01:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:15.841 09:01:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:15.841 09:01:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:17.747 09:01:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:17.747 00:22:17.747 real 0m8.463s 00:22:17.747 user 0m26.670s 00:22:17.747 sys 0m1.551s 00:22:17.747 09:01:06 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:22:17.747 09:01:06 -- common/autotest_common.sh@10 -- # set +x 00:22:17.747 ************************************ 00:22:17.747 END TEST nvmf_shutdown_tc2 00:22:17.747 ************************************ 00:22:17.747 09:01:06 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:22:17.747 09:01:06 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:22:17.747 09:01:06 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:22:17.747 09:01:06 -- common/autotest_common.sh@10 -- # set +x 00:22:17.747 ************************************ 00:22:17.747 START TEST nvmf_shutdown_tc3 00:22:17.747 ************************************ 00:22:17.747 09:01:06 -- common/autotest_common.sh@1104 -- # nvmf_shutdown_tc3 00:22:17.747 09:01:06 -- target/shutdown.sh@120 -- # starttarget 00:22:17.747 09:01:06 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:17.747 09:01:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:17.747 09:01:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:17.747 09:01:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:17.747 09:01:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:17.747 09:01:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:17.747 09:01:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:17.747 09:01:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:17.747 09:01:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:17.747 09:01:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:17.747 09:01:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:17.747 09:01:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:17.747 09:01:06 -- common/autotest_common.sh@10 -- # set +x 00:22:17.747 09:01:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:17.747 09:01:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:17.747 09:01:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:17.747 09:01:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:17.747 09:01:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:17.747 09:01:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:17.747 09:01:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:17.747 09:01:06 -- nvmf/common.sh@294 -- # net_devs=() 00:22:17.747 09:01:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:17.747 09:01:06 -- nvmf/common.sh@295 -- # e810=() 00:22:17.747 09:01:06 -- nvmf/common.sh@295 -- # local -ga e810 00:22:17.747 09:01:06 -- nvmf/common.sh@296 -- # x722=() 00:22:17.747 09:01:06 -- nvmf/common.sh@296 -- # local -ga x722 00:22:17.747 09:01:06 -- nvmf/common.sh@297 -- # mlx=() 00:22:17.747 09:01:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:17.747 09:01:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:17.747 09:01:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:17.747 09:01:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:17.747 09:01:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:17.747 09:01:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:17.747 09:01:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:17.747 09:01:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:17.747 09:01:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:17.747 09:01:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:17.747 09:01:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:17.747 09:01:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:17.747 09:01:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:17.747 09:01:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:17.747 09:01:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:17.747 09:01:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:17.747 09:01:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:17.747 09:01:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:17.747 09:01:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:17.747 09:01:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:17.747 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:17.747 09:01:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:17.747 09:01:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:17.747 09:01:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:17.747 09:01:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:17.747 09:01:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:17.747 09:01:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:17.747 09:01:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:17.747 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:17.747 09:01:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:17.747 09:01:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:17.747 09:01:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:17.747 09:01:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:17.747 09:01:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:17.747 09:01:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:17.747 09:01:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:17.747 09:01:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:17.747 09:01:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:17.747 09:01:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:17.747 09:01:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:17.747 09:01:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:17.747 09:01:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:17.747 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:17.747 09:01:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:17.747 09:01:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:17.747 09:01:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:17.747 09:01:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:17.747 09:01:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:17.747 09:01:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:17.747 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:17.747 09:01:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:17.748 09:01:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:17.748 09:01:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:17.748 09:01:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:17.748 09:01:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:17.748 09:01:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:17.748 09:01:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:17.748 09:01:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:17.748 09:01:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:17.748 09:01:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:17.748 09:01:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:17.748 09:01:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:17.748 09:01:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:17.748 09:01:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:17.748 09:01:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:17.748 09:01:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:17.748 09:01:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:17.748 09:01:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:17.748 09:01:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:17.748 09:01:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:17.748 09:01:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:18.006 09:01:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:18.006 09:01:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:18.006 09:01:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:18.007 09:01:06 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:18.007 09:01:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:18.007 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:18.007 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.132 ms 00:22:18.007 00:22:18.007 --- 10.0.0.2 ping statistics --- 00:22:18.007 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:18.007 rtt min/avg/max/mdev = 0.132/0.132/0.132/0.000 ms 00:22:18.007 09:01:06 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:18.007 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:18.007 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.182 ms 00:22:18.007 00:22:18.007 --- 10.0.0.1 ping statistics --- 00:22:18.007 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:18.007 rtt min/avg/max/mdev = 0.182/0.182/0.182/0.000 ms 00:22:18.007 09:01:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:18.007 09:01:06 -- nvmf/common.sh@410 -- # return 0 00:22:18.007 09:01:06 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:18.007 09:01:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:18.007 09:01:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:18.007 09:01:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:18.007 09:01:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:18.007 09:01:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:18.007 09:01:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:18.007 09:01:06 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:18.007 09:01:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:18.007 09:01:06 -- common/autotest_common.sh@712 -- # xtrace_disable 00:22:18.007 09:01:06 -- common/autotest_common.sh@10 -- # set +x 00:22:18.007 09:01:06 -- nvmf/common.sh@469 -- # nvmfpid=1565886 00:22:18.007 09:01:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:18.007 09:01:06 -- nvmf/common.sh@470 -- # waitforlisten 1565886 00:22:18.007 09:01:06 -- common/autotest_common.sh@819 -- # '[' -z 1565886 ']' 00:22:18.007 09:01:06 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:18.007 09:01:06 -- common/autotest_common.sh@824 -- # local max_retries=100 00:22:18.007 09:01:06 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:18.007 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:18.007 09:01:06 -- common/autotest_common.sh@828 -- # xtrace_disable 00:22:18.007 09:01:06 -- common/autotest_common.sh@10 -- # set +x 00:22:18.007 [2024-07-15 09:01:06.427968] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:22:18.007 [2024-07-15 09:01:06.428039] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:18.007 EAL: No free 2048 kB hugepages reported on node 1 00:22:18.007 [2024-07-15 09:01:06.491913] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:18.265 [2024-07-15 09:01:06.602082] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:18.265 [2024-07-15 09:01:06.602230] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:18.265 [2024-07-15 09:01:06.602246] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:18.265 [2024-07-15 09:01:06.602258] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:18.265 [2024-07-15 09:01:06.602350] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:18.265 [2024-07-15 09:01:06.602413] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:18.265 [2024-07-15 09:01:06.602482] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:18.265 [2024-07-15 09:01:06.602485] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:18.831 09:01:07 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:22:18.831 09:01:07 -- common/autotest_common.sh@852 -- # return 0 00:22:18.831 09:01:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:18.831 09:01:07 -- common/autotest_common.sh@718 -- # xtrace_disable 00:22:18.831 09:01:07 -- common/autotest_common.sh@10 -- # set +x 00:22:19.089 09:01:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:19.089 09:01:07 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:19.089 09:01:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:19.089 09:01:07 -- common/autotest_common.sh@10 -- # set +x 00:22:19.089 [2024-07-15 09:01:07.398371] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:19.089 09:01:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:19.089 09:01:07 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:19.089 09:01:07 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:19.089 09:01:07 -- common/autotest_common.sh@712 -- # xtrace_disable 00:22:19.089 09:01:07 -- common/autotest_common.sh@10 -- # set +x 00:22:19.089 09:01:07 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:19.089 09:01:07 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:19.090 09:01:07 -- target/shutdown.sh@28 -- # cat 00:22:19.090 09:01:07 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:19.090 09:01:07 -- target/shutdown.sh@28 -- # cat 00:22:19.090 09:01:07 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:19.090 09:01:07 -- target/shutdown.sh@28 -- # cat 00:22:19.090 09:01:07 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:19.090 09:01:07 -- target/shutdown.sh@28 -- # cat 00:22:19.090 09:01:07 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:19.090 09:01:07 -- target/shutdown.sh@28 -- # cat 00:22:19.090 09:01:07 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:19.090 09:01:07 -- target/shutdown.sh@28 -- # cat 00:22:19.090 09:01:07 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:19.090 09:01:07 -- target/shutdown.sh@28 -- # cat 00:22:19.090 09:01:07 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:19.090 09:01:07 -- target/shutdown.sh@28 -- # cat 00:22:19.090 09:01:07 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:19.090 09:01:07 -- target/shutdown.sh@28 -- # cat 00:22:19.090 09:01:07 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:19.090 09:01:07 -- target/shutdown.sh@28 -- # cat 00:22:19.090 09:01:07 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:19.090 09:01:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:19.090 09:01:07 -- common/autotest_common.sh@10 -- # set +x 00:22:19.090 Malloc1 00:22:19.090 [2024-07-15 09:01:07.487684] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:19.090 Malloc2 00:22:19.090 Malloc3 00:22:19.090 Malloc4 00:22:19.348 Malloc5 00:22:19.348 Malloc6 00:22:19.348 Malloc7 00:22:19.348 Malloc8 00:22:19.348 Malloc9 00:22:19.606 Malloc10 00:22:19.606 09:01:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:19.606 09:01:07 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:19.606 09:01:07 -- common/autotest_common.sh@718 -- # xtrace_disable 00:22:19.606 09:01:07 -- common/autotest_common.sh@10 -- # set +x 00:22:19.606 09:01:07 -- target/shutdown.sh@124 -- # perfpid=1566201 00:22:19.606 09:01:07 -- target/shutdown.sh@125 -- # waitforlisten 1566201 /var/tmp/bdevperf.sock 00:22:19.606 09:01:07 -- common/autotest_common.sh@819 -- # '[' -z 1566201 ']' 00:22:19.606 09:01:07 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:19.606 09:01:07 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:19.606 09:01:07 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:19.606 09:01:07 -- common/autotest_common.sh@824 -- # local max_retries=100 00:22:19.606 09:01:07 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:19.606 09:01:07 -- nvmf/common.sh@520 -- # config=() 00:22:19.606 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:19.606 09:01:07 -- common/autotest_common.sh@828 -- # xtrace_disable 00:22:19.606 09:01:07 -- nvmf/common.sh@520 -- # local subsystem config 00:22:19.606 09:01:07 -- common/autotest_common.sh@10 -- # set +x 00:22:19.606 09:01:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:19.606 09:01:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:19.606 { 00:22:19.606 "params": { 00:22:19.606 "name": "Nvme$subsystem", 00:22:19.606 "trtype": "$TEST_TRANSPORT", 00:22:19.606 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:19.606 "adrfam": "ipv4", 00:22:19.606 "trsvcid": "$NVMF_PORT", 00:22:19.606 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:19.606 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:19.606 "hdgst": ${hdgst:-false}, 00:22:19.606 "ddgst": ${ddgst:-false} 00:22:19.606 }, 00:22:19.606 "method": "bdev_nvme_attach_controller" 00:22:19.606 } 00:22:19.606 EOF 00:22:19.606 )") 00:22:19.606 09:01:07 -- nvmf/common.sh@542 -- # cat 00:22:19.606 09:01:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:19.606 09:01:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:19.606 { 00:22:19.606 "params": { 00:22:19.606 "name": "Nvme$subsystem", 00:22:19.606 "trtype": "$TEST_TRANSPORT", 00:22:19.606 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:19.606 "adrfam": "ipv4", 00:22:19.606 "trsvcid": "$NVMF_PORT", 00:22:19.606 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:19.606 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:19.606 "hdgst": ${hdgst:-false}, 00:22:19.606 "ddgst": ${ddgst:-false} 00:22:19.606 }, 00:22:19.606 "method": "bdev_nvme_attach_controller" 00:22:19.606 } 00:22:19.606 EOF 00:22:19.606 )") 00:22:19.606 09:01:07 -- nvmf/common.sh@542 -- # cat 00:22:19.606 09:01:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:19.606 09:01:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:19.606 { 00:22:19.606 "params": { 00:22:19.606 "name": "Nvme$subsystem", 00:22:19.606 "trtype": "$TEST_TRANSPORT", 00:22:19.606 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:19.606 "adrfam": "ipv4", 00:22:19.606 "trsvcid": "$NVMF_PORT", 00:22:19.606 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:19.606 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:19.606 "hdgst": ${hdgst:-false}, 00:22:19.606 "ddgst": ${ddgst:-false} 00:22:19.606 }, 00:22:19.606 "method": "bdev_nvme_attach_controller" 00:22:19.606 } 00:22:19.606 EOF 00:22:19.606 )") 00:22:19.606 09:01:07 -- nvmf/common.sh@542 -- # cat 00:22:19.606 09:01:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:19.606 09:01:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:19.606 { 00:22:19.606 "params": { 00:22:19.606 "name": "Nvme$subsystem", 00:22:19.606 "trtype": "$TEST_TRANSPORT", 00:22:19.606 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:19.606 "adrfam": "ipv4", 00:22:19.606 "trsvcid": "$NVMF_PORT", 00:22:19.606 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:19.606 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:19.606 "hdgst": ${hdgst:-false}, 00:22:19.606 "ddgst": ${ddgst:-false} 00:22:19.606 }, 00:22:19.606 "method": "bdev_nvme_attach_controller" 00:22:19.606 } 00:22:19.606 EOF 00:22:19.606 )") 00:22:19.606 09:01:07 -- nvmf/common.sh@542 -- # cat 00:22:19.606 09:01:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:19.606 09:01:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:19.606 { 00:22:19.606 "params": { 00:22:19.606 "name": "Nvme$subsystem", 00:22:19.606 "trtype": "$TEST_TRANSPORT", 00:22:19.606 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:19.606 "adrfam": "ipv4", 00:22:19.606 "trsvcid": "$NVMF_PORT", 00:22:19.606 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:19.606 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:19.606 "hdgst": ${hdgst:-false}, 00:22:19.606 "ddgst": ${ddgst:-false} 00:22:19.606 }, 00:22:19.606 "method": "bdev_nvme_attach_controller" 00:22:19.606 } 00:22:19.606 EOF 00:22:19.606 )") 00:22:19.606 09:01:07 -- nvmf/common.sh@542 -- # cat 00:22:19.606 09:01:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:19.606 09:01:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:19.606 { 00:22:19.606 "params": { 00:22:19.606 "name": "Nvme$subsystem", 00:22:19.607 "trtype": "$TEST_TRANSPORT", 00:22:19.607 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:19.607 "adrfam": "ipv4", 00:22:19.607 "trsvcid": "$NVMF_PORT", 00:22:19.607 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:19.607 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:19.607 "hdgst": ${hdgst:-false}, 00:22:19.607 "ddgst": ${ddgst:-false} 00:22:19.607 }, 00:22:19.607 "method": "bdev_nvme_attach_controller" 00:22:19.607 } 00:22:19.607 EOF 00:22:19.607 )") 00:22:19.607 09:01:07 -- nvmf/common.sh@542 -- # cat 00:22:19.607 09:01:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:19.607 09:01:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:19.607 { 00:22:19.607 "params": { 00:22:19.607 "name": "Nvme$subsystem", 00:22:19.607 "trtype": "$TEST_TRANSPORT", 00:22:19.607 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:19.607 "adrfam": "ipv4", 00:22:19.607 "trsvcid": "$NVMF_PORT", 00:22:19.607 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:19.607 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:19.607 "hdgst": ${hdgst:-false}, 00:22:19.607 "ddgst": ${ddgst:-false} 00:22:19.607 }, 00:22:19.607 "method": "bdev_nvme_attach_controller" 00:22:19.607 } 00:22:19.607 EOF 00:22:19.607 )") 00:22:19.607 09:01:07 -- nvmf/common.sh@542 -- # cat 00:22:19.607 09:01:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:19.607 09:01:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:19.607 { 00:22:19.607 "params": { 00:22:19.607 "name": "Nvme$subsystem", 00:22:19.607 "trtype": "$TEST_TRANSPORT", 00:22:19.607 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:19.607 "adrfam": "ipv4", 00:22:19.607 "trsvcid": "$NVMF_PORT", 00:22:19.607 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:19.607 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:19.607 "hdgst": ${hdgst:-false}, 00:22:19.607 "ddgst": ${ddgst:-false} 00:22:19.607 }, 00:22:19.607 "method": "bdev_nvme_attach_controller" 00:22:19.607 } 00:22:19.607 EOF 00:22:19.607 )") 00:22:19.607 09:01:07 -- nvmf/common.sh@542 -- # cat 00:22:19.607 09:01:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:19.607 09:01:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:19.607 { 00:22:19.607 "params": { 00:22:19.607 "name": "Nvme$subsystem", 00:22:19.607 "trtype": "$TEST_TRANSPORT", 00:22:19.607 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:19.607 "adrfam": "ipv4", 00:22:19.607 "trsvcid": "$NVMF_PORT", 00:22:19.607 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:19.607 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:19.607 "hdgst": ${hdgst:-false}, 00:22:19.607 "ddgst": ${ddgst:-false} 00:22:19.607 }, 00:22:19.607 "method": "bdev_nvme_attach_controller" 00:22:19.607 } 00:22:19.607 EOF 00:22:19.607 )") 00:22:19.607 09:01:07 -- nvmf/common.sh@542 -- # cat 00:22:19.607 09:01:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:19.607 09:01:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:19.607 { 00:22:19.607 "params": { 00:22:19.607 "name": "Nvme$subsystem", 00:22:19.607 "trtype": "$TEST_TRANSPORT", 00:22:19.607 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:19.607 "adrfam": "ipv4", 00:22:19.607 "trsvcid": "$NVMF_PORT", 00:22:19.607 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:19.607 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:19.607 "hdgst": ${hdgst:-false}, 00:22:19.607 "ddgst": ${ddgst:-false} 00:22:19.607 }, 00:22:19.607 "method": "bdev_nvme_attach_controller" 00:22:19.607 } 00:22:19.607 EOF 00:22:19.607 )") 00:22:19.607 09:01:07 -- nvmf/common.sh@542 -- # cat 00:22:19.607 09:01:07 -- nvmf/common.sh@544 -- # jq . 00:22:19.607 09:01:07 -- nvmf/common.sh@545 -- # IFS=, 00:22:19.607 09:01:07 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:19.607 "params": { 00:22:19.607 "name": "Nvme1", 00:22:19.607 "trtype": "tcp", 00:22:19.607 "traddr": "10.0.0.2", 00:22:19.607 "adrfam": "ipv4", 00:22:19.607 "trsvcid": "4420", 00:22:19.607 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:19.607 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:19.607 "hdgst": false, 00:22:19.607 "ddgst": false 00:22:19.607 }, 00:22:19.607 "method": "bdev_nvme_attach_controller" 00:22:19.607 },{ 00:22:19.607 "params": { 00:22:19.607 "name": "Nvme2", 00:22:19.607 "trtype": "tcp", 00:22:19.607 "traddr": "10.0.0.2", 00:22:19.607 "adrfam": "ipv4", 00:22:19.607 "trsvcid": "4420", 00:22:19.607 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:19.607 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:19.607 "hdgst": false, 00:22:19.607 "ddgst": false 00:22:19.607 }, 00:22:19.607 "method": "bdev_nvme_attach_controller" 00:22:19.607 },{ 00:22:19.607 "params": { 00:22:19.607 "name": "Nvme3", 00:22:19.607 "trtype": "tcp", 00:22:19.607 "traddr": "10.0.0.2", 00:22:19.607 "adrfam": "ipv4", 00:22:19.607 "trsvcid": "4420", 00:22:19.607 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:19.607 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:19.607 "hdgst": false, 00:22:19.607 "ddgst": false 00:22:19.607 }, 00:22:19.607 "method": "bdev_nvme_attach_controller" 00:22:19.607 },{ 00:22:19.607 "params": { 00:22:19.607 "name": "Nvme4", 00:22:19.607 "trtype": "tcp", 00:22:19.607 "traddr": "10.0.0.2", 00:22:19.607 "adrfam": "ipv4", 00:22:19.607 "trsvcid": "4420", 00:22:19.607 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:19.607 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:19.607 "hdgst": false, 00:22:19.607 "ddgst": false 00:22:19.607 }, 00:22:19.607 "method": "bdev_nvme_attach_controller" 00:22:19.607 },{ 00:22:19.607 "params": { 00:22:19.607 "name": "Nvme5", 00:22:19.607 "trtype": "tcp", 00:22:19.607 "traddr": "10.0.0.2", 00:22:19.607 "adrfam": "ipv4", 00:22:19.607 "trsvcid": "4420", 00:22:19.607 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:19.607 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:19.607 "hdgst": false, 00:22:19.607 "ddgst": false 00:22:19.607 }, 00:22:19.607 "method": "bdev_nvme_attach_controller" 00:22:19.607 },{ 00:22:19.607 "params": { 00:22:19.607 "name": "Nvme6", 00:22:19.607 "trtype": "tcp", 00:22:19.607 "traddr": "10.0.0.2", 00:22:19.607 "adrfam": "ipv4", 00:22:19.607 "trsvcid": "4420", 00:22:19.607 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:19.607 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:19.607 "hdgst": false, 00:22:19.607 "ddgst": false 00:22:19.607 }, 00:22:19.607 "method": "bdev_nvme_attach_controller" 00:22:19.607 },{ 00:22:19.607 "params": { 00:22:19.607 "name": "Nvme7", 00:22:19.607 "trtype": "tcp", 00:22:19.607 "traddr": "10.0.0.2", 00:22:19.607 "adrfam": "ipv4", 00:22:19.607 "trsvcid": "4420", 00:22:19.607 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:19.607 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:19.607 "hdgst": false, 00:22:19.607 "ddgst": false 00:22:19.607 }, 00:22:19.607 "method": "bdev_nvme_attach_controller" 00:22:19.607 },{ 00:22:19.607 "params": { 00:22:19.607 "name": "Nvme8", 00:22:19.607 "trtype": "tcp", 00:22:19.607 "traddr": "10.0.0.2", 00:22:19.607 "adrfam": "ipv4", 00:22:19.607 "trsvcid": "4420", 00:22:19.607 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:19.607 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:19.607 "hdgst": false, 00:22:19.607 "ddgst": false 00:22:19.607 }, 00:22:19.607 "method": "bdev_nvme_attach_controller" 00:22:19.607 },{ 00:22:19.607 "params": { 00:22:19.607 "name": "Nvme9", 00:22:19.607 "trtype": "tcp", 00:22:19.607 "traddr": "10.0.0.2", 00:22:19.607 "adrfam": "ipv4", 00:22:19.607 "trsvcid": "4420", 00:22:19.607 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:19.607 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:19.607 "hdgst": false, 00:22:19.607 "ddgst": false 00:22:19.607 }, 00:22:19.607 "method": "bdev_nvme_attach_controller" 00:22:19.607 },{ 00:22:19.607 "params": { 00:22:19.607 "name": "Nvme10", 00:22:19.607 "trtype": "tcp", 00:22:19.607 "traddr": "10.0.0.2", 00:22:19.607 "adrfam": "ipv4", 00:22:19.607 "trsvcid": "4420", 00:22:19.607 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:19.607 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:19.607 "hdgst": false, 00:22:19.607 "ddgst": false 00:22:19.607 }, 00:22:19.607 "method": "bdev_nvme_attach_controller" 00:22:19.607 }' 00:22:19.607 [2024-07-15 09:01:07.983345] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:22:19.607 [2024-07-15 09:01:07.983421] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1566201 ] 00:22:19.607 EAL: No free 2048 kB hugepages reported on node 1 00:22:19.607 [2024-07-15 09:01:08.046819] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:19.865 [2024-07-15 09:01:08.155436] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:21.762 Running I/O for 10 seconds... 00:22:22.025 09:01:10 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:22:22.025 09:01:10 -- common/autotest_common.sh@852 -- # return 0 00:22:22.025 09:01:10 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:22.025 09:01:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:22.025 09:01:10 -- common/autotest_common.sh@10 -- # set +x 00:22:22.025 09:01:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:22.025 09:01:10 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:22.025 09:01:10 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:22.025 09:01:10 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:22.025 09:01:10 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:22:22.025 09:01:10 -- target/shutdown.sh@57 -- # local ret=1 00:22:22.025 09:01:10 -- target/shutdown.sh@58 -- # local i 00:22:22.025 09:01:10 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:22:22.025 09:01:10 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:22.025 09:01:10 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:22.025 09:01:10 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:22.025 09:01:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:22.025 09:01:10 -- common/autotest_common.sh@10 -- # set +x 00:22:22.025 09:01:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:22.025 09:01:10 -- target/shutdown.sh@60 -- # read_io_count=167 00:22:22.025 09:01:10 -- target/shutdown.sh@63 -- # '[' 167 -ge 100 ']' 00:22:22.025 09:01:10 -- target/shutdown.sh@64 -- # ret=0 00:22:22.025 09:01:10 -- target/shutdown.sh@65 -- # break 00:22:22.025 09:01:10 -- target/shutdown.sh@69 -- # return 0 00:22:22.025 09:01:10 -- target/shutdown.sh@134 -- # killprocess 1565886 00:22:22.025 09:01:10 -- common/autotest_common.sh@926 -- # '[' -z 1565886 ']' 00:22:22.025 09:01:10 -- common/autotest_common.sh@930 -- # kill -0 1565886 00:22:22.025 09:01:10 -- common/autotest_common.sh@931 -- # uname 00:22:22.025 09:01:10 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:22:22.025 09:01:10 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1565886 00:22:22.025 09:01:10 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:22:22.025 09:01:10 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:22:22.025 09:01:10 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1565886' 00:22:22.025 killing process with pid 1565886 00:22:22.025 09:01:10 -- common/autotest_common.sh@945 -- # kill 1565886 00:22:22.025 09:01:10 -- common/autotest_common.sh@950 -- # wait 1565886 00:22:22.025 [2024-07-15 09:01:10.525973] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd100 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.526093] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd100 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.526109] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd100 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.526122] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd100 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.526134] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd100 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.526145] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd100 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.526157] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd100 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.526169] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd100 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.526191] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd100 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.526218] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd100 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.526231] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd100 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.526242] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd100 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.526254] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd100 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.526265] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd100 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.526277] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd100 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.526288] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd100 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.526300] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd100 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.526311] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd100 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.526323] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd100 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.526335] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd100 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.526346] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd100 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.526358] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd100 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.526370] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd100 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.526381] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd100 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.527197] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.527238] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.527267] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.527279] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.527396] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.527412] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.527424] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.527437] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.527449] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.527462] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.527474] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.527486] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.527498] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.527510] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.527522] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.527534] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.527546] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.527558] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.527570] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.527582] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.527594] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.527606] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.527619] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.527646] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.527658] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.025 [2024-07-15 09:01:10.527669] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.527680] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.527692] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.527703] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.527715] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.527726] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.527742] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.527754] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.527766] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.527778] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.527791] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.527803] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.527814] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.527826] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.527838] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.527850] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.527872] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.527911] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.527924] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.527937] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.527949] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.527961] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.527973] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.527985] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.527997] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.528009] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.528021] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.528032] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.528044] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.528056] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.528068] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.528079] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.528091] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.528107] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.528119] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.528131] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.528143] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.528155] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bfa70 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533220] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533246] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533260] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533272] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533284] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533295] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533307] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533319] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533330] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533343] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533354] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533366] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533378] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533389] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533401] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533412] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533424] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533436] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533447] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533459] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533470] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533482] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533498] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533510] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533522] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533549] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533560] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533572] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533583] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533595] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533607] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533618] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533630] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533641] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533652] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533664] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533675] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533686] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533697] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533709] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533720] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533731] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533743] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533754] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533766] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533779] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533791] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533802] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533814] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533826] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533841] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533853] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533865] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533883] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533912] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533929] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533941] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533953] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533965] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533977] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.533990] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.534001] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.534013] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bd590 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535423] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535454] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535468] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535480] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535492] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535504] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535516] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535527] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535538] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535550] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535561] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535573] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535585] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535596] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535613] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535626] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535637] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535649] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535660] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535671] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535684] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535695] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535707] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535718] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535729] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535740] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535767] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535779] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535790] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535801] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535812] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535823] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535834] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535845] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535857] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535868] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535905] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535920] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535933] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535944] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535955] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535971] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535984] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.535996] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.536008] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.536019] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.536031] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.536043] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.536055] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.536066] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.536078] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.536089] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.536101] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.536113] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.536124] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.536136] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.536148] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.536159] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.536176] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.536187] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.536199] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.536211] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.536222] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bda40 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.542841] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.542873] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.542927] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.542939] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.542951] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.542975] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.542988] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.542999] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.543011] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.026 [2024-07-15 09:01:10.543023] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543034] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543046] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543058] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543069] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543081] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543092] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543104] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543116] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543128] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543139] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543150] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543170] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543181] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543193] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543220] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543233] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543244] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543255] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543267] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543279] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543290] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543301] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543316] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543328] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543339] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543350] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543361] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543372] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543383] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543395] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543406] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543417] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543428] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543439] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543452] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543463] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543475] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543486] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543497] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543509] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543520] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543532] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543543] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543554] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543565] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543576] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543588] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543599] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543611] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543626] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543638] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543649] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.543660] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bded0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545036] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545061] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545074] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545086] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545098] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545110] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545122] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545134] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545146] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545163] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545175] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545187] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545199] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545210] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545229] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545250] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545270] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545282] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 ns[2024-07-15 09:01:10.545296] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with id:0 cdw10:00000000 cdw11:00000000 00:22:22.027 the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545326] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.027 [2024-07-15 09:01:10.545348] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545363] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 ns[2024-07-15 09:01:10.545369] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with id:0 cdw10:00000000 cdw11:00000000 00:22:22.027 the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545404] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with [2024-07-15 09:01:10.545406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cthe state(5) to be set 00:22:22.027 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.027 [2024-07-15 09:01:10.545429] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545432] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.027 [2024-07-15 09:01:10.545453] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.027 [2024-07-15 09:01:10.545475] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545483] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.027 [2024-07-15 09:01:10.545497] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.027 [2024-07-15 09:01:10.545520] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545531] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e2d4f0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545541] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545563] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545577] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545589] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545601] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545612] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545625] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545637] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545649] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545642] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.027 [2024-07-15 09:01:10.545662] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545674] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.027 [2024-07-15 09:01:10.545697] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545705] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.027 [2024-07-15 09:01:10.545719] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545732] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.027 [2024-07-15 09:01:10.545745] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545758] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545755] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.027 [2024-07-15 09:01:10.545771] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545784] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.027 [2024-07-15 09:01:10.545796] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545809] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545806] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.027 [2024-07-15 09:01:10.545821] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545833] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.027 [2024-07-15 09:01:10.545845] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545858] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545855] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1df4f70 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545871] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545893] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545907] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545919] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545936] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545948] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545944] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.027 [2024-07-15 09:01:10.545961] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545974] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.545978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 c[2024-07-15 09:01:10.545986] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.027 the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.546001] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.546007] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 ns[2024-07-15 09:01:10.546013] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with id:0 cdw10:00000000 cdw11:00000000 00:22:22.027 the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.546028] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19be810 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.546032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.027 [2024-07-15 09:01:10.546058] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.027 [2024-07-15 09:01:10.546080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.027 [2024-07-15 09:01:10.546104] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.027 [2024-07-15 09:01:10.546128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.027 [2024-07-15 09:01:10.546151] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fb38c0 is same with the state(5) to be set 00:22:22.027 [2024-07-15 09:01:10.546241] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.027 [2024-07-15 09:01:10.546271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.027 [2024-07-15 09:01:10.546296] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.027 [2024-07-15 09:01:10.546319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 [2024-07-15 09:01:10.546344] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.028 [2024-07-15 09:01:10.546368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 [2024-07-15 09:01:10.546392] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.028 [2024-07-15 09:01:10.546415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 [2024-07-15 09:01:10.546438] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d55a50 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.546503] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.028 [2024-07-15 09:01:10.546533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 [2024-07-15 09:01:10.546557] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.028 [2024-07-15 09:01:10.546586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 [2024-07-15 09:01:10.546612] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.028 [2024-07-15 09:01:10.546636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 [2024-07-15 09:01:10.546660] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.028 [2024-07-15 09:01:10.546684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 [2024-07-15 09:01:10.546705] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fb8a60 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.546769] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.028 [2024-07-15 09:01:10.546798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 [2024-07-15 09:01:10.546822] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.028 [2024-07-15 09:01:10.546847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 [2024-07-15 09:01:10.546870] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.028 [2024-07-15 09:01:10.546905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 [2024-07-15 09:01:10.546941] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.028 [2024-07-15 09:01:10.546963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 [2024-07-15 09:01:10.546983] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1df2210 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.547198] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19becc0 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.547678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.028 [2024-07-15 09:01:10.547712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 [2024-07-15 09:01:10.547751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.028 [2024-07-15 09:01:10.547778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 [2024-07-15 09:01:10.547780] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.547806] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.547807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.028 [2024-07-15 09:01:10.547818] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.547831] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.547832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-07-15 09:01:10.547843] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.547858] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.547870] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.547890] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.547868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.028 [2024-07-15 09:01:10.547903] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.547915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-07-15 09:01:10.547925] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.547939] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.547951] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.547948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.028 [2024-07-15 09:01:10.547963] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.547974] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.547974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 [2024-07-15 09:01:10.547986] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.547998] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128[2024-07-15 09:01:10.548009] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.028 the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548024] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-07-15 09:01:10.548036] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548051] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548062] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.028 [2024-07-15 09:01:10.548074] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548086] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-07-15 09:01:10.548098] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548111] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548123] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.028 [2024-07-15 09:01:10.548134] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548146] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 [2024-07-15 09:01:10.548181] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548193] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.028 [2024-07-15 09:01:10.548204] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548216] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 [2024-07-15 09:01:10.548228] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548240] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548252] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with [2024-07-15 09:01:10.548247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25600 len:12the state(5) to be set 00:22:22.028 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.028 [2024-07-15 09:01:10.548266] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-07-15 09:01:10.548277] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548292] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548303] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with [2024-07-15 09:01:10.548299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25984 len:12the state(5) to be set 00:22:22.028 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.028 [2024-07-15 09:01:10.548317] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548329] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 [2024-07-15 09:01:10.548341] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548352] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548363] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.028 [2024-07-15 09:01:10.548375] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548386] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 [2024-07-15 09:01:10.548398] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548410] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.028 [2024-07-15 09:01:10.548421] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548433] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 [2024-07-15 09:01:10.548444] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548457] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29696 len:12[2024-07-15 09:01:10.548468] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.028 the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548483] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-07-15 09:01:10.548495] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548508] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548519] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.028 [2024-07-15 09:01:10.548531] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548542] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 [2024-07-15 09:01:10.548554] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548565] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548577] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with [2024-07-15 09:01:10.548572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:29952 len:1the state(5) to be set 00:22:22.028 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.028 [2024-07-15 09:01:10.548591] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf150 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.548597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 [2024-07-15 09:01:10.548624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.028 [2024-07-15 09:01:10.548647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 [2024-07-15 09:01:10.548673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.028 [2024-07-15 09:01:10.548696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 [2024-07-15 09:01:10.548721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.028 [2024-07-15 09:01:10.548745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 [2024-07-15 09:01:10.548770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.028 [2024-07-15 09:01:10.548794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 [2024-07-15 09:01:10.548819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.028 [2024-07-15 09:01:10.548843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 [2024-07-15 09:01:10.548868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.028 [2024-07-15 09:01:10.548917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 [2024-07-15 09:01:10.548957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.028 [2024-07-15 09:01:10.548982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 [2024-07-15 09:01:10.549035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.028 [2024-07-15 09:01:10.549059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 [2024-07-15 09:01:10.549087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.028 [2024-07-15 09:01:10.549111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 [2024-07-15 09:01:10.549139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.028 [2024-07-15 09:01:10.549163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 [2024-07-15 09:01:10.549199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.028 [2024-07-15 09:01:10.549245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 [2024-07-15 09:01:10.549273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.028 [2024-07-15 09:01:10.549296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 [2024-07-15 09:01:10.549324] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with [2024-07-15 09:01:10.549331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28800 len:12the state(5) to be set 00:22:22.028 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.028 [2024-07-15 09:01:10.549354] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.549356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 [2024-07-15 09:01:10.549368] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.549381] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.549383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.028 [2024-07-15 09:01:10.549392] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.549405] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.549408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 [2024-07-15 09:01:10.549417] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.549430] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.549435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:30464 len:128[2024-07-15 09:01:10.549442] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.028 the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.549456] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.549459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 [2024-07-15 09:01:10.549467] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.549480] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.549486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:30592 len:1[2024-07-15 09:01:10.549491] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.028 the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.549507] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.549511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-07-15 09:01:10.549519] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.028 the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.549536] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.028 [2024-07-15 09:01:10.549547] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.549544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.549559] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.549571] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.549569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.549582] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.549594] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.549597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.549606] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.549618] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.549621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.549630] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.549642] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.549653] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with [2024-07-15 09:01:10.549649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:30976 len:12the state(5) to be set 00:22:22.029 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.549667] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.549673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-07-15 09:01:10.549678] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.549694] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.549706] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.549703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.549718] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.549730] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.549728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.549742] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.549755] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.549760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:31232 len:12[2024-07-15 09:01:10.549766] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.549782] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.549786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.549794] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.549807] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.549812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:31360 len:12[2024-07-15 09:01:10.549819] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.549834] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.549838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.549846] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.549859] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.549864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:31488 len:1[2024-07-15 09:01:10.549871] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.549920] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.549921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.549933] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.549946] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.549949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:31616 len:12[2024-07-15 09:01:10.549958] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.549972] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.549975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.549984] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.549997] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.550002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:31744 len:12[2024-07-15 09:01:10.550008] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.550029] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.550033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.550043] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.550056] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.550061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:31872 len:1[2024-07-15 09:01:10.550068] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.550083] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.550086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.550095] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.550108] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.550114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:32000 len:12[2024-07-15 09:01:10.550121] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.550137] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.550141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.550149] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.550168] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.550180] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19bf5e0 is same with [2024-07-15 09:01:10.550175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:32128 len:12the state(5) to be set 00:22:22.029 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.550200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.550228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.550255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.550282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.550307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.550335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.550359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.550391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.550416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.550443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.550469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.550495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.550520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.550545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.550570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.550595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.550620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.550647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.550671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.550711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.550735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.550759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.550783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.550808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.550831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.550857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.550904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.550941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.550967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.550993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.551017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.551043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.551073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.551100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.551124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.551151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.551186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.551212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.551242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.551269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.551293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.551318] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f31c30 is same with the state(5) to be set 00:22:22.029 [2024-07-15 09:01:10.551407] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1f31c30 was disconnected and freed. reset controller. 00:22:22.029 [2024-07-15 09:01:10.551952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.551984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.552017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.552044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.552073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.552097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.552124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.552148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.552175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.552200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.552227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.552250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.552276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.552314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.552345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.552371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.552396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.552419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.552443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.552467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.552492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.552516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.552541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.552566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.552591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.552617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.552643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.552667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.552692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.552717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.552741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.552765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.552790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.552814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.552839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.552863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.552922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.552949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.552976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.553010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.553038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.553065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.553091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.553117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.553143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.553181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.553208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.553247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.553273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.553298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.029 [2024-07-15 09:01:10.553326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.029 [2024-07-15 09:01:10.553350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.553377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.030 [2024-07-15 09:01:10.553401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.553430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.030 [2024-07-15 09:01:10.553453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.553480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.030 [2024-07-15 09:01:10.553503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.553530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.030 [2024-07-15 09:01:10.553560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.553588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.030 [2024-07-15 09:01:10.553612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.553639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.030 [2024-07-15 09:01:10.553663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.553697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.030 [2024-07-15 09:01:10.553721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.553748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.030 [2024-07-15 09:01:10.553771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.553799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.030 [2024-07-15 09:01:10.553822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.553850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.030 [2024-07-15 09:01:10.553873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.553920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.030 [2024-07-15 09:01:10.553946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.553972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.030 [2024-07-15 09:01:10.553997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.554023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.030 [2024-07-15 09:01:10.554047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.554073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.030 [2024-07-15 09:01:10.554098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.554125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.030 [2024-07-15 09:01:10.554150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.554178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.030 [2024-07-15 09:01:10.554207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.554235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.030 [2024-07-15 09:01:10.554259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.554287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.030 [2024-07-15 09:01:10.554311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.554338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.030 [2024-07-15 09:01:10.554369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.554396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.030 [2024-07-15 09:01:10.554421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.554448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.030 [2024-07-15 09:01:10.554472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.554498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.030 [2024-07-15 09:01:10.554524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.554551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.030 [2024-07-15 09:01:10.554576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.554603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.030 [2024-07-15 09:01:10.554628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.554655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.030 [2024-07-15 09:01:10.554680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.554707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.030 [2024-07-15 09:01:10.554732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.554760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.030 [2024-07-15 09:01:10.554785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.554813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.030 [2024-07-15 09:01:10.554837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.554864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.030 [2024-07-15 09:01:10.554898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.554936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.030 [2024-07-15 09:01:10.554960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.554987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.030 [2024-07-15 09:01:10.555011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.555043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.030 [2024-07-15 09:01:10.555068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.555095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.030 [2024-07-15 09:01:10.555120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.555146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.030 [2024-07-15 09:01:10.555170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.555207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.030 [2024-07-15 09:01:10.555230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.555262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.030 [2024-07-15 09:01:10.555285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.555313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.030 [2024-07-15 09:01:10.555337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.555365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.030 [2024-07-15 09:01:10.555389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.555514] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1f69f40 was disconnected and freed. reset controller. 00:22:22.030 [2024-07-15 09:01:10.560837] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:22:22.030 [2024-07-15 09:01:10.560943] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fb38c0 (9): Bad file descriptor 00:22:22.030 [2024-07-15 09:01:10.560990] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e2d4f0 (9): Bad file descriptor 00:22:22.030 [2024-07-15 09:01:10.561084] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.030 [2024-07-15 09:01:10.561116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.561143] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.030 [2024-07-15 09:01:10.561169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.561201] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.030 [2024-07-15 09:01:10.561223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.561250] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.030 [2024-07-15 09:01:10.561275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.561310] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1debe60 is same with the state(5) to be set 00:22:22.030 [2024-07-15 09:01:10.561380] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.030 [2024-07-15 09:01:10.561409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.561434] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.030 [2024-07-15 09:01:10.561458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.561482] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.030 [2024-07-15 09:01:10.561505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.561530] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.030 [2024-07-15 09:01:10.561552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.561576] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1deba30 is same with the state(5) to be set 00:22:22.030 [2024-07-15 09:01:10.561620] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1df4f70 (9): Bad file descriptor 00:22:22.030 [2024-07-15 09:01:10.561696] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.030 [2024-07-15 09:01:10.561726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.561750] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.030 [2024-07-15 09:01:10.561775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.561800] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.030 [2024-07-15 09:01:10.561823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.561847] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.030 [2024-07-15 09:01:10.561869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.561903] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fb3490 is same with the state(5) to be set 00:22:22.030 [2024-07-15 09:01:10.561953] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d55a50 (9): Bad file descriptor 00:22:22.030 [2024-07-15 09:01:10.562000] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fb8a60 (9): Bad file descriptor 00:22:22.030 [2024-07-15 09:01:10.562045] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1df2210 (9): Bad file descriptor 00:22:22.030 [2024-07-15 09:01:10.562112] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.030 [2024-07-15 09:01:10.562142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.562168] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.030 [2024-07-15 09:01:10.562207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.562234] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.030 [2024-07-15 09:01:10.562260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.562284] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.030 [2024-07-15 09:01:10.562308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.030 [2024-07-15 09:01:10.562330] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f76830 is same with the state(5) to be set 00:22:22.296 [2024-07-15 09:01:10.563864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.296 [2024-07-15 09:01:10.563909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.296 [2024-07-15 09:01:10.563949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.296 [2024-07-15 09:01:10.563976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.296 [2024-07-15 09:01:10.564006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.296 [2024-07-15 09:01:10.564030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.296 [2024-07-15 09:01:10.564060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.296 [2024-07-15 09:01:10.564084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.296 [2024-07-15 09:01:10.564111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.296 [2024-07-15 09:01:10.564136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.296 [2024-07-15 09:01:10.564163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.296 [2024-07-15 09:01:10.564187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.297 [2024-07-15 09:01:10.564215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.297 [2024-07-15 09:01:10.564239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.297 [2024-07-15 09:01:10.564267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.297 [2024-07-15 09:01:10.564291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.297 [2024-07-15 09:01:10.564321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.297 [2024-07-15 09:01:10.564344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.297 [2024-07-15 09:01:10.564375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.297 [2024-07-15 09:01:10.564407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.297 [2024-07-15 09:01:10.564435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.297 [2024-07-15 09:01:10.564459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.297 [2024-07-15 09:01:10.564487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.297 [2024-07-15 09:01:10.564511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.297 [2024-07-15 09:01:10.564538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.297 [2024-07-15 09:01:10.564562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.297 [2024-07-15 09:01:10.564591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.297 [2024-07-15 09:01:10.564614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.297 [2024-07-15 09:01:10.564644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.297 [2024-07-15 09:01:10.564667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.297 [2024-07-15 09:01:10.564695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.297 [2024-07-15 09:01:10.564718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.297 [2024-07-15 09:01:10.564747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.297 [2024-07-15 09:01:10.564771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.297 [2024-07-15 09:01:10.564799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.297 [2024-07-15 09:01:10.564823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.297 [2024-07-15 09:01:10.564852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.297 [2024-07-15 09:01:10.564883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.297 [2024-07-15 09:01:10.564915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.297 [2024-07-15 09:01:10.564939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.297 [2024-07-15 09:01:10.564968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.297 [2024-07-15 09:01:10.564992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.297 [2024-07-15 09:01:10.565023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.297 [2024-07-15 09:01:10.565047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.297 [2024-07-15 09:01:10.565081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.297 [2024-07-15 09:01:10.565105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.297 [2024-07-15 09:01:10.565133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.297 [2024-07-15 09:01:10.565157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.297 [2024-07-15 09:01:10.565192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.297 [2024-07-15 09:01:10.565216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.297 [2024-07-15 09:01:10.565244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.297 [2024-07-15 09:01:10.565268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.297 [2024-07-15 09:01:10.565299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.297 [2024-07-15 09:01:10.565322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.297 [2024-07-15 09:01:10.565353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.297 [2024-07-15 09:01:10.565376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.297 [2024-07-15 09:01:10.565405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.297 [2024-07-15 09:01:10.565429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.297 [2024-07-15 09:01:10.565459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.297 [2024-07-15 09:01:10.565484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.297 [2024-07-15 09:01:10.565513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.297 [2024-07-15 09:01:10.565538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.297 [2024-07-15 09:01:10.565568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.297 [2024-07-15 09:01:10.565592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.297 [2024-07-15 09:01:10.565620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.297 [2024-07-15 09:01:10.565645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.297 [2024-07-15 09:01:10.565673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.297 [2024-07-15 09:01:10.565697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.297 [2024-07-15 09:01:10.565725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.297 [2024-07-15 09:01:10.565755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.297 [2024-07-15 09:01:10.565785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.297 [2024-07-15 09:01:10.565808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.297 [2024-07-15 09:01:10.565837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.297 [2024-07-15 09:01:10.565861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.297 [2024-07-15 09:01:10.565912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.297 [2024-07-15 09:01:10.565947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.297 [2024-07-15 09:01:10.565974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.297 [2024-07-15 09:01:10.565998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.297 [2024-07-15 09:01:10.566026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.297 [2024-07-15 09:01:10.566050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.297 [2024-07-15 09:01:10.566077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.297 [2024-07-15 09:01:10.566102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.297 [2024-07-15 09:01:10.566129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.297 [2024-07-15 09:01:10.566153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.297 [2024-07-15 09:01:10.566188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.297 [2024-07-15 09:01:10.566212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.297 [2024-07-15 09:01:10.566240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.297 [2024-07-15 09:01:10.566265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.297 [2024-07-15 09:01:10.566294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.297 [2024-07-15 09:01:10.566318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.297 [2024-07-15 09:01:10.566346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.297 [2024-07-15 09:01:10.566371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.297 [2024-07-15 09:01:10.566400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.297 [2024-07-15 09:01:10.566424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.297 [2024-07-15 09:01:10.566460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.297 [2024-07-15 09:01:10.566485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.298 [2024-07-15 09:01:10.566513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.298 [2024-07-15 09:01:10.566536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.298 [2024-07-15 09:01:10.566564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.298 [2024-07-15 09:01:10.566588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.298 [2024-07-15 09:01:10.566618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.298 [2024-07-15 09:01:10.566642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.298 [2024-07-15 09:01:10.566671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.298 [2024-07-15 09:01:10.566694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.298 [2024-07-15 09:01:10.566724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.298 [2024-07-15 09:01:10.566747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.298 [2024-07-15 09:01:10.566776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.298 [2024-07-15 09:01:10.566799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.298 [2024-07-15 09:01:10.566828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.298 [2024-07-15 09:01:10.566852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.298 [2024-07-15 09:01:10.566894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.298 [2024-07-15 09:01:10.566928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.298 [2024-07-15 09:01:10.566957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.298 [2024-07-15 09:01:10.566981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.298 [2024-07-15 09:01:10.567011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.298 [2024-07-15 09:01:10.567034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.298 [2024-07-15 09:01:10.567063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.298 [2024-07-15 09:01:10.567088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.298 [2024-07-15 09:01:10.567117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.298 [2024-07-15 09:01:10.567147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.298 [2024-07-15 09:01:10.567185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.298 [2024-07-15 09:01:10.567209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.298 [2024-07-15 09:01:10.567238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.298 [2024-07-15 09:01:10.567261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.298 [2024-07-15 09:01:10.567292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.298 [2024-07-15 09:01:10.567316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.298 [2024-07-15 09:01:10.567345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.298 [2024-07-15 09:01:10.567369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.298 [2024-07-15 09:01:10.567514] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1f6a260 was disconnected and freed. reset controller. 00:22:22.298 [2024-07-15 09:01:10.567583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.298 [2024-07-15 09:01:10.567614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.298 [2024-07-15 09:01:10.567645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.298 [2024-07-15 09:01:10.567672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.298 [2024-07-15 09:01:10.567699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.298 [2024-07-15 09:01:10.567725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.298 [2024-07-15 09:01:10.567752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.298 [2024-07-15 09:01:10.574114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.298 [2024-07-15 09:01:10.574192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.298 [2024-07-15 09:01:10.574220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.298 [2024-07-15 09:01:10.574248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.298 [2024-07-15 09:01:10.574273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.298 [2024-07-15 09:01:10.574301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.298 [2024-07-15 09:01:10.574326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.298 [2024-07-15 09:01:10.574354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.298 [2024-07-15 09:01:10.574390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.298 [2024-07-15 09:01:10.574418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.298 [2024-07-15 09:01:10.574442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.298 [2024-07-15 09:01:10.574470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.298 [2024-07-15 09:01:10.574495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.298 [2024-07-15 09:01:10.574521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.298 [2024-07-15 09:01:10.574547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.298 [2024-07-15 09:01:10.574575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.298 [2024-07-15 09:01:10.574601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.298 [2024-07-15 09:01:10.574628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.298 [2024-07-15 09:01:10.574653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.298 [2024-07-15 09:01:10.574680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.298 [2024-07-15 09:01:10.574706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.298 [2024-07-15 09:01:10.574734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.298 [2024-07-15 09:01:10.574760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.298 [2024-07-15 09:01:10.574786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.298 [2024-07-15 09:01:10.574812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.298 [2024-07-15 09:01:10.574839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.298 [2024-07-15 09:01:10.574866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.298 [2024-07-15 09:01:10.574926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.298 [2024-07-15 09:01:10.574953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.298 [2024-07-15 09:01:10.574980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.298 [2024-07-15 09:01:10.575006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.298 [2024-07-15 09:01:10.575034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.298 [2024-07-15 09:01:10.575059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.298 [2024-07-15 09:01:10.575092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.298 [2024-07-15 09:01:10.575116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.298 [2024-07-15 09:01:10.575144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.298 [2024-07-15 09:01:10.575176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.298 [2024-07-15 09:01:10.575204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.298 [2024-07-15 09:01:10.575228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.298 [2024-07-15 09:01:10.575256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.298 [2024-07-15 09:01:10.575282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.298 [2024-07-15 09:01:10.575308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.298 [2024-07-15 09:01:10.575334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.298 [2024-07-15 09:01:10.575361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.298 [2024-07-15 09:01:10.575385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.299 [2024-07-15 09:01:10.575410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.299 [2024-07-15 09:01:10.575435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.299 [2024-07-15 09:01:10.575462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.299 [2024-07-15 09:01:10.575488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.299 [2024-07-15 09:01:10.575514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.299 [2024-07-15 09:01:10.575540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.299 [2024-07-15 09:01:10.575566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.299 [2024-07-15 09:01:10.575594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.299 [2024-07-15 09:01:10.575620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.299 [2024-07-15 09:01:10.575646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.299 [2024-07-15 09:01:10.575674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.299 [2024-07-15 09:01:10.575700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.299 [2024-07-15 09:01:10.575727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.299 [2024-07-15 09:01:10.575758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.299 [2024-07-15 09:01:10.575786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.299 [2024-07-15 09:01:10.575813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.299 [2024-07-15 09:01:10.575839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.299 [2024-07-15 09:01:10.575864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.299 [2024-07-15 09:01:10.575925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.299 [2024-07-15 09:01:10.575951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.299 [2024-07-15 09:01:10.575980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.299 [2024-07-15 09:01:10.576004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.299 [2024-07-15 09:01:10.576031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.299 [2024-07-15 09:01:10.576057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.299 [2024-07-15 09:01:10.576085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.299 [2024-07-15 09:01:10.576109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.299 [2024-07-15 09:01:10.576137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.299 [2024-07-15 09:01:10.576172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.299 [2024-07-15 09:01:10.576199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.299 [2024-07-15 09:01:10.576225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.299 [2024-07-15 09:01:10.576252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.299 [2024-07-15 09:01:10.576278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.299 [2024-07-15 09:01:10.576304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.299 [2024-07-15 09:01:10.576330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.299 [2024-07-15 09:01:10.576357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.299 [2024-07-15 09:01:10.576383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.299 [2024-07-15 09:01:10.576409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.299 [2024-07-15 09:01:10.576435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.299 [2024-07-15 09:01:10.576474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.299 [2024-07-15 09:01:10.576500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.299 [2024-07-15 09:01:10.576527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.299 [2024-07-15 09:01:10.576553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.299 [2024-07-15 09:01:10.576579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.299 [2024-07-15 09:01:10.576604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.299 [2024-07-15 09:01:10.576631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.299 [2024-07-15 09:01:10.576657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.299 [2024-07-15 09:01:10.576684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.299 [2024-07-15 09:01:10.576709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.299 [2024-07-15 09:01:10.576735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.299 [2024-07-15 09:01:10.576761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.299 [2024-07-15 09:01:10.576788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.299 [2024-07-15 09:01:10.576813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.299 [2024-07-15 09:01:10.576839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.299 [2024-07-15 09:01:10.576865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.299 [2024-07-15 09:01:10.576902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.299 [2024-07-15 09:01:10.576931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.299 [2024-07-15 09:01:10.576958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.299 [2024-07-15 09:01:10.576984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.299 [2024-07-15 09:01:10.577012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.299 [2024-07-15 09:01:10.577037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.299 [2024-07-15 09:01:10.577064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.299 [2024-07-15 09:01:10.577090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.299 [2024-07-15 09:01:10.577117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.299 [2024-07-15 09:01:10.577148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.299 [2024-07-15 09:01:10.577185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.299 [2024-07-15 09:01:10.577211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.299 [2024-07-15 09:01:10.577238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.299 [2024-07-15 09:01:10.577264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.299 [2024-07-15 09:01:10.577290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.299 [2024-07-15 09:01:10.577316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.299 [2024-07-15 09:01:10.577343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.299 [2024-07-15 09:01:10.577369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.299 [2024-07-15 09:01:10.577397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.299 [2024-07-15 09:01:10.577423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.299 [2024-07-15 09:01:10.577450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.299 [2024-07-15 09:01:10.577476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.299 [2024-07-15 09:01:10.577649] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1f6b820 was disconnected and freed. reset controller. 00:22:22.299 [2024-07-15 09:01:10.578016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.299 [2024-07-15 09:01:10.578047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.299 [2024-07-15 09:01:10.578085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.299 [2024-07-15 09:01:10.578112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.299 [2024-07-15 09:01:10.578141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.299 [2024-07-15 09:01:10.578165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.299 [2024-07-15 09:01:10.578204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.300 [2024-07-15 09:01:10.578228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.300 [2024-07-15 09:01:10.578257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.300 [2024-07-15 09:01:10.578282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.300 [2024-07-15 09:01:10.578310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.300 [2024-07-15 09:01:10.578339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.300 [2024-07-15 09:01:10.578368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.300 [2024-07-15 09:01:10.578394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.300 [2024-07-15 09:01:10.578422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.300 [2024-07-15 09:01:10.578446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.300 [2024-07-15 09:01:10.578474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.300 [2024-07-15 09:01:10.578498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.300 [2024-07-15 09:01:10.578527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.300 [2024-07-15 09:01:10.578551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.300 [2024-07-15 09:01:10.578580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.300 [2024-07-15 09:01:10.578604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.300 [2024-07-15 09:01:10.578633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.300 [2024-07-15 09:01:10.578657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.300 [2024-07-15 09:01:10.578687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.300 [2024-07-15 09:01:10.578712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.300 [2024-07-15 09:01:10.578740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.300 [2024-07-15 09:01:10.578765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.300 [2024-07-15 09:01:10.578793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.300 [2024-07-15 09:01:10.578818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.300 [2024-07-15 09:01:10.578846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.300 [2024-07-15 09:01:10.578871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.300 [2024-07-15 09:01:10.578929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.300 [2024-07-15 09:01:10.578956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.300 [2024-07-15 09:01:10.578983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.300 [2024-07-15 09:01:10.579008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.300 [2024-07-15 09:01:10.579041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.300 [2024-07-15 09:01:10.579067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.300 [2024-07-15 09:01:10.579095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.300 [2024-07-15 09:01:10.579121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.300 [2024-07-15 09:01:10.579147] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f347f0 is same with the state(5) to be set 00:22:22.300 [2024-07-15 09:01:10.579251] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1f347f0 was disconnected and freed. reset controller. 00:22:22.300 [2024-07-15 09:01:10.579581] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:22.300 [2024-07-15 09:01:10.579725] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1debe60 (9): Bad file descriptor 00:22:22.300 [2024-07-15 09:01:10.579774] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1deba30 (9): Bad file descriptor 00:22:22.300 [2024-07-15 09:01:10.579813] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:22.300 [2024-07-15 09:01:10.579849] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fb3490 (9): Bad file descriptor 00:22:22.300 [2024-07-15 09:01:10.579903] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:22.300 [2024-07-15 09:01:10.579954] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f76830 (9): Bad file descriptor 00:22:22.300 [2024-07-15 09:01:10.584510] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:22.300 [2024-07-15 09:01:10.584593] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:22:22.300 [2024-07-15 09:01:10.584837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.300 [2024-07-15 09:01:10.584994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.300 [2024-07-15 09:01:10.585029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1fb38c0 with addr=10.0.0.2, port=4420 00:22:22.300 [2024-07-15 09:01:10.585057] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fb38c0 is same with the state(5) to be set 00:22:22.300 [2024-07-15 09:01:10.585207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.300 [2024-07-15 09:01:10.585382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.300 [2024-07-15 09:01:10.585416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1df2210 with addr=10.0.0.2, port=4420 00:22:22.300 [2024-07-15 09:01:10.585442] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1df2210 is same with the state(5) to be set 00:22:22.300 [2024-07-15 09:01:10.585898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.300 [2024-07-15 09:01:10.585939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.300 [2024-07-15 09:01:10.585977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.300 [2024-07-15 09:01:10.586005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.300 [2024-07-15 09:01:10.586034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.300 [2024-07-15 09:01:10.586060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.300 [2024-07-15 09:01:10.586100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.300 [2024-07-15 09:01:10.586127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.300 [2024-07-15 09:01:10.586154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.300 [2024-07-15 09:01:10.586180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.300 [2024-07-15 09:01:10.586207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.300 [2024-07-15 09:01:10.586232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.300 [2024-07-15 09:01:10.586259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.300 [2024-07-15 09:01:10.586286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.300 [2024-07-15 09:01:10.586312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.300 [2024-07-15 09:01:10.586337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.300 [2024-07-15 09:01:10.586364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.300 [2024-07-15 09:01:10.586389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.300 [2024-07-15 09:01:10.586416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.300 [2024-07-15 09:01:10.586441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.300 [2024-07-15 09:01:10.586470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.300 [2024-07-15 09:01:10.586496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.300 [2024-07-15 09:01:10.586525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.300 [2024-07-15 09:01:10.586549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.300 [2024-07-15 09:01:10.586577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.300 [2024-07-15 09:01:10.586602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.300 [2024-07-15 09:01:10.586631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.300 [2024-07-15 09:01:10.586656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.300 [2024-07-15 09:01:10.586684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.300 [2024-07-15 09:01:10.586708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.301 [2024-07-15 09:01:10.586737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.301 [2024-07-15 09:01:10.586767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.301 [2024-07-15 09:01:10.586794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.301 [2024-07-15 09:01:10.586819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.301 [2024-07-15 09:01:10.586847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.301 [2024-07-15 09:01:10.586872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.301 [2024-07-15 09:01:10.586909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.301 [2024-07-15 09:01:10.586933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.301 [2024-07-15 09:01:10.586962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.301 [2024-07-15 09:01:10.586986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.301 [2024-07-15 09:01:10.587014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.301 [2024-07-15 09:01:10.587037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.301 [2024-07-15 09:01:10.587066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.301 [2024-07-15 09:01:10.587091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.301 [2024-07-15 09:01:10.587120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.301 [2024-07-15 09:01:10.587144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.301 [2024-07-15 09:01:10.587173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.301 [2024-07-15 09:01:10.587197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.301 [2024-07-15 09:01:10.587227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.301 [2024-07-15 09:01:10.587251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.301 [2024-07-15 09:01:10.587279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.301 [2024-07-15 09:01:10.587303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.301 [2024-07-15 09:01:10.587332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.301 [2024-07-15 09:01:10.587356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.301 [2024-07-15 09:01:10.587386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.301 [2024-07-15 09:01:10.587409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.301 [2024-07-15 09:01:10.587443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.301 [2024-07-15 09:01:10.587469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.301 [2024-07-15 09:01:10.587498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.301 [2024-07-15 09:01:10.587523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.301 [2024-07-15 09:01:10.587550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.301 [2024-07-15 09:01:10.587574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.301 [2024-07-15 09:01:10.587601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.301 [2024-07-15 09:01:10.587626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.301 [2024-07-15 09:01:10.587654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.301 [2024-07-15 09:01:10.587679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.301 [2024-07-15 09:01:10.587707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.301 [2024-07-15 09:01:10.587731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.301 [2024-07-15 09:01:10.587760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.301 [2024-07-15 09:01:10.587784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.301 [2024-07-15 09:01:10.587812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.301 [2024-07-15 09:01:10.587837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.301 [2024-07-15 09:01:10.587866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.301 [2024-07-15 09:01:10.587900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.301 [2024-07-15 09:01:10.587930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.301 [2024-07-15 09:01:10.587954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.301 [2024-07-15 09:01:10.587982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.301 [2024-07-15 09:01:10.588006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.301 [2024-07-15 09:01:10.588034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.301 [2024-07-15 09:01:10.588059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.301 [2024-07-15 09:01:10.588088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.301 [2024-07-15 09:01:10.588118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.301 [2024-07-15 09:01:10.588146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.301 [2024-07-15 09:01:10.588170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.301 [2024-07-15 09:01:10.588199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.301 [2024-07-15 09:01:10.588224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.301 [2024-07-15 09:01:10.588252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.301 [2024-07-15 09:01:10.588275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.301 [2024-07-15 09:01:10.588304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.301 [2024-07-15 09:01:10.588327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.301 [2024-07-15 09:01:10.588357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.301 [2024-07-15 09:01:10.588380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.301 [2024-07-15 09:01:10.588408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.302 [2024-07-15 09:01:10.588432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.302 [2024-07-15 09:01:10.588461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.302 [2024-07-15 09:01:10.588485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.302 [2024-07-15 09:01:10.588515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.302 [2024-07-15 09:01:10.588538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.302 [2024-07-15 09:01:10.588568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.302 [2024-07-15 09:01:10.588591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.302 [2024-07-15 09:01:10.588620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.302 [2024-07-15 09:01:10.588645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.302 [2024-07-15 09:01:10.588674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.302 [2024-07-15 09:01:10.588698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.302 [2024-07-15 09:01:10.588727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.302 [2024-07-15 09:01:10.588752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.302 [2024-07-15 09:01:10.588785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.302 [2024-07-15 09:01:10.588811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.302 [2024-07-15 09:01:10.588838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.302 [2024-07-15 09:01:10.588863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.302 [2024-07-15 09:01:10.588900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.302 [2024-07-15 09:01:10.588925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.302 [2024-07-15 09:01:10.588953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.302 [2024-07-15 09:01:10.588977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.302 [2024-07-15 09:01:10.589005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.302 [2024-07-15 09:01:10.589029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.302 [2024-07-15 09:01:10.589057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.302 [2024-07-15 09:01:10.589081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.302 [2024-07-15 09:01:10.589109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.302 [2024-07-15 09:01:10.589132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.302 [2024-07-15 09:01:10.589161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.302 [2024-07-15 09:01:10.589185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.302 [2024-07-15 09:01:10.589214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.302 [2024-07-15 09:01:10.589238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.302 [2024-07-15 09:01:10.589267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.302 [2024-07-15 09:01:10.589292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.302 [2024-07-15 09:01:10.589322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.302 [2024-07-15 09:01:10.589346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.302 [2024-07-15 09:01:10.590993] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:22.302 [2024-07-15 09:01:10.591124] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:22.302 [2024-07-15 09:01:10.591231] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:22.302 [2024-07-15 09:01:10.591331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.302 [2024-07-15 09:01:10.591370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.302 [2024-07-15 09:01:10.591405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.302 [2024-07-15 09:01:10.591433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.302 [2024-07-15 09:01:10.591460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.302 [2024-07-15 09:01:10.591487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.302 [2024-07-15 09:01:10.591513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.302 [2024-07-15 09:01:10.591538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.302 [2024-07-15 09:01:10.591564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.302 [2024-07-15 09:01:10.591590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.302 [2024-07-15 09:01:10.591618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.302 [2024-07-15 09:01:10.591643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.302 [2024-07-15 09:01:10.591669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.302 [2024-07-15 09:01:10.591694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.302 [2024-07-15 09:01:10.591720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.302 [2024-07-15 09:01:10.591747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.302 [2024-07-15 09:01:10.591774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.302 [2024-07-15 09:01:10.591800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.302 [2024-07-15 09:01:10.591826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.302 [2024-07-15 09:01:10.591851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.302 [2024-07-15 09:01:10.591903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.302 [2024-07-15 09:01:10.591932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.302 [2024-07-15 09:01:10.591961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.302 [2024-07-15 09:01:10.591986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.302 [2024-07-15 09:01:10.592015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.302 [2024-07-15 09:01:10.592040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.302 [2024-07-15 09:01:10.592076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.302 [2024-07-15 09:01:10.592101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.302 [2024-07-15 09:01:10.592130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.302 [2024-07-15 09:01:10.592153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.302 [2024-07-15 09:01:10.592183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.302 [2024-07-15 09:01:10.592207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.302 [2024-07-15 09:01:10.592237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.302 [2024-07-15 09:01:10.592261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.302 [2024-07-15 09:01:10.592290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.302 [2024-07-15 09:01:10.592313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.302 [2024-07-15 09:01:10.592342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.302 [2024-07-15 09:01:10.592367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.302 [2024-07-15 09:01:10.592396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.302 [2024-07-15 09:01:10.592419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.302 [2024-07-15 09:01:10.592447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.302 [2024-07-15 09:01:10.592471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.302 [2024-07-15 09:01:10.592500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.302 [2024-07-15 09:01:10.592523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.302 [2024-07-15 09:01:10.592551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.302 [2024-07-15 09:01:10.592576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.302 [2024-07-15 09:01:10.592604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.302 [2024-07-15 09:01:10.592630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.303 [2024-07-15 09:01:10.592658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.303 [2024-07-15 09:01:10.592682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.303 [2024-07-15 09:01:10.592710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.303 [2024-07-15 09:01:10.592739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.303 [2024-07-15 09:01:10.592769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.303 [2024-07-15 09:01:10.592792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.303 [2024-07-15 09:01:10.592821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.303 [2024-07-15 09:01:10.592845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.303 [2024-07-15 09:01:10.592873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.303 [2024-07-15 09:01:10.592906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.303 [2024-07-15 09:01:10.592935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.303 [2024-07-15 09:01:10.592960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.303 [2024-07-15 09:01:10.592987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.303 [2024-07-15 09:01:10.593011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.303 [2024-07-15 09:01:10.593040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.303 [2024-07-15 09:01:10.593065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.303 [2024-07-15 09:01:10.593094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.303 [2024-07-15 09:01:10.593118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.303 [2024-07-15 09:01:10.593146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.303 [2024-07-15 09:01:10.593169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.303 [2024-07-15 09:01:10.593198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.303 [2024-07-15 09:01:10.593222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.303 [2024-07-15 09:01:10.593251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.303 [2024-07-15 09:01:10.593275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.303 [2024-07-15 09:01:10.593304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.303 [2024-07-15 09:01:10.593328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.303 [2024-07-15 09:01:10.593358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.303 [2024-07-15 09:01:10.593382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.303 [2024-07-15 09:01:10.593417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.303 [2024-07-15 09:01:10.593442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.303 [2024-07-15 09:01:10.593472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.303 [2024-07-15 09:01:10.593496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.303 [2024-07-15 09:01:10.593525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.303 [2024-07-15 09:01:10.593549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.303 [2024-07-15 09:01:10.593577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.303 [2024-07-15 09:01:10.593601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.303 [2024-07-15 09:01:10.593630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.303 [2024-07-15 09:01:10.593653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.303 [2024-07-15 09:01:10.593681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.303 [2024-07-15 09:01:10.593705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.303 [2024-07-15 09:01:10.593733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.303 [2024-07-15 09:01:10.593757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.303 [2024-07-15 09:01:10.593786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.303 [2024-07-15 09:01:10.593809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.303 [2024-07-15 09:01:10.593838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.303 [2024-07-15 09:01:10.593862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.303 [2024-07-15 09:01:10.593899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.303 [2024-07-15 09:01:10.593933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.303 [2024-07-15 09:01:10.593962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.303 [2024-07-15 09:01:10.593986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.303 [2024-07-15 09:01:10.594014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.303 [2024-07-15 09:01:10.594039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.303 [2024-07-15 09:01:10.594066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.303 [2024-07-15 09:01:10.594096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.303 [2024-07-15 09:01:10.594125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.303 [2024-07-15 09:01:10.594149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.303 [2024-07-15 09:01:10.594176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.303 [2024-07-15 09:01:10.594200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.303 [2024-07-15 09:01:10.594229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.303 [2024-07-15 09:01:10.594253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.303 [2024-07-15 09:01:10.594280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.303 [2024-07-15 09:01:10.594305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.303 [2024-07-15 09:01:10.594333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.303 [2024-07-15 09:01:10.594358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.303 [2024-07-15 09:01:10.594385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.303 [2024-07-15 09:01:10.594409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.303 [2024-07-15 09:01:10.594435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.303 [2024-07-15 09:01:10.594461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.303 [2024-07-15 09:01:10.594488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.303 [2024-07-15 09:01:10.594513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.303 [2024-07-15 09:01:10.594540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.303 [2024-07-15 09:01:10.594565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.303 [2024-07-15 09:01:10.594592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.303 [2024-07-15 09:01:10.594619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.303 [2024-07-15 09:01:10.594645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.303 [2024-07-15 09:01:10.594669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.303 [2024-07-15 09:01:10.594696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.303 [2024-07-15 09:01:10.594722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.303 [2024-07-15 09:01:10.594760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.303 [2024-07-15 09:01:10.594785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.303 [2024-07-15 09:01:10.594810] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2fecb70 is same with the state(5) to be set 00:22:22.303 [2024-07-15 09:01:10.596665] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:22:22.303 [2024-07-15 09:01:10.596712] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:22:22.303 [2024-07-15 09:01:10.596746] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:22:22.303 [2024-07-15 09:01:10.597047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.303 [2024-07-15 09:01:10.597198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.304 [2024-07-15 09:01:10.597231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1df4f70 with addr=10.0.0.2, port=4420 00:22:22.304 [2024-07-15 09:01:10.597259] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1df4f70 is same with the state(5) to be set 00:22:22.304 [2024-07-15 09:01:10.597296] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fb38c0 (9): Bad file descriptor 00:22:22.304 [2024-07-15 09:01:10.597330] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1df2210 (9): Bad file descriptor 00:22:22.304 [2024-07-15 09:01:10.597397] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:22.304 [2024-07-15 09:01:10.597470] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:22.304 [2024-07-15 09:01:10.597506] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:22.304 [2024-07-15 09:01:10.597541] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1df4f70 (9): Bad file descriptor 00:22:22.304 [2024-07-15 09:01:10.598746] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:22:22.304 [2024-07-15 09:01:10.598947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.304 [2024-07-15 09:01:10.599088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.304 [2024-07-15 09:01:10.599119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d55a50 with addr=10.0.0.2, port=4420 00:22:22.304 [2024-07-15 09:01:10.599141] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d55a50 is same with the state(5) to be set 00:22:22.304 [2024-07-15 09:01:10.599271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.304 [2024-07-15 09:01:10.599408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.304 [2024-07-15 09:01:10.599441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1fb8a60 with addr=10.0.0.2, port=4420 00:22:22.304 [2024-07-15 09:01:10.599465] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fb8a60 is same with the state(5) to be set 00:22:22.304 [2024-07-15 09:01:10.599586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.304 [2024-07-15 09:01:10.599732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.304 [2024-07-15 09:01:10.599765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1debe60 with addr=10.0.0.2, port=4420 00:22:22.304 [2024-07-15 09:01:10.599788] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1debe60 is same with the state(5) to be set 00:22:22.304 [2024-07-15 09:01:10.599814] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:22:22.304 [2024-07-15 09:01:10.599835] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:22:22.304 [2024-07-15 09:01:10.599863] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:22:22.304 [2024-07-15 09:01:10.599905] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:22.304 [2024-07-15 09:01:10.599930] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:22.304 [2024-07-15 09:01:10.599952] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:22.304 [2024-07-15 09:01:10.600446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.304 [2024-07-15 09:01:10.600478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.304 [2024-07-15 09:01:10.600514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.304 [2024-07-15 09:01:10.600537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.304 [2024-07-15 09:01:10.600559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.304 [2024-07-15 09:01:10.600579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.304 [2024-07-15 09:01:10.600600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.304 [2024-07-15 09:01:10.600618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.304 [2024-07-15 09:01:10.600640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.304 [2024-07-15 09:01:10.600658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.304 [2024-07-15 09:01:10.600679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.304 [2024-07-15 09:01:10.600697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.304 [2024-07-15 09:01:10.600718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.304 [2024-07-15 09:01:10.600737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.304 [2024-07-15 09:01:10.600758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.304 [2024-07-15 09:01:10.600779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.304 [2024-07-15 09:01:10.600805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.304 [2024-07-15 09:01:10.600828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.304 [2024-07-15 09:01:10.600854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.304 [2024-07-15 09:01:10.600883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.304 [2024-07-15 09:01:10.600910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.304 [2024-07-15 09:01:10.600947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.304 [2024-07-15 09:01:10.600971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.304 [2024-07-15 09:01:10.600990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.304 [2024-07-15 09:01:10.601012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.304 [2024-07-15 09:01:10.601031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.304 [2024-07-15 09:01:10.601052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.304 [2024-07-15 09:01:10.601071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.304 [2024-07-15 09:01:10.601092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.304 [2024-07-15 09:01:10.601111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.304 [2024-07-15 09:01:10.601131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.304 [2024-07-15 09:01:10.601150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.304 [2024-07-15 09:01:10.601181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.304 [2024-07-15 09:01:10.601204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.304 [2024-07-15 09:01:10.601231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.304 [2024-07-15 09:01:10.601254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.304 [2024-07-15 09:01:10.601281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.304 [2024-07-15 09:01:10.601305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.304 [2024-07-15 09:01:10.601331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.304 [2024-07-15 09:01:10.601356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.304 [2024-07-15 09:01:10.601383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.304 [2024-07-15 09:01:10.601405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.304 [2024-07-15 09:01:10.601442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.304 [2024-07-15 09:01:10.601464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.304 [2024-07-15 09:01:10.601492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.304 [2024-07-15 09:01:10.601518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.304 [2024-07-15 09:01:10.601543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.304 [2024-07-15 09:01:10.601574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.304 [2024-07-15 09:01:10.601601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.304 [2024-07-15 09:01:10.601627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.304 [2024-07-15 09:01:10.601653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.304 [2024-07-15 09:01:10.601677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.304 [2024-07-15 09:01:10.601705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.304 [2024-07-15 09:01:10.601729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.304 [2024-07-15 09:01:10.601758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.304 [2024-07-15 09:01:10.601780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.304 [2024-07-15 09:01:10.601818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.304 [2024-07-15 09:01:10.601842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.304 [2024-07-15 09:01:10.601889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.304 [2024-07-15 09:01:10.601917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.305 [2024-07-15 09:01:10.601944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.305 [2024-07-15 09:01:10.601969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.305 [2024-07-15 09:01:10.601996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.305 [2024-07-15 09:01:10.602021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.305 [2024-07-15 09:01:10.602047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.305 [2024-07-15 09:01:10.602071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.305 [2024-07-15 09:01:10.602098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.305 [2024-07-15 09:01:10.602121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.305 [2024-07-15 09:01:10.602149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.305 [2024-07-15 09:01:10.602173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.305 [2024-07-15 09:01:10.602209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.305 [2024-07-15 09:01:10.602233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.305 [2024-07-15 09:01:10.602265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.305 [2024-07-15 09:01:10.602290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.305 [2024-07-15 09:01:10.602316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.305 [2024-07-15 09:01:10.602341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.305 [2024-07-15 09:01:10.602367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.305 [2024-07-15 09:01:10.602392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.305 [2024-07-15 09:01:10.602418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.305 [2024-07-15 09:01:10.602441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.305 [2024-07-15 09:01:10.602469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.305 [2024-07-15 09:01:10.602492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.305 [2024-07-15 09:01:10.602531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.305 [2024-07-15 09:01:10.602554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.305 [2024-07-15 09:01:10.602581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.305 [2024-07-15 09:01:10.602606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.305 [2024-07-15 09:01:10.602632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.305 [2024-07-15 09:01:10.602657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.305 [2024-07-15 09:01:10.602684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.305 [2024-07-15 09:01:10.602709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.305 [2024-07-15 09:01:10.602736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.305 [2024-07-15 09:01:10.602760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.305 [2024-07-15 09:01:10.602787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.305 [2024-07-15 09:01:10.602811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.305 [2024-07-15 09:01:10.602839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.305 [2024-07-15 09:01:10.602873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.305 [2024-07-15 09:01:10.602912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.305 [2024-07-15 09:01:10.602943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.305 [2024-07-15 09:01:10.602969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.305 [2024-07-15 09:01:10.602995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.305 [2024-07-15 09:01:10.603021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.305 [2024-07-15 09:01:10.603046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.305 [2024-07-15 09:01:10.603073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.305 [2024-07-15 09:01:10.603096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.305 [2024-07-15 09:01:10.603123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.305 [2024-07-15 09:01:10.603147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.305 [2024-07-15 09:01:10.603187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.305 [2024-07-15 09:01:10.603211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.305 [2024-07-15 09:01:10.603240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.305 [2024-07-15 09:01:10.603263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.305 [2024-07-15 09:01:10.603290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.305 [2024-07-15 09:01:10.603315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.305 [2024-07-15 09:01:10.603340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.305 [2024-07-15 09:01:10.603365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.305 [2024-07-15 09:01:10.603391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.305 [2024-07-15 09:01:10.603417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.305 [2024-07-15 09:01:10.603443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.305 [2024-07-15 09:01:10.603468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.305 [2024-07-15 09:01:10.603495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.305 [2024-07-15 09:01:10.603519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.305 [2024-07-15 09:01:10.603546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.305 [2024-07-15 09:01:10.603569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.305 [2024-07-15 09:01:10.603603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.305 [2024-07-15 09:01:10.603628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.305 [2024-07-15 09:01:10.603653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.305 [2024-07-15 09:01:10.603678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.305 [2024-07-15 09:01:10.603712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.305 [2024-07-15 09:01:10.603737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.305 [2024-07-15 09:01:10.603762] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f33210 is same with the state(5) to be set 00:22:22.305 [2024-07-15 09:01:10.605266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.605298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.306 [2024-07-15 09:01:10.605333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.605359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.306 [2024-07-15 09:01:10.605389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.605420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.306 [2024-07-15 09:01:10.605450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.605475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.306 [2024-07-15 09:01:10.605504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.605528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.306 [2024-07-15 09:01:10.605554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.605578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.306 [2024-07-15 09:01:10.605602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.605629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.306 [2024-07-15 09:01:10.605657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.605682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.306 [2024-07-15 09:01:10.605708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.605733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.306 [2024-07-15 09:01:10.605767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.605792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.306 [2024-07-15 09:01:10.605820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.605845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.306 [2024-07-15 09:01:10.605871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.605906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.306 [2024-07-15 09:01:10.605936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.605960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.306 [2024-07-15 09:01:10.605988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.606011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.306 [2024-07-15 09:01:10.606038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.606062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.306 [2024-07-15 09:01:10.606087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.606112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.306 [2024-07-15 09:01:10.606138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.606162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.306 [2024-07-15 09:01:10.606188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.606213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.306 [2024-07-15 09:01:10.606240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.606262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.306 [2024-07-15 09:01:10.606290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.606313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.306 [2024-07-15 09:01:10.606341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.606364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.306 [2024-07-15 09:01:10.606390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.606419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.306 [2024-07-15 09:01:10.606445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.606470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.306 [2024-07-15 09:01:10.606496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.606520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.306 [2024-07-15 09:01:10.606546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.606568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.306 [2024-07-15 09:01:10.606597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.606620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.306 [2024-07-15 09:01:10.606649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.606672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.306 [2024-07-15 09:01:10.606699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.606724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.306 [2024-07-15 09:01:10.606750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.606774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.306 [2024-07-15 09:01:10.606800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.606835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.306 [2024-07-15 09:01:10.606861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.606895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.306 [2024-07-15 09:01:10.606924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.606948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.306 [2024-07-15 09:01:10.606976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.606999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.306 [2024-07-15 09:01:10.607026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.607050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.306 [2024-07-15 09:01:10.607083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.607108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.306 [2024-07-15 09:01:10.607143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.607168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.306 [2024-07-15 09:01:10.607195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.607219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.306 [2024-07-15 09:01:10.607246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.607269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.306 [2024-07-15 09:01:10.607297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.607320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.306 [2024-07-15 09:01:10.607348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.607371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.306 [2024-07-15 09:01:10.607399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.607423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.306 [2024-07-15 09:01:10.607451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.607476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.306 [2024-07-15 09:01:10.607503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.306 [2024-07-15 09:01:10.607526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.307 [2024-07-15 09:01:10.607552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.307 [2024-07-15 09:01:10.607577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.307 [2024-07-15 09:01:10.607603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.307 [2024-07-15 09:01:10.607628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.307 [2024-07-15 09:01:10.607654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.307 [2024-07-15 09:01:10.607678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.307 [2024-07-15 09:01:10.607705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.307 [2024-07-15 09:01:10.607734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.307 [2024-07-15 09:01:10.607762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.307 [2024-07-15 09:01:10.607785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.307 [2024-07-15 09:01:10.607813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.307 [2024-07-15 09:01:10.607837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.307 [2024-07-15 09:01:10.607873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.307 [2024-07-15 09:01:10.607906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.307 [2024-07-15 09:01:10.607933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.307 [2024-07-15 09:01:10.607957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.307 [2024-07-15 09:01:10.607983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.307 [2024-07-15 09:01:10.608009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.307 [2024-07-15 09:01:10.608035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.307 [2024-07-15 09:01:10.608061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.307 [2024-07-15 09:01:10.608087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.307 [2024-07-15 09:01:10.608111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.307 [2024-07-15 09:01:10.608137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.307 [2024-07-15 09:01:10.608160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.307 [2024-07-15 09:01:10.608196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.307 [2024-07-15 09:01:10.608219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.307 [2024-07-15 09:01:10.608258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.307 [2024-07-15 09:01:10.608281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.307 [2024-07-15 09:01:10.608308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.307 [2024-07-15 09:01:10.608332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.307 [2024-07-15 09:01:10.608358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.307 [2024-07-15 09:01:10.608384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.307 [2024-07-15 09:01:10.608417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.307 [2024-07-15 09:01:10.608442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.307 [2024-07-15 09:01:10.608469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.307 [2024-07-15 09:01:10.608492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.307 [2024-07-15 09:01:10.608520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.307 [2024-07-15 09:01:10.608543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.307 [2024-07-15 09:01:10.608577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.307 [2024-07-15 09:01:10.608600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.307 [2024-07-15 09:01:10.608626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.307 [2024-07-15 09:01:10.608649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.307 [2024-07-15 09:01:10.608673] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f35dd0 is same with the state(5) to be set 00:22:22.307 [2024-07-15 09:01:10.610168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.307 [2024-07-15 09:01:10.610201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.307 [2024-07-15 09:01:10.610235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.307 [2024-07-15 09:01:10.610262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.307 [2024-07-15 09:01:10.610290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.307 [2024-07-15 09:01:10.610314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.307 [2024-07-15 09:01:10.610342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.307 [2024-07-15 09:01:10.610367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.307 [2024-07-15 09:01:10.610396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.307 [2024-07-15 09:01:10.610421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.307 [2024-07-15 09:01:10.610446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.307 [2024-07-15 09:01:10.610473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.307 [2024-07-15 09:01:10.610499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.307 [2024-07-15 09:01:10.610522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.307 [2024-07-15 09:01:10.610555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.307 [2024-07-15 09:01:10.610579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.307 [2024-07-15 09:01:10.610608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.307 [2024-07-15 09:01:10.610630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.307 [2024-07-15 09:01:10.610672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.307 [2024-07-15 09:01:10.610697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.307 [2024-07-15 09:01:10.610725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.307 [2024-07-15 09:01:10.610749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.307 [2024-07-15 09:01:10.610774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.307 [2024-07-15 09:01:10.610799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.307 [2024-07-15 09:01:10.610824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.307 [2024-07-15 09:01:10.610849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.307 [2024-07-15 09:01:10.610900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.307 [2024-07-15 09:01:10.610928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.307 [2024-07-15 09:01:10.610955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.307 [2024-07-15 09:01:10.610978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.307 [2024-07-15 09:01:10.611007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.307 [2024-07-15 09:01:10.611031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.307 [2024-07-15 09:01:10.611059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.307 [2024-07-15 09:01:10.611083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.307 [2024-07-15 09:01:10.611111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.307 [2024-07-15 09:01:10.611134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.307 [2024-07-15 09:01:10.611160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.307 [2024-07-15 09:01:10.611184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.307 [2024-07-15 09:01:10.611208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.307 [2024-07-15 09:01:10.611240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.307 [2024-07-15 09:01:10.611267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.307 [2024-07-15 09:01:10.611291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.308 [2024-07-15 09:01:10.611318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.308 [2024-07-15 09:01:10.611341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.308 [2024-07-15 09:01:10.611369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.308 [2024-07-15 09:01:10.611392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.308 [2024-07-15 09:01:10.611417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.308 [2024-07-15 09:01:10.611442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.308 [2024-07-15 09:01:10.611467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.308 [2024-07-15 09:01:10.611491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.308 [2024-07-15 09:01:10.611523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.308 [2024-07-15 09:01:10.611548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.308 [2024-07-15 09:01:10.611575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.308 [2024-07-15 09:01:10.611598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.308 [2024-07-15 09:01:10.611626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.308 [2024-07-15 09:01:10.611649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.308 [2024-07-15 09:01:10.611675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.308 [2024-07-15 09:01:10.611699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.308 [2024-07-15 09:01:10.611724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.308 [2024-07-15 09:01:10.611749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.308 [2024-07-15 09:01:10.611776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.308 [2024-07-15 09:01:10.611802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.308 [2024-07-15 09:01:10.611829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.308 [2024-07-15 09:01:10.611854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.308 [2024-07-15 09:01:10.611894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.308 [2024-07-15 09:01:10.611922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.308 [2024-07-15 09:01:10.611950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.308 [2024-07-15 09:01:10.611973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.308 [2024-07-15 09:01:10.612001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.308 [2024-07-15 09:01:10.612024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.308 [2024-07-15 09:01:10.612049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.308 [2024-07-15 09:01:10.612074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.308 [2024-07-15 09:01:10.612099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.308 [2024-07-15 09:01:10.612124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.308 [2024-07-15 09:01:10.612151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.308 [2024-07-15 09:01:10.612185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.308 [2024-07-15 09:01:10.612214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.308 [2024-07-15 09:01:10.612247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.308 [2024-07-15 09:01:10.612275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.308 [2024-07-15 09:01:10.612298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.308 [2024-07-15 09:01:10.612324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.308 [2024-07-15 09:01:10.612349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.308 [2024-07-15 09:01:10.612375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.308 [2024-07-15 09:01:10.612401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.308 [2024-07-15 09:01:10.612426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.308 [2024-07-15 09:01:10.612451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.308 [2024-07-15 09:01:10.612478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.308 [2024-07-15 09:01:10.612500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.308 [2024-07-15 09:01:10.612528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.308 [2024-07-15 09:01:10.612561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.308 [2024-07-15 09:01:10.612590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.308 [2024-07-15 09:01:10.612613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.308 [2024-07-15 09:01:10.612641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.308 [2024-07-15 09:01:10.612664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.308 [2024-07-15 09:01:10.612691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.308 [2024-07-15 09:01:10.612715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.308 [2024-07-15 09:01:10.612740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.308 [2024-07-15 09:01:10.612763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.308 [2024-07-15 09:01:10.612790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.308 [2024-07-15 09:01:10.612814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.308 [2024-07-15 09:01:10.612842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.308 [2024-07-15 09:01:10.612864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.308 [2024-07-15 09:01:10.612903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.308 [2024-07-15 09:01:10.612926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.308 [2024-07-15 09:01:10.612956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.308 [2024-07-15 09:01:10.612979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.308 [2024-07-15 09:01:10.613005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.308 [2024-07-15 09:01:10.613029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.308 [2024-07-15 09:01:10.613054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.308 [2024-07-15 09:01:10.613080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.308 [2024-07-15 09:01:10.613105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.308 [2024-07-15 09:01:10.613130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.308 [2024-07-15 09:01:10.613155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.308 [2024-07-15 09:01:10.613180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.308 [2024-07-15 09:01:10.613213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.308 [2024-07-15 09:01:10.613239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.308 [2024-07-15 09:01:10.613266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.308 [2024-07-15 09:01:10.613289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.308 [2024-07-15 09:01:10.613316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.308 [2024-07-15 09:01:10.613338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.309 [2024-07-15 09:01:10.613368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.309 [2024-07-15 09:01:10.613393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.309 [2024-07-15 09:01:10.613420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.309 [2024-07-15 09:01:10.613444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.309 [2024-07-15 09:01:10.613470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.309 [2024-07-15 09:01:10.613494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.309 [2024-07-15 09:01:10.613519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.309 [2024-07-15 09:01:10.613543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.309 [2024-07-15 09:01:10.613568] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2e49fa0 is same with the state(5) to be set 00:22:22.309 [2024-07-15 09:01:10.615852] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:22.309 [2024-07-15 09:01:10.615896] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:22.309 [2024-07-15 09:01:10.615926] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:22:22.309 [2024-07-15 09:01:10.615962] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:22:22.309 task offset: 29184 on job bdev=Nvme5n1 fails 00:22:22.309 00:22:22.309 Latency(us) 00:22:22.309 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:22.309 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:22.309 Job: Nvme1n1 ended in about 0.58 seconds with error 00:22:22.309 Verification LBA range: start 0x0 length 0x400 00:22:22.309 Nvme1n1 : 0.58 359.03 22.44 110.47 0.00 135171.21 43302.31 146023.92 00:22:22.309 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:22.309 Job: Nvme2n1 ended in about 0.61 seconds with error 00:22:22.309 Verification LBA range: start 0x0 length 0x400 00:22:22.309 Nvme2n1 : 0.61 270.52 16.91 105.57 0.00 166729.72 99420.54 155344.59 00:22:22.309 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:22.309 Job: Nvme3n1 ended in about 0.60 seconds with error 00:22:22.309 Verification LBA range: start 0x0 length 0x400 00:22:22.309 Nvme3n1 : 0.60 348.39 21.77 107.20 0.00 135768.03 53205.52 117285.17 00:22:22.309 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:22.309 Job: Nvme4n1 ended in about 0.60 seconds with error 00:22:22.309 Verification LBA range: start 0x0 length 0x400 00:22:22.309 Nvme4n1 : 0.60 347.63 21.73 106.96 0.00 134228.86 45632.47 116508.44 00:22:22.309 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:22.309 Job: Nvme5n1 ended in about 0.57 seconds with error 00:22:22.309 Verification LBA range: start 0x0 length 0x400 00:22:22.309 Nvme5n1 : 0.57 361.84 22.62 111.34 0.00 126938.16 13592.65 114178.28 00:22:22.309 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:22.309 Job: Nvme6n1 ended in about 0.62 seconds with error 00:22:22.309 Verification LBA range: start 0x0 length 0x400 00:22:22.309 Nvme6n1 : 0.62 264.25 16.52 103.12 0.00 162251.64 93595.12 146800.64 00:22:22.309 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:22.309 Job: Nvme7n1 ended in about 0.60 seconds with error 00:22:22.309 Verification LBA range: start 0x0 length 0x400 00:22:22.309 Nvme7n1 : 0.60 346.75 21.67 33.34 0.00 149932.66 23107.51 119615.34 00:22:22.309 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:22.309 Job: Nvme8n1 ended in about 0.63 seconds with error 00:22:22.309 Verification LBA range: start 0x0 length 0x400 00:22:22.309 Nvme8n1 : 0.63 262.18 16.39 102.31 0.00 159527.14 91264.95 159228.21 00:22:22.309 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:22.309 Job: Nvme9n1 ended in about 0.63 seconds with error 00:22:22.309 Verification LBA range: start 0x0 length 0x400 00:22:22.309 Nvme9n1 : 0.63 260.15 16.26 101.52 0.00 158829.63 91653.31 152237.70 00:22:22.309 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:22.309 Job: Nvme10n1 ended in about 0.61 seconds with error 00:22:22.309 Verification LBA range: start 0x0 length 0x400 00:22:22.309 Nvme10n1 : 0.61 268.11 16.76 104.63 0.00 151484.82 87769.69 122722.23 00:22:22.309 =================================================================================================================== 00:22:22.309 Total : 3088.85 193.05 986.46 0.00 147007.00 13592.65 159228.21 00:22:22.309 [2024-07-15 09:01:10.642991] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:22:22.309 [2024-07-15 09:01:10.643074] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:22:22.309 [2024-07-15 09:01:10.643419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.309 [2024-07-15 09:01:10.643666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.309 [2024-07-15 09:01:10.643698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1e2d4f0 with addr=10.0.0.2, port=4420 00:22:22.309 [2024-07-15 09:01:10.643728] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e2d4f0 is same with the state(5) to be set 00:22:22.309 [2024-07-15 09:01:10.643769] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d55a50 (9): Bad file descriptor 00:22:22.309 [2024-07-15 09:01:10.643807] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fb8a60 (9): Bad file descriptor 00:22:22.309 [2024-07-15 09:01:10.643839] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1debe60 (9): Bad file descriptor 00:22:22.309 [2024-07-15 09:01:10.643867] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:22:22.309 [2024-07-15 09:01:10.643903] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:22:22.309 [2024-07-15 09:01:10.643937] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:22:22.309 [2024-07-15 09:01:10.644041] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:22.309 [2024-07-15 09:01:10.644077] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:22.309 [2024-07-15 09:01:10.644120] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:22.309 [2024-07-15 09:01:10.644151] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:22.309 [2024-07-15 09:01:10.644185] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e2d4f0 (9): Bad file descriptor 00:22:22.309 [2024-07-15 09:01:10.644409] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:22.309 [2024-07-15 09:01:10.644622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.309 [2024-07-15 09:01:10.644801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.309 [2024-07-15 09:01:10.644831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1fb3490 with addr=10.0.0.2, port=4420 00:22:22.309 [2024-07-15 09:01:10.644858] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fb3490 is same with the state(5) to be set 00:22:22.309 [2024-07-15 09:01:10.645020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.309 [2024-07-15 09:01:10.645188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.309 [2024-07-15 09:01:10.645217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1deba30 with addr=10.0.0.2, port=4420 00:22:22.309 [2024-07-15 09:01:10.645244] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1deba30 is same with the state(5) to be set 00:22:22.309 [2024-07-15 09:01:10.645479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.309 [2024-07-15 09:01:10.645613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.309 [2024-07-15 09:01:10.645642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f76830 with addr=10.0.0.2, port=4420 00:22:22.309 [2024-07-15 09:01:10.645668] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f76830 is same with the state(5) to be set 00:22:22.309 [2024-07-15 09:01:10.645695] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:22:22.309 [2024-07-15 09:01:10.645717] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:22:22.309 [2024-07-15 09:01:10.645741] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:22:22.309 [2024-07-15 09:01:10.645771] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:22:22.309 [2024-07-15 09:01:10.645796] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:22:22.309 [2024-07-15 09:01:10.645817] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:22:22.309 [2024-07-15 09:01:10.645845] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:22:22.309 [2024-07-15 09:01:10.645868] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:22:22.309 [2024-07-15 09:01:10.645900] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:22:22.309 [2024-07-15 09:01:10.645953] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:22.310 [2024-07-15 09:01:10.645986] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:22.310 [2024-07-15 09:01:10.646023] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:22.310 [2024-07-15 09:01:10.646054] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:22.310 [2024-07-15 09:01:10.646084] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:22.310 [2024-07-15 09:01:10.646114] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:22.310 [2024-07-15 09:01:10.647108] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:22.310 [2024-07-15 09:01:10.647139] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:22:22.310 [2024-07-15 09:01:10.647193] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:22.310 [2024-07-15 09:01:10.647218] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:22.310 [2024-07-15 09:01:10.647241] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:22.310 [2024-07-15 09:01:10.647294] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fb3490 (9): Bad file descriptor 00:22:22.310 [2024-07-15 09:01:10.647328] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1deba30 (9): Bad file descriptor 00:22:22.310 [2024-07-15 09:01:10.647360] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f76830 (9): Bad file descriptor 00:22:22.310 [2024-07-15 09:01:10.647386] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:22:22.310 [2024-07-15 09:01:10.647408] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:22:22.310 [2024-07-15 09:01:10.647430] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:22:22.310 [2024-07-15 09:01:10.647522] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:22:22.310 [2024-07-15 09:01:10.647557] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:22.310 [2024-07-15 09:01:10.647706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.310 [2024-07-15 09:01:10.647848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.310 [2024-07-15 09:01:10.647887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1df2210 with addr=10.0.0.2, port=4420 00:22:22.310 [2024-07-15 09:01:10.647925] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1df2210 is same with the state(5) to be set 00:22:22.310 [2024-07-15 09:01:10.648052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.310 [2024-07-15 09:01:10.648195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.310 [2024-07-15 09:01:10.648230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1fb38c0 with addr=10.0.0.2, port=4420 00:22:22.310 [2024-07-15 09:01:10.648258] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fb38c0 is same with the state(5) to be set 00:22:22.310 [2024-07-15 09:01:10.648282] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:22:22.310 [2024-07-15 09:01:10.648302] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:22:22.310 [2024-07-15 09:01:10.648326] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:22:22.310 [2024-07-15 09:01:10.648354] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:22:22.310 [2024-07-15 09:01:10.648377] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:22:22.310 [2024-07-15 09:01:10.648398] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:22:22.310 [2024-07-15 09:01:10.648425] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:22:22.310 [2024-07-15 09:01:10.648448] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:22:22.310 [2024-07-15 09:01:10.648470] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:22:22.310 [2024-07-15 09:01:10.648551] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:22.310 [2024-07-15 09:01:10.648585] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:22.310 [2024-07-15 09:01:10.648607] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:22.310 [2024-07-15 09:01:10.648744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.310 [2024-07-15 09:01:10.648888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.310 [2024-07-15 09:01:10.648922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1df4f70 with addr=10.0.0.2, port=4420 00:22:22.310 [2024-07-15 09:01:10.648946] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1df4f70 is same with the state(5) to be set 00:22:22.310 [2024-07-15 09:01:10.648976] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1df2210 (9): Bad file descriptor 00:22:22.310 [2024-07-15 09:01:10.649006] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fb38c0 (9): Bad file descriptor 00:22:22.310 [2024-07-15 09:01:10.649084] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1df4f70 (9): Bad file descriptor 00:22:22.310 [2024-07-15 09:01:10.649114] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:22.310 [2024-07-15 09:01:10.649138] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:22.310 [2024-07-15 09:01:10.649169] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:22.310 [2024-07-15 09:01:10.649194] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:22:22.310 [2024-07-15 09:01:10.649218] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:22:22.310 [2024-07-15 09:01:10.649238] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:22:22.310 [2024-07-15 09:01:10.649291] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:22.310 [2024-07-15 09:01:10.649318] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:22.310 [2024-07-15 09:01:10.649341] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:22:22.310 [2024-07-15 09:01:10.649361] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:22:22.310 [2024-07-15 09:01:10.649380] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:22:22.310 [2024-07-15 09:01:10.649437] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:22.877 09:01:11 -- target/shutdown.sh@135 -- # nvmfpid= 00:22:22.877 09:01:11 -- target/shutdown.sh@138 -- # sleep 1 00:22:23.813 09:01:12 -- target/shutdown.sh@141 -- # kill -9 1566201 00:22:23.813 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (1566201) - No such process 00:22:23.813 09:01:12 -- target/shutdown.sh@141 -- # true 00:22:23.813 09:01:12 -- target/shutdown.sh@143 -- # stoptarget 00:22:23.813 09:01:12 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:23.813 09:01:12 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:23.813 09:01:12 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:23.813 09:01:12 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:23.813 09:01:12 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:23.813 09:01:12 -- nvmf/common.sh@116 -- # sync 00:22:23.813 09:01:12 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:23.813 09:01:12 -- nvmf/common.sh@119 -- # set +e 00:22:23.813 09:01:12 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:23.813 09:01:12 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:23.813 rmmod nvme_tcp 00:22:23.813 rmmod nvme_fabrics 00:22:23.813 rmmod nvme_keyring 00:22:23.813 09:01:12 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:23.813 09:01:12 -- nvmf/common.sh@123 -- # set -e 00:22:23.813 09:01:12 -- nvmf/common.sh@124 -- # return 0 00:22:23.813 09:01:12 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:22:23.813 09:01:12 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:23.813 09:01:12 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:23.813 09:01:12 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:23.813 09:01:12 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:23.813 09:01:12 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:23.813 09:01:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:23.813 09:01:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:23.813 09:01:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:25.715 09:01:14 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:25.715 00:22:25.715 real 0m8.055s 00:22:25.715 user 0m20.854s 00:22:25.715 sys 0m1.479s 00:22:25.715 09:01:14 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:22:25.715 09:01:14 -- common/autotest_common.sh@10 -- # set +x 00:22:25.715 ************************************ 00:22:25.715 END TEST nvmf_shutdown_tc3 00:22:25.715 ************************************ 00:22:25.975 09:01:14 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:22:25.975 00:22:25.975 real 0m28.769s 00:22:25.975 user 1m22.296s 00:22:25.975 sys 0m6.521s 00:22:25.975 09:01:14 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:22:25.975 09:01:14 -- common/autotest_common.sh@10 -- # set +x 00:22:25.975 ************************************ 00:22:25.975 END TEST nvmf_shutdown 00:22:25.975 ************************************ 00:22:25.975 09:01:14 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:22:25.975 09:01:14 -- common/autotest_common.sh@718 -- # xtrace_disable 00:22:25.975 09:01:14 -- common/autotest_common.sh@10 -- # set +x 00:22:25.975 09:01:14 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:22:25.975 09:01:14 -- common/autotest_common.sh@712 -- # xtrace_disable 00:22:25.975 09:01:14 -- common/autotest_common.sh@10 -- # set +x 00:22:25.975 09:01:14 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:22:25.975 09:01:14 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:22:25.975 09:01:14 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:22:25.975 09:01:14 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:22:25.975 09:01:14 -- common/autotest_common.sh@10 -- # set +x 00:22:25.975 ************************************ 00:22:25.975 START TEST nvmf_multicontroller 00:22:25.975 ************************************ 00:22:25.975 09:01:14 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:22:25.975 * Looking for test storage... 00:22:25.975 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:25.975 09:01:14 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:25.975 09:01:14 -- nvmf/common.sh@7 -- # uname -s 00:22:25.975 09:01:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:25.975 09:01:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:25.975 09:01:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:25.975 09:01:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:25.975 09:01:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:25.975 09:01:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:25.975 09:01:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:25.975 09:01:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:25.975 09:01:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:25.975 09:01:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:25.975 09:01:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:25.975 09:01:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:25.975 09:01:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:25.975 09:01:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:25.975 09:01:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:25.975 09:01:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:25.975 09:01:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:25.975 09:01:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:25.975 09:01:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:25.975 09:01:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:25.975 09:01:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:25.975 09:01:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:25.975 09:01:14 -- paths/export.sh@5 -- # export PATH 00:22:25.975 09:01:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:25.975 09:01:14 -- nvmf/common.sh@46 -- # : 0 00:22:25.975 09:01:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:25.975 09:01:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:25.975 09:01:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:25.975 09:01:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:25.975 09:01:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:25.975 09:01:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:25.975 09:01:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:25.975 09:01:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:25.975 09:01:14 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:25.975 09:01:14 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:25.975 09:01:14 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:22:25.975 09:01:14 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:22:25.975 09:01:14 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:22:25.975 09:01:14 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:22:25.975 09:01:14 -- host/multicontroller.sh@23 -- # nvmftestinit 00:22:25.975 09:01:14 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:25.975 09:01:14 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:25.975 09:01:14 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:25.975 09:01:14 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:25.975 09:01:14 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:25.975 09:01:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:25.975 09:01:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:25.975 09:01:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:25.975 09:01:14 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:25.975 09:01:14 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:25.975 09:01:14 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:25.975 09:01:14 -- common/autotest_common.sh@10 -- # set +x 00:22:27.881 09:01:16 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:27.881 09:01:16 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:27.881 09:01:16 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:27.881 09:01:16 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:27.881 09:01:16 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:27.881 09:01:16 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:27.881 09:01:16 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:27.881 09:01:16 -- nvmf/common.sh@294 -- # net_devs=() 00:22:27.881 09:01:16 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:27.881 09:01:16 -- nvmf/common.sh@295 -- # e810=() 00:22:27.881 09:01:16 -- nvmf/common.sh@295 -- # local -ga e810 00:22:27.881 09:01:16 -- nvmf/common.sh@296 -- # x722=() 00:22:27.881 09:01:16 -- nvmf/common.sh@296 -- # local -ga x722 00:22:27.881 09:01:16 -- nvmf/common.sh@297 -- # mlx=() 00:22:27.881 09:01:16 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:27.881 09:01:16 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:27.881 09:01:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:27.881 09:01:16 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:27.881 09:01:16 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:27.881 09:01:16 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:27.881 09:01:16 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:27.881 09:01:16 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:27.881 09:01:16 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:27.881 09:01:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:27.881 09:01:16 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:27.881 09:01:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:27.881 09:01:16 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:27.881 09:01:16 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:27.881 09:01:16 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:27.881 09:01:16 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:27.881 09:01:16 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:27.881 09:01:16 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:27.881 09:01:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:27.881 09:01:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:27.881 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:27.881 09:01:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:27.881 09:01:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:27.881 09:01:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:27.881 09:01:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:27.881 09:01:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:27.881 09:01:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:27.881 09:01:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:27.881 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:27.882 09:01:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:27.882 09:01:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:27.882 09:01:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:27.882 09:01:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:27.882 09:01:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:27.882 09:01:16 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:27.882 09:01:16 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:27.882 09:01:16 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:27.882 09:01:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:27.882 09:01:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:27.882 09:01:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:27.882 09:01:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:27.882 09:01:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:27.882 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:27.882 09:01:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:27.882 09:01:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:27.882 09:01:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:27.882 09:01:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:27.882 09:01:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:27.882 09:01:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:27.882 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:27.882 09:01:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:27.882 09:01:16 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:27.882 09:01:16 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:27.882 09:01:16 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:27.882 09:01:16 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:27.882 09:01:16 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:27.882 09:01:16 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:27.882 09:01:16 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:27.882 09:01:16 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:27.882 09:01:16 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:27.882 09:01:16 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:27.882 09:01:16 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:27.882 09:01:16 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:27.882 09:01:16 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:27.882 09:01:16 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:27.882 09:01:16 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:27.882 09:01:16 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:27.882 09:01:16 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:27.882 09:01:16 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:27.882 09:01:16 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:27.882 09:01:16 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:27.882 09:01:16 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:27.882 09:01:16 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:27.882 09:01:16 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:27.882 09:01:16 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:27.882 09:01:16 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:27.882 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:27.882 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.134 ms 00:22:27.882 00:22:27.882 --- 10.0.0.2 ping statistics --- 00:22:27.882 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:27.882 rtt min/avg/max/mdev = 0.134/0.134/0.134/0.000 ms 00:22:27.882 09:01:16 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:27.882 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:27.882 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.169 ms 00:22:27.882 00:22:27.882 --- 10.0.0.1 ping statistics --- 00:22:27.882 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:27.882 rtt min/avg/max/mdev = 0.169/0.169/0.169/0.000 ms 00:22:27.882 09:01:16 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:27.882 09:01:16 -- nvmf/common.sh@410 -- # return 0 00:22:27.882 09:01:16 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:27.882 09:01:16 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:27.882 09:01:16 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:27.882 09:01:16 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:27.882 09:01:16 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:27.882 09:01:16 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:27.882 09:01:16 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:28.154 09:01:16 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:22:28.154 09:01:16 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:28.154 09:01:16 -- common/autotest_common.sh@712 -- # xtrace_disable 00:22:28.154 09:01:16 -- common/autotest_common.sh@10 -- # set +x 00:22:28.154 09:01:16 -- nvmf/common.sh@469 -- # nvmfpid=1568623 00:22:28.154 09:01:16 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:22:28.154 09:01:16 -- nvmf/common.sh@470 -- # waitforlisten 1568623 00:22:28.154 09:01:16 -- common/autotest_common.sh@819 -- # '[' -z 1568623 ']' 00:22:28.154 09:01:16 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:28.155 09:01:16 -- common/autotest_common.sh@824 -- # local max_retries=100 00:22:28.155 09:01:16 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:28.155 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:28.155 09:01:16 -- common/autotest_common.sh@828 -- # xtrace_disable 00:22:28.155 09:01:16 -- common/autotest_common.sh@10 -- # set +x 00:22:28.155 [2024-07-15 09:01:16.468547] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:22:28.155 [2024-07-15 09:01:16.468622] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:28.155 EAL: No free 2048 kB hugepages reported on node 1 00:22:28.155 [2024-07-15 09:01:16.531554] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:22:28.155 [2024-07-15 09:01:16.636159] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:28.155 [2024-07-15 09:01:16.636295] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:28.155 [2024-07-15 09:01:16.636312] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:28.155 [2024-07-15 09:01:16.636324] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:28.155 [2024-07-15 09:01:16.636419] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:28.155 [2024-07-15 09:01:16.636484] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:28.155 [2024-07-15 09:01:16.636487] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:29.127 09:01:17 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:22:29.127 09:01:17 -- common/autotest_common.sh@852 -- # return 0 00:22:29.127 09:01:17 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:29.127 09:01:17 -- common/autotest_common.sh@718 -- # xtrace_disable 00:22:29.127 09:01:17 -- common/autotest_common.sh@10 -- # set +x 00:22:29.127 09:01:17 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:29.127 09:01:17 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:29.127 09:01:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:29.127 09:01:17 -- common/autotest_common.sh@10 -- # set +x 00:22:29.127 [2024-07-15 09:01:17.479589] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:29.127 09:01:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:29.127 09:01:17 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:22:29.127 09:01:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:29.127 09:01:17 -- common/autotest_common.sh@10 -- # set +x 00:22:29.127 Malloc0 00:22:29.127 09:01:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:29.127 09:01:17 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:29.127 09:01:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:29.127 09:01:17 -- common/autotest_common.sh@10 -- # set +x 00:22:29.127 09:01:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:29.127 09:01:17 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:29.127 09:01:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:29.127 09:01:17 -- common/autotest_common.sh@10 -- # set +x 00:22:29.127 09:01:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:29.127 09:01:17 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:29.127 09:01:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:29.127 09:01:17 -- common/autotest_common.sh@10 -- # set +x 00:22:29.127 [2024-07-15 09:01:17.539487] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:29.127 09:01:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:29.127 09:01:17 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:22:29.127 09:01:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:29.127 09:01:17 -- common/autotest_common.sh@10 -- # set +x 00:22:29.127 [2024-07-15 09:01:17.547348] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:22:29.127 09:01:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:29.127 09:01:17 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:29.127 09:01:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:29.127 09:01:17 -- common/autotest_common.sh@10 -- # set +x 00:22:29.127 Malloc1 00:22:29.127 09:01:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:29.127 09:01:17 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:22:29.127 09:01:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:29.127 09:01:17 -- common/autotest_common.sh@10 -- # set +x 00:22:29.127 09:01:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:29.127 09:01:17 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:22:29.127 09:01:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:29.127 09:01:17 -- common/autotest_common.sh@10 -- # set +x 00:22:29.127 09:01:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:29.127 09:01:17 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:22:29.127 09:01:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:29.127 09:01:17 -- common/autotest_common.sh@10 -- # set +x 00:22:29.127 09:01:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:29.127 09:01:17 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:22:29.127 09:01:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:29.127 09:01:17 -- common/autotest_common.sh@10 -- # set +x 00:22:29.127 09:01:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:29.127 09:01:17 -- host/multicontroller.sh@44 -- # bdevperf_pid=1568780 00:22:29.127 09:01:17 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:29.127 09:01:17 -- host/multicontroller.sh@47 -- # waitforlisten 1568780 /var/tmp/bdevperf.sock 00:22:29.127 09:01:17 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:22:29.127 09:01:17 -- common/autotest_common.sh@819 -- # '[' -z 1568780 ']' 00:22:29.127 09:01:17 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:29.127 09:01:17 -- common/autotest_common.sh@824 -- # local max_retries=100 00:22:29.127 09:01:17 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:29.127 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:29.127 09:01:17 -- common/autotest_common.sh@828 -- # xtrace_disable 00:22:29.127 09:01:17 -- common/autotest_common.sh@10 -- # set +x 00:22:30.057 09:01:18 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:22:30.057 09:01:18 -- common/autotest_common.sh@852 -- # return 0 00:22:30.057 09:01:18 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:22:30.057 09:01:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:30.057 09:01:18 -- common/autotest_common.sh@10 -- # set +x 00:22:30.314 NVMe0n1 00:22:30.314 09:01:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:30.314 09:01:18 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:22:30.314 09:01:18 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:22:30.314 09:01:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:30.314 09:01:18 -- common/autotest_common.sh@10 -- # set +x 00:22:30.314 09:01:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:30.314 1 00:22:30.314 09:01:18 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:22:30.314 09:01:18 -- common/autotest_common.sh@640 -- # local es=0 00:22:30.314 09:01:18 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:22:30.314 09:01:18 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:22:30.314 09:01:18 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:22:30.314 09:01:18 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:22:30.314 09:01:18 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:22:30.314 09:01:18 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:22:30.314 09:01:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:30.314 09:01:18 -- common/autotest_common.sh@10 -- # set +x 00:22:30.314 request: 00:22:30.314 { 00:22:30.314 "name": "NVMe0", 00:22:30.314 "trtype": "tcp", 00:22:30.314 "traddr": "10.0.0.2", 00:22:30.314 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:22:30.314 "hostaddr": "10.0.0.2", 00:22:30.314 "hostsvcid": "60000", 00:22:30.314 "adrfam": "ipv4", 00:22:30.314 "trsvcid": "4420", 00:22:30.314 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:30.314 "method": "bdev_nvme_attach_controller", 00:22:30.314 "req_id": 1 00:22:30.314 } 00:22:30.314 Got JSON-RPC error response 00:22:30.314 response: 00:22:30.314 { 00:22:30.314 "code": -114, 00:22:30.314 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:22:30.314 } 00:22:30.314 09:01:18 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:22:30.314 09:01:18 -- common/autotest_common.sh@643 -- # es=1 00:22:30.314 09:01:18 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:22:30.314 09:01:18 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:22:30.314 09:01:18 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:22:30.314 09:01:18 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:22:30.314 09:01:18 -- common/autotest_common.sh@640 -- # local es=0 00:22:30.314 09:01:18 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:22:30.315 09:01:18 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:22:30.315 09:01:18 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:22:30.315 09:01:18 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:22:30.315 09:01:18 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:22:30.315 09:01:18 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:22:30.315 09:01:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:30.315 09:01:18 -- common/autotest_common.sh@10 -- # set +x 00:22:30.315 request: 00:22:30.315 { 00:22:30.315 "name": "NVMe0", 00:22:30.315 "trtype": "tcp", 00:22:30.315 "traddr": "10.0.0.2", 00:22:30.315 "hostaddr": "10.0.0.2", 00:22:30.315 "hostsvcid": "60000", 00:22:30.315 "adrfam": "ipv4", 00:22:30.315 "trsvcid": "4420", 00:22:30.315 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:30.315 "method": "bdev_nvme_attach_controller", 00:22:30.315 "req_id": 1 00:22:30.315 } 00:22:30.315 Got JSON-RPC error response 00:22:30.315 response: 00:22:30.315 { 00:22:30.315 "code": -114, 00:22:30.315 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:22:30.315 } 00:22:30.315 09:01:18 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:22:30.315 09:01:18 -- common/autotest_common.sh@643 -- # es=1 00:22:30.315 09:01:18 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:22:30.315 09:01:18 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:22:30.315 09:01:18 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:22:30.315 09:01:18 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:22:30.315 09:01:18 -- common/autotest_common.sh@640 -- # local es=0 00:22:30.315 09:01:18 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:22:30.315 09:01:18 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:22:30.315 09:01:18 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:22:30.315 09:01:18 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:22:30.315 09:01:18 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:22:30.315 09:01:18 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:22:30.315 09:01:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:30.315 09:01:18 -- common/autotest_common.sh@10 -- # set +x 00:22:30.315 request: 00:22:30.315 { 00:22:30.315 "name": "NVMe0", 00:22:30.315 "trtype": "tcp", 00:22:30.315 "traddr": "10.0.0.2", 00:22:30.315 "hostaddr": "10.0.0.2", 00:22:30.315 "hostsvcid": "60000", 00:22:30.315 "adrfam": "ipv4", 00:22:30.315 "trsvcid": "4420", 00:22:30.315 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:30.315 "multipath": "disable", 00:22:30.315 "method": "bdev_nvme_attach_controller", 00:22:30.315 "req_id": 1 00:22:30.315 } 00:22:30.315 Got JSON-RPC error response 00:22:30.315 response: 00:22:30.315 { 00:22:30.315 "code": -114, 00:22:30.315 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:22:30.315 } 00:22:30.315 09:01:18 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:22:30.315 09:01:18 -- common/autotest_common.sh@643 -- # es=1 00:22:30.315 09:01:18 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:22:30.315 09:01:18 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:22:30.315 09:01:18 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:22:30.315 09:01:18 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:22:30.315 09:01:18 -- common/autotest_common.sh@640 -- # local es=0 00:22:30.315 09:01:18 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:22:30.315 09:01:18 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:22:30.315 09:01:18 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:22:30.315 09:01:18 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:22:30.315 09:01:18 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:22:30.315 09:01:18 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:22:30.315 09:01:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:30.315 09:01:18 -- common/autotest_common.sh@10 -- # set +x 00:22:30.315 request: 00:22:30.315 { 00:22:30.315 "name": "NVMe0", 00:22:30.315 "trtype": "tcp", 00:22:30.315 "traddr": "10.0.0.2", 00:22:30.315 "hostaddr": "10.0.0.2", 00:22:30.315 "hostsvcid": "60000", 00:22:30.315 "adrfam": "ipv4", 00:22:30.315 "trsvcid": "4420", 00:22:30.315 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:30.315 "multipath": "failover", 00:22:30.315 "method": "bdev_nvme_attach_controller", 00:22:30.315 "req_id": 1 00:22:30.315 } 00:22:30.315 Got JSON-RPC error response 00:22:30.315 response: 00:22:30.315 { 00:22:30.315 "code": -114, 00:22:30.315 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:22:30.315 } 00:22:30.315 09:01:18 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:22:30.315 09:01:18 -- common/autotest_common.sh@643 -- # es=1 00:22:30.315 09:01:18 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:22:30.315 09:01:18 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:22:30.315 09:01:18 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:22:30.315 09:01:18 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:22:30.315 09:01:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:30.315 09:01:18 -- common/autotest_common.sh@10 -- # set +x 00:22:30.571 00:22:30.571 09:01:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:30.571 09:01:18 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:22:30.571 09:01:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:30.571 09:01:18 -- common/autotest_common.sh@10 -- # set +x 00:22:30.571 09:01:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:30.571 09:01:18 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:22:30.571 09:01:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:30.571 09:01:18 -- common/autotest_common.sh@10 -- # set +x 00:22:30.571 00:22:30.571 09:01:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:30.571 09:01:19 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:22:30.571 09:01:19 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:22:30.571 09:01:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:30.571 09:01:19 -- common/autotest_common.sh@10 -- # set +x 00:22:30.571 09:01:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:30.571 09:01:19 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:22:30.571 09:01:19 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:22:31.941 0 00:22:31.941 09:01:20 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:22:31.941 09:01:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:31.941 09:01:20 -- common/autotest_common.sh@10 -- # set +x 00:22:31.941 09:01:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:31.941 09:01:20 -- host/multicontroller.sh@100 -- # killprocess 1568780 00:22:31.941 09:01:20 -- common/autotest_common.sh@926 -- # '[' -z 1568780 ']' 00:22:31.941 09:01:20 -- common/autotest_common.sh@930 -- # kill -0 1568780 00:22:31.941 09:01:20 -- common/autotest_common.sh@931 -- # uname 00:22:31.941 09:01:20 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:22:31.941 09:01:20 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1568780 00:22:31.941 09:01:20 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:22:31.941 09:01:20 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:22:31.941 09:01:20 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1568780' 00:22:31.941 killing process with pid 1568780 00:22:31.941 09:01:20 -- common/autotest_common.sh@945 -- # kill 1568780 00:22:31.941 09:01:20 -- common/autotest_common.sh@950 -- # wait 1568780 00:22:31.941 09:01:20 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:31.941 09:01:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:31.941 09:01:20 -- common/autotest_common.sh@10 -- # set +x 00:22:31.941 09:01:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:31.941 09:01:20 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:22:31.941 09:01:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:31.941 09:01:20 -- common/autotest_common.sh@10 -- # set +x 00:22:31.941 09:01:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:31.941 09:01:20 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:22:31.941 09:01:20 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:22:31.941 09:01:20 -- common/autotest_common.sh@1597 -- # read -r file 00:22:31.941 09:01:20 -- common/autotest_common.sh@1596 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:22:31.941 09:01:20 -- common/autotest_common.sh@1596 -- # sort -u 00:22:31.941 09:01:20 -- common/autotest_common.sh@1598 -- # cat 00:22:31.941 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:22:31.941 [2024-07-15 09:01:17.646381] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:22:31.941 [2024-07-15 09:01:17.646459] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1568780 ] 00:22:31.941 EAL: No free 2048 kB hugepages reported on node 1 00:22:31.941 [2024-07-15 09:01:17.705007] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:31.941 [2024-07-15 09:01:17.811674] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:31.941 [2024-07-15 09:01:19.020308] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name dcd7ab83-0e5b-4742-966e-e75336edc431 already exists 00:22:31.941 [2024-07-15 09:01:19.020360] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:dcd7ab83-0e5b-4742-966e-e75336edc431 alias for bdev NVMe1n1 00:22:31.941 [2024-07-15 09:01:19.020387] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:22:31.941 Running I/O for 1 seconds... 00:22:31.941 00:22:31.941 Latency(us) 00:22:31.941 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:31.941 Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:22:31.941 NVMe0n1 : 1.01 19677.21 76.86 0.00 0.00 6495.59 3907.89 12718.84 00:22:31.941 =================================================================================================================== 00:22:31.941 Total : 19677.21 76.86 0.00 0.00 6495.59 3907.89 12718.84 00:22:31.941 Received shutdown signal, test time was about 1.000000 seconds 00:22:31.941 00:22:31.941 Latency(us) 00:22:31.941 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:31.941 =================================================================================================================== 00:22:31.941 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:22:31.941 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:22:31.941 09:01:20 -- common/autotest_common.sh@1603 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:22:31.941 09:01:20 -- common/autotest_common.sh@1597 -- # read -r file 00:22:32.199 09:01:20 -- host/multicontroller.sh@108 -- # nvmftestfini 00:22:32.199 09:01:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:32.199 09:01:20 -- nvmf/common.sh@116 -- # sync 00:22:32.199 09:01:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:32.199 09:01:20 -- nvmf/common.sh@119 -- # set +e 00:22:32.199 09:01:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:32.199 09:01:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:32.199 rmmod nvme_tcp 00:22:32.199 rmmod nvme_fabrics 00:22:32.199 rmmod nvme_keyring 00:22:32.199 09:01:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:32.199 09:01:20 -- nvmf/common.sh@123 -- # set -e 00:22:32.199 09:01:20 -- nvmf/common.sh@124 -- # return 0 00:22:32.199 09:01:20 -- nvmf/common.sh@477 -- # '[' -n 1568623 ']' 00:22:32.199 09:01:20 -- nvmf/common.sh@478 -- # killprocess 1568623 00:22:32.199 09:01:20 -- common/autotest_common.sh@926 -- # '[' -z 1568623 ']' 00:22:32.199 09:01:20 -- common/autotest_common.sh@930 -- # kill -0 1568623 00:22:32.199 09:01:20 -- common/autotest_common.sh@931 -- # uname 00:22:32.199 09:01:20 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:22:32.199 09:01:20 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1568623 00:22:32.199 09:01:20 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:22:32.199 09:01:20 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:22:32.199 09:01:20 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1568623' 00:22:32.199 killing process with pid 1568623 00:22:32.199 09:01:20 -- common/autotest_common.sh@945 -- # kill 1568623 00:22:32.199 09:01:20 -- common/autotest_common.sh@950 -- # wait 1568623 00:22:32.458 09:01:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:32.458 09:01:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:32.458 09:01:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:32.458 09:01:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:32.458 09:01:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:32.458 09:01:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:32.458 09:01:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:32.458 09:01:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:34.989 09:01:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:34.989 00:22:34.989 real 0m8.599s 00:22:34.989 user 0m16.541s 00:22:34.989 sys 0m2.231s 00:22:34.989 09:01:22 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:22:34.989 09:01:22 -- common/autotest_common.sh@10 -- # set +x 00:22:34.989 ************************************ 00:22:34.989 END TEST nvmf_multicontroller 00:22:34.989 ************************************ 00:22:34.989 09:01:22 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:22:34.989 09:01:22 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:22:34.989 09:01:22 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:22:34.989 09:01:22 -- common/autotest_common.sh@10 -- # set +x 00:22:34.989 ************************************ 00:22:34.989 START TEST nvmf_aer 00:22:34.989 ************************************ 00:22:34.989 09:01:22 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:22:34.989 * Looking for test storage... 00:22:34.989 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:34.989 09:01:23 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:34.989 09:01:23 -- nvmf/common.sh@7 -- # uname -s 00:22:34.989 09:01:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:34.989 09:01:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:34.989 09:01:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:34.989 09:01:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:34.989 09:01:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:34.989 09:01:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:34.989 09:01:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:34.989 09:01:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:34.989 09:01:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:34.989 09:01:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:34.989 09:01:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:34.989 09:01:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:34.989 09:01:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:34.989 09:01:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:34.989 09:01:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:34.989 09:01:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:34.989 09:01:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:34.989 09:01:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:34.989 09:01:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:34.989 09:01:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:34.989 09:01:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:34.989 09:01:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:34.989 09:01:23 -- paths/export.sh@5 -- # export PATH 00:22:34.989 09:01:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:34.989 09:01:23 -- nvmf/common.sh@46 -- # : 0 00:22:34.989 09:01:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:34.989 09:01:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:34.989 09:01:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:34.989 09:01:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:34.989 09:01:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:34.989 09:01:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:34.989 09:01:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:34.989 09:01:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:34.989 09:01:23 -- host/aer.sh@11 -- # nvmftestinit 00:22:34.989 09:01:23 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:34.989 09:01:23 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:34.989 09:01:23 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:34.989 09:01:23 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:34.989 09:01:23 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:34.989 09:01:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:34.989 09:01:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:34.989 09:01:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:34.989 09:01:23 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:34.989 09:01:23 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:34.989 09:01:23 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:34.989 09:01:23 -- common/autotest_common.sh@10 -- # set +x 00:22:36.892 09:01:25 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:36.892 09:01:25 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:36.892 09:01:25 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:36.892 09:01:25 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:36.892 09:01:25 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:36.892 09:01:25 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:36.892 09:01:25 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:36.892 09:01:25 -- nvmf/common.sh@294 -- # net_devs=() 00:22:36.892 09:01:25 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:36.892 09:01:25 -- nvmf/common.sh@295 -- # e810=() 00:22:36.892 09:01:25 -- nvmf/common.sh@295 -- # local -ga e810 00:22:36.892 09:01:25 -- nvmf/common.sh@296 -- # x722=() 00:22:36.892 09:01:25 -- nvmf/common.sh@296 -- # local -ga x722 00:22:36.892 09:01:25 -- nvmf/common.sh@297 -- # mlx=() 00:22:36.892 09:01:25 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:36.892 09:01:25 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:36.892 09:01:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:36.892 09:01:25 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:36.892 09:01:25 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:36.892 09:01:25 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:36.892 09:01:25 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:36.892 09:01:25 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:36.892 09:01:25 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:36.892 09:01:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:36.892 09:01:25 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:36.892 09:01:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:36.892 09:01:25 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:36.892 09:01:25 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:36.892 09:01:25 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:36.892 09:01:25 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:36.892 09:01:25 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:36.892 09:01:25 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:36.892 09:01:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:36.892 09:01:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:36.892 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:36.892 09:01:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:36.892 09:01:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:36.892 09:01:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:36.892 09:01:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:36.892 09:01:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:36.892 09:01:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:36.892 09:01:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:36.892 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:36.892 09:01:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:36.892 09:01:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:36.892 09:01:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:36.892 09:01:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:36.892 09:01:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:36.892 09:01:25 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:36.892 09:01:25 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:36.892 09:01:25 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:36.892 09:01:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:36.892 09:01:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:36.892 09:01:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:36.892 09:01:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:36.892 09:01:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:36.892 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:36.892 09:01:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:36.892 09:01:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:36.892 09:01:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:36.892 09:01:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:36.892 09:01:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:36.892 09:01:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:36.892 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:36.892 09:01:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:36.892 09:01:25 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:36.892 09:01:25 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:36.892 09:01:25 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:36.892 09:01:25 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:36.892 09:01:25 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:36.892 09:01:25 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:36.892 09:01:25 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:36.892 09:01:25 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:36.892 09:01:25 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:36.892 09:01:25 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:36.892 09:01:25 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:36.892 09:01:25 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:36.892 09:01:25 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:36.892 09:01:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:36.892 09:01:25 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:36.892 09:01:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:36.892 09:01:25 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:36.892 09:01:25 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:36.892 09:01:25 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:36.892 09:01:25 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:36.892 09:01:25 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:36.892 09:01:25 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:36.892 09:01:25 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:36.892 09:01:25 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:36.892 09:01:25 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:36.892 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:36.892 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.227 ms 00:22:36.892 00:22:36.892 --- 10.0.0.2 ping statistics --- 00:22:36.892 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:36.892 rtt min/avg/max/mdev = 0.227/0.227/0.227/0.000 ms 00:22:36.892 09:01:25 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:36.892 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:36.892 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.093 ms 00:22:36.892 00:22:36.892 --- 10.0.0.1 ping statistics --- 00:22:36.892 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:36.892 rtt min/avg/max/mdev = 0.093/0.093/0.093/0.000 ms 00:22:36.892 09:01:25 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:36.892 09:01:25 -- nvmf/common.sh@410 -- # return 0 00:22:36.892 09:01:25 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:36.892 09:01:25 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:36.892 09:01:25 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:36.892 09:01:25 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:36.892 09:01:25 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:36.892 09:01:25 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:36.892 09:01:25 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:36.892 09:01:25 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:22:36.892 09:01:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:36.892 09:01:25 -- common/autotest_common.sh@712 -- # xtrace_disable 00:22:36.892 09:01:25 -- common/autotest_common.sh@10 -- # set +x 00:22:36.892 09:01:25 -- nvmf/common.sh@469 -- # nvmfpid=1571145 00:22:36.892 09:01:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:36.892 09:01:25 -- nvmf/common.sh@470 -- # waitforlisten 1571145 00:22:36.892 09:01:25 -- common/autotest_common.sh@819 -- # '[' -z 1571145 ']' 00:22:36.892 09:01:25 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:36.892 09:01:25 -- common/autotest_common.sh@824 -- # local max_retries=100 00:22:36.892 09:01:25 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:36.892 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:36.892 09:01:25 -- common/autotest_common.sh@828 -- # xtrace_disable 00:22:36.892 09:01:25 -- common/autotest_common.sh@10 -- # set +x 00:22:36.892 [2024-07-15 09:01:25.204506] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:22:36.893 [2024-07-15 09:01:25.204588] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:36.893 EAL: No free 2048 kB hugepages reported on node 1 00:22:36.893 [2024-07-15 09:01:25.267470] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:36.893 [2024-07-15 09:01:25.371836] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:36.893 [2024-07-15 09:01:25.371985] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:36.893 [2024-07-15 09:01:25.372004] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:36.893 [2024-07-15 09:01:25.372016] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:36.893 [2024-07-15 09:01:25.372070] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:36.893 [2024-07-15 09:01:25.372129] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:36.893 [2024-07-15 09:01:25.372195] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:36.893 [2024-07-15 09:01:25.372198] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:37.831 09:01:26 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:22:37.831 09:01:26 -- common/autotest_common.sh@852 -- # return 0 00:22:37.831 09:01:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:37.831 09:01:26 -- common/autotest_common.sh@718 -- # xtrace_disable 00:22:37.831 09:01:26 -- common/autotest_common.sh@10 -- # set +x 00:22:37.831 09:01:26 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:37.831 09:01:26 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:37.831 09:01:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:37.831 09:01:26 -- common/autotest_common.sh@10 -- # set +x 00:22:37.831 [2024-07-15 09:01:26.216627] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:37.831 09:01:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:37.831 09:01:26 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:22:37.831 09:01:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:37.831 09:01:26 -- common/autotest_common.sh@10 -- # set +x 00:22:37.831 Malloc0 00:22:37.831 09:01:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:37.831 09:01:26 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:22:37.831 09:01:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:37.831 09:01:26 -- common/autotest_common.sh@10 -- # set +x 00:22:37.831 09:01:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:37.831 09:01:26 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:37.831 09:01:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:37.831 09:01:26 -- common/autotest_common.sh@10 -- # set +x 00:22:37.831 09:01:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:37.831 09:01:26 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:37.831 09:01:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:37.831 09:01:26 -- common/autotest_common.sh@10 -- # set +x 00:22:37.831 [2024-07-15 09:01:26.270120] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:37.831 09:01:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:37.831 09:01:26 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:22:37.831 09:01:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:37.831 09:01:26 -- common/autotest_common.sh@10 -- # set +x 00:22:37.831 [2024-07-15 09:01:26.277818] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:22:37.831 [ 00:22:37.831 { 00:22:37.831 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:22:37.831 "subtype": "Discovery", 00:22:37.831 "listen_addresses": [], 00:22:37.831 "allow_any_host": true, 00:22:37.831 "hosts": [] 00:22:37.831 }, 00:22:37.831 { 00:22:37.831 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:22:37.831 "subtype": "NVMe", 00:22:37.831 "listen_addresses": [ 00:22:37.831 { 00:22:37.831 "transport": "TCP", 00:22:37.831 "trtype": "TCP", 00:22:37.831 "adrfam": "IPv4", 00:22:37.831 "traddr": "10.0.0.2", 00:22:37.831 "trsvcid": "4420" 00:22:37.831 } 00:22:37.831 ], 00:22:37.831 "allow_any_host": true, 00:22:37.831 "hosts": [], 00:22:37.831 "serial_number": "SPDK00000000000001", 00:22:37.831 "model_number": "SPDK bdev Controller", 00:22:37.831 "max_namespaces": 2, 00:22:37.831 "min_cntlid": 1, 00:22:37.831 "max_cntlid": 65519, 00:22:37.831 "namespaces": [ 00:22:37.831 { 00:22:37.831 "nsid": 1, 00:22:37.831 "bdev_name": "Malloc0", 00:22:37.831 "name": "Malloc0", 00:22:37.831 "nguid": "34210F051F064AE38B0B2BD98D49D28A", 00:22:37.831 "uuid": "34210f05-1f06-4ae3-8b0b-2bd98d49d28a" 00:22:37.831 } 00:22:37.831 ] 00:22:37.831 } 00:22:37.831 ] 00:22:37.831 09:01:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:37.831 09:01:26 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:22:37.831 09:01:26 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:22:37.831 09:01:26 -- host/aer.sh@33 -- # aerpid=1571303 00:22:37.831 09:01:26 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:22:37.831 09:01:26 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:22:37.831 09:01:26 -- common/autotest_common.sh@1244 -- # local i=0 00:22:37.831 09:01:26 -- common/autotest_common.sh@1245 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:37.831 09:01:26 -- common/autotest_common.sh@1246 -- # '[' 0 -lt 200 ']' 00:22:37.831 09:01:26 -- common/autotest_common.sh@1247 -- # i=1 00:22:37.831 09:01:26 -- common/autotest_common.sh@1248 -- # sleep 0.1 00:22:37.831 EAL: No free 2048 kB hugepages reported on node 1 00:22:38.089 09:01:26 -- common/autotest_common.sh@1245 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:38.089 09:01:26 -- common/autotest_common.sh@1246 -- # '[' 1 -lt 200 ']' 00:22:38.089 09:01:26 -- common/autotest_common.sh@1247 -- # i=2 00:22:38.089 09:01:26 -- common/autotest_common.sh@1248 -- # sleep 0.1 00:22:38.089 09:01:26 -- common/autotest_common.sh@1245 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:38.089 09:01:26 -- common/autotest_common.sh@1251 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:38.089 09:01:26 -- common/autotest_common.sh@1255 -- # return 0 00:22:38.089 09:01:26 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:22:38.089 09:01:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:38.089 09:01:26 -- common/autotest_common.sh@10 -- # set +x 00:22:38.089 Malloc1 00:22:38.089 09:01:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:38.089 09:01:26 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:22:38.089 09:01:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:38.089 09:01:26 -- common/autotest_common.sh@10 -- # set +x 00:22:38.089 09:01:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:38.089 09:01:26 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:22:38.089 09:01:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:38.089 09:01:26 -- common/autotest_common.sh@10 -- # set +x 00:22:38.089 Asynchronous Event Request test 00:22:38.089 Attaching to 10.0.0.2 00:22:38.089 Attached to 10.0.0.2 00:22:38.089 Registering asynchronous event callbacks... 00:22:38.089 Starting namespace attribute notice tests for all controllers... 00:22:38.089 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:22:38.089 aer_cb - Changed Namespace 00:22:38.089 Cleaning up... 00:22:38.089 [ 00:22:38.089 { 00:22:38.089 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:22:38.089 "subtype": "Discovery", 00:22:38.089 "listen_addresses": [], 00:22:38.089 "allow_any_host": true, 00:22:38.089 "hosts": [] 00:22:38.089 }, 00:22:38.089 { 00:22:38.089 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:22:38.089 "subtype": "NVMe", 00:22:38.089 "listen_addresses": [ 00:22:38.089 { 00:22:38.089 "transport": "TCP", 00:22:38.089 "trtype": "TCP", 00:22:38.089 "adrfam": "IPv4", 00:22:38.089 "traddr": "10.0.0.2", 00:22:38.089 "trsvcid": "4420" 00:22:38.089 } 00:22:38.089 ], 00:22:38.089 "allow_any_host": true, 00:22:38.089 "hosts": [], 00:22:38.089 "serial_number": "SPDK00000000000001", 00:22:38.089 "model_number": "SPDK bdev Controller", 00:22:38.089 "max_namespaces": 2, 00:22:38.090 "min_cntlid": 1, 00:22:38.090 "max_cntlid": 65519, 00:22:38.090 "namespaces": [ 00:22:38.090 { 00:22:38.090 "nsid": 1, 00:22:38.090 "bdev_name": "Malloc0", 00:22:38.090 "name": "Malloc0", 00:22:38.090 "nguid": "34210F051F064AE38B0B2BD98D49D28A", 00:22:38.090 "uuid": "34210f05-1f06-4ae3-8b0b-2bd98d49d28a" 00:22:38.090 }, 00:22:38.090 { 00:22:38.090 "nsid": 2, 00:22:38.090 "bdev_name": "Malloc1", 00:22:38.090 "name": "Malloc1", 00:22:38.090 "nguid": "531F4A447CC347C3A7CE58E8B6CD14BC", 00:22:38.090 "uuid": "531f4a44-7cc3-47c3-a7ce-58e8b6cd14bc" 00:22:38.090 } 00:22:38.090 ] 00:22:38.090 } 00:22:38.090 ] 00:22:38.090 09:01:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:38.090 09:01:26 -- host/aer.sh@43 -- # wait 1571303 00:22:38.090 09:01:26 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:22:38.090 09:01:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:38.090 09:01:26 -- common/autotest_common.sh@10 -- # set +x 00:22:38.090 09:01:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:38.090 09:01:26 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:22:38.090 09:01:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:38.090 09:01:26 -- common/autotest_common.sh@10 -- # set +x 00:22:38.348 09:01:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:38.348 09:01:26 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:38.348 09:01:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:38.348 09:01:26 -- common/autotest_common.sh@10 -- # set +x 00:22:38.348 09:01:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:38.348 09:01:26 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:22:38.348 09:01:26 -- host/aer.sh@51 -- # nvmftestfini 00:22:38.348 09:01:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:38.348 09:01:26 -- nvmf/common.sh@116 -- # sync 00:22:38.348 09:01:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:38.348 09:01:26 -- nvmf/common.sh@119 -- # set +e 00:22:38.348 09:01:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:38.348 09:01:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:38.348 rmmod nvme_tcp 00:22:38.348 rmmod nvme_fabrics 00:22:38.348 rmmod nvme_keyring 00:22:38.348 09:01:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:38.348 09:01:26 -- nvmf/common.sh@123 -- # set -e 00:22:38.348 09:01:26 -- nvmf/common.sh@124 -- # return 0 00:22:38.348 09:01:26 -- nvmf/common.sh@477 -- # '[' -n 1571145 ']' 00:22:38.348 09:01:26 -- nvmf/common.sh@478 -- # killprocess 1571145 00:22:38.348 09:01:26 -- common/autotest_common.sh@926 -- # '[' -z 1571145 ']' 00:22:38.348 09:01:26 -- common/autotest_common.sh@930 -- # kill -0 1571145 00:22:38.348 09:01:26 -- common/autotest_common.sh@931 -- # uname 00:22:38.348 09:01:26 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:22:38.348 09:01:26 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1571145 00:22:38.348 09:01:26 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:22:38.348 09:01:26 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:22:38.348 09:01:26 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1571145' 00:22:38.348 killing process with pid 1571145 00:22:38.348 09:01:26 -- common/autotest_common.sh@945 -- # kill 1571145 00:22:38.348 [2024-07-15 09:01:26.707140] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:22:38.348 09:01:26 -- common/autotest_common.sh@950 -- # wait 1571145 00:22:38.606 09:01:26 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:38.606 09:01:26 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:38.606 09:01:26 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:38.606 09:01:26 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:38.606 09:01:26 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:38.606 09:01:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:38.606 09:01:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:38.606 09:01:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:40.514 09:01:28 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:40.514 00:22:40.514 real 0m6.028s 00:22:40.514 user 0m7.110s 00:22:40.514 sys 0m1.893s 00:22:40.514 09:01:28 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:22:40.514 09:01:28 -- common/autotest_common.sh@10 -- # set +x 00:22:40.514 ************************************ 00:22:40.514 END TEST nvmf_aer 00:22:40.514 ************************************ 00:22:40.514 09:01:29 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:22:40.514 09:01:29 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:22:40.514 09:01:29 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:22:40.514 09:01:29 -- common/autotest_common.sh@10 -- # set +x 00:22:40.514 ************************************ 00:22:40.514 START TEST nvmf_async_init 00:22:40.514 ************************************ 00:22:40.514 09:01:29 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:22:40.774 * Looking for test storage... 00:22:40.774 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:40.774 09:01:29 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:40.774 09:01:29 -- nvmf/common.sh@7 -- # uname -s 00:22:40.774 09:01:29 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:40.774 09:01:29 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:40.774 09:01:29 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:40.774 09:01:29 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:40.774 09:01:29 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:40.774 09:01:29 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:40.774 09:01:29 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:40.774 09:01:29 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:40.774 09:01:29 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:40.774 09:01:29 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:40.774 09:01:29 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:40.774 09:01:29 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:40.774 09:01:29 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:40.774 09:01:29 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:40.774 09:01:29 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:40.774 09:01:29 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:40.774 09:01:29 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:40.774 09:01:29 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:40.774 09:01:29 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:40.774 09:01:29 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:40.774 09:01:29 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:40.774 09:01:29 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:40.774 09:01:29 -- paths/export.sh@5 -- # export PATH 00:22:40.774 09:01:29 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:40.774 09:01:29 -- nvmf/common.sh@46 -- # : 0 00:22:40.774 09:01:29 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:40.774 09:01:29 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:40.774 09:01:29 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:40.774 09:01:29 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:40.774 09:01:29 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:40.774 09:01:29 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:40.774 09:01:29 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:40.774 09:01:29 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:40.774 09:01:29 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:22:40.774 09:01:29 -- host/async_init.sh@14 -- # null_block_size=512 00:22:40.774 09:01:29 -- host/async_init.sh@15 -- # null_bdev=null0 00:22:40.774 09:01:29 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:22:40.774 09:01:29 -- host/async_init.sh@20 -- # uuidgen 00:22:40.774 09:01:29 -- host/async_init.sh@20 -- # tr -d - 00:22:40.774 09:01:29 -- host/async_init.sh@20 -- # nguid=f3306c86ce754af7aa1b358719bffa7e 00:22:40.774 09:01:29 -- host/async_init.sh@22 -- # nvmftestinit 00:22:40.774 09:01:29 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:40.774 09:01:29 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:40.774 09:01:29 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:40.774 09:01:29 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:40.774 09:01:29 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:40.775 09:01:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:40.775 09:01:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:40.775 09:01:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:40.775 09:01:29 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:40.775 09:01:29 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:40.775 09:01:29 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:40.775 09:01:29 -- common/autotest_common.sh@10 -- # set +x 00:22:42.675 09:01:30 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:42.675 09:01:30 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:42.675 09:01:30 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:42.675 09:01:30 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:42.675 09:01:30 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:42.675 09:01:30 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:42.675 09:01:30 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:42.675 09:01:30 -- nvmf/common.sh@294 -- # net_devs=() 00:22:42.675 09:01:30 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:42.675 09:01:30 -- nvmf/common.sh@295 -- # e810=() 00:22:42.675 09:01:30 -- nvmf/common.sh@295 -- # local -ga e810 00:22:42.675 09:01:30 -- nvmf/common.sh@296 -- # x722=() 00:22:42.675 09:01:30 -- nvmf/common.sh@296 -- # local -ga x722 00:22:42.675 09:01:30 -- nvmf/common.sh@297 -- # mlx=() 00:22:42.675 09:01:30 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:42.675 09:01:30 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:42.675 09:01:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:42.675 09:01:30 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:42.675 09:01:30 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:42.675 09:01:30 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:42.675 09:01:30 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:42.675 09:01:30 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:42.675 09:01:30 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:42.675 09:01:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:42.675 09:01:30 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:42.675 09:01:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:42.675 09:01:30 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:42.675 09:01:30 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:42.675 09:01:30 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:42.675 09:01:30 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:42.675 09:01:30 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:42.675 09:01:30 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:42.675 09:01:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:42.675 09:01:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:42.675 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:42.675 09:01:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:42.675 09:01:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:42.675 09:01:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:42.675 09:01:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:42.675 09:01:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:42.675 09:01:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:42.675 09:01:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:42.675 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:42.675 09:01:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:42.675 09:01:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:42.675 09:01:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:42.675 09:01:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:42.675 09:01:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:42.675 09:01:30 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:42.675 09:01:30 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:42.675 09:01:30 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:42.676 09:01:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:42.676 09:01:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:42.676 09:01:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:42.676 09:01:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:42.676 09:01:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:42.676 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:42.676 09:01:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:42.676 09:01:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:42.676 09:01:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:42.676 09:01:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:42.676 09:01:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:42.676 09:01:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:42.676 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:42.676 09:01:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:42.676 09:01:30 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:42.676 09:01:30 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:42.676 09:01:30 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:42.676 09:01:30 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:42.676 09:01:30 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:42.676 09:01:30 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:42.676 09:01:30 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:42.676 09:01:30 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:42.676 09:01:30 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:42.676 09:01:30 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:42.676 09:01:30 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:42.676 09:01:30 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:42.676 09:01:30 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:42.676 09:01:30 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:42.676 09:01:30 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:42.676 09:01:30 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:42.676 09:01:30 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:42.676 09:01:30 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:42.676 09:01:31 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:42.676 09:01:31 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:42.676 09:01:31 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:42.676 09:01:31 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:42.676 09:01:31 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:42.676 09:01:31 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:42.676 09:01:31 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:42.676 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:42.676 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.208 ms 00:22:42.676 00:22:42.676 --- 10.0.0.2 ping statistics --- 00:22:42.676 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:42.676 rtt min/avg/max/mdev = 0.208/0.208/0.208/0.000 ms 00:22:42.676 09:01:31 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:42.676 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:42.676 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.150 ms 00:22:42.676 00:22:42.676 --- 10.0.0.1 ping statistics --- 00:22:42.676 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:42.676 rtt min/avg/max/mdev = 0.150/0.150/0.150/0.000 ms 00:22:42.676 09:01:31 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:42.676 09:01:31 -- nvmf/common.sh@410 -- # return 0 00:22:42.676 09:01:31 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:42.676 09:01:31 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:42.676 09:01:31 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:42.676 09:01:31 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:42.676 09:01:31 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:42.676 09:01:31 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:42.676 09:01:31 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:42.676 09:01:31 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:22:42.676 09:01:31 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:42.676 09:01:31 -- common/autotest_common.sh@712 -- # xtrace_disable 00:22:42.676 09:01:31 -- common/autotest_common.sh@10 -- # set +x 00:22:42.676 09:01:31 -- nvmf/common.sh@469 -- # nvmfpid=1573250 00:22:42.676 09:01:31 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:22:42.676 09:01:31 -- nvmf/common.sh@470 -- # waitforlisten 1573250 00:22:42.676 09:01:31 -- common/autotest_common.sh@819 -- # '[' -z 1573250 ']' 00:22:42.676 09:01:31 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:42.676 09:01:31 -- common/autotest_common.sh@824 -- # local max_retries=100 00:22:42.676 09:01:31 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:42.676 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:42.676 09:01:31 -- common/autotest_common.sh@828 -- # xtrace_disable 00:22:42.676 09:01:31 -- common/autotest_common.sh@10 -- # set +x 00:22:42.676 [2024-07-15 09:01:31.171271] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:22:42.676 [2024-07-15 09:01:31.171343] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:42.676 EAL: No free 2048 kB hugepages reported on node 1 00:22:42.935 [2024-07-15 09:01:31.240059] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:42.935 [2024-07-15 09:01:31.354809] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:42.935 [2024-07-15 09:01:31.354988] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:42.935 [2024-07-15 09:01:31.355009] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:42.935 [2024-07-15 09:01:31.355040] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:42.935 [2024-07-15 09:01:31.355072] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:43.869 09:01:32 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:22:43.869 09:01:32 -- common/autotest_common.sh@852 -- # return 0 00:22:43.869 09:01:32 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:43.869 09:01:32 -- common/autotest_common.sh@718 -- # xtrace_disable 00:22:43.869 09:01:32 -- common/autotest_common.sh@10 -- # set +x 00:22:43.869 09:01:32 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:43.869 09:01:32 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:22:43.869 09:01:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:43.869 09:01:32 -- common/autotest_common.sh@10 -- # set +x 00:22:43.869 [2024-07-15 09:01:32.117028] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:43.869 09:01:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:43.869 09:01:32 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:22:43.869 09:01:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:43.869 09:01:32 -- common/autotest_common.sh@10 -- # set +x 00:22:43.869 null0 00:22:43.869 09:01:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:43.869 09:01:32 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:22:43.869 09:01:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:43.869 09:01:32 -- common/autotest_common.sh@10 -- # set +x 00:22:43.869 09:01:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:43.869 09:01:32 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:22:43.869 09:01:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:43.869 09:01:32 -- common/autotest_common.sh@10 -- # set +x 00:22:43.869 09:01:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:43.869 09:01:32 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g f3306c86ce754af7aa1b358719bffa7e 00:22:43.869 09:01:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:43.869 09:01:32 -- common/autotest_common.sh@10 -- # set +x 00:22:43.869 09:01:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:43.869 09:01:32 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:22:43.869 09:01:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:43.869 09:01:32 -- common/autotest_common.sh@10 -- # set +x 00:22:43.869 [2024-07-15 09:01:32.157300] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:43.869 09:01:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:43.869 09:01:32 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:22:43.869 09:01:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:43.869 09:01:32 -- common/autotest_common.sh@10 -- # set +x 00:22:43.869 nvme0n1 00:22:43.869 09:01:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:43.869 09:01:32 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:22:43.869 09:01:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:43.869 09:01:32 -- common/autotest_common.sh@10 -- # set +x 00:22:43.869 [ 00:22:43.869 { 00:22:43.869 "name": "nvme0n1", 00:22:43.869 "aliases": [ 00:22:43.869 "f3306c86-ce75-4af7-aa1b-358719bffa7e" 00:22:43.869 ], 00:22:43.869 "product_name": "NVMe disk", 00:22:43.869 "block_size": 512, 00:22:43.869 "num_blocks": 2097152, 00:22:43.869 "uuid": "f3306c86-ce75-4af7-aa1b-358719bffa7e", 00:22:43.869 "assigned_rate_limits": { 00:22:43.869 "rw_ios_per_sec": 0, 00:22:43.869 "rw_mbytes_per_sec": 0, 00:22:43.869 "r_mbytes_per_sec": 0, 00:22:43.869 "w_mbytes_per_sec": 0 00:22:43.869 }, 00:22:43.869 "claimed": false, 00:22:43.869 "zoned": false, 00:22:43.869 "supported_io_types": { 00:22:43.869 "read": true, 00:22:43.869 "write": true, 00:22:43.869 "unmap": false, 00:22:43.869 "write_zeroes": true, 00:22:43.869 "flush": true, 00:22:43.869 "reset": true, 00:22:43.869 "compare": true, 00:22:43.869 "compare_and_write": true, 00:22:43.869 "abort": true, 00:22:43.869 "nvme_admin": true, 00:22:43.869 "nvme_io": true 00:22:43.869 }, 00:22:43.869 "driver_specific": { 00:22:43.869 "nvme": [ 00:22:43.869 { 00:22:43.869 "trid": { 00:22:43.869 "trtype": "TCP", 00:22:43.869 "adrfam": "IPv4", 00:22:43.869 "traddr": "10.0.0.2", 00:22:43.870 "trsvcid": "4420", 00:22:43.870 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:22:43.870 }, 00:22:43.870 "ctrlr_data": { 00:22:43.870 "cntlid": 1, 00:22:43.870 "vendor_id": "0x8086", 00:22:43.870 "model_number": "SPDK bdev Controller", 00:22:43.870 "serial_number": "00000000000000000000", 00:22:43.870 "firmware_revision": "24.01.1", 00:22:43.870 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:22:43.870 "oacs": { 00:22:43.870 "security": 0, 00:22:43.870 "format": 0, 00:22:43.870 "firmware": 0, 00:22:43.870 "ns_manage": 0 00:22:43.870 }, 00:22:43.870 "multi_ctrlr": true, 00:22:43.870 "ana_reporting": false 00:22:43.870 }, 00:22:43.870 "vs": { 00:22:43.870 "nvme_version": "1.3" 00:22:43.870 }, 00:22:43.870 "ns_data": { 00:22:43.870 "id": 1, 00:22:43.870 "can_share": true 00:22:43.870 } 00:22:43.870 } 00:22:43.870 ], 00:22:43.870 "mp_policy": "active_passive" 00:22:43.870 } 00:22:43.870 } 00:22:43.870 ] 00:22:43.870 09:01:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:43.870 09:01:32 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:22:43.870 09:01:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:43.870 09:01:32 -- common/autotest_common.sh@10 -- # set +x 00:22:43.870 [2024-07-15 09:01:32.405893] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:22:43.870 [2024-07-15 09:01:32.406014] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x233ca80 (9): Bad file descriptor 00:22:44.128 [2024-07-15 09:01:32.538022] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:22:44.128 09:01:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:44.128 09:01:32 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:22:44.128 09:01:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:44.128 09:01:32 -- common/autotest_common.sh@10 -- # set +x 00:22:44.128 [ 00:22:44.128 { 00:22:44.128 "name": "nvme0n1", 00:22:44.128 "aliases": [ 00:22:44.128 "f3306c86-ce75-4af7-aa1b-358719bffa7e" 00:22:44.128 ], 00:22:44.128 "product_name": "NVMe disk", 00:22:44.128 "block_size": 512, 00:22:44.128 "num_blocks": 2097152, 00:22:44.128 "uuid": "f3306c86-ce75-4af7-aa1b-358719bffa7e", 00:22:44.129 "assigned_rate_limits": { 00:22:44.129 "rw_ios_per_sec": 0, 00:22:44.129 "rw_mbytes_per_sec": 0, 00:22:44.129 "r_mbytes_per_sec": 0, 00:22:44.129 "w_mbytes_per_sec": 0 00:22:44.129 }, 00:22:44.129 "claimed": false, 00:22:44.129 "zoned": false, 00:22:44.129 "supported_io_types": { 00:22:44.129 "read": true, 00:22:44.129 "write": true, 00:22:44.129 "unmap": false, 00:22:44.129 "write_zeroes": true, 00:22:44.129 "flush": true, 00:22:44.129 "reset": true, 00:22:44.129 "compare": true, 00:22:44.129 "compare_and_write": true, 00:22:44.129 "abort": true, 00:22:44.129 "nvme_admin": true, 00:22:44.129 "nvme_io": true 00:22:44.129 }, 00:22:44.129 "driver_specific": { 00:22:44.129 "nvme": [ 00:22:44.129 { 00:22:44.129 "trid": { 00:22:44.129 "trtype": "TCP", 00:22:44.129 "adrfam": "IPv4", 00:22:44.129 "traddr": "10.0.0.2", 00:22:44.129 "trsvcid": "4420", 00:22:44.129 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:22:44.129 }, 00:22:44.129 "ctrlr_data": { 00:22:44.129 "cntlid": 2, 00:22:44.129 "vendor_id": "0x8086", 00:22:44.129 "model_number": "SPDK bdev Controller", 00:22:44.129 "serial_number": "00000000000000000000", 00:22:44.129 "firmware_revision": "24.01.1", 00:22:44.129 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:22:44.129 "oacs": { 00:22:44.129 "security": 0, 00:22:44.129 "format": 0, 00:22:44.129 "firmware": 0, 00:22:44.129 "ns_manage": 0 00:22:44.129 }, 00:22:44.129 "multi_ctrlr": true, 00:22:44.129 "ana_reporting": false 00:22:44.129 }, 00:22:44.129 "vs": { 00:22:44.129 "nvme_version": "1.3" 00:22:44.129 }, 00:22:44.129 "ns_data": { 00:22:44.129 "id": 1, 00:22:44.129 "can_share": true 00:22:44.129 } 00:22:44.129 } 00:22:44.129 ], 00:22:44.129 "mp_policy": "active_passive" 00:22:44.129 } 00:22:44.129 } 00:22:44.129 ] 00:22:44.129 09:01:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:44.129 09:01:32 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:44.129 09:01:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:44.129 09:01:32 -- common/autotest_common.sh@10 -- # set +x 00:22:44.129 09:01:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:44.129 09:01:32 -- host/async_init.sh@53 -- # mktemp 00:22:44.129 09:01:32 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.gC8QsEUMUR 00:22:44.129 09:01:32 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:22:44.129 09:01:32 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.gC8QsEUMUR 00:22:44.129 09:01:32 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:22:44.129 09:01:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:44.129 09:01:32 -- common/autotest_common.sh@10 -- # set +x 00:22:44.129 09:01:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:44.129 09:01:32 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:22:44.129 09:01:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:44.129 09:01:32 -- common/autotest_common.sh@10 -- # set +x 00:22:44.129 [2024-07-15 09:01:32.582511] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:22:44.129 [2024-07-15 09:01:32.582647] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:22:44.129 09:01:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:44.129 09:01:32 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.gC8QsEUMUR 00:22:44.129 09:01:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:44.129 09:01:32 -- common/autotest_common.sh@10 -- # set +x 00:22:44.129 09:01:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:44.129 09:01:32 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.gC8QsEUMUR 00:22:44.129 09:01:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:44.129 09:01:32 -- common/autotest_common.sh@10 -- # set +x 00:22:44.129 [2024-07-15 09:01:32.598554] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:22:44.129 nvme0n1 00:22:44.129 09:01:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:44.129 09:01:32 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:22:44.129 09:01:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:44.129 09:01:32 -- common/autotest_common.sh@10 -- # set +x 00:22:44.389 [ 00:22:44.389 { 00:22:44.389 "name": "nvme0n1", 00:22:44.389 "aliases": [ 00:22:44.389 "f3306c86-ce75-4af7-aa1b-358719bffa7e" 00:22:44.389 ], 00:22:44.389 "product_name": "NVMe disk", 00:22:44.389 "block_size": 512, 00:22:44.389 "num_blocks": 2097152, 00:22:44.389 "uuid": "f3306c86-ce75-4af7-aa1b-358719bffa7e", 00:22:44.389 "assigned_rate_limits": { 00:22:44.389 "rw_ios_per_sec": 0, 00:22:44.389 "rw_mbytes_per_sec": 0, 00:22:44.389 "r_mbytes_per_sec": 0, 00:22:44.389 "w_mbytes_per_sec": 0 00:22:44.389 }, 00:22:44.389 "claimed": false, 00:22:44.389 "zoned": false, 00:22:44.389 "supported_io_types": { 00:22:44.389 "read": true, 00:22:44.389 "write": true, 00:22:44.389 "unmap": false, 00:22:44.389 "write_zeroes": true, 00:22:44.389 "flush": true, 00:22:44.389 "reset": true, 00:22:44.389 "compare": true, 00:22:44.389 "compare_and_write": true, 00:22:44.389 "abort": true, 00:22:44.389 "nvme_admin": true, 00:22:44.389 "nvme_io": true 00:22:44.389 }, 00:22:44.389 "driver_specific": { 00:22:44.389 "nvme": [ 00:22:44.389 { 00:22:44.389 "trid": { 00:22:44.389 "trtype": "TCP", 00:22:44.389 "adrfam": "IPv4", 00:22:44.389 "traddr": "10.0.0.2", 00:22:44.389 "trsvcid": "4421", 00:22:44.389 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:22:44.389 }, 00:22:44.389 "ctrlr_data": { 00:22:44.389 "cntlid": 3, 00:22:44.389 "vendor_id": "0x8086", 00:22:44.389 "model_number": "SPDK bdev Controller", 00:22:44.389 "serial_number": "00000000000000000000", 00:22:44.389 "firmware_revision": "24.01.1", 00:22:44.389 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:22:44.389 "oacs": { 00:22:44.389 "security": 0, 00:22:44.389 "format": 0, 00:22:44.389 "firmware": 0, 00:22:44.389 "ns_manage": 0 00:22:44.389 }, 00:22:44.389 "multi_ctrlr": true, 00:22:44.389 "ana_reporting": false 00:22:44.389 }, 00:22:44.389 "vs": { 00:22:44.389 "nvme_version": "1.3" 00:22:44.389 }, 00:22:44.389 "ns_data": { 00:22:44.389 "id": 1, 00:22:44.389 "can_share": true 00:22:44.389 } 00:22:44.389 } 00:22:44.389 ], 00:22:44.389 "mp_policy": "active_passive" 00:22:44.389 } 00:22:44.389 } 00:22:44.389 ] 00:22:44.389 09:01:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:44.389 09:01:32 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:44.389 09:01:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:44.389 09:01:32 -- common/autotest_common.sh@10 -- # set +x 00:22:44.389 09:01:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:44.389 09:01:32 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.gC8QsEUMUR 00:22:44.389 09:01:32 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:22:44.389 09:01:32 -- host/async_init.sh@78 -- # nvmftestfini 00:22:44.389 09:01:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:44.389 09:01:32 -- nvmf/common.sh@116 -- # sync 00:22:44.389 09:01:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:44.389 09:01:32 -- nvmf/common.sh@119 -- # set +e 00:22:44.389 09:01:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:44.389 09:01:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:44.389 rmmod nvme_tcp 00:22:44.389 rmmod nvme_fabrics 00:22:44.389 rmmod nvme_keyring 00:22:44.389 09:01:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:44.389 09:01:32 -- nvmf/common.sh@123 -- # set -e 00:22:44.389 09:01:32 -- nvmf/common.sh@124 -- # return 0 00:22:44.389 09:01:32 -- nvmf/common.sh@477 -- # '[' -n 1573250 ']' 00:22:44.389 09:01:32 -- nvmf/common.sh@478 -- # killprocess 1573250 00:22:44.389 09:01:32 -- common/autotest_common.sh@926 -- # '[' -z 1573250 ']' 00:22:44.389 09:01:32 -- common/autotest_common.sh@930 -- # kill -0 1573250 00:22:44.389 09:01:32 -- common/autotest_common.sh@931 -- # uname 00:22:44.389 09:01:32 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:22:44.389 09:01:32 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1573250 00:22:44.389 09:01:32 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:22:44.389 09:01:32 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:22:44.389 09:01:32 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1573250' 00:22:44.389 killing process with pid 1573250 00:22:44.389 09:01:32 -- common/autotest_common.sh@945 -- # kill 1573250 00:22:44.389 09:01:32 -- common/autotest_common.sh@950 -- # wait 1573250 00:22:44.649 09:01:33 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:44.649 09:01:33 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:44.649 09:01:33 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:44.649 09:01:33 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:44.649 09:01:33 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:44.649 09:01:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:44.649 09:01:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:44.649 09:01:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:46.565 09:01:35 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:46.565 00:22:46.565 real 0m6.076s 00:22:46.565 user 0m2.913s 00:22:46.565 sys 0m1.741s 00:22:46.565 09:01:35 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:22:46.565 09:01:35 -- common/autotest_common.sh@10 -- # set +x 00:22:46.565 ************************************ 00:22:46.565 END TEST nvmf_async_init 00:22:46.565 ************************************ 00:22:46.825 09:01:35 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:22:46.825 09:01:35 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:22:46.825 09:01:35 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:22:46.825 09:01:35 -- common/autotest_common.sh@10 -- # set +x 00:22:46.825 ************************************ 00:22:46.825 START TEST dma 00:22:46.825 ************************************ 00:22:46.825 09:01:35 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:22:46.825 * Looking for test storage... 00:22:46.825 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:46.825 09:01:35 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:46.825 09:01:35 -- nvmf/common.sh@7 -- # uname -s 00:22:46.825 09:01:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:46.825 09:01:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:46.825 09:01:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:46.825 09:01:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:46.825 09:01:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:46.825 09:01:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:46.825 09:01:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:46.825 09:01:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:46.825 09:01:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:46.825 09:01:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:46.825 09:01:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:46.825 09:01:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:46.825 09:01:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:46.825 09:01:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:46.825 09:01:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:46.825 09:01:35 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:46.825 09:01:35 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:46.825 09:01:35 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:46.825 09:01:35 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:46.825 09:01:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:46.825 09:01:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:46.825 09:01:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:46.825 09:01:35 -- paths/export.sh@5 -- # export PATH 00:22:46.825 09:01:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:46.825 09:01:35 -- nvmf/common.sh@46 -- # : 0 00:22:46.825 09:01:35 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:46.825 09:01:35 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:46.825 09:01:35 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:46.825 09:01:35 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:46.825 09:01:35 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:46.825 09:01:35 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:46.825 09:01:35 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:46.825 09:01:35 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:46.825 09:01:35 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:22:46.825 09:01:35 -- host/dma.sh@13 -- # exit 0 00:22:46.825 00:22:46.825 real 0m0.061s 00:22:46.825 user 0m0.029s 00:22:46.825 sys 0m0.037s 00:22:46.825 09:01:35 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:22:46.825 09:01:35 -- common/autotest_common.sh@10 -- # set +x 00:22:46.825 ************************************ 00:22:46.825 END TEST dma 00:22:46.825 ************************************ 00:22:46.825 09:01:35 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:22:46.825 09:01:35 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:22:46.825 09:01:35 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:22:46.825 09:01:35 -- common/autotest_common.sh@10 -- # set +x 00:22:46.825 ************************************ 00:22:46.825 START TEST nvmf_identify 00:22:46.825 ************************************ 00:22:46.825 09:01:35 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:22:46.825 * Looking for test storage... 00:22:46.825 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:46.825 09:01:35 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:46.825 09:01:35 -- nvmf/common.sh@7 -- # uname -s 00:22:46.825 09:01:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:46.825 09:01:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:46.825 09:01:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:46.825 09:01:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:46.825 09:01:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:46.825 09:01:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:46.825 09:01:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:46.825 09:01:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:46.825 09:01:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:46.825 09:01:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:46.825 09:01:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:46.825 09:01:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:46.825 09:01:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:46.825 09:01:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:46.825 09:01:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:46.825 09:01:35 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:46.825 09:01:35 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:46.825 09:01:35 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:46.825 09:01:35 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:46.825 09:01:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:46.825 09:01:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:46.825 09:01:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:46.825 09:01:35 -- paths/export.sh@5 -- # export PATH 00:22:46.825 09:01:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:46.825 09:01:35 -- nvmf/common.sh@46 -- # : 0 00:22:46.825 09:01:35 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:46.825 09:01:35 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:46.825 09:01:35 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:46.825 09:01:35 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:46.825 09:01:35 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:46.825 09:01:35 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:46.825 09:01:35 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:46.825 09:01:35 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:46.825 09:01:35 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:46.825 09:01:35 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:46.825 09:01:35 -- host/identify.sh@14 -- # nvmftestinit 00:22:46.825 09:01:35 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:46.825 09:01:35 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:46.825 09:01:35 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:46.825 09:01:35 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:46.825 09:01:35 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:46.825 09:01:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:46.825 09:01:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:46.825 09:01:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:46.825 09:01:35 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:46.825 09:01:35 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:46.825 09:01:35 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:46.825 09:01:35 -- common/autotest_common.sh@10 -- # set +x 00:22:48.726 09:01:37 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:48.726 09:01:37 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:48.726 09:01:37 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:48.726 09:01:37 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:48.726 09:01:37 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:48.726 09:01:37 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:48.726 09:01:37 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:48.726 09:01:37 -- nvmf/common.sh@294 -- # net_devs=() 00:22:48.726 09:01:37 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:48.726 09:01:37 -- nvmf/common.sh@295 -- # e810=() 00:22:48.726 09:01:37 -- nvmf/common.sh@295 -- # local -ga e810 00:22:48.726 09:01:37 -- nvmf/common.sh@296 -- # x722=() 00:22:48.726 09:01:37 -- nvmf/common.sh@296 -- # local -ga x722 00:22:48.726 09:01:37 -- nvmf/common.sh@297 -- # mlx=() 00:22:48.726 09:01:37 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:48.726 09:01:37 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:48.726 09:01:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:48.726 09:01:37 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:48.726 09:01:37 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:48.726 09:01:37 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:48.726 09:01:37 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:48.726 09:01:37 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:48.726 09:01:37 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:48.726 09:01:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:48.726 09:01:37 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:48.726 09:01:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:48.726 09:01:37 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:48.726 09:01:37 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:48.726 09:01:37 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:48.726 09:01:37 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:48.726 09:01:37 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:48.726 09:01:37 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:48.726 09:01:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:48.726 09:01:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:48.726 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:48.726 09:01:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:48.726 09:01:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:48.726 09:01:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:48.726 09:01:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:48.726 09:01:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:48.726 09:01:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:48.726 09:01:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:48.726 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:48.726 09:01:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:48.726 09:01:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:48.726 09:01:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:48.726 09:01:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:48.726 09:01:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:48.726 09:01:37 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:48.726 09:01:37 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:48.726 09:01:37 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:48.726 09:01:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:48.726 09:01:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:48.726 09:01:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:48.726 09:01:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:48.726 09:01:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:48.726 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:48.726 09:01:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:48.726 09:01:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:48.726 09:01:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:48.726 09:01:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:48.726 09:01:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:48.726 09:01:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:48.726 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:48.726 09:01:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:48.726 09:01:37 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:48.726 09:01:37 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:48.726 09:01:37 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:48.726 09:01:37 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:48.726 09:01:37 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:48.726 09:01:37 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:48.726 09:01:37 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:48.726 09:01:37 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:48.726 09:01:37 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:48.726 09:01:37 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:48.726 09:01:37 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:48.726 09:01:37 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:48.726 09:01:37 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:48.726 09:01:37 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:48.726 09:01:37 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:48.726 09:01:37 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:48.726 09:01:37 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:48.726 09:01:37 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:48.726 09:01:37 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:48.726 09:01:37 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:48.726 09:01:37 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:48.986 09:01:37 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:48.986 09:01:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:48.986 09:01:37 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:48.986 09:01:37 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:48.986 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:48.986 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.120 ms 00:22:48.986 00:22:48.986 --- 10.0.0.2 ping statistics --- 00:22:48.986 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:48.986 rtt min/avg/max/mdev = 0.120/0.120/0.120/0.000 ms 00:22:48.987 09:01:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:48.987 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:48.987 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.106 ms 00:22:48.987 00:22:48.987 --- 10.0.0.1 ping statistics --- 00:22:48.987 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:48.987 rtt min/avg/max/mdev = 0.106/0.106/0.106/0.000 ms 00:22:48.987 09:01:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:48.987 09:01:37 -- nvmf/common.sh@410 -- # return 0 00:22:48.987 09:01:37 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:48.987 09:01:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:48.987 09:01:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:48.987 09:01:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:48.987 09:01:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:48.987 09:01:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:48.987 09:01:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:48.987 09:01:37 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:22:48.987 09:01:37 -- common/autotest_common.sh@712 -- # xtrace_disable 00:22:48.987 09:01:37 -- common/autotest_common.sh@10 -- # set +x 00:22:48.987 09:01:37 -- host/identify.sh@19 -- # nvmfpid=1575520 00:22:48.987 09:01:37 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:48.987 09:01:37 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:48.987 09:01:37 -- host/identify.sh@23 -- # waitforlisten 1575520 00:22:48.987 09:01:37 -- common/autotest_common.sh@819 -- # '[' -z 1575520 ']' 00:22:48.987 09:01:37 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:48.987 09:01:37 -- common/autotest_common.sh@824 -- # local max_retries=100 00:22:48.987 09:01:37 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:48.987 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:48.987 09:01:37 -- common/autotest_common.sh@828 -- # xtrace_disable 00:22:48.987 09:01:37 -- common/autotest_common.sh@10 -- # set +x 00:22:48.987 [2024-07-15 09:01:37.389424] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:22:48.987 [2024-07-15 09:01:37.389493] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:48.987 EAL: No free 2048 kB hugepages reported on node 1 00:22:48.987 [2024-07-15 09:01:37.460261] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:49.247 [2024-07-15 09:01:37.581358] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:49.247 [2024-07-15 09:01:37.581524] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:49.247 [2024-07-15 09:01:37.581541] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:49.247 [2024-07-15 09:01:37.581553] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:49.247 [2024-07-15 09:01:37.581615] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:49.247 [2024-07-15 09:01:37.581791] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:49.247 [2024-07-15 09:01:37.581847] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:49.247 [2024-07-15 09:01:37.581851] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:50.186 09:01:38 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:22:50.186 09:01:38 -- common/autotest_common.sh@852 -- # return 0 00:22:50.186 09:01:38 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:50.186 09:01:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:50.186 09:01:38 -- common/autotest_common.sh@10 -- # set +x 00:22:50.186 [2024-07-15 09:01:38.393460] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:50.186 09:01:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:50.186 09:01:38 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:22:50.186 09:01:38 -- common/autotest_common.sh@718 -- # xtrace_disable 00:22:50.186 09:01:38 -- common/autotest_common.sh@10 -- # set +x 00:22:50.186 09:01:38 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:22:50.186 09:01:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:50.186 09:01:38 -- common/autotest_common.sh@10 -- # set +x 00:22:50.186 Malloc0 00:22:50.186 09:01:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:50.186 09:01:38 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:50.186 09:01:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:50.186 09:01:38 -- common/autotest_common.sh@10 -- # set +x 00:22:50.186 09:01:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:50.186 09:01:38 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:22:50.186 09:01:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:50.186 09:01:38 -- common/autotest_common.sh@10 -- # set +x 00:22:50.186 09:01:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:50.186 09:01:38 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:50.186 09:01:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:50.186 09:01:38 -- common/autotest_common.sh@10 -- # set +x 00:22:50.186 [2024-07-15 09:01:38.471241] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:50.186 09:01:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:50.186 09:01:38 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:22:50.186 09:01:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:50.186 09:01:38 -- common/autotest_common.sh@10 -- # set +x 00:22:50.186 09:01:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:50.186 09:01:38 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:22:50.186 09:01:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:50.186 09:01:38 -- common/autotest_common.sh@10 -- # set +x 00:22:50.186 [2024-07-15 09:01:38.486954] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:22:50.186 [ 00:22:50.186 { 00:22:50.186 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:22:50.186 "subtype": "Discovery", 00:22:50.186 "listen_addresses": [ 00:22:50.186 { 00:22:50.186 "transport": "TCP", 00:22:50.186 "trtype": "TCP", 00:22:50.186 "adrfam": "IPv4", 00:22:50.186 "traddr": "10.0.0.2", 00:22:50.186 "trsvcid": "4420" 00:22:50.186 } 00:22:50.186 ], 00:22:50.186 "allow_any_host": true, 00:22:50.186 "hosts": [] 00:22:50.186 }, 00:22:50.186 { 00:22:50.186 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:22:50.186 "subtype": "NVMe", 00:22:50.186 "listen_addresses": [ 00:22:50.186 { 00:22:50.186 "transport": "TCP", 00:22:50.186 "trtype": "TCP", 00:22:50.186 "adrfam": "IPv4", 00:22:50.186 "traddr": "10.0.0.2", 00:22:50.186 "trsvcid": "4420" 00:22:50.186 } 00:22:50.186 ], 00:22:50.186 "allow_any_host": true, 00:22:50.186 "hosts": [], 00:22:50.186 "serial_number": "SPDK00000000000001", 00:22:50.186 "model_number": "SPDK bdev Controller", 00:22:50.186 "max_namespaces": 32, 00:22:50.186 "min_cntlid": 1, 00:22:50.186 "max_cntlid": 65519, 00:22:50.186 "namespaces": [ 00:22:50.186 { 00:22:50.186 "nsid": 1, 00:22:50.186 "bdev_name": "Malloc0", 00:22:50.186 "name": "Malloc0", 00:22:50.186 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:22:50.186 "eui64": "ABCDEF0123456789", 00:22:50.186 "uuid": "f44bb437-e720-453c-821a-d99d856bbce5" 00:22:50.186 } 00:22:50.186 ] 00:22:50.186 } 00:22:50.186 ] 00:22:50.186 09:01:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:50.186 09:01:38 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:22:50.186 [2024-07-15 09:01:38.510905] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:22:50.186 [2024-07-15 09:01:38.510949] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1575681 ] 00:22:50.186 EAL: No free 2048 kB hugepages reported on node 1 00:22:50.186 [2024-07-15 09:01:38.543095] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:22:50.186 [2024-07-15 09:01:38.543151] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:22:50.186 [2024-07-15 09:01:38.543175] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:22:50.186 [2024-07-15 09:01:38.543190] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:22:50.186 [2024-07-15 09:01:38.543202] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:22:50.186 [2024-07-15 09:01:38.546919] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:22:50.186 [2024-07-15 09:01:38.546981] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x1671e10 0 00:22:50.186 [2024-07-15 09:01:38.553894] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:22:50.186 [2024-07-15 09:01:38.553915] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:22:50.186 [2024-07-15 09:01:38.553924] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:22:50.186 [2024-07-15 09:01:38.553930] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:22:50.186 [2024-07-15 09:01:38.553979] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.186 [2024-07-15 09:01:38.553992] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.186 [2024-07-15 09:01:38.553999] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1671e10) 00:22:50.186 [2024-07-15 09:01:38.554016] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:22:50.186 [2024-07-15 09:01:38.554046] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16f1bf0, cid 0, qid 0 00:22:50.186 [2024-07-15 09:01:38.561888] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.186 [2024-07-15 09:01:38.561905] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.186 [2024-07-15 09:01:38.561912] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.186 [2024-07-15 09:01:38.561919] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16f1bf0) on tqpair=0x1671e10 00:22:50.186 [2024-07-15 09:01:38.561954] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:22:50.186 [2024-07-15 09:01:38.561966] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:22:50.186 [2024-07-15 09:01:38.561975] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:22:50.186 [2024-07-15 09:01:38.561993] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.186 [2024-07-15 09:01:38.562002] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.186 [2024-07-15 09:01:38.562008] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1671e10) 00:22:50.187 [2024-07-15 09:01:38.562019] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.187 [2024-07-15 09:01:38.562043] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16f1bf0, cid 0, qid 0 00:22:50.187 [2024-07-15 09:01:38.562207] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.187 [2024-07-15 09:01:38.562222] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.187 [2024-07-15 09:01:38.562229] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.187 [2024-07-15 09:01:38.562235] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16f1bf0) on tqpair=0x1671e10 00:22:50.187 [2024-07-15 09:01:38.562246] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:22:50.187 [2024-07-15 09:01:38.562259] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:22:50.187 [2024-07-15 09:01:38.562271] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.187 [2024-07-15 09:01:38.562279] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.187 [2024-07-15 09:01:38.562285] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1671e10) 00:22:50.187 [2024-07-15 09:01:38.562296] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.187 [2024-07-15 09:01:38.562317] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16f1bf0, cid 0, qid 0 00:22:50.187 [2024-07-15 09:01:38.562428] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.187 [2024-07-15 09:01:38.562443] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.187 [2024-07-15 09:01:38.562450] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.187 [2024-07-15 09:01:38.562456] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16f1bf0) on tqpair=0x1671e10 00:22:50.187 [2024-07-15 09:01:38.562466] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:22:50.187 [2024-07-15 09:01:38.562480] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:22:50.187 [2024-07-15 09:01:38.562493] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.187 [2024-07-15 09:01:38.562500] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.187 [2024-07-15 09:01:38.562507] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1671e10) 00:22:50.187 [2024-07-15 09:01:38.562517] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.187 [2024-07-15 09:01:38.562542] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16f1bf0, cid 0, qid 0 00:22:50.187 [2024-07-15 09:01:38.562651] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.187 [2024-07-15 09:01:38.562666] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.187 [2024-07-15 09:01:38.562673] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.187 [2024-07-15 09:01:38.562680] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16f1bf0) on tqpair=0x1671e10 00:22:50.187 [2024-07-15 09:01:38.562689] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:22:50.187 [2024-07-15 09:01:38.562706] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.187 [2024-07-15 09:01:38.562715] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.187 [2024-07-15 09:01:38.562722] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1671e10) 00:22:50.187 [2024-07-15 09:01:38.562732] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.187 [2024-07-15 09:01:38.562752] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16f1bf0, cid 0, qid 0 00:22:50.187 [2024-07-15 09:01:38.562864] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.187 [2024-07-15 09:01:38.562886] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.187 [2024-07-15 09:01:38.562895] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.187 [2024-07-15 09:01:38.562902] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16f1bf0) on tqpair=0x1671e10 00:22:50.187 [2024-07-15 09:01:38.562911] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:22:50.187 [2024-07-15 09:01:38.562920] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:22:50.187 [2024-07-15 09:01:38.562933] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:22:50.187 [2024-07-15 09:01:38.563042] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:22:50.187 [2024-07-15 09:01:38.563051] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:22:50.187 [2024-07-15 09:01:38.563064] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.187 [2024-07-15 09:01:38.563071] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.187 [2024-07-15 09:01:38.563078] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1671e10) 00:22:50.187 [2024-07-15 09:01:38.563088] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.187 [2024-07-15 09:01:38.563109] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16f1bf0, cid 0, qid 0 00:22:50.187 [2024-07-15 09:01:38.563276] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.187 [2024-07-15 09:01:38.563288] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.187 [2024-07-15 09:01:38.563294] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.187 [2024-07-15 09:01:38.563301] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16f1bf0) on tqpair=0x1671e10 00:22:50.187 [2024-07-15 09:01:38.563310] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:22:50.187 [2024-07-15 09:01:38.563326] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.187 [2024-07-15 09:01:38.563335] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.187 [2024-07-15 09:01:38.563341] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1671e10) 00:22:50.187 [2024-07-15 09:01:38.563355] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.187 [2024-07-15 09:01:38.563376] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16f1bf0, cid 0, qid 0 00:22:50.187 [2024-07-15 09:01:38.563487] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.187 [2024-07-15 09:01:38.563502] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.187 [2024-07-15 09:01:38.563509] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.187 [2024-07-15 09:01:38.563516] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16f1bf0) on tqpair=0x1671e10 00:22:50.187 [2024-07-15 09:01:38.563525] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:22:50.187 [2024-07-15 09:01:38.563533] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:22:50.187 [2024-07-15 09:01:38.563546] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:22:50.187 [2024-07-15 09:01:38.563566] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:22:50.187 [2024-07-15 09:01:38.563581] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.187 [2024-07-15 09:01:38.563589] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.187 [2024-07-15 09:01:38.563595] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1671e10) 00:22:50.187 [2024-07-15 09:01:38.563606] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.187 [2024-07-15 09:01:38.563627] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16f1bf0, cid 0, qid 0 00:22:50.187 [2024-07-15 09:01:38.563775] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:50.187 [2024-07-15 09:01:38.563790] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:50.187 [2024-07-15 09:01:38.563797] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:50.187 [2024-07-15 09:01:38.563804] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1671e10): datao=0, datal=4096, cccid=0 00:22:50.187 [2024-07-15 09:01:38.563812] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x16f1bf0) on tqpair(0x1671e10): expected_datao=0, payload_size=4096 00:22:50.187 [2024-07-15 09:01:38.563843] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:50.187 [2024-07-15 09:01:38.563853] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:50.187 [2024-07-15 09:01:38.563960] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.187 [2024-07-15 09:01:38.563975] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.187 [2024-07-15 09:01:38.563982] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.187 [2024-07-15 09:01:38.563989] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16f1bf0) on tqpair=0x1671e10 00:22:50.187 [2024-07-15 09:01:38.564002] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:22:50.187 [2024-07-15 09:01:38.564010] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:22:50.187 [2024-07-15 09:01:38.564018] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:22:50.187 [2024-07-15 09:01:38.564026] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:22:50.187 [2024-07-15 09:01:38.564033] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:22:50.187 [2024-07-15 09:01:38.564041] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:22:50.187 [2024-07-15 09:01:38.564064] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:22:50.187 [2024-07-15 09:01:38.564078] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.187 [2024-07-15 09:01:38.564085] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.187 [2024-07-15 09:01:38.564091] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1671e10) 00:22:50.187 [2024-07-15 09:01:38.564102] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:22:50.187 [2024-07-15 09:01:38.564123] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16f1bf0, cid 0, qid 0 00:22:50.187 [2024-07-15 09:01:38.564267] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.187 [2024-07-15 09:01:38.564282] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.187 [2024-07-15 09:01:38.564289] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.187 [2024-07-15 09:01:38.564296] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16f1bf0) on tqpair=0x1671e10 00:22:50.187 [2024-07-15 09:01:38.564309] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.187 [2024-07-15 09:01:38.564316] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.187 [2024-07-15 09:01:38.564322] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1671e10) 00:22:50.187 [2024-07-15 09:01:38.564332] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.187 [2024-07-15 09:01:38.564342] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.188 [2024-07-15 09:01:38.564349] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.188 [2024-07-15 09:01:38.564355] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x1671e10) 00:22:50.188 [2024-07-15 09:01:38.564364] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.188 [2024-07-15 09:01:38.564373] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.188 [2024-07-15 09:01:38.564380] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.188 [2024-07-15 09:01:38.564386] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x1671e10) 00:22:50.188 [2024-07-15 09:01:38.564395] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.188 [2024-07-15 09:01:38.564405] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.188 [2024-07-15 09:01:38.564411] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.188 [2024-07-15 09:01:38.564418] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1671e10) 00:22:50.188 [2024-07-15 09:01:38.564426] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.188 [2024-07-15 09:01:38.564435] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:22:50.188 [2024-07-15 09:01:38.564454] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:22:50.188 [2024-07-15 09:01:38.564467] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.188 [2024-07-15 09:01:38.564474] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.188 [2024-07-15 09:01:38.564480] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1671e10) 00:22:50.188 [2024-07-15 09:01:38.564490] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.188 [2024-07-15 09:01:38.564512] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16f1bf0, cid 0, qid 0 00:22:50.188 [2024-07-15 09:01:38.564541] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16f1d50, cid 1, qid 0 00:22:50.188 [2024-07-15 09:01:38.564550] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16f1eb0, cid 2, qid 0 00:22:50.188 [2024-07-15 09:01:38.564557] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16f2010, cid 3, qid 0 00:22:50.188 [2024-07-15 09:01:38.564564] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16f2170, cid 4, qid 0 00:22:50.188 [2024-07-15 09:01:38.564825] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.188 [2024-07-15 09:01:38.564841] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.188 [2024-07-15 09:01:38.564848] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.188 [2024-07-15 09:01:38.564854] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16f2170) on tqpair=0x1671e10 00:22:50.188 [2024-07-15 09:01:38.564864] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:22:50.188 [2024-07-15 09:01:38.564873] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:22:50.188 [2024-07-15 09:01:38.564901] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.188 [2024-07-15 09:01:38.564910] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.188 [2024-07-15 09:01:38.564917] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1671e10) 00:22:50.188 [2024-07-15 09:01:38.564927] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.188 [2024-07-15 09:01:38.564948] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16f2170, cid 4, qid 0 00:22:50.188 [2024-07-15 09:01:38.565107] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:50.188 [2024-07-15 09:01:38.565122] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:50.188 [2024-07-15 09:01:38.565129] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:50.188 [2024-07-15 09:01:38.565135] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1671e10): datao=0, datal=4096, cccid=4 00:22:50.188 [2024-07-15 09:01:38.565143] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x16f2170) on tqpair(0x1671e10): expected_datao=0, payload_size=4096 00:22:50.188 [2024-07-15 09:01:38.565154] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:50.188 [2024-07-15 09:01:38.565161] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:50.188 [2024-07-15 09:01:38.565215] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.188 [2024-07-15 09:01:38.565226] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.188 [2024-07-15 09:01:38.565233] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.188 [2024-07-15 09:01:38.565240] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16f2170) on tqpair=0x1671e10 00:22:50.188 [2024-07-15 09:01:38.565259] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:22:50.188 [2024-07-15 09:01:38.565294] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.188 [2024-07-15 09:01:38.565305] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.188 [2024-07-15 09:01:38.565311] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1671e10) 00:22:50.188 [2024-07-15 09:01:38.565321] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.188 [2024-07-15 09:01:38.565333] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.188 [2024-07-15 09:01:38.565340] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.188 [2024-07-15 09:01:38.565346] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1671e10) 00:22:50.188 [2024-07-15 09:01:38.565355] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.188 [2024-07-15 09:01:38.565384] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16f2170, cid 4, qid 0 00:22:50.188 [2024-07-15 09:01:38.565396] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16f22d0, cid 5, qid 0 00:22:50.188 [2024-07-15 09:01:38.568888] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:50.188 [2024-07-15 09:01:38.568904] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:50.188 [2024-07-15 09:01:38.568911] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:50.188 [2024-07-15 09:01:38.568918] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1671e10): datao=0, datal=1024, cccid=4 00:22:50.188 [2024-07-15 09:01:38.568925] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x16f2170) on tqpair(0x1671e10): expected_datao=0, payload_size=1024 00:22:50.188 [2024-07-15 09:01:38.568935] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:50.188 [2024-07-15 09:01:38.568943] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:50.188 [2024-07-15 09:01:38.568951] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.188 [2024-07-15 09:01:38.568959] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.188 [2024-07-15 09:01:38.568966] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.188 [2024-07-15 09:01:38.568972] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16f22d0) on tqpair=0x1671e10 00:22:50.188 [2024-07-15 09:01:38.608888] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.188 [2024-07-15 09:01:38.608907] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.188 [2024-07-15 09:01:38.608914] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.188 [2024-07-15 09:01:38.608921] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16f2170) on tqpair=0x1671e10 00:22:50.188 [2024-07-15 09:01:38.608940] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.188 [2024-07-15 09:01:38.608949] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.188 [2024-07-15 09:01:38.608955] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1671e10) 00:22:50.188 [2024-07-15 09:01:38.608966] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.188 [2024-07-15 09:01:38.609011] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16f2170, cid 4, qid 0 00:22:50.188 [2024-07-15 09:01:38.609247] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:50.188 [2024-07-15 09:01:38.609262] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:50.188 [2024-07-15 09:01:38.609269] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:50.188 [2024-07-15 09:01:38.609276] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1671e10): datao=0, datal=3072, cccid=4 00:22:50.188 [2024-07-15 09:01:38.609283] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x16f2170) on tqpair(0x1671e10): expected_datao=0, payload_size=3072 00:22:50.188 [2024-07-15 09:01:38.609336] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:50.188 [2024-07-15 09:01:38.609345] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:50.188 [2024-07-15 09:01:38.609451] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.188 [2024-07-15 09:01:38.609463] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.188 [2024-07-15 09:01:38.609469] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.188 [2024-07-15 09:01:38.609476] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16f2170) on tqpair=0x1671e10 00:22:50.188 [2024-07-15 09:01:38.609492] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.188 [2024-07-15 09:01:38.609500] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.188 [2024-07-15 09:01:38.609507] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1671e10) 00:22:50.188 [2024-07-15 09:01:38.609517] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.188 [2024-07-15 09:01:38.609550] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16f2170, cid 4, qid 0 00:22:50.188 [2024-07-15 09:01:38.609680] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:50.188 [2024-07-15 09:01:38.609695] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:50.188 [2024-07-15 09:01:38.609702] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:50.188 [2024-07-15 09:01:38.609708] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1671e10): datao=0, datal=8, cccid=4 00:22:50.188 [2024-07-15 09:01:38.609716] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x16f2170) on tqpair(0x1671e10): expected_datao=0, payload_size=8 00:22:50.188 [2024-07-15 09:01:38.609726] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:50.188 [2024-07-15 09:01:38.609733] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:50.188 [2024-07-15 09:01:38.649998] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.188 [2024-07-15 09:01:38.650016] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.188 [2024-07-15 09:01:38.650024] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.188 [2024-07-15 09:01:38.650030] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16f2170) on tqpair=0x1671e10 00:22:50.188 ===================================================== 00:22:50.188 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:22:50.188 ===================================================== 00:22:50.188 Controller Capabilities/Features 00:22:50.188 ================================ 00:22:50.188 Vendor ID: 0000 00:22:50.188 Subsystem Vendor ID: 0000 00:22:50.188 Serial Number: .................... 00:22:50.188 Model Number: ........................................ 00:22:50.188 Firmware Version: 24.01.1 00:22:50.188 Recommended Arb Burst: 0 00:22:50.188 IEEE OUI Identifier: 00 00 00 00:22:50.188 Multi-path I/O 00:22:50.188 May have multiple subsystem ports: No 00:22:50.189 May have multiple controllers: No 00:22:50.189 Associated with SR-IOV VF: No 00:22:50.189 Max Data Transfer Size: 131072 00:22:50.189 Max Number of Namespaces: 0 00:22:50.189 Max Number of I/O Queues: 1024 00:22:50.189 NVMe Specification Version (VS): 1.3 00:22:50.189 NVMe Specification Version (Identify): 1.3 00:22:50.189 Maximum Queue Entries: 128 00:22:50.189 Contiguous Queues Required: Yes 00:22:50.189 Arbitration Mechanisms Supported 00:22:50.189 Weighted Round Robin: Not Supported 00:22:50.189 Vendor Specific: Not Supported 00:22:50.189 Reset Timeout: 15000 ms 00:22:50.189 Doorbell Stride: 4 bytes 00:22:50.189 NVM Subsystem Reset: Not Supported 00:22:50.189 Command Sets Supported 00:22:50.189 NVM Command Set: Supported 00:22:50.189 Boot Partition: Not Supported 00:22:50.189 Memory Page Size Minimum: 4096 bytes 00:22:50.189 Memory Page Size Maximum: 4096 bytes 00:22:50.189 Persistent Memory Region: Not Supported 00:22:50.189 Optional Asynchronous Events Supported 00:22:50.189 Namespace Attribute Notices: Not Supported 00:22:50.189 Firmware Activation Notices: Not Supported 00:22:50.189 ANA Change Notices: Not Supported 00:22:50.189 PLE Aggregate Log Change Notices: Not Supported 00:22:50.189 LBA Status Info Alert Notices: Not Supported 00:22:50.189 EGE Aggregate Log Change Notices: Not Supported 00:22:50.189 Normal NVM Subsystem Shutdown event: Not Supported 00:22:50.189 Zone Descriptor Change Notices: Not Supported 00:22:50.189 Discovery Log Change Notices: Supported 00:22:50.189 Controller Attributes 00:22:50.189 128-bit Host Identifier: Not Supported 00:22:50.189 Non-Operational Permissive Mode: Not Supported 00:22:50.189 NVM Sets: Not Supported 00:22:50.189 Read Recovery Levels: Not Supported 00:22:50.189 Endurance Groups: Not Supported 00:22:50.189 Predictable Latency Mode: Not Supported 00:22:50.189 Traffic Based Keep ALive: Not Supported 00:22:50.189 Namespace Granularity: Not Supported 00:22:50.189 SQ Associations: Not Supported 00:22:50.189 UUID List: Not Supported 00:22:50.189 Multi-Domain Subsystem: Not Supported 00:22:50.189 Fixed Capacity Management: Not Supported 00:22:50.189 Variable Capacity Management: Not Supported 00:22:50.189 Delete Endurance Group: Not Supported 00:22:50.189 Delete NVM Set: Not Supported 00:22:50.189 Extended LBA Formats Supported: Not Supported 00:22:50.189 Flexible Data Placement Supported: Not Supported 00:22:50.189 00:22:50.189 Controller Memory Buffer Support 00:22:50.189 ================================ 00:22:50.189 Supported: No 00:22:50.189 00:22:50.189 Persistent Memory Region Support 00:22:50.189 ================================ 00:22:50.189 Supported: No 00:22:50.189 00:22:50.189 Admin Command Set Attributes 00:22:50.189 ============================ 00:22:50.189 Security Send/Receive: Not Supported 00:22:50.189 Format NVM: Not Supported 00:22:50.189 Firmware Activate/Download: Not Supported 00:22:50.189 Namespace Management: Not Supported 00:22:50.189 Device Self-Test: Not Supported 00:22:50.189 Directives: Not Supported 00:22:50.189 NVMe-MI: Not Supported 00:22:50.189 Virtualization Management: Not Supported 00:22:50.189 Doorbell Buffer Config: Not Supported 00:22:50.189 Get LBA Status Capability: Not Supported 00:22:50.189 Command & Feature Lockdown Capability: Not Supported 00:22:50.189 Abort Command Limit: 1 00:22:50.189 Async Event Request Limit: 4 00:22:50.189 Number of Firmware Slots: N/A 00:22:50.189 Firmware Slot 1 Read-Only: N/A 00:22:50.189 Firmware Activation Without Reset: N/A 00:22:50.189 Multiple Update Detection Support: N/A 00:22:50.189 Firmware Update Granularity: No Information Provided 00:22:50.189 Per-Namespace SMART Log: No 00:22:50.189 Asymmetric Namespace Access Log Page: Not Supported 00:22:50.189 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:22:50.189 Command Effects Log Page: Not Supported 00:22:50.189 Get Log Page Extended Data: Supported 00:22:50.189 Telemetry Log Pages: Not Supported 00:22:50.189 Persistent Event Log Pages: Not Supported 00:22:50.189 Supported Log Pages Log Page: May Support 00:22:50.189 Commands Supported & Effects Log Page: Not Supported 00:22:50.189 Feature Identifiers & Effects Log Page:May Support 00:22:50.189 NVMe-MI Commands & Effects Log Page: May Support 00:22:50.189 Data Area 4 for Telemetry Log: Not Supported 00:22:50.189 Error Log Page Entries Supported: 128 00:22:50.189 Keep Alive: Not Supported 00:22:50.189 00:22:50.189 NVM Command Set Attributes 00:22:50.189 ========================== 00:22:50.189 Submission Queue Entry Size 00:22:50.189 Max: 1 00:22:50.189 Min: 1 00:22:50.189 Completion Queue Entry Size 00:22:50.189 Max: 1 00:22:50.189 Min: 1 00:22:50.189 Number of Namespaces: 0 00:22:50.189 Compare Command: Not Supported 00:22:50.189 Write Uncorrectable Command: Not Supported 00:22:50.189 Dataset Management Command: Not Supported 00:22:50.189 Write Zeroes Command: Not Supported 00:22:50.189 Set Features Save Field: Not Supported 00:22:50.189 Reservations: Not Supported 00:22:50.189 Timestamp: Not Supported 00:22:50.189 Copy: Not Supported 00:22:50.189 Volatile Write Cache: Not Present 00:22:50.189 Atomic Write Unit (Normal): 1 00:22:50.189 Atomic Write Unit (PFail): 1 00:22:50.189 Atomic Compare & Write Unit: 1 00:22:50.189 Fused Compare & Write: Supported 00:22:50.189 Scatter-Gather List 00:22:50.189 SGL Command Set: Supported 00:22:50.189 SGL Keyed: Supported 00:22:50.189 SGL Bit Bucket Descriptor: Not Supported 00:22:50.189 SGL Metadata Pointer: Not Supported 00:22:50.189 Oversized SGL: Not Supported 00:22:50.189 SGL Metadata Address: Not Supported 00:22:50.189 SGL Offset: Supported 00:22:50.189 Transport SGL Data Block: Not Supported 00:22:50.189 Replay Protected Memory Block: Not Supported 00:22:50.189 00:22:50.189 Firmware Slot Information 00:22:50.189 ========================= 00:22:50.189 Active slot: 0 00:22:50.189 00:22:50.189 00:22:50.189 Error Log 00:22:50.189 ========= 00:22:50.189 00:22:50.189 Active Namespaces 00:22:50.189 ================= 00:22:50.189 Discovery Log Page 00:22:50.189 ================== 00:22:50.189 Generation Counter: 2 00:22:50.189 Number of Records: 2 00:22:50.189 Record Format: 0 00:22:50.189 00:22:50.189 Discovery Log Entry 0 00:22:50.189 ---------------------- 00:22:50.189 Transport Type: 3 (TCP) 00:22:50.189 Address Family: 1 (IPv4) 00:22:50.189 Subsystem Type: 3 (Current Discovery Subsystem) 00:22:50.189 Entry Flags: 00:22:50.189 Duplicate Returned Information: 1 00:22:50.189 Explicit Persistent Connection Support for Discovery: 1 00:22:50.189 Transport Requirements: 00:22:50.189 Secure Channel: Not Required 00:22:50.189 Port ID: 0 (0x0000) 00:22:50.189 Controller ID: 65535 (0xffff) 00:22:50.189 Admin Max SQ Size: 128 00:22:50.189 Transport Service Identifier: 4420 00:22:50.189 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:22:50.189 Transport Address: 10.0.0.2 00:22:50.189 Discovery Log Entry 1 00:22:50.189 ---------------------- 00:22:50.189 Transport Type: 3 (TCP) 00:22:50.189 Address Family: 1 (IPv4) 00:22:50.189 Subsystem Type: 2 (NVM Subsystem) 00:22:50.189 Entry Flags: 00:22:50.189 Duplicate Returned Information: 0 00:22:50.189 Explicit Persistent Connection Support for Discovery: 0 00:22:50.189 Transport Requirements: 00:22:50.189 Secure Channel: Not Required 00:22:50.189 Port ID: 0 (0x0000) 00:22:50.189 Controller ID: 65535 (0xffff) 00:22:50.189 Admin Max SQ Size: 128 00:22:50.189 Transport Service Identifier: 4420 00:22:50.189 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:22:50.189 Transport Address: 10.0.0.2 [2024-07-15 09:01:38.650145] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:22:50.189 [2024-07-15 09:01:38.650170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.189 [2024-07-15 09:01:38.650182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.189 [2024-07-15 09:01:38.650192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.189 [2024-07-15 09:01:38.650201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.189 [2024-07-15 09:01:38.650214] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.189 [2024-07-15 09:01:38.650222] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.189 [2024-07-15 09:01:38.650228] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1671e10) 00:22:50.189 [2024-07-15 09:01:38.650239] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.189 [2024-07-15 09:01:38.650264] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16f2010, cid 3, qid 0 00:22:50.189 [2024-07-15 09:01:38.650376] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.189 [2024-07-15 09:01:38.650392] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.189 [2024-07-15 09:01:38.650398] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.189 [2024-07-15 09:01:38.650405] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16f2010) on tqpair=0x1671e10 00:22:50.189 [2024-07-15 09:01:38.650418] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.189 [2024-07-15 09:01:38.650425] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.189 [2024-07-15 09:01:38.650431] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1671e10) 00:22:50.190 [2024-07-15 09:01:38.650442] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.190 [2024-07-15 09:01:38.650468] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16f2010, cid 3, qid 0 00:22:50.190 [2024-07-15 09:01:38.650657] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.190 [2024-07-15 09:01:38.650669] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.190 [2024-07-15 09:01:38.650676] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.190 [2024-07-15 09:01:38.650682] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16f2010) on tqpair=0x1671e10 00:22:50.190 [2024-07-15 09:01:38.650695] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:22:50.190 [2024-07-15 09:01:38.650704] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:22:50.190 [2024-07-15 09:01:38.650720] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.190 [2024-07-15 09:01:38.650729] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.190 [2024-07-15 09:01:38.650735] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1671e10) 00:22:50.190 [2024-07-15 09:01:38.650745] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.190 [2024-07-15 09:01:38.650765] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16f2010, cid 3, qid 0 00:22:50.190 [2024-07-15 09:01:38.650918] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.190 [2024-07-15 09:01:38.650933] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.190 [2024-07-15 09:01:38.650940] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.190 [2024-07-15 09:01:38.650947] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16f2010) on tqpair=0x1671e10 00:22:50.190 [2024-07-15 09:01:38.650965] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.190 [2024-07-15 09:01:38.650974] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.190 [2024-07-15 09:01:38.650980] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1671e10) 00:22:50.190 [2024-07-15 09:01:38.650991] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.190 [2024-07-15 09:01:38.651011] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16f2010, cid 3, qid 0 00:22:50.190 [2024-07-15 09:01:38.651132] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.190 [2024-07-15 09:01:38.651147] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.190 [2024-07-15 09:01:38.651154] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.190 [2024-07-15 09:01:38.651160] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16f2010) on tqpair=0x1671e10 00:22:50.190 [2024-07-15 09:01:38.651178] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.190 [2024-07-15 09:01:38.651187] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.190 [2024-07-15 09:01:38.651193] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1671e10) 00:22:50.190 [2024-07-15 09:01:38.651203] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.190 [2024-07-15 09:01:38.651223] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16f2010, cid 3, qid 0 00:22:50.190 [2024-07-15 09:01:38.651383] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.190 [2024-07-15 09:01:38.651395] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.190 [2024-07-15 09:01:38.651401] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.190 [2024-07-15 09:01:38.651408] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16f2010) on tqpair=0x1671e10 00:22:50.190 [2024-07-15 09:01:38.651425] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.190 [2024-07-15 09:01:38.651434] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.190 [2024-07-15 09:01:38.651440] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1671e10) 00:22:50.190 [2024-07-15 09:01:38.651450] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.190 [2024-07-15 09:01:38.651470] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16f2010, cid 3, qid 0 00:22:50.190 [2024-07-15 09:01:38.651633] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.190 [2024-07-15 09:01:38.651652] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.190 [2024-07-15 09:01:38.651659] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.190 [2024-07-15 09:01:38.651666] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16f2010) on tqpair=0x1671e10 00:22:50.190 [2024-07-15 09:01:38.651683] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.190 [2024-07-15 09:01:38.651692] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.190 [2024-07-15 09:01:38.651699] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1671e10) 00:22:50.190 [2024-07-15 09:01:38.651709] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.190 [2024-07-15 09:01:38.651729] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16f2010, cid 3, qid 0 00:22:50.190 [2024-07-15 09:01:38.651891] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.190 [2024-07-15 09:01:38.651906] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.190 [2024-07-15 09:01:38.651913] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.190 [2024-07-15 09:01:38.651920] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16f2010) on tqpair=0x1671e10 00:22:50.190 [2024-07-15 09:01:38.651937] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.190 [2024-07-15 09:01:38.651946] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.190 [2024-07-15 09:01:38.651952] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1671e10) 00:22:50.190 [2024-07-15 09:01:38.651963] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.190 [2024-07-15 09:01:38.651983] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16f2010, cid 3, qid 0 00:22:50.190 [2024-07-15 09:01:38.652143] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.190 [2024-07-15 09:01:38.652158] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.190 [2024-07-15 09:01:38.652165] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.190 [2024-07-15 09:01:38.652171] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16f2010) on tqpair=0x1671e10 00:22:50.190 [2024-07-15 09:01:38.652189] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.190 [2024-07-15 09:01:38.652197] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.190 [2024-07-15 09:01:38.652204] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1671e10) 00:22:50.190 [2024-07-15 09:01:38.652214] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.190 [2024-07-15 09:01:38.652234] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16f2010, cid 3, qid 0 00:22:50.190 [2024-07-15 09:01:38.652393] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.190 [2024-07-15 09:01:38.652405] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.190 [2024-07-15 09:01:38.652411] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.190 [2024-07-15 09:01:38.652418] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16f2010) on tqpair=0x1671e10 00:22:50.190 [2024-07-15 09:01:38.652435] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.190 [2024-07-15 09:01:38.652444] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.190 [2024-07-15 09:01:38.652450] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1671e10) 00:22:50.190 [2024-07-15 09:01:38.652460] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.190 [2024-07-15 09:01:38.652480] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16f2010, cid 3, qid 0 00:22:50.190 [2024-07-15 09:01:38.652595] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.190 [2024-07-15 09:01:38.652606] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.190 [2024-07-15 09:01:38.652617] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.190 [2024-07-15 09:01:38.652624] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16f2010) on tqpair=0x1671e10 00:22:50.190 [2024-07-15 09:01:38.652642] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.190 [2024-07-15 09:01:38.652651] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.191 [2024-07-15 09:01:38.652657] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1671e10) 00:22:50.191 [2024-07-15 09:01:38.652667] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.191 [2024-07-15 09:01:38.652687] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16f2010, cid 3, qid 0 00:22:50.191 [2024-07-15 09:01:38.652798] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.191 [2024-07-15 09:01:38.652813] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.191 [2024-07-15 09:01:38.652820] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.191 [2024-07-15 09:01:38.652826] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16f2010) on tqpair=0x1671e10 00:22:50.191 [2024-07-15 09:01:38.652844] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.191 [2024-07-15 09:01:38.652853] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.191 [2024-07-15 09:01:38.652859] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1671e10) 00:22:50.191 [2024-07-15 09:01:38.652869] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.191 [2024-07-15 09:01:38.656915] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16f2010, cid 3, qid 0 00:22:50.191 [2024-07-15 09:01:38.657134] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.191 [2024-07-15 09:01:38.657147] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.191 [2024-07-15 09:01:38.657154] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.191 [2024-07-15 09:01:38.657160] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16f2010) on tqpair=0x1671e10 00:22:50.191 [2024-07-15 09:01:38.657174] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 6 milliseconds 00:22:50.191 00:22:50.191 09:01:38 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:22:50.191 [2024-07-15 09:01:38.686980] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:22:50.191 [2024-07-15 09:01:38.687021] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1575683 ] 00:22:50.191 EAL: No free 2048 kB hugepages reported on node 1 00:22:50.191 [2024-07-15 09:01:38.718648] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:22:50.191 [2024-07-15 09:01:38.718691] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:22:50.191 [2024-07-15 09:01:38.718701] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:22:50.191 [2024-07-15 09:01:38.718714] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:22:50.191 [2024-07-15 09:01:38.718725] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:22:50.191 [2024-07-15 09:01:38.721929] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:22:50.191 [2024-07-15 09:01:38.721970] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x132be10 0 00:22:50.452 [2024-07-15 09:01:38.729889] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:22:50.452 [2024-07-15 09:01:38.729908] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:22:50.452 [2024-07-15 09:01:38.729916] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:22:50.452 [2024-07-15 09:01:38.729936] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:22:50.452 [2024-07-15 09:01:38.729975] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.452 [2024-07-15 09:01:38.729987] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.452 [2024-07-15 09:01:38.729994] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x132be10) 00:22:50.452 [2024-07-15 09:01:38.730008] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:22:50.452 [2024-07-15 09:01:38.730035] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13abbf0, cid 0, qid 0 00:22:50.452 [2024-07-15 09:01:38.737894] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.452 [2024-07-15 09:01:38.737911] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.452 [2024-07-15 09:01:38.737919] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.452 [2024-07-15 09:01:38.737926] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13abbf0) on tqpair=0x132be10 00:22:50.452 [2024-07-15 09:01:38.737940] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:22:50.452 [2024-07-15 09:01:38.737965] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:22:50.452 [2024-07-15 09:01:38.737975] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:22:50.452 [2024-07-15 09:01:38.737991] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.452 [2024-07-15 09:01:38.738001] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.452 [2024-07-15 09:01:38.738007] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x132be10) 00:22:50.452 [2024-07-15 09:01:38.738019] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.452 [2024-07-15 09:01:38.738044] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13abbf0, cid 0, qid 0 00:22:50.452 [2024-07-15 09:01:38.738212] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.452 [2024-07-15 09:01:38.738227] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.452 [2024-07-15 09:01:38.738235] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.452 [2024-07-15 09:01:38.738242] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13abbf0) on tqpair=0x132be10 00:22:50.452 [2024-07-15 09:01:38.738252] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:22:50.452 [2024-07-15 09:01:38.738265] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:22:50.452 [2024-07-15 09:01:38.738278] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.452 [2024-07-15 09:01:38.738285] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.452 [2024-07-15 09:01:38.738292] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x132be10) 00:22:50.452 [2024-07-15 09:01:38.738303] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.452 [2024-07-15 09:01:38.738326] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13abbf0, cid 0, qid 0 00:22:50.452 [2024-07-15 09:01:38.738469] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.452 [2024-07-15 09:01:38.738485] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.452 [2024-07-15 09:01:38.738492] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.452 [2024-07-15 09:01:38.738499] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13abbf0) on tqpair=0x132be10 00:22:50.452 [2024-07-15 09:01:38.738513] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:22:50.452 [2024-07-15 09:01:38.738529] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:22:50.452 [2024-07-15 09:01:38.738542] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.452 [2024-07-15 09:01:38.738549] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.453 [2024-07-15 09:01:38.738556] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x132be10) 00:22:50.453 [2024-07-15 09:01:38.738567] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.453 [2024-07-15 09:01:38.738589] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13abbf0, cid 0, qid 0 00:22:50.453 [2024-07-15 09:01:38.738699] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.453 [2024-07-15 09:01:38.738712] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.453 [2024-07-15 09:01:38.738719] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.453 [2024-07-15 09:01:38.738726] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13abbf0) on tqpair=0x132be10 00:22:50.453 [2024-07-15 09:01:38.738736] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:22:50.453 [2024-07-15 09:01:38.738752] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.453 [2024-07-15 09:01:38.738761] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.453 [2024-07-15 09:01:38.738768] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x132be10) 00:22:50.453 [2024-07-15 09:01:38.738779] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.453 [2024-07-15 09:01:38.738800] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13abbf0, cid 0, qid 0 00:22:50.453 [2024-07-15 09:01:38.738961] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.453 [2024-07-15 09:01:38.738975] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.453 [2024-07-15 09:01:38.738982] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.453 [2024-07-15 09:01:38.738989] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13abbf0) on tqpair=0x132be10 00:22:50.453 [2024-07-15 09:01:38.738998] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:22:50.453 [2024-07-15 09:01:38.739007] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:22:50.453 [2024-07-15 09:01:38.739020] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:22:50.453 [2024-07-15 09:01:38.739130] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:22:50.453 [2024-07-15 09:01:38.739137] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:22:50.453 [2024-07-15 09:01:38.739149] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.453 [2024-07-15 09:01:38.739157] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.453 [2024-07-15 09:01:38.739164] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x132be10) 00:22:50.453 [2024-07-15 09:01:38.739190] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.453 [2024-07-15 09:01:38.739212] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13abbf0, cid 0, qid 0 00:22:50.453 [2024-07-15 09:01:38.739372] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.453 [2024-07-15 09:01:38.739388] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.453 [2024-07-15 09:01:38.739396] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.453 [2024-07-15 09:01:38.739403] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13abbf0) on tqpair=0x132be10 00:22:50.453 [2024-07-15 09:01:38.739413] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:22:50.453 [2024-07-15 09:01:38.739429] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.453 [2024-07-15 09:01:38.739438] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.453 [2024-07-15 09:01:38.739445] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x132be10) 00:22:50.453 [2024-07-15 09:01:38.739456] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.453 [2024-07-15 09:01:38.739477] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13abbf0, cid 0, qid 0 00:22:50.453 [2024-07-15 09:01:38.739589] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.453 [2024-07-15 09:01:38.739604] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.453 [2024-07-15 09:01:38.739611] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.453 [2024-07-15 09:01:38.739618] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13abbf0) on tqpair=0x132be10 00:22:50.453 [2024-07-15 09:01:38.739628] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:22:50.453 [2024-07-15 09:01:38.739637] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:22:50.453 [2024-07-15 09:01:38.739650] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:22:50.453 [2024-07-15 09:01:38.739664] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:22:50.453 [2024-07-15 09:01:38.739678] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.453 [2024-07-15 09:01:38.739686] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.453 [2024-07-15 09:01:38.739693] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x132be10) 00:22:50.453 [2024-07-15 09:01:38.739704] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.453 [2024-07-15 09:01:38.739726] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13abbf0, cid 0, qid 0 00:22:50.453 [2024-07-15 09:01:38.739895] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:50.453 [2024-07-15 09:01:38.739910] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:50.453 [2024-07-15 09:01:38.739917] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:50.453 [2024-07-15 09:01:38.739924] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x132be10): datao=0, datal=4096, cccid=0 00:22:50.453 [2024-07-15 09:01:38.739932] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x13abbf0) on tqpair(0x132be10): expected_datao=0, payload_size=4096 00:22:50.453 [2024-07-15 09:01:38.739944] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:50.453 [2024-07-15 09:01:38.739951] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:50.453 [2024-07-15 09:01:38.739968] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.453 [2024-07-15 09:01:38.739979] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.453 [2024-07-15 09:01:38.739986] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.453 [2024-07-15 09:01:38.739993] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13abbf0) on tqpair=0x132be10 00:22:50.453 [2024-07-15 09:01:38.740005] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:22:50.453 [2024-07-15 09:01:38.740017] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:22:50.453 [2024-07-15 09:01:38.740025] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:22:50.453 [2024-07-15 09:01:38.740032] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:22:50.453 [2024-07-15 09:01:38.740040] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:22:50.453 [2024-07-15 09:01:38.740048] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:22:50.453 [2024-07-15 09:01:38.740066] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:22:50.453 [2024-07-15 09:01:38.740079] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.453 [2024-07-15 09:01:38.740087] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.453 [2024-07-15 09:01:38.740094] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x132be10) 00:22:50.453 [2024-07-15 09:01:38.740105] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:22:50.453 [2024-07-15 09:01:38.740127] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13abbf0, cid 0, qid 0 00:22:50.453 [2024-07-15 09:01:38.740286] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.453 [2024-07-15 09:01:38.740298] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.453 [2024-07-15 09:01:38.740306] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.453 [2024-07-15 09:01:38.740312] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13abbf0) on tqpair=0x132be10 00:22:50.453 [2024-07-15 09:01:38.740324] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.453 [2024-07-15 09:01:38.740332] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.453 [2024-07-15 09:01:38.740339] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x132be10) 00:22:50.453 [2024-07-15 09:01:38.740349] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.453 [2024-07-15 09:01:38.740360] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.453 [2024-07-15 09:01:38.740367] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.453 [2024-07-15 09:01:38.740374] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x132be10) 00:22:50.453 [2024-07-15 09:01:38.740383] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.453 [2024-07-15 09:01:38.740394] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.453 [2024-07-15 09:01:38.740401] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.453 [2024-07-15 09:01:38.740408] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x132be10) 00:22:50.453 [2024-07-15 09:01:38.740417] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.453 [2024-07-15 09:01:38.740443] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.454 [2024-07-15 09:01:38.740450] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.454 [2024-07-15 09:01:38.740456] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x132be10) 00:22:50.454 [2024-07-15 09:01:38.740466] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.454 [2024-07-15 09:01:38.740475] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:22:50.454 [2024-07-15 09:01:38.740492] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:22:50.454 [2024-07-15 09:01:38.740508] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.454 [2024-07-15 09:01:38.740515] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.454 [2024-07-15 09:01:38.740522] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x132be10) 00:22:50.454 [2024-07-15 09:01:38.740533] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.454 [2024-07-15 09:01:38.740554] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13abbf0, cid 0, qid 0 00:22:50.454 [2024-07-15 09:01:38.740581] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13abd50, cid 1, qid 0 00:22:50.454 [2024-07-15 09:01:38.740589] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13abeb0, cid 2, qid 0 00:22:50.454 [2024-07-15 09:01:38.740597] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13ac010, cid 3, qid 0 00:22:50.454 [2024-07-15 09:01:38.740605] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13ac170, cid 4, qid 0 00:22:50.454 [2024-07-15 09:01:38.740763] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.454 [2024-07-15 09:01:38.740775] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.454 [2024-07-15 09:01:38.740782] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.454 [2024-07-15 09:01:38.740789] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13ac170) on tqpair=0x132be10 00:22:50.454 [2024-07-15 09:01:38.740799] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:22:50.454 [2024-07-15 09:01:38.740808] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:22:50.454 [2024-07-15 09:01:38.740821] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:22:50.454 [2024-07-15 09:01:38.740836] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:22:50.454 [2024-07-15 09:01:38.740848] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.454 [2024-07-15 09:01:38.740855] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.454 [2024-07-15 09:01:38.740885] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x132be10) 00:22:50.454 [2024-07-15 09:01:38.740897] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:22:50.454 [2024-07-15 09:01:38.740919] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13ac170, cid 4, qid 0 00:22:50.454 [2024-07-15 09:01:38.741044] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.454 [2024-07-15 09:01:38.741056] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.454 [2024-07-15 09:01:38.741063] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.454 [2024-07-15 09:01:38.741070] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13ac170) on tqpair=0x132be10 00:22:50.454 [2024-07-15 09:01:38.741136] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:22:50.454 [2024-07-15 09:01:38.741162] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:22:50.454 [2024-07-15 09:01:38.741175] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.454 [2024-07-15 09:01:38.741183] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.454 [2024-07-15 09:01:38.741190] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x132be10) 00:22:50.454 [2024-07-15 09:01:38.741201] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.454 [2024-07-15 09:01:38.741222] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13ac170, cid 4, qid 0 00:22:50.454 [2024-07-15 09:01:38.741352] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:50.454 [2024-07-15 09:01:38.741368] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:50.454 [2024-07-15 09:01:38.741375] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:50.454 [2024-07-15 09:01:38.741382] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x132be10): datao=0, datal=4096, cccid=4 00:22:50.454 [2024-07-15 09:01:38.741390] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x13ac170) on tqpair(0x132be10): expected_datao=0, payload_size=4096 00:22:50.454 [2024-07-15 09:01:38.741437] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:50.454 [2024-07-15 09:01:38.741446] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:50.454 [2024-07-15 09:01:38.741563] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.454 [2024-07-15 09:01:38.741575] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.454 [2024-07-15 09:01:38.741582] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.454 [2024-07-15 09:01:38.741589] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13ac170) on tqpair=0x132be10 00:22:50.454 [2024-07-15 09:01:38.741608] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:22:50.454 [2024-07-15 09:01:38.741627] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:22:50.454 [2024-07-15 09:01:38.741645] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:22:50.454 [2024-07-15 09:01:38.741658] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.454 [2024-07-15 09:01:38.741665] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.454 [2024-07-15 09:01:38.741672] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x132be10) 00:22:50.454 [2024-07-15 09:01:38.741683] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.454 [2024-07-15 09:01:38.741705] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13ac170, cid 4, qid 0 00:22:50.454 [2024-07-15 09:01:38.741854] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:50.454 [2024-07-15 09:01:38.741869] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:50.454 [2024-07-15 09:01:38.745885] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:50.454 [2024-07-15 09:01:38.745897] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x132be10): datao=0, datal=4096, cccid=4 00:22:50.454 [2024-07-15 09:01:38.745905] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x13ac170) on tqpair(0x132be10): expected_datao=0, payload_size=4096 00:22:50.454 [2024-07-15 09:01:38.745924] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:50.454 [2024-07-15 09:01:38.745934] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:50.454 [2024-07-15 09:01:38.745945] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.454 [2024-07-15 09:01:38.745955] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.454 [2024-07-15 09:01:38.745962] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.454 [2024-07-15 09:01:38.745968] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13ac170) on tqpair=0x132be10 00:22:50.454 [2024-07-15 09:01:38.745991] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:22:50.454 [2024-07-15 09:01:38.746009] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:22:50.454 [2024-07-15 09:01:38.746039] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.454 [2024-07-15 09:01:38.746047] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.454 [2024-07-15 09:01:38.746057] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x132be10) 00:22:50.454 [2024-07-15 09:01:38.746069] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.454 [2024-07-15 09:01:38.746092] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13ac170, cid 4, qid 0 00:22:50.454 [2024-07-15 09:01:38.746218] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:50.454 [2024-07-15 09:01:38.746233] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:50.454 [2024-07-15 09:01:38.746241] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:50.454 [2024-07-15 09:01:38.746247] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x132be10): datao=0, datal=4096, cccid=4 00:22:50.454 [2024-07-15 09:01:38.746255] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x13ac170) on tqpair(0x132be10): expected_datao=0, payload_size=4096 00:22:50.454 [2024-07-15 09:01:38.746308] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:50.454 [2024-07-15 09:01:38.746318] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:50.454 [2024-07-15 09:01:38.746441] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.454 [2024-07-15 09:01:38.746456] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.454 [2024-07-15 09:01:38.746463] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.454 [2024-07-15 09:01:38.746469] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13ac170) on tqpair=0x132be10 00:22:50.454 [2024-07-15 09:01:38.746483] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:22:50.454 [2024-07-15 09:01:38.746498] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:22:50.454 [2024-07-15 09:01:38.746513] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:22:50.455 [2024-07-15 09:01:38.746523] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:22:50.455 [2024-07-15 09:01:38.746532] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:22:50.455 [2024-07-15 09:01:38.746540] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:22:50.455 [2024-07-15 09:01:38.746548] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:22:50.455 [2024-07-15 09:01:38.746557] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:22:50.455 [2024-07-15 09:01:38.746575] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.455 [2024-07-15 09:01:38.746583] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.455 [2024-07-15 09:01:38.746590] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x132be10) 00:22:50.455 [2024-07-15 09:01:38.746601] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.455 [2024-07-15 09:01:38.746612] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.455 [2024-07-15 09:01:38.746619] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.455 [2024-07-15 09:01:38.746626] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x132be10) 00:22:50.455 [2024-07-15 09:01:38.746635] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.455 [2024-07-15 09:01:38.746660] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13ac170, cid 4, qid 0 00:22:50.455 [2024-07-15 09:01:38.746686] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13ac2d0, cid 5, qid 0 00:22:50.455 [2024-07-15 09:01:38.746812] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.455 [2024-07-15 09:01:38.746828] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.455 [2024-07-15 09:01:38.746835] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.455 [2024-07-15 09:01:38.746842] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13ac170) on tqpair=0x132be10 00:22:50.455 [2024-07-15 09:01:38.746853] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.455 [2024-07-15 09:01:38.746863] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.455 [2024-07-15 09:01:38.746870] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.455 [2024-07-15 09:01:38.746884] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13ac2d0) on tqpair=0x132be10 00:22:50.455 [2024-07-15 09:01:38.746903] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.455 [2024-07-15 09:01:38.746912] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.455 [2024-07-15 09:01:38.746919] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x132be10) 00:22:50.455 [2024-07-15 09:01:38.746930] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.455 [2024-07-15 09:01:38.746953] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13ac2d0, cid 5, qid 0 00:22:50.455 [2024-07-15 09:01:38.747112] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.455 [2024-07-15 09:01:38.747125] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.455 [2024-07-15 09:01:38.747132] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.455 [2024-07-15 09:01:38.747139] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13ac2d0) on tqpair=0x132be10 00:22:50.455 [2024-07-15 09:01:38.747155] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.455 [2024-07-15 09:01:38.747164] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.455 [2024-07-15 09:01:38.747171] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x132be10) 00:22:50.455 [2024-07-15 09:01:38.747182] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.455 [2024-07-15 09:01:38.747202] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13ac2d0, cid 5, qid 0 00:22:50.455 [2024-07-15 09:01:38.747361] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.455 [2024-07-15 09:01:38.747373] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.455 [2024-07-15 09:01:38.747380] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.455 [2024-07-15 09:01:38.747387] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13ac2d0) on tqpair=0x132be10 00:22:50.455 [2024-07-15 09:01:38.747404] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.455 [2024-07-15 09:01:38.747413] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.455 [2024-07-15 09:01:38.747420] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x132be10) 00:22:50.455 [2024-07-15 09:01:38.747430] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.455 [2024-07-15 09:01:38.747451] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13ac2d0, cid 5, qid 0 00:22:50.455 [2024-07-15 09:01:38.747560] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.455 [2024-07-15 09:01:38.747573] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.455 [2024-07-15 09:01:38.747580] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.455 [2024-07-15 09:01:38.747587] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13ac2d0) on tqpair=0x132be10 00:22:50.455 [2024-07-15 09:01:38.747607] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.455 [2024-07-15 09:01:38.747617] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.455 [2024-07-15 09:01:38.747627] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x132be10) 00:22:50.455 [2024-07-15 09:01:38.747639] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.455 [2024-07-15 09:01:38.747652] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.455 [2024-07-15 09:01:38.747659] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.455 [2024-07-15 09:01:38.747666] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x132be10) 00:22:50.455 [2024-07-15 09:01:38.747676] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.455 [2024-07-15 09:01:38.747688] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.455 [2024-07-15 09:01:38.747696] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.455 [2024-07-15 09:01:38.747702] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x132be10) 00:22:50.455 [2024-07-15 09:01:38.747712] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.455 [2024-07-15 09:01:38.747724] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.455 [2024-07-15 09:01:38.747747] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.455 [2024-07-15 09:01:38.747754] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x132be10) 00:22:50.455 [2024-07-15 09:01:38.747763] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.455 [2024-07-15 09:01:38.747786] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13ac2d0, cid 5, qid 0 00:22:50.455 [2024-07-15 09:01:38.747812] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13ac170, cid 4, qid 0 00:22:50.455 [2024-07-15 09:01:38.747820] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13ac430, cid 6, qid 0 00:22:50.455 [2024-07-15 09:01:38.747828] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13ac590, cid 7, qid 0 00:22:50.455 [2024-07-15 09:01:38.748077] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:50.455 [2024-07-15 09:01:38.748093] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:50.455 [2024-07-15 09:01:38.748100] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:50.455 [2024-07-15 09:01:38.748107] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x132be10): datao=0, datal=8192, cccid=5 00:22:50.455 [2024-07-15 09:01:38.748115] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x13ac2d0) on tqpair(0x132be10): expected_datao=0, payload_size=8192 00:22:50.455 [2024-07-15 09:01:38.748126] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:50.455 [2024-07-15 09:01:38.748134] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:50.455 [2024-07-15 09:01:38.748143] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:50.455 [2024-07-15 09:01:38.748152] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:50.455 [2024-07-15 09:01:38.748159] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:50.455 [2024-07-15 09:01:38.748165] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x132be10): datao=0, datal=512, cccid=4 00:22:50.455 [2024-07-15 09:01:38.748173] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x13ac170) on tqpair(0x132be10): expected_datao=0, payload_size=512 00:22:50.455 [2024-07-15 09:01:38.748184] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:50.455 [2024-07-15 09:01:38.748191] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:50.455 [2024-07-15 09:01:38.748200] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:50.455 [2024-07-15 09:01:38.748209] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:50.455 [2024-07-15 09:01:38.748216] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:50.455 [2024-07-15 09:01:38.748226] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x132be10): datao=0, datal=512, cccid=6 00:22:50.455 [2024-07-15 09:01:38.748234] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x13ac430) on tqpair(0x132be10): expected_datao=0, payload_size=512 00:22:50.455 [2024-07-15 09:01:38.748245] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:50.455 [2024-07-15 09:01:38.748253] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:50.455 [2024-07-15 09:01:38.748261] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:50.455 [2024-07-15 09:01:38.748270] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:50.456 [2024-07-15 09:01:38.748277] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:50.456 [2024-07-15 09:01:38.748284] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x132be10): datao=0, datal=4096, cccid=7 00:22:50.456 [2024-07-15 09:01:38.748291] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x13ac590) on tqpair(0x132be10): expected_datao=0, payload_size=4096 00:22:50.456 [2024-07-15 09:01:38.748302] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:50.456 [2024-07-15 09:01:38.748309] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:50.456 [2024-07-15 09:01:38.748321] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.456 [2024-07-15 09:01:38.748331] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.456 [2024-07-15 09:01:38.748338] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.456 [2024-07-15 09:01:38.748345] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13ac2d0) on tqpair=0x132be10 00:22:50.456 [2024-07-15 09:01:38.748365] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.456 [2024-07-15 09:01:38.748377] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.456 [2024-07-15 09:01:38.748384] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.456 [2024-07-15 09:01:38.748390] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13ac170) on tqpair=0x132be10 00:22:50.456 [2024-07-15 09:01:38.748406] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.456 [2024-07-15 09:01:38.748416] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.456 [2024-07-15 09:01:38.748423] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.456 [2024-07-15 09:01:38.748445] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13ac430) on tqpair=0x132be10 00:22:50.456 [2024-07-15 09:01:38.748457] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.456 [2024-07-15 09:01:38.748467] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.456 [2024-07-15 09:01:38.748473] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.456 [2024-07-15 09:01:38.748480] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13ac590) on tqpair=0x132be10 00:22:50.456 ===================================================== 00:22:50.456 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:50.456 ===================================================== 00:22:50.456 Controller Capabilities/Features 00:22:50.456 ================================ 00:22:50.456 Vendor ID: 8086 00:22:50.456 Subsystem Vendor ID: 8086 00:22:50.456 Serial Number: SPDK00000000000001 00:22:50.456 Model Number: SPDK bdev Controller 00:22:50.456 Firmware Version: 24.01.1 00:22:50.456 Recommended Arb Burst: 6 00:22:50.456 IEEE OUI Identifier: e4 d2 5c 00:22:50.456 Multi-path I/O 00:22:50.456 May have multiple subsystem ports: Yes 00:22:50.456 May have multiple controllers: Yes 00:22:50.456 Associated with SR-IOV VF: No 00:22:50.456 Max Data Transfer Size: 131072 00:22:50.456 Max Number of Namespaces: 32 00:22:50.456 Max Number of I/O Queues: 127 00:22:50.456 NVMe Specification Version (VS): 1.3 00:22:50.456 NVMe Specification Version (Identify): 1.3 00:22:50.456 Maximum Queue Entries: 128 00:22:50.456 Contiguous Queues Required: Yes 00:22:50.456 Arbitration Mechanisms Supported 00:22:50.456 Weighted Round Robin: Not Supported 00:22:50.456 Vendor Specific: Not Supported 00:22:50.456 Reset Timeout: 15000 ms 00:22:50.456 Doorbell Stride: 4 bytes 00:22:50.456 NVM Subsystem Reset: Not Supported 00:22:50.456 Command Sets Supported 00:22:50.456 NVM Command Set: Supported 00:22:50.456 Boot Partition: Not Supported 00:22:50.456 Memory Page Size Minimum: 4096 bytes 00:22:50.456 Memory Page Size Maximum: 4096 bytes 00:22:50.456 Persistent Memory Region: Not Supported 00:22:50.456 Optional Asynchronous Events Supported 00:22:50.456 Namespace Attribute Notices: Supported 00:22:50.456 Firmware Activation Notices: Not Supported 00:22:50.456 ANA Change Notices: Not Supported 00:22:50.456 PLE Aggregate Log Change Notices: Not Supported 00:22:50.456 LBA Status Info Alert Notices: Not Supported 00:22:50.456 EGE Aggregate Log Change Notices: Not Supported 00:22:50.456 Normal NVM Subsystem Shutdown event: Not Supported 00:22:50.456 Zone Descriptor Change Notices: Not Supported 00:22:50.456 Discovery Log Change Notices: Not Supported 00:22:50.456 Controller Attributes 00:22:50.456 128-bit Host Identifier: Supported 00:22:50.456 Non-Operational Permissive Mode: Not Supported 00:22:50.456 NVM Sets: Not Supported 00:22:50.456 Read Recovery Levels: Not Supported 00:22:50.456 Endurance Groups: Not Supported 00:22:50.456 Predictable Latency Mode: Not Supported 00:22:50.456 Traffic Based Keep ALive: Not Supported 00:22:50.456 Namespace Granularity: Not Supported 00:22:50.456 SQ Associations: Not Supported 00:22:50.456 UUID List: Not Supported 00:22:50.456 Multi-Domain Subsystem: Not Supported 00:22:50.456 Fixed Capacity Management: Not Supported 00:22:50.456 Variable Capacity Management: Not Supported 00:22:50.456 Delete Endurance Group: Not Supported 00:22:50.456 Delete NVM Set: Not Supported 00:22:50.456 Extended LBA Formats Supported: Not Supported 00:22:50.456 Flexible Data Placement Supported: Not Supported 00:22:50.456 00:22:50.456 Controller Memory Buffer Support 00:22:50.456 ================================ 00:22:50.456 Supported: No 00:22:50.456 00:22:50.456 Persistent Memory Region Support 00:22:50.456 ================================ 00:22:50.456 Supported: No 00:22:50.456 00:22:50.456 Admin Command Set Attributes 00:22:50.456 ============================ 00:22:50.456 Security Send/Receive: Not Supported 00:22:50.456 Format NVM: Not Supported 00:22:50.456 Firmware Activate/Download: Not Supported 00:22:50.456 Namespace Management: Not Supported 00:22:50.456 Device Self-Test: Not Supported 00:22:50.456 Directives: Not Supported 00:22:50.456 NVMe-MI: Not Supported 00:22:50.456 Virtualization Management: Not Supported 00:22:50.456 Doorbell Buffer Config: Not Supported 00:22:50.456 Get LBA Status Capability: Not Supported 00:22:50.456 Command & Feature Lockdown Capability: Not Supported 00:22:50.456 Abort Command Limit: 4 00:22:50.456 Async Event Request Limit: 4 00:22:50.456 Number of Firmware Slots: N/A 00:22:50.456 Firmware Slot 1 Read-Only: N/A 00:22:50.456 Firmware Activation Without Reset: N/A 00:22:50.456 Multiple Update Detection Support: N/A 00:22:50.456 Firmware Update Granularity: No Information Provided 00:22:50.456 Per-Namespace SMART Log: No 00:22:50.456 Asymmetric Namespace Access Log Page: Not Supported 00:22:50.456 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:22:50.456 Command Effects Log Page: Supported 00:22:50.456 Get Log Page Extended Data: Supported 00:22:50.456 Telemetry Log Pages: Not Supported 00:22:50.456 Persistent Event Log Pages: Not Supported 00:22:50.456 Supported Log Pages Log Page: May Support 00:22:50.456 Commands Supported & Effects Log Page: Not Supported 00:22:50.456 Feature Identifiers & Effects Log Page:May Support 00:22:50.456 NVMe-MI Commands & Effects Log Page: May Support 00:22:50.456 Data Area 4 for Telemetry Log: Not Supported 00:22:50.456 Error Log Page Entries Supported: 128 00:22:50.456 Keep Alive: Supported 00:22:50.456 Keep Alive Granularity: 10000 ms 00:22:50.456 00:22:50.456 NVM Command Set Attributes 00:22:50.456 ========================== 00:22:50.456 Submission Queue Entry Size 00:22:50.456 Max: 64 00:22:50.456 Min: 64 00:22:50.456 Completion Queue Entry Size 00:22:50.456 Max: 16 00:22:50.456 Min: 16 00:22:50.456 Number of Namespaces: 32 00:22:50.457 Compare Command: Supported 00:22:50.457 Write Uncorrectable Command: Not Supported 00:22:50.457 Dataset Management Command: Supported 00:22:50.457 Write Zeroes Command: Supported 00:22:50.457 Set Features Save Field: Not Supported 00:22:50.457 Reservations: Supported 00:22:50.457 Timestamp: Not Supported 00:22:50.457 Copy: Supported 00:22:50.457 Volatile Write Cache: Present 00:22:50.457 Atomic Write Unit (Normal): 1 00:22:50.457 Atomic Write Unit (PFail): 1 00:22:50.457 Atomic Compare & Write Unit: 1 00:22:50.457 Fused Compare & Write: Supported 00:22:50.457 Scatter-Gather List 00:22:50.457 SGL Command Set: Supported 00:22:50.457 SGL Keyed: Supported 00:22:50.457 SGL Bit Bucket Descriptor: Not Supported 00:22:50.457 SGL Metadata Pointer: Not Supported 00:22:50.457 Oversized SGL: Not Supported 00:22:50.457 SGL Metadata Address: Not Supported 00:22:50.457 SGL Offset: Supported 00:22:50.457 Transport SGL Data Block: Not Supported 00:22:50.457 Replay Protected Memory Block: Not Supported 00:22:50.457 00:22:50.457 Firmware Slot Information 00:22:50.457 ========================= 00:22:50.457 Active slot: 1 00:22:50.457 Slot 1 Firmware Revision: 24.01.1 00:22:50.457 00:22:50.457 00:22:50.457 Commands Supported and Effects 00:22:50.457 ============================== 00:22:50.457 Admin Commands 00:22:50.457 -------------- 00:22:50.457 Get Log Page (02h): Supported 00:22:50.457 Identify (06h): Supported 00:22:50.457 Abort (08h): Supported 00:22:50.457 Set Features (09h): Supported 00:22:50.457 Get Features (0Ah): Supported 00:22:50.457 Asynchronous Event Request (0Ch): Supported 00:22:50.457 Keep Alive (18h): Supported 00:22:50.457 I/O Commands 00:22:50.457 ------------ 00:22:50.457 Flush (00h): Supported LBA-Change 00:22:50.457 Write (01h): Supported LBA-Change 00:22:50.457 Read (02h): Supported 00:22:50.457 Compare (05h): Supported 00:22:50.457 Write Zeroes (08h): Supported LBA-Change 00:22:50.457 Dataset Management (09h): Supported LBA-Change 00:22:50.457 Copy (19h): Supported LBA-Change 00:22:50.457 Unknown (79h): Supported LBA-Change 00:22:50.457 Unknown (7Ah): Supported 00:22:50.457 00:22:50.457 Error Log 00:22:50.457 ========= 00:22:50.457 00:22:50.457 Arbitration 00:22:50.457 =========== 00:22:50.457 Arbitration Burst: 1 00:22:50.457 00:22:50.457 Power Management 00:22:50.457 ================ 00:22:50.457 Number of Power States: 1 00:22:50.457 Current Power State: Power State #0 00:22:50.457 Power State #0: 00:22:50.457 Max Power: 0.00 W 00:22:50.457 Non-Operational State: Operational 00:22:50.457 Entry Latency: Not Reported 00:22:50.457 Exit Latency: Not Reported 00:22:50.457 Relative Read Throughput: 0 00:22:50.457 Relative Read Latency: 0 00:22:50.457 Relative Write Throughput: 0 00:22:50.457 Relative Write Latency: 0 00:22:50.457 Idle Power: Not Reported 00:22:50.457 Active Power: Not Reported 00:22:50.457 Non-Operational Permissive Mode: Not Supported 00:22:50.457 00:22:50.457 Health Information 00:22:50.457 ================== 00:22:50.457 Critical Warnings: 00:22:50.457 Available Spare Space: OK 00:22:50.457 Temperature: OK 00:22:50.457 Device Reliability: OK 00:22:50.457 Read Only: No 00:22:50.457 Volatile Memory Backup: OK 00:22:50.457 Current Temperature: 0 Kelvin (-273 Celsius) 00:22:50.457 Temperature Threshold: [2024-07-15 09:01:38.748625] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.457 [2024-07-15 09:01:38.748637] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.457 [2024-07-15 09:01:38.748644] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x132be10) 00:22:50.457 [2024-07-15 09:01:38.748655] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.457 [2024-07-15 09:01:38.748677] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13ac590, cid 7, qid 0 00:22:50.457 [2024-07-15 09:01:38.748855] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.457 [2024-07-15 09:01:38.748868] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.457 [2024-07-15 09:01:38.748884] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.457 [2024-07-15 09:01:38.748892] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13ac590) on tqpair=0x132be10 00:22:50.457 [2024-07-15 09:01:38.748934] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:22:50.457 [2024-07-15 09:01:38.748958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.457 [2024-07-15 09:01:38.748971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.457 [2024-07-15 09:01:38.748981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.457 [2024-07-15 09:01:38.748991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.457 [2024-07-15 09:01:38.749003] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.457 [2024-07-15 09:01:38.749011] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.457 [2024-07-15 09:01:38.749018] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x132be10) 00:22:50.457 [2024-07-15 09:01:38.749029] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.457 [2024-07-15 09:01:38.749052] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13ac010, cid 3, qid 0 00:22:50.457 [2024-07-15 09:01:38.749166] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.457 [2024-07-15 09:01:38.749182] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.458 [2024-07-15 09:01:38.749189] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.458 [2024-07-15 09:01:38.749196] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13ac010) on tqpair=0x132be10 00:22:50.458 [2024-07-15 09:01:38.749208] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.458 [2024-07-15 09:01:38.749216] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.458 [2024-07-15 09:01:38.749223] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x132be10) 00:22:50.458 [2024-07-15 09:01:38.749234] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.458 [2024-07-15 09:01:38.749260] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13ac010, cid 3, qid 0 00:22:50.458 [2024-07-15 09:01:38.749392] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.458 [2024-07-15 09:01:38.749404] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.458 [2024-07-15 09:01:38.749411] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.458 [2024-07-15 09:01:38.749418] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13ac010) on tqpair=0x132be10 00:22:50.458 [2024-07-15 09:01:38.749427] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:22:50.459 [2024-07-15 09:01:38.749435] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:22:50.459 [2024-07-15 09:01:38.749451] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.459 [2024-07-15 09:01:38.749459] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.459 [2024-07-15 09:01:38.749466] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x132be10) 00:22:50.459 [2024-07-15 09:01:38.749477] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.459 [2024-07-15 09:01:38.749498] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13ac010, cid 3, qid 0 00:22:50.459 [2024-07-15 09:01:38.749657] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.459 [2024-07-15 09:01:38.749669] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.459 [2024-07-15 09:01:38.749676] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.459 [2024-07-15 09:01:38.749683] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13ac010) on tqpair=0x132be10 00:22:50.459 [2024-07-15 09:01:38.749700] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.459 [2024-07-15 09:01:38.749709] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.459 [2024-07-15 09:01:38.749720] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x132be10) 00:22:50.459 [2024-07-15 09:01:38.749731] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.459 [2024-07-15 09:01:38.749752] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13ac010, cid 3, qid 0 00:22:50.459 [2024-07-15 09:01:38.753892] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.459 [2024-07-15 09:01:38.753908] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.459 [2024-07-15 09:01:38.753915] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.459 [2024-07-15 09:01:38.753922] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13ac010) on tqpair=0x132be10 00:22:50.459 [2024-07-15 09:01:38.753940] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:50.459 [2024-07-15 09:01:38.753965] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:50.459 [2024-07-15 09:01:38.753972] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x132be10) 00:22:50.459 [2024-07-15 09:01:38.753983] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.459 [2024-07-15 09:01:38.754006] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13ac010, cid 3, qid 0 00:22:50.459 [2024-07-15 09:01:38.754125] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:50.459 [2024-07-15 09:01:38.754140] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:50.459 [2024-07-15 09:01:38.754147] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:50.459 [2024-07-15 09:01:38.754154] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13ac010) on tqpair=0x132be10 00:22:50.459 [2024-07-15 09:01:38.754169] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 4 milliseconds 00:22:50.459 0 Kelvin (-273 Celsius) 00:22:50.459 Available Spare: 0% 00:22:50.459 Available Spare Threshold: 0% 00:22:50.459 Life Percentage Used: 0% 00:22:50.459 Data Units Read: 0 00:22:50.459 Data Units Written: 0 00:22:50.459 Host Read Commands: 0 00:22:50.459 Host Write Commands: 0 00:22:50.459 Controller Busy Time: 0 minutes 00:22:50.459 Power Cycles: 0 00:22:50.459 Power On Hours: 0 hours 00:22:50.459 Unsafe Shutdowns: 0 00:22:50.459 Unrecoverable Media Errors: 0 00:22:50.459 Lifetime Error Log Entries: 0 00:22:50.459 Warning Temperature Time: 0 minutes 00:22:50.459 Critical Temperature Time: 0 minutes 00:22:50.459 00:22:50.459 Number of Queues 00:22:50.459 ================ 00:22:50.459 Number of I/O Submission Queues: 127 00:22:50.459 Number of I/O Completion Queues: 127 00:22:50.459 00:22:50.459 Active Namespaces 00:22:50.459 ================= 00:22:50.459 Namespace ID:1 00:22:50.459 Error Recovery Timeout: Unlimited 00:22:50.459 Command Set Identifier: NVM (00h) 00:22:50.459 Deallocate: Supported 00:22:50.459 Deallocated/Unwritten Error: Not Supported 00:22:50.459 Deallocated Read Value: Unknown 00:22:50.459 Deallocate in Write Zeroes: Not Supported 00:22:50.459 Deallocated Guard Field: 0xFFFF 00:22:50.459 Flush: Supported 00:22:50.459 Reservation: Supported 00:22:50.459 Namespace Sharing Capabilities: Multiple Controllers 00:22:50.459 Size (in LBAs): 131072 (0GiB) 00:22:50.459 Capacity (in LBAs): 131072 (0GiB) 00:22:50.459 Utilization (in LBAs): 131072 (0GiB) 00:22:50.459 NGUID: ABCDEF0123456789ABCDEF0123456789 00:22:50.459 EUI64: ABCDEF0123456789 00:22:50.459 UUID: f44bb437-e720-453c-821a-d99d856bbce5 00:22:50.459 Thin Provisioning: Not Supported 00:22:50.459 Per-NS Atomic Units: Yes 00:22:50.459 Atomic Boundary Size (Normal): 0 00:22:50.459 Atomic Boundary Size (PFail): 0 00:22:50.459 Atomic Boundary Offset: 0 00:22:50.459 Maximum Single Source Range Length: 65535 00:22:50.459 Maximum Copy Length: 65535 00:22:50.459 Maximum Source Range Count: 1 00:22:50.459 NGUID/EUI64 Never Reused: No 00:22:50.459 Namespace Write Protected: No 00:22:50.459 Number of LBA Formats: 1 00:22:50.459 Current LBA Format: LBA Format #00 00:22:50.459 LBA Format #00: Data Size: 512 Metadata Size: 0 00:22:50.459 00:22:50.459 09:01:38 -- host/identify.sh@51 -- # sync 00:22:50.459 09:01:38 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:50.459 09:01:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:50.459 09:01:38 -- common/autotest_common.sh@10 -- # set +x 00:22:50.459 09:01:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:50.459 09:01:38 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:22:50.459 09:01:38 -- host/identify.sh@56 -- # nvmftestfini 00:22:50.459 09:01:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:50.459 09:01:38 -- nvmf/common.sh@116 -- # sync 00:22:50.459 09:01:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:50.459 09:01:38 -- nvmf/common.sh@119 -- # set +e 00:22:50.459 09:01:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:50.459 09:01:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:50.459 rmmod nvme_tcp 00:22:50.459 rmmod nvme_fabrics 00:22:50.459 rmmod nvme_keyring 00:22:50.459 09:01:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:50.459 09:01:38 -- nvmf/common.sh@123 -- # set -e 00:22:50.459 09:01:38 -- nvmf/common.sh@124 -- # return 0 00:22:50.459 09:01:38 -- nvmf/common.sh@477 -- # '[' -n 1575520 ']' 00:22:50.459 09:01:38 -- nvmf/common.sh@478 -- # killprocess 1575520 00:22:50.459 09:01:38 -- common/autotest_common.sh@926 -- # '[' -z 1575520 ']' 00:22:50.459 09:01:38 -- common/autotest_common.sh@930 -- # kill -0 1575520 00:22:50.459 09:01:38 -- common/autotest_common.sh@931 -- # uname 00:22:50.459 09:01:38 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:22:50.459 09:01:38 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1575520 00:22:50.459 09:01:38 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:22:50.459 09:01:38 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:22:50.459 09:01:38 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1575520' 00:22:50.459 killing process with pid 1575520 00:22:50.459 09:01:38 -- common/autotest_common.sh@945 -- # kill 1575520 00:22:50.459 [2024-07-15 09:01:38.844517] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:22:50.459 09:01:38 -- common/autotest_common.sh@950 -- # wait 1575520 00:22:50.717 09:01:39 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:50.717 09:01:39 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:50.717 09:01:39 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:50.717 09:01:39 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:50.717 09:01:39 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:50.717 09:01:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:50.718 09:01:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:50.718 09:01:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:53.257 09:01:41 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:53.257 00:22:53.257 real 0m5.960s 00:22:53.257 user 0m6.870s 00:22:53.257 sys 0m1.898s 00:22:53.257 09:01:41 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:22:53.257 09:01:41 -- common/autotest_common.sh@10 -- # set +x 00:22:53.257 ************************************ 00:22:53.257 END TEST nvmf_identify 00:22:53.257 ************************************ 00:22:53.257 09:01:41 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:22:53.257 09:01:41 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:22:53.257 09:01:41 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:22:53.257 09:01:41 -- common/autotest_common.sh@10 -- # set +x 00:22:53.257 ************************************ 00:22:53.257 START TEST nvmf_perf 00:22:53.257 ************************************ 00:22:53.257 09:01:41 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:22:53.257 * Looking for test storage... 00:22:53.257 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:53.258 09:01:41 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:53.258 09:01:41 -- nvmf/common.sh@7 -- # uname -s 00:22:53.258 09:01:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:53.258 09:01:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:53.258 09:01:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:53.258 09:01:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:53.258 09:01:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:53.258 09:01:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:53.258 09:01:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:53.258 09:01:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:53.258 09:01:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:53.258 09:01:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:53.258 09:01:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:53.258 09:01:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:53.258 09:01:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:53.258 09:01:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:53.258 09:01:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:53.258 09:01:41 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:53.258 09:01:41 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:53.258 09:01:41 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:53.258 09:01:41 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:53.258 09:01:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:53.258 09:01:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:53.258 09:01:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:53.258 09:01:41 -- paths/export.sh@5 -- # export PATH 00:22:53.258 09:01:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:53.258 09:01:41 -- nvmf/common.sh@46 -- # : 0 00:22:53.258 09:01:41 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:53.258 09:01:41 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:53.258 09:01:41 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:53.258 09:01:41 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:53.258 09:01:41 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:53.258 09:01:41 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:53.258 09:01:41 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:53.258 09:01:41 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:53.258 09:01:41 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:22:53.258 09:01:41 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:22:53.258 09:01:41 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:22:53.258 09:01:41 -- host/perf.sh@17 -- # nvmftestinit 00:22:53.258 09:01:41 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:53.258 09:01:41 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:53.258 09:01:41 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:53.258 09:01:41 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:53.258 09:01:41 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:53.258 09:01:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:53.258 09:01:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:53.258 09:01:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:53.258 09:01:41 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:53.258 09:01:41 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:53.258 09:01:41 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:53.258 09:01:41 -- common/autotest_common.sh@10 -- # set +x 00:22:54.633 09:01:43 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:54.633 09:01:43 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:54.633 09:01:43 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:54.633 09:01:43 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:54.633 09:01:43 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:54.633 09:01:43 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:54.633 09:01:43 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:54.633 09:01:43 -- nvmf/common.sh@294 -- # net_devs=() 00:22:54.633 09:01:43 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:54.633 09:01:43 -- nvmf/common.sh@295 -- # e810=() 00:22:54.633 09:01:43 -- nvmf/common.sh@295 -- # local -ga e810 00:22:54.633 09:01:43 -- nvmf/common.sh@296 -- # x722=() 00:22:54.633 09:01:43 -- nvmf/common.sh@296 -- # local -ga x722 00:22:54.633 09:01:43 -- nvmf/common.sh@297 -- # mlx=() 00:22:54.633 09:01:43 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:54.633 09:01:43 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:54.633 09:01:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:54.633 09:01:43 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:54.633 09:01:43 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:54.633 09:01:43 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:54.633 09:01:43 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:54.633 09:01:43 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:54.633 09:01:43 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:54.633 09:01:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:54.633 09:01:43 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:54.633 09:01:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:54.633 09:01:43 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:54.633 09:01:43 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:54.633 09:01:43 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:54.633 09:01:43 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:54.633 09:01:43 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:54.633 09:01:43 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:54.633 09:01:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:54.633 09:01:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:54.633 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:54.633 09:01:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:54.633 09:01:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:54.633 09:01:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:54.633 09:01:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:54.633 09:01:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:54.633 09:01:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:54.633 09:01:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:54.633 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:54.633 09:01:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:54.633 09:01:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:54.633 09:01:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:54.633 09:01:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:54.633 09:01:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:54.633 09:01:43 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:54.633 09:01:43 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:54.633 09:01:43 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:54.633 09:01:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:54.633 09:01:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:54.633 09:01:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:54.633 09:01:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:54.633 09:01:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:54.633 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:54.633 09:01:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:54.633 09:01:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:54.633 09:01:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:54.633 09:01:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:54.633 09:01:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:54.633 09:01:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:54.633 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:54.633 09:01:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:54.633 09:01:43 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:54.633 09:01:43 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:54.633 09:01:43 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:54.633 09:01:43 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:54.633 09:01:43 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:54.633 09:01:43 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:54.633 09:01:43 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:54.633 09:01:43 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:54.633 09:01:43 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:54.633 09:01:43 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:54.633 09:01:43 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:54.633 09:01:43 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:54.633 09:01:43 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:54.633 09:01:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:54.633 09:01:43 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:54.633 09:01:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:54.633 09:01:43 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:54.633 09:01:43 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:54.890 09:01:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:54.890 09:01:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:54.890 09:01:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:54.890 09:01:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:54.890 09:01:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:54.890 09:01:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:54.890 09:01:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:54.890 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:54.890 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.167 ms 00:22:54.890 00:22:54.890 --- 10.0.0.2 ping statistics --- 00:22:54.890 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:54.890 rtt min/avg/max/mdev = 0.167/0.167/0.167/0.000 ms 00:22:54.890 09:01:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:54.890 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:54.890 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.186 ms 00:22:54.890 00:22:54.890 --- 10.0.0.1 ping statistics --- 00:22:54.890 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:54.890 rtt min/avg/max/mdev = 0.186/0.186/0.186/0.000 ms 00:22:54.890 09:01:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:54.890 09:01:43 -- nvmf/common.sh@410 -- # return 0 00:22:54.890 09:01:43 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:54.890 09:01:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:54.890 09:01:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:54.890 09:01:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:54.890 09:01:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:54.890 09:01:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:54.890 09:01:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:54.890 09:01:43 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:22:54.890 09:01:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:54.890 09:01:43 -- common/autotest_common.sh@712 -- # xtrace_disable 00:22:54.890 09:01:43 -- common/autotest_common.sh@10 -- # set +x 00:22:54.890 09:01:43 -- nvmf/common.sh@469 -- # nvmfpid=1577621 00:22:54.890 09:01:43 -- nvmf/common.sh@470 -- # waitforlisten 1577621 00:22:54.890 09:01:43 -- common/autotest_common.sh@819 -- # '[' -z 1577621 ']' 00:22:54.890 09:01:43 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:54.890 09:01:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:54.890 09:01:43 -- common/autotest_common.sh@824 -- # local max_retries=100 00:22:54.890 09:01:43 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:54.891 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:54.891 09:01:43 -- common/autotest_common.sh@828 -- # xtrace_disable 00:22:54.891 09:01:43 -- common/autotest_common.sh@10 -- # set +x 00:22:54.891 [2024-07-15 09:01:43.318428] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:22:54.891 [2024-07-15 09:01:43.318510] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:54.891 EAL: No free 2048 kB hugepages reported on node 1 00:22:54.891 [2024-07-15 09:01:43.386905] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:55.146 [2024-07-15 09:01:43.502098] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:55.146 [2024-07-15 09:01:43.502266] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:55.146 [2024-07-15 09:01:43.502284] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:55.146 [2024-07-15 09:01:43.502298] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:55.146 [2024-07-15 09:01:43.502358] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:55.146 [2024-07-15 09:01:43.502420] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:55.146 [2024-07-15 09:01:43.502604] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:55.146 [2024-07-15 09:01:43.502608] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:55.710 09:01:44 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:22:55.710 09:01:44 -- common/autotest_common.sh@852 -- # return 0 00:22:55.710 09:01:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:55.710 09:01:44 -- common/autotest_common.sh@718 -- # xtrace_disable 00:22:55.710 09:01:44 -- common/autotest_common.sh@10 -- # set +x 00:22:55.710 09:01:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:55.710 09:01:44 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:22:55.710 09:01:44 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:22:58.997 09:01:47 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:22:58.997 09:01:47 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:22:59.255 09:01:47 -- host/perf.sh@30 -- # local_nvme_trid=0000:88:00.0 00:22:59.255 09:01:47 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:22:59.515 09:01:47 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:22:59.515 09:01:47 -- host/perf.sh@33 -- # '[' -n 0000:88:00.0 ']' 00:22:59.515 09:01:47 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:22:59.515 09:01:47 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:22:59.515 09:01:47 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:22:59.515 [2024-07-15 09:01:48.033523] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:59.515 09:01:48 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:59.773 09:01:48 -- host/perf.sh@45 -- # for bdev in $bdevs 00:22:59.773 09:01:48 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:00.031 09:01:48 -- host/perf.sh@45 -- # for bdev in $bdevs 00:23:00.031 09:01:48 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:23:00.288 09:01:48 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:00.546 [2024-07-15 09:01:49.025250] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:00.546 09:01:49 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:23:00.804 09:01:49 -- host/perf.sh@52 -- # '[' -n 0000:88:00.0 ']' 00:23:00.804 09:01:49 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:23:00.804 09:01:49 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:23:00.804 09:01:49 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:23:02.200 Initializing NVMe Controllers 00:23:02.200 Attached to NVMe Controller at 0000:88:00.0 [8086:0a54] 00:23:02.200 Associating PCIE (0000:88:00.0) NSID 1 with lcore 0 00:23:02.200 Initialization complete. Launching workers. 00:23:02.200 ======================================================== 00:23:02.200 Latency(us) 00:23:02.200 Device Information : IOPS MiB/s Average min max 00:23:02.200 PCIE (0000:88:00.0) NSID 1 from core 0: 86108.88 336.36 371.02 39.94 7257.01 00:23:02.200 ======================================================== 00:23:02.200 Total : 86108.88 336.36 371.02 39.94 7257.01 00:23:02.200 00:23:02.200 09:01:50 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:02.200 EAL: No free 2048 kB hugepages reported on node 1 00:23:03.605 Initializing NVMe Controllers 00:23:03.605 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:03.605 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:03.605 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:03.605 Initialization complete. Launching workers. 00:23:03.605 ======================================================== 00:23:03.605 Latency(us) 00:23:03.605 Device Information : IOPS MiB/s Average min max 00:23:03.605 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 77.72 0.30 12866.06 175.54 45799.51 00:23:03.605 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 66.76 0.26 15096.69 4994.83 50863.38 00:23:03.605 ======================================================== 00:23:03.605 Total : 144.48 0.56 13896.76 175.54 50863.38 00:23:03.605 00:23:03.605 09:01:51 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:03.605 EAL: No free 2048 kB hugepages reported on node 1 00:23:04.982 Initializing NVMe Controllers 00:23:04.982 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:04.982 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:04.982 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:04.982 Initialization complete. Launching workers. 00:23:04.982 ======================================================== 00:23:04.982 Latency(us) 00:23:04.982 Device Information : IOPS MiB/s Average min max 00:23:04.982 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8607.25 33.62 3718.42 466.35 8513.91 00:23:04.982 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3763.68 14.70 8516.28 5273.56 17349.32 00:23:04.982 ======================================================== 00:23:04.982 Total : 12370.93 48.32 5178.10 466.35 17349.32 00:23:04.982 00:23:04.982 09:01:53 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:23:04.982 09:01:53 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:23:04.982 09:01:53 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:04.982 EAL: No free 2048 kB hugepages reported on node 1 00:23:07.515 Initializing NVMe Controllers 00:23:07.515 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:07.515 Controller IO queue size 128, less than required. 00:23:07.515 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:07.515 Controller IO queue size 128, less than required. 00:23:07.515 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:07.515 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:07.515 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:07.515 Initialization complete. Launching workers. 00:23:07.515 ======================================================== 00:23:07.515 Latency(us) 00:23:07.515 Device Information : IOPS MiB/s Average min max 00:23:07.515 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1276.85 319.21 102364.85 69776.49 152537.54 00:23:07.515 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 565.43 141.36 231840.32 70802.49 357009.64 00:23:07.515 ======================================================== 00:23:07.515 Total : 1842.29 460.57 142103.45 69776.49 357009.64 00:23:07.515 00:23:07.515 09:01:55 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:23:07.515 EAL: No free 2048 kB hugepages reported on node 1 00:23:07.774 No valid NVMe controllers or AIO or URING devices found 00:23:07.774 Initializing NVMe Controllers 00:23:07.774 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:07.774 Controller IO queue size 128, less than required. 00:23:07.774 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:07.774 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:23:07.774 Controller IO queue size 128, less than required. 00:23:07.774 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:07.774 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:23:07.774 WARNING: Some requested NVMe devices were skipped 00:23:07.774 09:01:56 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:23:07.774 EAL: No free 2048 kB hugepages reported on node 1 00:23:10.310 Initializing NVMe Controllers 00:23:10.310 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:10.310 Controller IO queue size 128, less than required. 00:23:10.310 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:10.310 Controller IO queue size 128, less than required. 00:23:10.310 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:10.310 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:10.310 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:10.310 Initialization complete. Launching workers. 00:23:10.310 00:23:10.310 ==================== 00:23:10.310 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:23:10.310 TCP transport: 00:23:10.310 polls: 21324 00:23:10.310 idle_polls: 6822 00:23:10.310 sock_completions: 14502 00:23:10.310 nvme_completions: 4945 00:23:10.310 submitted_requests: 7475 00:23:10.310 queued_requests: 1 00:23:10.310 00:23:10.310 ==================== 00:23:10.310 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:23:10.310 TCP transport: 00:23:10.310 polls: 24473 00:23:10.310 idle_polls: 14125 00:23:10.310 sock_completions: 10348 00:23:10.310 nvme_completions: 2556 00:23:10.310 submitted_requests: 3969 00:23:10.310 queued_requests: 1 00:23:10.310 ======================================================== 00:23:10.310 Latency(us) 00:23:10.310 Device Information : IOPS MiB/s Average min max 00:23:10.310 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1299.96 324.99 101068.67 64966.97 136000.38 00:23:10.310 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 702.48 175.62 189237.32 57465.69 279291.60 00:23:10.310 ======================================================== 00:23:10.310 Total : 2002.44 500.61 131999.24 57465.69 279291.60 00:23:10.310 00:23:10.310 09:01:58 -- host/perf.sh@66 -- # sync 00:23:10.310 09:01:58 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:10.875 09:01:59 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:23:10.875 09:01:59 -- host/perf.sh@71 -- # '[' -n 0000:88:00.0 ']' 00:23:10.875 09:01:59 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:23:14.157 09:02:02 -- host/perf.sh@72 -- # ls_guid=7c795980-805a-4f68-ab9a-3246760892cd 00:23:14.157 09:02:02 -- host/perf.sh@73 -- # get_lvs_free_mb 7c795980-805a-4f68-ab9a-3246760892cd 00:23:14.157 09:02:02 -- common/autotest_common.sh@1343 -- # local lvs_uuid=7c795980-805a-4f68-ab9a-3246760892cd 00:23:14.157 09:02:02 -- common/autotest_common.sh@1344 -- # local lvs_info 00:23:14.157 09:02:02 -- common/autotest_common.sh@1345 -- # local fc 00:23:14.157 09:02:02 -- common/autotest_common.sh@1346 -- # local cs 00:23:14.157 09:02:02 -- common/autotest_common.sh@1347 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:23:14.414 09:02:02 -- common/autotest_common.sh@1347 -- # lvs_info='[ 00:23:14.414 { 00:23:14.414 "uuid": "7c795980-805a-4f68-ab9a-3246760892cd", 00:23:14.414 "name": "lvs_0", 00:23:14.414 "base_bdev": "Nvme0n1", 00:23:14.414 "total_data_clusters": 238234, 00:23:14.414 "free_clusters": 238234, 00:23:14.414 "block_size": 512, 00:23:14.414 "cluster_size": 4194304 00:23:14.414 } 00:23:14.414 ]' 00:23:14.414 09:02:02 -- common/autotest_common.sh@1348 -- # jq '.[] | select(.uuid=="7c795980-805a-4f68-ab9a-3246760892cd") .free_clusters' 00:23:14.414 09:02:02 -- common/autotest_common.sh@1348 -- # fc=238234 00:23:14.414 09:02:02 -- common/autotest_common.sh@1349 -- # jq '.[] | select(.uuid=="7c795980-805a-4f68-ab9a-3246760892cd") .cluster_size' 00:23:14.414 09:02:02 -- common/autotest_common.sh@1349 -- # cs=4194304 00:23:14.414 09:02:02 -- common/autotest_common.sh@1352 -- # free_mb=952936 00:23:14.414 09:02:02 -- common/autotest_common.sh@1353 -- # echo 952936 00:23:14.414 952936 00:23:14.414 09:02:02 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:23:14.414 09:02:02 -- host/perf.sh@78 -- # free_mb=20480 00:23:14.414 09:02:02 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 7c795980-805a-4f68-ab9a-3246760892cd lbd_0 20480 00:23:14.672 09:02:03 -- host/perf.sh@80 -- # lb_guid=ad1c0c7a-9af0-4449-a552-45a68bd7e25d 00:23:14.672 09:02:03 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore ad1c0c7a-9af0-4449-a552-45a68bd7e25d lvs_n_0 00:23:15.606 09:02:03 -- host/perf.sh@83 -- # ls_nested_guid=23a9183e-d0c3-45e9-b965-f30762f99e24 00:23:15.606 09:02:03 -- host/perf.sh@84 -- # get_lvs_free_mb 23a9183e-d0c3-45e9-b965-f30762f99e24 00:23:15.606 09:02:03 -- common/autotest_common.sh@1343 -- # local lvs_uuid=23a9183e-d0c3-45e9-b965-f30762f99e24 00:23:15.606 09:02:03 -- common/autotest_common.sh@1344 -- # local lvs_info 00:23:15.606 09:02:03 -- common/autotest_common.sh@1345 -- # local fc 00:23:15.606 09:02:03 -- common/autotest_common.sh@1346 -- # local cs 00:23:15.606 09:02:03 -- common/autotest_common.sh@1347 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:23:15.864 09:02:04 -- common/autotest_common.sh@1347 -- # lvs_info='[ 00:23:15.864 { 00:23:15.864 "uuid": "7c795980-805a-4f68-ab9a-3246760892cd", 00:23:15.864 "name": "lvs_0", 00:23:15.864 "base_bdev": "Nvme0n1", 00:23:15.864 "total_data_clusters": 238234, 00:23:15.864 "free_clusters": 233114, 00:23:15.864 "block_size": 512, 00:23:15.864 "cluster_size": 4194304 00:23:15.864 }, 00:23:15.864 { 00:23:15.864 "uuid": "23a9183e-d0c3-45e9-b965-f30762f99e24", 00:23:15.864 "name": "lvs_n_0", 00:23:15.864 "base_bdev": "ad1c0c7a-9af0-4449-a552-45a68bd7e25d", 00:23:15.864 "total_data_clusters": 5114, 00:23:15.864 "free_clusters": 5114, 00:23:15.864 "block_size": 512, 00:23:15.864 "cluster_size": 4194304 00:23:15.864 } 00:23:15.864 ]' 00:23:15.864 09:02:04 -- common/autotest_common.sh@1348 -- # jq '.[] | select(.uuid=="23a9183e-d0c3-45e9-b965-f30762f99e24") .free_clusters' 00:23:15.864 09:02:04 -- common/autotest_common.sh@1348 -- # fc=5114 00:23:15.864 09:02:04 -- common/autotest_common.sh@1349 -- # jq '.[] | select(.uuid=="23a9183e-d0c3-45e9-b965-f30762f99e24") .cluster_size' 00:23:15.864 09:02:04 -- common/autotest_common.sh@1349 -- # cs=4194304 00:23:15.864 09:02:04 -- common/autotest_common.sh@1352 -- # free_mb=20456 00:23:15.864 09:02:04 -- common/autotest_common.sh@1353 -- # echo 20456 00:23:15.864 20456 00:23:15.864 09:02:04 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:23:15.864 09:02:04 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 23a9183e-d0c3-45e9-b965-f30762f99e24 lbd_nest_0 20456 00:23:16.122 09:02:04 -- host/perf.sh@88 -- # lb_nested_guid=54cee938-f257-47b5-a4bd-8a3621db8251 00:23:16.122 09:02:04 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:16.379 09:02:04 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:23:16.379 09:02:04 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 54cee938-f257-47b5-a4bd-8a3621db8251 00:23:16.637 09:02:05 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:16.896 09:02:05 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:23:16.896 09:02:05 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:23:16.896 09:02:05 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:23:16.896 09:02:05 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:16.896 09:02:05 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:16.896 EAL: No free 2048 kB hugepages reported on node 1 00:23:29.123 Initializing NVMe Controllers 00:23:29.123 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:29.123 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:29.123 Initialization complete. Launching workers. 00:23:29.123 ======================================================== 00:23:29.123 Latency(us) 00:23:29.123 Device Information : IOPS MiB/s Average min max 00:23:29.123 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 44.98 0.02 22322.84 202.10 47580.72 00:23:29.123 ======================================================== 00:23:29.123 Total : 44.98 0.02 22322.84 202.10 47580.72 00:23:29.123 00:23:29.123 09:02:15 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:29.123 09:02:15 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:29.123 EAL: No free 2048 kB hugepages reported on node 1 00:23:39.108 Initializing NVMe Controllers 00:23:39.108 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:39.108 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:39.108 Initialization complete. Launching workers. 00:23:39.108 ======================================================== 00:23:39.108 Latency(us) 00:23:39.108 Device Information : IOPS MiB/s Average min max 00:23:39.108 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 76.69 9.59 13039.26 5024.04 47887.25 00:23:39.108 ======================================================== 00:23:39.108 Total : 76.69 9.59 13039.26 5024.04 47887.25 00:23:39.108 00:23:39.108 09:02:25 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:23:39.108 09:02:25 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:39.108 09:02:25 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:39.108 EAL: No free 2048 kB hugepages reported on node 1 00:23:49.088 Initializing NVMe Controllers 00:23:49.088 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:49.088 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:49.088 Initialization complete. Launching workers. 00:23:49.088 ======================================================== 00:23:49.088 Latency(us) 00:23:49.088 Device Information : IOPS MiB/s Average min max 00:23:49.088 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7671.90 3.75 4180.82 279.40 44833.92 00:23:49.088 ======================================================== 00:23:49.088 Total : 7671.90 3.75 4180.82 279.40 44833.92 00:23:49.088 00:23:49.088 09:02:36 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:49.088 09:02:36 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:49.088 EAL: No free 2048 kB hugepages reported on node 1 00:23:59.063 Initializing NVMe Controllers 00:23:59.063 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:59.063 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:59.063 Initialization complete. Launching workers. 00:23:59.063 ======================================================== 00:23:59.064 Latency(us) 00:23:59.064 Device Information : IOPS MiB/s Average min max 00:23:59.064 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 2050.28 256.29 15622.72 1601.50 33807.30 00:23:59.064 ======================================================== 00:23:59.064 Total : 2050.28 256.29 15622.72 1601.50 33807.30 00:23:59.064 00:23:59.064 09:02:46 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:23:59.064 09:02:46 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:59.064 09:02:46 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:59.064 EAL: No free 2048 kB hugepages reported on node 1 00:24:09.073 Initializing NVMe Controllers 00:24:09.073 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:09.073 Controller IO queue size 128, less than required. 00:24:09.073 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:09.073 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:09.073 Initialization complete. Launching workers. 00:24:09.073 ======================================================== 00:24:09.073 Latency(us) 00:24:09.073 Device Information : IOPS MiB/s Average min max 00:24:09.073 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 11988.86 5.85 10678.63 1687.79 26333.98 00:24:09.073 ======================================================== 00:24:09.073 Total : 11988.86 5.85 10678.63 1687.79 26333.98 00:24:09.074 00:24:09.074 09:02:56 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:09.074 09:02:56 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:09.074 EAL: No free 2048 kB hugepages reported on node 1 00:24:19.078 Initializing NVMe Controllers 00:24:19.078 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:19.078 Controller IO queue size 128, less than required. 00:24:19.078 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:19.078 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:19.078 Initialization complete. Launching workers. 00:24:19.078 ======================================================== 00:24:19.078 Latency(us) 00:24:19.078 Device Information : IOPS MiB/s Average min max 00:24:19.078 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1199.40 149.92 107228.24 16032.93 223453.17 00:24:19.078 ======================================================== 00:24:19.078 Total : 1199.40 149.92 107228.24 16032.93 223453.17 00:24:19.078 00:24:19.078 09:03:07 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:19.078 09:03:07 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 54cee938-f257-47b5-a4bd-8a3621db8251 00:24:20.012 09:03:08 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:24:20.012 09:03:08 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete ad1c0c7a-9af0-4449-a552-45a68bd7e25d 00:24:20.269 09:03:08 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:24:20.526 09:03:09 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:24:20.526 09:03:09 -- host/perf.sh@114 -- # nvmftestfini 00:24:20.526 09:03:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:20.526 09:03:09 -- nvmf/common.sh@116 -- # sync 00:24:20.526 09:03:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:20.526 09:03:09 -- nvmf/common.sh@119 -- # set +e 00:24:20.526 09:03:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:20.526 09:03:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:20.526 rmmod nvme_tcp 00:24:20.783 rmmod nvme_fabrics 00:24:20.783 rmmod nvme_keyring 00:24:20.783 09:03:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:20.783 09:03:09 -- nvmf/common.sh@123 -- # set -e 00:24:20.783 09:03:09 -- nvmf/common.sh@124 -- # return 0 00:24:20.783 09:03:09 -- nvmf/common.sh@477 -- # '[' -n 1577621 ']' 00:24:20.783 09:03:09 -- nvmf/common.sh@478 -- # killprocess 1577621 00:24:20.783 09:03:09 -- common/autotest_common.sh@926 -- # '[' -z 1577621 ']' 00:24:20.783 09:03:09 -- common/autotest_common.sh@930 -- # kill -0 1577621 00:24:20.783 09:03:09 -- common/autotest_common.sh@931 -- # uname 00:24:20.783 09:03:09 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:24:20.783 09:03:09 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1577621 00:24:20.783 09:03:09 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:24:20.783 09:03:09 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:24:20.783 09:03:09 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1577621' 00:24:20.783 killing process with pid 1577621 00:24:20.783 09:03:09 -- common/autotest_common.sh@945 -- # kill 1577621 00:24:20.783 09:03:09 -- common/autotest_common.sh@950 -- # wait 1577621 00:24:22.689 09:03:10 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:22.689 09:03:10 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:22.689 09:03:10 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:22.689 09:03:10 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:22.689 09:03:10 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:22.689 09:03:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:22.689 09:03:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:22.689 09:03:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:24.594 09:03:12 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:24.594 00:24:24.594 real 1m31.633s 00:24:24.594 user 5m37.668s 00:24:24.594 sys 0m15.442s 00:24:24.594 09:03:12 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:24:24.594 09:03:12 -- common/autotest_common.sh@10 -- # set +x 00:24:24.594 ************************************ 00:24:24.594 END TEST nvmf_perf 00:24:24.594 ************************************ 00:24:24.594 09:03:12 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:24:24.594 09:03:12 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:24:24.594 09:03:12 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:24:24.594 09:03:12 -- common/autotest_common.sh@10 -- # set +x 00:24:24.594 ************************************ 00:24:24.594 START TEST nvmf_fio_host 00:24:24.594 ************************************ 00:24:24.594 09:03:12 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:24:24.594 * Looking for test storage... 00:24:24.594 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:24:24.594 09:03:12 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:24.594 09:03:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:24.594 09:03:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:24.594 09:03:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:24.594 09:03:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:24.594 09:03:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:24.594 09:03:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:24.594 09:03:12 -- paths/export.sh@5 -- # export PATH 00:24:24.594 09:03:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:24.594 09:03:12 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:24.594 09:03:12 -- nvmf/common.sh@7 -- # uname -s 00:24:24.594 09:03:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:24.594 09:03:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:24.594 09:03:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:24.594 09:03:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:24.594 09:03:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:24.594 09:03:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:24.594 09:03:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:24.594 09:03:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:24.594 09:03:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:24.594 09:03:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:24.594 09:03:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:24.594 09:03:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:24.594 09:03:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:24.594 09:03:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:24.594 09:03:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:24.594 09:03:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:24.594 09:03:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:24.594 09:03:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:24.594 09:03:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:24.594 09:03:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:24.594 09:03:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:24.594 09:03:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:24.594 09:03:12 -- paths/export.sh@5 -- # export PATH 00:24:24.594 09:03:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:24.594 09:03:12 -- nvmf/common.sh@46 -- # : 0 00:24:24.594 09:03:12 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:24.594 09:03:12 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:24.594 09:03:12 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:24.594 09:03:12 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:24.594 09:03:12 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:24.594 09:03:12 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:24.594 09:03:12 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:24.594 09:03:12 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:24.594 09:03:12 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:24:24.594 09:03:12 -- host/fio.sh@14 -- # nvmftestinit 00:24:24.594 09:03:12 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:24.594 09:03:12 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:24.594 09:03:12 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:24.594 09:03:12 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:24.594 09:03:12 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:24.594 09:03:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:24.594 09:03:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:24.594 09:03:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:24.594 09:03:12 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:24.594 09:03:12 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:24.594 09:03:12 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:24.594 09:03:12 -- common/autotest_common.sh@10 -- # set +x 00:24:26.494 09:03:14 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:26.494 09:03:14 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:26.494 09:03:14 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:26.494 09:03:14 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:26.494 09:03:14 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:26.494 09:03:14 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:26.494 09:03:14 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:26.494 09:03:14 -- nvmf/common.sh@294 -- # net_devs=() 00:24:26.494 09:03:14 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:26.494 09:03:14 -- nvmf/common.sh@295 -- # e810=() 00:24:26.494 09:03:14 -- nvmf/common.sh@295 -- # local -ga e810 00:24:26.494 09:03:14 -- nvmf/common.sh@296 -- # x722=() 00:24:26.494 09:03:14 -- nvmf/common.sh@296 -- # local -ga x722 00:24:26.494 09:03:14 -- nvmf/common.sh@297 -- # mlx=() 00:24:26.494 09:03:14 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:26.494 09:03:14 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:26.494 09:03:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:26.494 09:03:14 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:26.494 09:03:14 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:26.494 09:03:14 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:26.494 09:03:14 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:26.494 09:03:14 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:26.494 09:03:14 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:26.495 09:03:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:26.495 09:03:14 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:26.495 09:03:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:26.495 09:03:14 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:26.495 09:03:14 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:26.495 09:03:14 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:26.495 09:03:14 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:26.495 09:03:14 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:26.495 09:03:14 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:26.495 09:03:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:26.495 09:03:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:26.495 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:26.495 09:03:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:26.495 09:03:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:26.495 09:03:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:26.495 09:03:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:26.495 09:03:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:26.495 09:03:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:26.495 09:03:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:26.495 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:26.495 09:03:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:26.495 09:03:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:26.495 09:03:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:26.495 09:03:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:26.495 09:03:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:26.495 09:03:14 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:26.495 09:03:14 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:26.495 09:03:14 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:26.495 09:03:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:26.495 09:03:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:26.495 09:03:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:26.495 09:03:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:26.495 09:03:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:26.495 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:26.495 09:03:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:26.495 09:03:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:26.495 09:03:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:26.495 09:03:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:26.495 09:03:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:26.495 09:03:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:26.495 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:26.495 09:03:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:26.495 09:03:14 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:26.495 09:03:14 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:26.495 09:03:14 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:26.495 09:03:14 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:26.495 09:03:14 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:26.495 09:03:14 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:26.495 09:03:14 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:26.495 09:03:14 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:26.495 09:03:14 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:26.495 09:03:14 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:26.495 09:03:14 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:26.495 09:03:14 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:26.495 09:03:14 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:26.495 09:03:14 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:26.495 09:03:14 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:26.495 09:03:14 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:26.495 09:03:14 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:26.495 09:03:14 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:26.495 09:03:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:26.495 09:03:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:26.495 09:03:14 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:26.495 09:03:14 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:26.495 09:03:15 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:26.753 09:03:15 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:26.753 09:03:15 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:26.753 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:26.753 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.129 ms 00:24:26.753 00:24:26.753 --- 10.0.0.2 ping statistics --- 00:24:26.753 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:26.753 rtt min/avg/max/mdev = 0.129/0.129/0.129/0.000 ms 00:24:26.753 09:03:15 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:26.753 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:26.753 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.089 ms 00:24:26.753 00:24:26.753 --- 10.0.0.1 ping statistics --- 00:24:26.753 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:26.753 rtt min/avg/max/mdev = 0.089/0.089/0.089/0.000 ms 00:24:26.753 09:03:15 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:26.753 09:03:15 -- nvmf/common.sh@410 -- # return 0 00:24:26.753 09:03:15 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:26.753 09:03:15 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:26.753 09:03:15 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:26.753 09:03:15 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:26.753 09:03:15 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:26.753 09:03:15 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:26.753 09:03:15 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:26.753 09:03:15 -- host/fio.sh@16 -- # [[ y != y ]] 00:24:26.753 09:03:15 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:24:26.753 09:03:15 -- common/autotest_common.sh@712 -- # xtrace_disable 00:24:26.753 09:03:15 -- common/autotest_common.sh@10 -- # set +x 00:24:26.753 09:03:15 -- host/fio.sh@24 -- # nvmfpid=1590682 00:24:26.753 09:03:15 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:24:26.753 09:03:15 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:24:26.753 09:03:15 -- host/fio.sh@28 -- # waitforlisten 1590682 00:24:26.753 09:03:15 -- common/autotest_common.sh@819 -- # '[' -z 1590682 ']' 00:24:26.753 09:03:15 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:26.753 09:03:15 -- common/autotest_common.sh@824 -- # local max_retries=100 00:24:26.753 09:03:15 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:26.754 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:26.754 09:03:15 -- common/autotest_common.sh@828 -- # xtrace_disable 00:24:26.754 09:03:15 -- common/autotest_common.sh@10 -- # set +x 00:24:26.754 [2024-07-15 09:03:15.122743] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:24:26.754 [2024-07-15 09:03:15.122821] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:26.754 EAL: No free 2048 kB hugepages reported on node 1 00:24:26.754 [2024-07-15 09:03:15.191207] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:27.011 [2024-07-15 09:03:15.306195] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:27.011 [2024-07-15 09:03:15.306364] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:27.011 [2024-07-15 09:03:15.306385] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:27.011 [2024-07-15 09:03:15.306399] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:27.011 [2024-07-15 09:03:15.306604] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:27.011 [2024-07-15 09:03:15.306671] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:27.011 [2024-07-15 09:03:15.306767] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:27.011 [2024-07-15 09:03:15.306910] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:27.577 09:03:16 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:24:27.577 09:03:16 -- common/autotest_common.sh@852 -- # return 0 00:24:27.577 09:03:16 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:24:27.835 [2024-07-15 09:03:16.267965] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:27.835 09:03:16 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:24:27.835 09:03:16 -- common/autotest_common.sh@718 -- # xtrace_disable 00:24:27.835 09:03:16 -- common/autotest_common.sh@10 -- # set +x 00:24:27.835 09:03:16 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:24:28.093 Malloc1 00:24:28.093 09:03:16 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:28.350 09:03:16 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:28.609 09:03:17 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:28.866 [2024-07-15 09:03:17.270454] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:28.866 09:03:17 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:24:29.124 09:03:17 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:24:29.124 09:03:17 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:29.124 09:03:17 -- common/autotest_common.sh@1339 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:29.124 09:03:17 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:24:29.124 09:03:17 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:24:29.124 09:03:17 -- common/autotest_common.sh@1318 -- # local sanitizers 00:24:29.124 09:03:17 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:29.124 09:03:17 -- common/autotest_common.sh@1320 -- # shift 00:24:29.124 09:03:17 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:24:29.124 09:03:17 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:24:29.124 09:03:17 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:29.124 09:03:17 -- common/autotest_common.sh@1324 -- # grep libasan 00:24:29.124 09:03:17 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:24:29.124 09:03:17 -- common/autotest_common.sh@1324 -- # asan_lib= 00:24:29.124 09:03:17 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:24:29.124 09:03:17 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:24:29.124 09:03:17 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:29.124 09:03:17 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:24:29.124 09:03:17 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:24:29.124 09:03:17 -- common/autotest_common.sh@1324 -- # asan_lib= 00:24:29.124 09:03:17 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:24:29.124 09:03:17 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:24:29.124 09:03:17 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:29.382 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:24:29.382 fio-3.35 00:24:29.382 Starting 1 thread 00:24:29.382 EAL: No free 2048 kB hugepages reported on node 1 00:24:31.943 00:24:31.943 test: (groupid=0, jobs=1): err= 0: pid=1591177: Mon Jul 15 09:03:20 2024 00:24:31.943 read: IOPS=9595, BW=37.5MiB/s (39.3MB/s)(75.2MiB/2006msec) 00:24:31.943 slat (nsec): min=1959, max=107728, avg=2455.10, stdev=1342.46 00:24:31.943 clat (usec): min=2026, max=12965, avg=7383.73, stdev=563.25 00:24:31.943 lat (usec): min=2047, max=12968, avg=7386.18, stdev=563.16 00:24:31.943 clat percentiles (usec): 00:24:31.943 | 1.00th=[ 6128], 5.00th=[ 6521], 10.00th=[ 6718], 20.00th=[ 6980], 00:24:31.943 | 30.00th=[ 7111], 40.00th=[ 7242], 50.00th=[ 7373], 60.00th=[ 7504], 00:24:31.943 | 70.00th=[ 7635], 80.00th=[ 7832], 90.00th=[ 8029], 95.00th=[ 8225], 00:24:31.943 | 99.00th=[ 8586], 99.50th=[ 8717], 99.90th=[11076], 99.95th=[12649], 00:24:31.943 | 99.99th=[12911] 00:24:31.943 bw ( KiB/s): min=37496, max=38984, per=99.90%, avg=38344.00, stdev=651.50, samples=4 00:24:31.943 iops : min= 9374, max= 9746, avg=9586.00, stdev=162.87, samples=4 00:24:31.943 write: IOPS=9599, BW=37.5MiB/s (39.3MB/s)(75.2MiB/2006msec); 0 zone resets 00:24:31.943 slat (nsec): min=2080, max=94577, avg=2567.51, stdev=1146.15 00:24:31.943 clat (usec): min=1598, max=10991, avg=5908.65, stdev=483.40 00:24:31.943 lat (usec): min=1605, max=10994, avg=5911.21, stdev=483.36 00:24:31.943 clat percentiles (usec): 00:24:31.943 | 1.00th=[ 4817], 5.00th=[ 5211], 10.00th=[ 5342], 20.00th=[ 5538], 00:24:31.943 | 30.00th=[ 5669], 40.00th=[ 5800], 50.00th=[ 5932], 60.00th=[ 5997], 00:24:31.943 | 70.00th=[ 6128], 80.00th=[ 6259], 90.00th=[ 6456], 95.00th=[ 6652], 00:24:31.943 | 99.00th=[ 6980], 99.50th=[ 7046], 99.90th=[ 9503], 99.95th=[10159], 00:24:31.943 | 99.99th=[10814] 00:24:31.943 bw ( KiB/s): min=38208, max=38704, per=100.00%, avg=38412.00, stdev=223.00, samples=4 00:24:31.943 iops : min= 9552, max= 9676, avg=9603.00, stdev=55.75, samples=4 00:24:31.943 lat (msec) : 2=0.02%, 4=0.10%, 10=99.76%, 20=0.12% 00:24:31.943 cpu : usr=59.50%, sys=35.46%, ctx=66, majf=0, minf=5 00:24:31.943 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:24:31.943 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:31.943 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:31.943 issued rwts: total=19249,19256,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:31.943 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:31.943 00:24:31.943 Run status group 0 (all jobs): 00:24:31.943 READ: bw=37.5MiB/s (39.3MB/s), 37.5MiB/s-37.5MiB/s (39.3MB/s-39.3MB/s), io=75.2MiB (78.8MB), run=2006-2006msec 00:24:31.943 WRITE: bw=37.5MiB/s (39.3MB/s), 37.5MiB/s-37.5MiB/s (39.3MB/s-39.3MB/s), io=75.2MiB (78.9MB), run=2006-2006msec 00:24:31.943 09:03:20 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:24:31.943 09:03:20 -- common/autotest_common.sh@1339 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:24:31.943 09:03:20 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:24:31.943 09:03:20 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:24:31.943 09:03:20 -- common/autotest_common.sh@1318 -- # local sanitizers 00:24:31.943 09:03:20 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:31.943 09:03:20 -- common/autotest_common.sh@1320 -- # shift 00:24:31.943 09:03:20 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:24:31.943 09:03:20 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:24:31.943 09:03:20 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:31.943 09:03:20 -- common/autotest_common.sh@1324 -- # grep libasan 00:24:31.943 09:03:20 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:24:31.943 09:03:20 -- common/autotest_common.sh@1324 -- # asan_lib= 00:24:31.943 09:03:20 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:24:31.943 09:03:20 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:24:31.943 09:03:20 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:31.943 09:03:20 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:24:31.943 09:03:20 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:24:31.943 09:03:20 -- common/autotest_common.sh@1324 -- # asan_lib= 00:24:31.943 09:03:20 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:24:31.943 09:03:20 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:24:31.943 09:03:20 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:24:31.943 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:24:31.943 fio-3.35 00:24:31.943 Starting 1 thread 00:24:31.943 EAL: No free 2048 kB hugepages reported on node 1 00:24:34.468 00:24:34.468 test: (groupid=0, jobs=1): err= 0: pid=1591522: Mon Jul 15 09:03:22 2024 00:24:34.468 read: IOPS=8880, BW=139MiB/s (145MB/s)(278MiB/2007msec) 00:24:34.468 slat (nsec): min=2883, max=92295, avg=3624.67, stdev=1713.73 00:24:34.468 clat (usec): min=3170, max=18662, avg=8726.98, stdev=2349.31 00:24:34.468 lat (usec): min=3174, max=18665, avg=8730.61, stdev=2349.42 00:24:34.468 clat percentiles (usec): 00:24:34.468 | 1.00th=[ 4228], 5.00th=[ 5211], 10.00th=[ 5866], 20.00th=[ 6718], 00:24:34.468 | 30.00th=[ 7373], 40.00th=[ 7963], 50.00th=[ 8455], 60.00th=[ 9110], 00:24:34.468 | 70.00th=[ 9765], 80.00th=[10552], 90.00th=[11863], 95.00th=[13042], 00:24:34.468 | 99.00th=[14877], 99.50th=[15795], 99.90th=[17695], 99.95th=[18220], 00:24:34.468 | 99.99th=[18482] 00:24:34.468 bw ( KiB/s): min=59872, max=80224, per=49.51%, avg=70344.00, stdev=8353.79, samples=4 00:24:34.468 iops : min= 3742, max= 5014, avg=4396.50, stdev=522.11, samples=4 00:24:34.468 write: IOPS=5136, BW=80.3MiB/s (84.2MB/s)(143MiB/1777msec); 0 zone resets 00:24:34.468 slat (usec): min=30, max=190, avg=33.55, stdev= 5.36 00:24:34.468 clat (usec): min=3696, max=19689, avg=10245.79, stdev=1949.32 00:24:34.468 lat (usec): min=3728, max=19721, avg=10279.34, stdev=1949.71 00:24:34.468 clat percentiles (usec): 00:24:34.468 | 1.00th=[ 6652], 5.00th=[ 7570], 10.00th=[ 7963], 20.00th=[ 8586], 00:24:34.468 | 30.00th=[ 9110], 40.00th=[ 9503], 50.00th=[10028], 60.00th=[10421], 00:24:34.468 | 70.00th=[11076], 80.00th=[11863], 90.00th=[13173], 95.00th=[13829], 00:24:34.468 | 99.00th=[14877], 99.50th=[15401], 99.90th=[19006], 99.95th=[19268], 00:24:34.468 | 99.99th=[19792] 00:24:34.469 bw ( KiB/s): min=63008, max=82752, per=88.85%, avg=73016.00, stdev=8069.14, samples=4 00:24:34.469 iops : min= 3938, max= 5172, avg=4563.50, stdev=504.32, samples=4 00:24:34.469 lat (msec) : 4=0.30%, 10=65.44%, 20=34.26% 00:24:34.469 cpu : usr=75.07%, sys=22.03%, ctx=31, majf=0, minf=1 00:24:34.469 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:24:34.469 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:34.469 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:34.469 issued rwts: total=17823,9127,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:34.469 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:34.469 00:24:34.469 Run status group 0 (all jobs): 00:24:34.469 READ: bw=139MiB/s (145MB/s), 139MiB/s-139MiB/s (145MB/s-145MB/s), io=278MiB (292MB), run=2007-2007msec 00:24:34.469 WRITE: bw=80.3MiB/s (84.2MB/s), 80.3MiB/s-80.3MiB/s (84.2MB/s-84.2MB/s), io=143MiB (150MB), run=1777-1777msec 00:24:34.469 09:03:22 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:34.469 09:03:22 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:24:34.469 09:03:22 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:24:34.469 09:03:22 -- host/fio.sh@51 -- # get_nvme_bdfs 00:24:34.469 09:03:22 -- common/autotest_common.sh@1498 -- # bdfs=() 00:24:34.469 09:03:22 -- common/autotest_common.sh@1498 -- # local bdfs 00:24:34.469 09:03:22 -- common/autotest_common.sh@1499 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:24:34.469 09:03:22 -- common/autotest_common.sh@1499 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:24:34.469 09:03:22 -- common/autotest_common.sh@1499 -- # jq -r '.config[].params.traddr' 00:24:34.469 09:03:22 -- common/autotest_common.sh@1500 -- # (( 1 == 0 )) 00:24:34.469 09:03:22 -- common/autotest_common.sh@1504 -- # printf '%s\n' 0000:88:00.0 00:24:34.469 09:03:22 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 -i 10.0.0.2 00:24:37.757 Nvme0n1 00:24:37.757 09:03:25 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:24:40.289 09:03:28 -- host/fio.sh@53 -- # ls_guid=3d134f95-54e4-4938-b68c-0bb374ee6f73 00:24:40.289 09:03:28 -- host/fio.sh@54 -- # get_lvs_free_mb 3d134f95-54e4-4938-b68c-0bb374ee6f73 00:24:40.289 09:03:28 -- common/autotest_common.sh@1343 -- # local lvs_uuid=3d134f95-54e4-4938-b68c-0bb374ee6f73 00:24:40.289 09:03:28 -- common/autotest_common.sh@1344 -- # local lvs_info 00:24:40.289 09:03:28 -- common/autotest_common.sh@1345 -- # local fc 00:24:40.289 09:03:28 -- common/autotest_common.sh@1346 -- # local cs 00:24:40.289 09:03:28 -- common/autotest_common.sh@1347 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:24:40.546 09:03:29 -- common/autotest_common.sh@1347 -- # lvs_info='[ 00:24:40.546 { 00:24:40.546 "uuid": "3d134f95-54e4-4938-b68c-0bb374ee6f73", 00:24:40.546 "name": "lvs_0", 00:24:40.546 "base_bdev": "Nvme0n1", 00:24:40.546 "total_data_clusters": 930, 00:24:40.546 "free_clusters": 930, 00:24:40.546 "block_size": 512, 00:24:40.546 "cluster_size": 1073741824 00:24:40.546 } 00:24:40.546 ]' 00:24:40.546 09:03:29 -- common/autotest_common.sh@1348 -- # jq '.[] | select(.uuid=="3d134f95-54e4-4938-b68c-0bb374ee6f73") .free_clusters' 00:24:40.546 09:03:29 -- common/autotest_common.sh@1348 -- # fc=930 00:24:40.546 09:03:29 -- common/autotest_common.sh@1349 -- # jq '.[] | select(.uuid=="3d134f95-54e4-4938-b68c-0bb374ee6f73") .cluster_size' 00:24:40.805 09:03:29 -- common/autotest_common.sh@1349 -- # cs=1073741824 00:24:40.805 09:03:29 -- common/autotest_common.sh@1352 -- # free_mb=952320 00:24:40.805 09:03:29 -- common/autotest_common.sh@1353 -- # echo 952320 00:24:40.805 952320 00:24:40.805 09:03:29 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:24:41.064 606e2c94-cb60-400a-99e3-727bedadfe2d 00:24:41.064 09:03:29 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:24:41.322 09:03:29 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:24:41.580 09:03:30 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:24:41.838 09:03:30 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:41.838 09:03:30 -- common/autotest_common.sh@1339 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:41.838 09:03:30 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:24:41.838 09:03:30 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:24:41.838 09:03:30 -- common/autotest_common.sh@1318 -- # local sanitizers 00:24:41.838 09:03:30 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:41.838 09:03:30 -- common/autotest_common.sh@1320 -- # shift 00:24:41.838 09:03:30 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:24:41.838 09:03:30 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:24:41.838 09:03:30 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:41.838 09:03:30 -- common/autotest_common.sh@1324 -- # grep libasan 00:24:41.838 09:03:30 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:24:41.838 09:03:30 -- common/autotest_common.sh@1324 -- # asan_lib= 00:24:41.838 09:03:30 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:24:41.838 09:03:30 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:24:41.839 09:03:30 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:41.839 09:03:30 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:24:41.839 09:03:30 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:24:41.839 09:03:30 -- common/autotest_common.sh@1324 -- # asan_lib= 00:24:41.839 09:03:30 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:24:41.839 09:03:30 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:24:41.839 09:03:30 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:42.098 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:24:42.098 fio-3.35 00:24:42.098 Starting 1 thread 00:24:42.098 EAL: No free 2048 kB hugepages reported on node 1 00:24:44.629 00:24:44.629 test: (groupid=0, jobs=1): err= 0: pid=1592838: Mon Jul 15 09:03:32 2024 00:24:44.629 read: IOPS=6374, BW=24.9MiB/s (26.1MB/s)(50.0MiB/2007msec) 00:24:44.629 slat (nsec): min=1910, max=164996, avg=2516.76, stdev=2218.15 00:24:44.629 clat (usec): min=965, max=170615, avg=11050.41, stdev=11297.96 00:24:44.629 lat (usec): min=969, max=170670, avg=11052.93, stdev=11298.32 00:24:44.629 clat percentiles (msec): 00:24:44.629 | 1.00th=[ 9], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 10], 00:24:44.629 | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 11], 60.00th=[ 11], 00:24:44.629 | 70.00th=[ 11], 80.00th=[ 11], 90.00th=[ 12], 95.00th=[ 12], 00:24:44.629 | 99.00th=[ 13], 99.50th=[ 157], 99.90th=[ 171], 99.95th=[ 171], 00:24:44.629 | 99.99th=[ 171] 00:24:44.629 bw ( KiB/s): min=17768, max=28248, per=99.82%, avg=25454.00, stdev=5127.28, samples=4 00:24:44.629 iops : min= 4442, max= 7062, avg=6363.50, stdev=1281.82, samples=4 00:24:44.629 write: IOPS=6374, BW=24.9MiB/s (26.1MB/s)(50.0MiB/2007msec); 0 zone resets 00:24:44.629 slat (usec): min=2, max=118, avg= 2.62, stdev= 1.71 00:24:44.629 clat (usec): min=377, max=168964, avg=8850.49, stdev=10613.82 00:24:44.629 lat (usec): min=380, max=168970, avg=8853.11, stdev=10614.13 00:24:44.629 clat percentiles (msec): 00:24:44.629 | 1.00th=[ 7], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 8], 00:24:44.629 | 30.00th=[ 8], 40.00th=[ 8], 50.00th=[ 9], 60.00th=[ 9], 00:24:44.629 | 70.00th=[ 9], 80.00th=[ 9], 90.00th=[ 10], 95.00th=[ 10], 00:24:44.629 | 99.00th=[ 10], 99.50th=[ 15], 99.90th=[ 169], 99.95th=[ 169], 00:24:44.629 | 99.99th=[ 169] 00:24:44.629 bw ( KiB/s): min=18792, max=27736, per=99.88%, avg=25466.00, stdev=4449.59, samples=4 00:24:44.629 iops : min= 4698, max= 6934, avg=6366.50, stdev=1112.40, samples=4 00:24:44.629 lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01% 00:24:44.629 lat (msec) : 2=0.02%, 4=0.19%, 10=68.00%, 20=31.27%, 250=0.50% 00:24:44.629 cpu : usr=58.72%, sys=37.99%, ctx=100, majf=0, minf=5 00:24:44.629 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:24:44.629 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:44.629 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:44.629 issued rwts: total=12794,12793,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:44.629 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:44.629 00:24:44.629 Run status group 0 (all jobs): 00:24:44.629 READ: bw=24.9MiB/s (26.1MB/s), 24.9MiB/s-24.9MiB/s (26.1MB/s-26.1MB/s), io=50.0MiB (52.4MB), run=2007-2007msec 00:24:44.629 WRITE: bw=24.9MiB/s (26.1MB/s), 24.9MiB/s-24.9MiB/s (26.1MB/s-26.1MB/s), io=50.0MiB (52.4MB), run=2007-2007msec 00:24:44.629 09:03:32 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:24:44.895 09:03:33 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:24:45.829 09:03:34 -- host/fio.sh@64 -- # ls_nested_guid=cb020ca4-0840-4128-bc05-27bdfbd10f44 00:24:45.829 09:03:34 -- host/fio.sh@65 -- # get_lvs_free_mb cb020ca4-0840-4128-bc05-27bdfbd10f44 00:24:45.829 09:03:34 -- common/autotest_common.sh@1343 -- # local lvs_uuid=cb020ca4-0840-4128-bc05-27bdfbd10f44 00:24:45.829 09:03:34 -- common/autotest_common.sh@1344 -- # local lvs_info 00:24:45.829 09:03:34 -- common/autotest_common.sh@1345 -- # local fc 00:24:45.829 09:03:34 -- common/autotest_common.sh@1346 -- # local cs 00:24:45.829 09:03:34 -- common/autotest_common.sh@1347 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:24:46.086 09:03:34 -- common/autotest_common.sh@1347 -- # lvs_info='[ 00:24:46.086 { 00:24:46.086 "uuid": "3d134f95-54e4-4938-b68c-0bb374ee6f73", 00:24:46.086 "name": "lvs_0", 00:24:46.086 "base_bdev": "Nvme0n1", 00:24:46.086 "total_data_clusters": 930, 00:24:46.086 "free_clusters": 0, 00:24:46.086 "block_size": 512, 00:24:46.086 "cluster_size": 1073741824 00:24:46.086 }, 00:24:46.086 { 00:24:46.086 "uuid": "cb020ca4-0840-4128-bc05-27bdfbd10f44", 00:24:46.086 "name": "lvs_n_0", 00:24:46.086 "base_bdev": "606e2c94-cb60-400a-99e3-727bedadfe2d", 00:24:46.086 "total_data_clusters": 237847, 00:24:46.086 "free_clusters": 237847, 00:24:46.086 "block_size": 512, 00:24:46.086 "cluster_size": 4194304 00:24:46.086 } 00:24:46.086 ]' 00:24:46.086 09:03:34 -- common/autotest_common.sh@1348 -- # jq '.[] | select(.uuid=="cb020ca4-0840-4128-bc05-27bdfbd10f44") .free_clusters' 00:24:46.086 09:03:34 -- common/autotest_common.sh@1348 -- # fc=237847 00:24:46.086 09:03:34 -- common/autotest_common.sh@1349 -- # jq '.[] | select(.uuid=="cb020ca4-0840-4128-bc05-27bdfbd10f44") .cluster_size' 00:24:46.345 09:03:34 -- common/autotest_common.sh@1349 -- # cs=4194304 00:24:46.345 09:03:34 -- common/autotest_common.sh@1352 -- # free_mb=951388 00:24:46.345 09:03:34 -- common/autotest_common.sh@1353 -- # echo 951388 00:24:46.345 951388 00:24:46.345 09:03:34 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:24:46.910 fe494386-42c3-476e-87ad-276dff7ed1cc 00:24:46.910 09:03:35 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:24:47.167 09:03:35 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:24:47.424 09:03:35 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:24:47.682 09:03:36 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:47.682 09:03:36 -- common/autotest_common.sh@1339 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:47.682 09:03:36 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:24:47.682 09:03:36 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:24:47.682 09:03:36 -- common/autotest_common.sh@1318 -- # local sanitizers 00:24:47.682 09:03:36 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:47.682 09:03:36 -- common/autotest_common.sh@1320 -- # shift 00:24:47.682 09:03:36 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:24:47.682 09:03:36 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:24:47.682 09:03:36 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:47.682 09:03:36 -- common/autotest_common.sh@1324 -- # grep libasan 00:24:47.682 09:03:36 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:24:47.682 09:03:36 -- common/autotest_common.sh@1324 -- # asan_lib= 00:24:47.682 09:03:36 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:24:47.682 09:03:36 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:24:47.682 09:03:36 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:47.682 09:03:36 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:24:47.682 09:03:36 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:24:47.682 09:03:36 -- common/autotest_common.sh@1324 -- # asan_lib= 00:24:47.682 09:03:36 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:24:47.682 09:03:36 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:24:47.682 09:03:36 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:47.940 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:24:47.940 fio-3.35 00:24:47.940 Starting 1 thread 00:24:47.940 EAL: No free 2048 kB hugepages reported on node 1 00:24:50.532 00:24:50.532 test: (groupid=0, jobs=1): err= 0: pid=1593593: Mon Jul 15 09:03:38 2024 00:24:50.532 read: IOPS=6235, BW=24.4MiB/s (25.5MB/s)(48.9MiB/2008msec) 00:24:50.532 slat (usec): min=2, max=148, avg= 2.46, stdev= 1.97 00:24:50.532 clat (usec): min=4242, max=18199, avg=11384.43, stdev=942.05 00:24:50.532 lat (usec): min=4247, max=18201, avg=11386.90, stdev=941.97 00:24:50.532 clat percentiles (usec): 00:24:50.532 | 1.00th=[ 9241], 5.00th=[ 9896], 10.00th=[10290], 20.00th=[10683], 00:24:50.532 | 30.00th=[10945], 40.00th=[11207], 50.00th=[11338], 60.00th=[11600], 00:24:50.532 | 70.00th=[11863], 80.00th=[12125], 90.00th=[12518], 95.00th=[12911], 00:24:50.532 | 99.00th=[13566], 99.50th=[13698], 99.90th=[16319], 99.95th=[17171], 00:24:50.532 | 99.99th=[18220] 00:24:50.532 bw ( KiB/s): min=23744, max=25376, per=99.82%, avg=24896.00, stdev=774.33, samples=4 00:24:50.532 iops : min= 5936, max= 6344, avg=6224.00, stdev=193.58, samples=4 00:24:50.532 write: IOPS=6227, BW=24.3MiB/s (25.5MB/s)(48.8MiB/2008msec); 0 zone resets 00:24:50.532 slat (usec): min=2, max=144, avg= 2.57, stdev= 1.63 00:24:50.532 clat (usec): min=2132, max=16961, avg=9043.35, stdev=848.14 00:24:50.532 lat (usec): min=2138, max=16964, avg=9045.92, stdev=848.13 00:24:50.532 clat percentiles (usec): 00:24:50.532 | 1.00th=[ 7111], 5.00th=[ 7767], 10.00th=[ 8094], 20.00th=[ 8455], 00:24:50.532 | 30.00th=[ 8717], 40.00th=[ 8848], 50.00th=[ 9110], 60.00th=[ 9241], 00:24:50.532 | 70.00th=[ 9503], 80.00th=[ 9634], 90.00th=[10028], 95.00th=[10290], 00:24:50.532 | 99.00th=[10814], 99.50th=[11076], 99.90th=[15139], 99.95th=[16188], 00:24:50.532 | 99.99th=[16909] 00:24:50.532 bw ( KiB/s): min=24832, max=25024, per=99.96%, avg=24900.00, stdev=87.02, samples=4 00:24:50.532 iops : min= 6208, max= 6256, avg=6225.00, stdev=21.76, samples=4 00:24:50.532 lat (msec) : 4=0.04%, 10=47.94%, 20=52.02% 00:24:50.532 cpu : usr=59.94%, sys=36.72%, ctx=79, majf=0, minf=5 00:24:50.532 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:24:50.532 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:50.532 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:50.532 issued rwts: total=12520,12505,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:50.532 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:50.532 00:24:50.532 Run status group 0 (all jobs): 00:24:50.532 READ: bw=24.4MiB/s (25.5MB/s), 24.4MiB/s-24.4MiB/s (25.5MB/s-25.5MB/s), io=48.9MiB (51.3MB), run=2008-2008msec 00:24:50.532 WRITE: bw=24.3MiB/s (25.5MB/s), 24.3MiB/s-24.3MiB/s (25.5MB/s-25.5MB/s), io=48.8MiB (51.2MB), run=2008-2008msec 00:24:50.532 09:03:38 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:24:50.532 09:03:38 -- host/fio.sh@74 -- # sync 00:24:50.532 09:03:38 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_n_0/lbd_nest_0 00:24:54.725 09:03:42 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:24:54.725 09:03:42 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:24:57.254 09:03:45 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:24:57.511 09:03:46 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:24:59.414 09:03:47 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:24:59.414 09:03:47 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:24:59.414 09:03:47 -- host/fio.sh@86 -- # nvmftestfini 00:24:59.414 09:03:47 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:59.414 09:03:47 -- nvmf/common.sh@116 -- # sync 00:24:59.414 09:03:47 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:59.414 09:03:47 -- nvmf/common.sh@119 -- # set +e 00:24:59.414 09:03:47 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:59.414 09:03:47 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:59.414 rmmod nvme_tcp 00:24:59.414 rmmod nvme_fabrics 00:24:59.674 rmmod nvme_keyring 00:24:59.674 09:03:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:59.674 09:03:47 -- nvmf/common.sh@123 -- # set -e 00:24:59.674 09:03:47 -- nvmf/common.sh@124 -- # return 0 00:24:59.674 09:03:47 -- nvmf/common.sh@477 -- # '[' -n 1590682 ']' 00:24:59.674 09:03:47 -- nvmf/common.sh@478 -- # killprocess 1590682 00:24:59.674 09:03:47 -- common/autotest_common.sh@926 -- # '[' -z 1590682 ']' 00:24:59.674 09:03:47 -- common/autotest_common.sh@930 -- # kill -0 1590682 00:24:59.674 09:03:47 -- common/autotest_common.sh@931 -- # uname 00:24:59.674 09:03:47 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:24:59.674 09:03:47 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1590682 00:24:59.674 09:03:48 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:24:59.674 09:03:48 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:24:59.674 09:03:48 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1590682' 00:24:59.674 killing process with pid 1590682 00:24:59.674 09:03:48 -- common/autotest_common.sh@945 -- # kill 1590682 00:24:59.674 09:03:48 -- common/autotest_common.sh@950 -- # wait 1590682 00:24:59.933 09:03:48 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:59.933 09:03:48 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:59.933 09:03:48 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:59.933 09:03:48 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:59.933 09:03:48 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:59.933 09:03:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:59.933 09:03:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:59.933 09:03:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:01.840 09:03:50 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:01.840 00:25:01.840 real 0m37.499s 00:25:01.840 user 2m23.176s 00:25:01.840 sys 0m7.065s 00:25:01.840 09:03:50 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:25:01.840 09:03:50 -- common/autotest_common.sh@10 -- # set +x 00:25:01.840 ************************************ 00:25:01.840 END TEST nvmf_fio_host 00:25:01.840 ************************************ 00:25:02.098 09:03:50 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:25:02.098 09:03:50 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:25:02.098 09:03:50 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:25:02.098 09:03:50 -- common/autotest_common.sh@10 -- # set +x 00:25:02.098 ************************************ 00:25:02.098 START TEST nvmf_failover 00:25:02.098 ************************************ 00:25:02.098 09:03:50 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:25:02.098 * Looking for test storage... 00:25:02.098 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:02.098 09:03:50 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:02.098 09:03:50 -- nvmf/common.sh@7 -- # uname -s 00:25:02.098 09:03:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:02.098 09:03:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:02.098 09:03:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:02.098 09:03:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:02.098 09:03:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:02.098 09:03:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:02.098 09:03:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:02.098 09:03:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:02.098 09:03:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:02.098 09:03:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:02.098 09:03:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:02.098 09:03:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:02.098 09:03:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:02.098 09:03:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:02.098 09:03:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:02.098 09:03:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:02.098 09:03:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:02.098 09:03:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:02.098 09:03:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:02.098 09:03:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:02.098 09:03:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:02.098 09:03:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:02.098 09:03:50 -- paths/export.sh@5 -- # export PATH 00:25:02.098 09:03:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:02.098 09:03:50 -- nvmf/common.sh@46 -- # : 0 00:25:02.098 09:03:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:02.098 09:03:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:02.098 09:03:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:02.098 09:03:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:02.098 09:03:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:02.098 09:03:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:02.098 09:03:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:02.098 09:03:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:02.098 09:03:50 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:02.098 09:03:50 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:02.098 09:03:50 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:25:02.098 09:03:50 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:25:02.098 09:03:50 -- host/failover.sh@18 -- # nvmftestinit 00:25:02.098 09:03:50 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:02.098 09:03:50 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:02.098 09:03:50 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:02.098 09:03:50 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:02.098 09:03:50 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:02.098 09:03:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:02.098 09:03:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:02.098 09:03:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:02.098 09:03:50 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:02.098 09:03:50 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:02.098 09:03:50 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:02.098 09:03:50 -- common/autotest_common.sh@10 -- # set +x 00:25:03.999 09:03:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:03.999 09:03:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:03.999 09:03:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:03.999 09:03:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:03.999 09:03:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:03.999 09:03:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:03.999 09:03:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:03.999 09:03:52 -- nvmf/common.sh@294 -- # net_devs=() 00:25:03.999 09:03:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:03.999 09:03:52 -- nvmf/common.sh@295 -- # e810=() 00:25:03.999 09:03:52 -- nvmf/common.sh@295 -- # local -ga e810 00:25:03.999 09:03:52 -- nvmf/common.sh@296 -- # x722=() 00:25:03.999 09:03:52 -- nvmf/common.sh@296 -- # local -ga x722 00:25:03.999 09:03:52 -- nvmf/common.sh@297 -- # mlx=() 00:25:03.999 09:03:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:03.999 09:03:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:03.999 09:03:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:03.999 09:03:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:03.999 09:03:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:03.999 09:03:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:03.999 09:03:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:03.999 09:03:52 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:03.999 09:03:52 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:03.999 09:03:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:03.999 09:03:52 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:03.999 09:03:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:03.999 09:03:52 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:03.999 09:03:52 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:03.999 09:03:52 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:03.999 09:03:52 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:03.999 09:03:52 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:03.999 09:03:52 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:03.999 09:03:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:03.999 09:03:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:03.999 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:03.999 09:03:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:03.999 09:03:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:03.999 09:03:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:03.999 09:03:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:03.999 09:03:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:03.999 09:03:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:03.999 09:03:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:03.999 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:03.999 09:03:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:03.999 09:03:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:03.999 09:03:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:03.999 09:03:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:03.999 09:03:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:03.999 09:03:52 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:03.999 09:03:52 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:03.999 09:03:52 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:03.999 09:03:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:03.999 09:03:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:03.999 09:03:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:03.999 09:03:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:03.999 09:03:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:03.999 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:03.999 09:03:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:03.999 09:03:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:03.999 09:03:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:03.999 09:03:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:03.999 09:03:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:03.999 09:03:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:03.999 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:03.999 09:03:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:03.999 09:03:52 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:03.999 09:03:52 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:03.999 09:03:52 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:03.999 09:03:52 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:03.999 09:03:52 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:03.999 09:03:52 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:03.999 09:03:52 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:03.999 09:03:52 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:03.999 09:03:52 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:03.999 09:03:52 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:03.999 09:03:52 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:03.999 09:03:52 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:03.999 09:03:52 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:03.999 09:03:52 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:03.999 09:03:52 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:03.999 09:03:52 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:03.999 09:03:52 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:03.999 09:03:52 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:03.999 09:03:52 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:03.999 09:03:52 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:03.999 09:03:52 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:03.999 09:03:52 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:03.999 09:03:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:03.999 09:03:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:03.999 09:03:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:03.999 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:03.999 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.204 ms 00:25:03.999 00:25:03.999 --- 10.0.0.2 ping statistics --- 00:25:03.999 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:03.999 rtt min/avg/max/mdev = 0.204/0.204/0.204/0.000 ms 00:25:03.999 09:03:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:03.999 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:03.999 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.183 ms 00:25:03.999 00:25:03.999 --- 10.0.0.1 ping statistics --- 00:25:03.999 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:03.999 rtt min/avg/max/mdev = 0.183/0.183/0.183/0.000 ms 00:25:03.999 09:03:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:03.999 09:03:52 -- nvmf/common.sh@410 -- # return 0 00:25:03.999 09:03:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:03.999 09:03:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:03.999 09:03:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:03.999 09:03:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:03.999 09:03:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:03.999 09:03:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:03.999 09:03:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:03.999 09:03:52 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:25:03.999 09:03:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:03.999 09:03:52 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:03.999 09:03:52 -- common/autotest_common.sh@10 -- # set +x 00:25:03.999 09:03:52 -- nvmf/common.sh@469 -- # nvmfpid=1596890 00:25:03.999 09:03:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:25:03.999 09:03:52 -- nvmf/common.sh@470 -- # waitforlisten 1596890 00:25:03.999 09:03:52 -- common/autotest_common.sh@819 -- # '[' -z 1596890 ']' 00:25:03.999 09:03:52 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:03.999 09:03:52 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:03.999 09:03:52 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:03.999 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:03.999 09:03:52 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:03.999 09:03:52 -- common/autotest_common.sh@10 -- # set +x 00:25:03.999 [2024-07-15 09:03:52.493234] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:25:03.999 [2024-07-15 09:03:52.493305] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:03.999 EAL: No free 2048 kB hugepages reported on node 1 00:25:04.258 [2024-07-15 09:03:52.559207] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:25:04.258 [2024-07-15 09:03:52.674235] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:04.258 [2024-07-15 09:03:52.674383] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:04.258 [2024-07-15 09:03:52.674401] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:04.258 [2024-07-15 09:03:52.674414] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:04.258 [2024-07-15 09:03:52.674475] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:04.258 [2024-07-15 09:03:52.674511] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:04.258 [2024-07-15 09:03:52.674514] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:05.193 09:03:53 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:05.193 09:03:53 -- common/autotest_common.sh@852 -- # return 0 00:25:05.193 09:03:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:05.193 09:03:53 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:05.193 09:03:53 -- common/autotest_common.sh@10 -- # set +x 00:25:05.193 09:03:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:05.193 09:03:53 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:25:05.451 [2024-07-15 09:03:53.777256] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:05.451 09:03:53 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:25:05.709 Malloc0 00:25:05.709 09:03:54 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:05.967 09:03:54 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:06.225 09:03:54 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:06.225 [2024-07-15 09:03:54.732352] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:06.225 09:03:54 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:06.482 [2024-07-15 09:03:54.985099] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:06.482 09:03:55 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:06.745 [2024-07-15 09:03:55.217938] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:25:06.745 09:03:55 -- host/failover.sh@31 -- # bdevperf_pid=1597319 00:25:06.745 09:03:55 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:25:06.745 09:03:55 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:06.745 09:03:55 -- host/failover.sh@34 -- # waitforlisten 1597319 /var/tmp/bdevperf.sock 00:25:06.745 09:03:55 -- common/autotest_common.sh@819 -- # '[' -z 1597319 ']' 00:25:06.745 09:03:55 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:06.745 09:03:55 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:06.746 09:03:55 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:06.746 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:06.746 09:03:55 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:06.746 09:03:55 -- common/autotest_common.sh@10 -- # set +x 00:25:07.708 09:03:56 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:07.708 09:03:56 -- common/autotest_common.sh@852 -- # return 0 00:25:07.708 09:03:56 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:07.964 NVMe0n1 00:25:07.964 09:03:56 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:08.531 00:25:08.531 09:03:56 -- host/failover.sh@39 -- # run_test_pid=1597471 00:25:08.531 09:03:56 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:08.531 09:03:56 -- host/failover.sh@41 -- # sleep 1 00:25:09.466 09:03:57 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:09.725 [2024-07-15 09:03:58.053420] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4370 is same with the state(5) to be set 00:25:09.725 [2024-07-15 09:03:58.053512] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4370 is same with the state(5) to be set 00:25:09.725 [2024-07-15 09:03:58.053536] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4370 is same with the state(5) to be set 00:25:09.725 [2024-07-15 09:03:58.053548] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4370 is same with the state(5) to be set 00:25:09.725 [2024-07-15 09:03:58.053560] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4370 is same with the state(5) to be set 00:25:09.725 [2024-07-15 09:03:58.053571] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4370 is same with the state(5) to be set 00:25:09.725 [2024-07-15 09:03:58.053583] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4370 is same with the state(5) to be set 00:25:09.725 [2024-07-15 09:03:58.053595] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4370 is same with the state(5) to be set 00:25:09.725 [2024-07-15 09:03:58.053606] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4370 is same with the state(5) to be set 00:25:09.725 [2024-07-15 09:03:58.053828] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4370 is same with the state(5) to be set 00:25:09.725 [2024-07-15 09:03:58.053843] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4370 is same with the state(5) to be set 00:25:09.725 [2024-07-15 09:03:58.053854] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4370 is same with the state(5) to be set 00:25:09.725 [2024-07-15 09:03:58.053891] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4370 is same with the state(5) to be set 00:25:09.725 [2024-07-15 09:03:58.053903] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4370 is same with the state(5) to be set 00:25:09.725 [2024-07-15 09:03:58.053914] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4370 is same with the state(5) to be set 00:25:09.725 [2024-07-15 09:03:58.053926] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4370 is same with the state(5) to be set 00:25:09.725 [2024-07-15 09:03:58.053937] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4370 is same with the state(5) to be set 00:25:09.725 [2024-07-15 09:03:58.053948] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4370 is same with the state(5) to be set 00:25:09.725 [2024-07-15 09:03:58.053960] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4370 is same with the state(5) to be set 00:25:09.725 [2024-07-15 09:03:58.053971] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4370 is same with the state(5) to be set 00:25:09.725 [2024-07-15 09:03:58.053982] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4370 is same with the state(5) to be set 00:25:09.725 [2024-07-15 09:03:58.053993] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4370 is same with the state(5) to be set 00:25:09.725 [2024-07-15 09:03:58.054005] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4370 is same with the state(5) to be set 00:25:09.725 [2024-07-15 09:03:58.054016] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4370 is same with the state(5) to be set 00:25:09.725 [2024-07-15 09:03:58.054028] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4370 is same with the state(5) to be set 00:25:09.725 [2024-07-15 09:03:58.054039] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4370 is same with the state(5) to be set 00:25:09.725 [2024-07-15 09:03:58.054050] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4370 is same with the state(5) to be set 00:25:09.725 [2024-07-15 09:03:58.054062] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4370 is same with the state(5) to be set 00:25:09.725 [2024-07-15 09:03:58.054074] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4370 is same with the state(5) to be set 00:25:09.725 [2024-07-15 09:03:58.054085] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4370 is same with the state(5) to be set 00:25:09.725 [2024-07-15 09:03:58.054097] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4370 is same with the state(5) to be set 00:25:09.725 [2024-07-15 09:03:58.054108] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4370 is same with the state(5) to be set 00:25:09.725 [2024-07-15 09:03:58.054119] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4370 is same with the state(5) to be set 00:25:09.725 [2024-07-15 09:03:58.054131] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4370 is same with the state(5) to be set 00:25:09.725 [2024-07-15 09:03:58.054142] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4370 is same with the state(5) to be set 00:25:09.725 [2024-07-15 09:03:58.054154] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4370 is same with the state(5) to be set 00:25:09.725 [2024-07-15 09:03:58.054185] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4370 is same with the state(5) to be set 00:25:09.725 [2024-07-15 09:03:58.054197] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4370 is same with the state(5) to be set 00:25:09.725 [2024-07-15 09:03:58.054209] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4370 is same with the state(5) to be set 00:25:09.725 [2024-07-15 09:03:58.054221] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4370 is same with the state(5) to be set 00:25:09.725 [2024-07-15 09:03:58.054232] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4370 is same with the state(5) to be set 00:25:09.725 [2024-07-15 09:03:58.054244] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4370 is same with the state(5) to be set 00:25:09.725 09:03:58 -- host/failover.sh@45 -- # sleep 3 00:25:13.015 09:04:01 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:13.015 00:25:13.015 09:04:01 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:13.273 [2024-07-15 09:04:01.779897] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4b80 is same with the state(5) to be set 00:25:13.273 [2024-07-15 09:04:01.779961] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4b80 is same with the state(5) to be set 00:25:13.273 [2024-07-15 09:04:01.779977] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4b80 is same with the state(5) to be set 00:25:13.273 [2024-07-15 09:04:01.779990] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4b80 is same with the state(5) to be set 00:25:13.273 [2024-07-15 09:04:01.780002] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4b80 is same with the state(5) to be set 00:25:13.273 [2024-07-15 09:04:01.780014] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4b80 is same with the state(5) to be set 00:25:13.273 [2024-07-15 09:04:01.780027] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4b80 is same with the state(5) to be set 00:25:13.273 [2024-07-15 09:04:01.780039] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4b80 is same with the state(5) to be set 00:25:13.273 [2024-07-15 09:04:01.780051] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4b80 is same with the state(5) to be set 00:25:13.273 [2024-07-15 09:04:01.780062] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4b80 is same with the state(5) to be set 00:25:13.273 [2024-07-15 09:04:01.780075] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4b80 is same with the state(5) to be set 00:25:13.273 [2024-07-15 09:04:01.780088] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4b80 is same with the state(5) to be set 00:25:13.273 [2024-07-15 09:04:01.780100] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4b80 is same with the state(5) to be set 00:25:13.273 [2024-07-15 09:04:01.780113] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4b80 is same with the state(5) to be set 00:25:13.273 [2024-07-15 09:04:01.780126] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4b80 is same with the state(5) to be set 00:25:13.273 [2024-07-15 09:04:01.780138] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4b80 is same with the state(5) to be set 00:25:13.273 [2024-07-15 09:04:01.780149] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4b80 is same with the state(5) to be set 00:25:13.273 [2024-07-15 09:04:01.780172] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4b80 is same with the state(5) to be set 00:25:13.273 [2024-07-15 09:04:01.780197] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4b80 is same with the state(5) to be set 00:25:13.273 [2024-07-15 09:04:01.780237] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4b80 is same with the state(5) to be set 00:25:13.273 [2024-07-15 09:04:01.780249] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4b80 is same with the state(5) to be set 00:25:13.273 [2024-07-15 09:04:01.780262] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4b80 is same with the state(5) to be set 00:25:13.273 [2024-07-15 09:04:01.780290] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19d4b80 is same with the state(5) to be set 00:25:13.273 09:04:01 -- host/failover.sh@50 -- # sleep 3 00:25:16.562 09:04:04 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:16.562 [2024-07-15 09:04:05.036813] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:16.562 09:04:05 -- host/failover.sh@55 -- # sleep 1 00:25:17.941 09:04:06 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:17.941 [2024-07-15 09:04:06.329403] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.329439] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.329454] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.329466] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.329478] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.329490] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.329502] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.329514] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.329526] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.329538] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.329549] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.329562] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.329574] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.329585] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.329597] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.329609] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.329621] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.329632] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.329650] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.329664] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.329676] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.329688] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.329701] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.329713] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.329726] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.329739] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.329752] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.329764] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.329777] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.329789] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.329801] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.329813] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.329825] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.329836] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.329871] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.329892] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.329903] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.329931] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.329943] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.329954] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.329966] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.329978] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.329989] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.330001] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.330013] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.330029] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.330041] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.330053] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.330064] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.330076] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 [2024-07-15 09:04:06.330088] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x177f2f0 is same with the state(5) to be set 00:25:17.941 09:04:06 -- host/failover.sh@59 -- # wait 1597471 00:25:24.502 0 00:25:24.502 09:04:11 -- host/failover.sh@61 -- # killprocess 1597319 00:25:24.502 09:04:11 -- common/autotest_common.sh@926 -- # '[' -z 1597319 ']' 00:25:24.502 09:04:11 -- common/autotest_common.sh@930 -- # kill -0 1597319 00:25:24.502 09:04:11 -- common/autotest_common.sh@931 -- # uname 00:25:24.502 09:04:11 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:24.503 09:04:11 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1597319 00:25:24.503 09:04:12 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:25:24.503 09:04:12 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:25:24.503 09:04:12 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1597319' 00:25:24.503 killing process with pid 1597319 00:25:24.503 09:04:12 -- common/autotest_common.sh@945 -- # kill 1597319 00:25:24.503 09:04:12 -- common/autotest_common.sh@950 -- # wait 1597319 00:25:24.503 09:04:12 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:24.503 [2024-07-15 09:03:55.276675] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:25:24.503 [2024-07-15 09:03:55.276749] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1597319 ] 00:25:24.503 EAL: No free 2048 kB hugepages reported on node 1 00:25:24.503 [2024-07-15 09:03:55.336674] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:24.503 [2024-07-15 09:03:55.442760] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:24.503 Running I/O for 15 seconds... 00:25:24.503 [2024-07-15 09:03:58.054540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:104616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.503 [2024-07-15 09:03:58.054581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.503 [2024-07-15 09:03:58.054610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:104680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.503 [2024-07-15 09:03:58.054626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.503 [2024-07-15 09:03:58.054643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:104712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.503 [2024-07-15 09:03:58.054656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.503 [2024-07-15 09:03:58.054672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:104720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.503 [2024-07-15 09:03:58.054686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.503 [2024-07-15 09:03:58.054701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:104728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.503 [2024-07-15 09:03:58.054714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.503 [2024-07-15 09:03:58.054729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:104736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.503 [2024-07-15 09:03:58.054743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.503 [2024-07-15 09:03:58.054758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:104776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.503 [2024-07-15 09:03:58.054771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.503 [2024-07-15 09:03:58.054786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:104784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.503 [2024-07-15 09:03:58.054799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.503 [2024-07-15 09:03:58.054814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:105192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.503 [2024-07-15 09:03:58.054828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.503 [2024-07-15 09:03:58.054842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:105200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.503 [2024-07-15 09:03:58.054855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.503 [2024-07-15 09:03:58.054895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:105208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.503 [2024-07-15 09:03:58.054910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.503 [2024-07-15 09:03:58.054933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:105216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.503 [2024-07-15 09:03:58.054948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.503 [2024-07-15 09:03:58.054964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:105232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.503 [2024-07-15 09:03:58.054977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.503 [2024-07-15 09:03:58.054993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:105240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.503 [2024-07-15 09:03:58.055007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.503 [2024-07-15 09:03:58.055036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:105264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.503 [2024-07-15 09:03:58.055050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.503 [2024-07-15 09:03:58.055065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:105280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.503 [2024-07-15 09:03:58.055078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.503 [2024-07-15 09:03:58.055093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:104792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.503 [2024-07-15 09:03:58.055106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.503 [2024-07-15 09:03:58.055122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:104800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.503 [2024-07-15 09:03:58.055136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.503 [2024-07-15 09:03:58.055151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:104824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.503 [2024-07-15 09:03:58.055165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.503 [2024-07-15 09:03:58.055195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:104832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.503 [2024-07-15 09:03:58.055210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.503 [2024-07-15 09:03:58.055225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:104856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.503 [2024-07-15 09:03:58.055238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.503 [2024-07-15 09:03:58.055253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:104888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.503 [2024-07-15 09:03:58.055265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.503 [2024-07-15 09:03:58.055279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:104896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.503 [2024-07-15 09:03:58.055291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.503 [2024-07-15 09:03:58.055306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:104936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.503 [2024-07-15 09:03:58.055322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.503 [2024-07-15 09:03:58.055337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:105328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.503 [2024-07-15 09:03:58.055350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.503 [2024-07-15 09:03:58.055364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:105344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.503 [2024-07-15 09:03:58.055377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.503 [2024-07-15 09:03:58.055391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:105360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.503 [2024-07-15 09:03:58.055404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.503 [2024-07-15 09:03:58.055418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:105376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.503 [2024-07-15 09:03:58.055430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.503 [2024-07-15 09:03:58.055444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:105384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.503 [2024-07-15 09:03:58.055457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.503 [2024-07-15 09:03:58.055471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:105400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.503 [2024-07-15 09:03:58.055484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.503 [2024-07-15 09:03:58.055498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:105416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.503 [2024-07-15 09:03:58.055511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.503 [2024-07-15 09:03:58.055525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:105424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.503 [2024-07-15 09:03:58.055553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.503 [2024-07-15 09:03:58.055568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:105432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.503 [2024-07-15 09:03:58.055581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.503 [2024-07-15 09:03:58.055596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:105440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.503 [2024-07-15 09:03:58.055610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.503 [2024-07-15 09:03:58.055624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:105448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.504 [2024-07-15 09:03:58.055637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.504 [2024-07-15 09:03:58.055652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:105456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.504 [2024-07-15 09:03:58.055665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.504 [2024-07-15 09:03:58.055683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:105464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.504 [2024-07-15 09:03:58.055697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.504 [2024-07-15 09:03:58.055712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:105472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.504 [2024-07-15 09:03:58.055725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.504 [2024-07-15 09:03:58.055739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:105480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.504 [2024-07-15 09:03:58.055752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.504 [2024-07-15 09:03:58.055767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:105488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.504 [2024-07-15 09:03:58.055780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.504 [2024-07-15 09:03:58.055802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:105496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.504 [2024-07-15 09:03:58.055827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.504 [2024-07-15 09:03:58.055847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:105504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.504 [2024-07-15 09:03:58.055860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.504 [2024-07-15 09:03:58.055883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:105512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.504 [2024-07-15 09:03:58.055915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.504 [2024-07-15 09:03:58.055931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:105520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.504 [2024-07-15 09:03:58.055945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.504 [2024-07-15 09:03:58.055960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:105528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.504 [2024-07-15 09:03:58.055974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.504 [2024-07-15 09:03:58.055989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:105536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.504 [2024-07-15 09:03:58.056003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.504 [2024-07-15 09:03:58.056018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:105544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.504 [2024-07-15 09:03:58.056031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.504 [2024-07-15 09:03:58.056046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:105552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.504 [2024-07-15 09:03:58.056061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.504 [2024-07-15 09:03:58.056076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:104952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.504 [2024-07-15 09:03:58.056094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.504 [2024-07-15 09:03:58.056111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:104976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.504 [2024-07-15 09:03:58.056125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.504 [2024-07-15 09:03:58.056141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:104984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.504 [2024-07-15 09:03:58.056154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.504 [2024-07-15 09:03:58.056170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:105008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.504 [2024-07-15 09:03:58.056184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.504 [2024-07-15 09:03:58.056214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:105040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.504 [2024-07-15 09:03:58.056228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.504 [2024-07-15 09:03:58.056242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:105064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.504 [2024-07-15 09:03:58.056255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.504 [2024-07-15 09:03:58.056270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:105112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.504 [2024-07-15 09:03:58.056283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.504 [2024-07-15 09:03:58.056298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:105120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.504 [2024-07-15 09:03:58.056311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.504 [2024-07-15 09:03:58.056325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:105560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.504 [2024-07-15 09:03:58.056338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.504 [2024-07-15 09:03:58.056353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:105568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.504 [2024-07-15 09:03:58.056366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.504 [2024-07-15 09:03:58.056381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:105576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.504 [2024-07-15 09:03:58.056394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.504 [2024-07-15 09:03:58.056409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:105584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.504 [2024-07-15 09:03:58.056422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.504 [2024-07-15 09:03:58.056436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:105592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.504 [2024-07-15 09:03:58.056449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.504 [2024-07-15 09:03:58.056467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:105600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.504 [2024-07-15 09:03:58.056481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.504 [2024-07-15 09:03:58.056495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:105608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.504 [2024-07-15 09:03:58.056508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.504 [2024-07-15 09:03:58.056522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:105616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.504 [2024-07-15 09:03:58.056535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.504 [2024-07-15 09:03:58.056550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:105624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.504 [2024-07-15 09:03:58.056563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.504 [2024-07-15 09:03:58.056577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:105632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.504 [2024-07-15 09:03:58.056591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.504 [2024-07-15 09:03:58.056605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:105640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.504 [2024-07-15 09:03:58.056618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.504 [2024-07-15 09:03:58.056633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:105648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.504 [2024-07-15 09:03:58.056645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.504 [2024-07-15 09:03:58.056660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:105656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.504 [2024-07-15 09:03:58.056673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.504 [2024-07-15 09:03:58.056687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:105664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.504 [2024-07-15 09:03:58.056700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.504 [2024-07-15 09:03:58.056714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:105672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.504 [2024-07-15 09:03:58.056727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.504 [2024-07-15 09:03:58.056742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:105680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.504 [2024-07-15 09:03:58.056755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.504 [2024-07-15 09:03:58.056770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:105688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.504 [2024-07-15 09:03:58.056789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.504 [2024-07-15 09:03:58.056804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:105696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.504 [2024-07-15 09:03:58.056824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.504 [2024-07-15 09:03:58.056841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:105704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.504 [2024-07-15 09:03:58.056854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.504 [2024-07-15 09:03:58.056869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:105712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.505 [2024-07-15 09:03:58.056904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.505 [2024-07-15 09:03:58.056922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:105720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.505 [2024-07-15 09:03:58.056936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.505 [2024-07-15 09:03:58.056952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:105728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.505 [2024-07-15 09:03:58.056966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.505 [2024-07-15 09:03:58.056981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:105736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.505 [2024-07-15 09:03:58.056995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.505 [2024-07-15 09:03:58.057010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:105744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.505 [2024-07-15 09:03:58.057024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.505 [2024-07-15 09:03:58.057039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:105752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.505 [2024-07-15 09:03:58.057052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.505 [2024-07-15 09:03:58.057068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:105760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.505 [2024-07-15 09:03:58.057081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.505 [2024-07-15 09:03:58.057096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:105768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.505 [2024-07-15 09:03:58.057110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.505 [2024-07-15 09:03:58.057125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:105776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.505 [2024-07-15 09:03:58.057139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.505 [2024-07-15 09:03:58.057163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:105784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.505 [2024-07-15 09:03:58.057177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.505 [2024-07-15 09:03:58.057207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:105792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.505 [2024-07-15 09:03:58.057220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.505 [2024-07-15 09:03:58.057235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:105800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.505 [2024-07-15 09:03:58.057252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.505 [2024-07-15 09:03:58.057267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:105808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.505 [2024-07-15 09:03:58.057281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.505 [2024-07-15 09:03:58.057296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:105816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.505 [2024-07-15 09:03:58.057314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.505 [2024-07-15 09:03:58.057329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:105824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.505 [2024-07-15 09:03:58.057342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.505 [2024-07-15 09:03:58.057357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:105832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.505 [2024-07-15 09:03:58.057370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.505 [2024-07-15 09:03:58.057384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:105840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.505 [2024-07-15 09:03:58.057398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.505 [2024-07-15 09:03:58.057424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:105848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.505 [2024-07-15 09:03:58.057446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.505 [2024-07-15 09:03:58.057463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:105856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.505 [2024-07-15 09:03:58.057477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.505 [2024-07-15 09:03:58.057492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:105864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.505 [2024-07-15 09:03:58.057505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.505 [2024-07-15 09:03:58.057520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:105872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.505 [2024-07-15 09:03:58.057533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.505 [2024-07-15 09:03:58.057547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:105880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.505 [2024-07-15 09:03:58.057561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.505 [2024-07-15 09:03:58.057575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:105888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.505 [2024-07-15 09:03:58.057588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.505 [2024-07-15 09:03:58.057603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:105896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.505 [2024-07-15 09:03:58.057616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.505 [2024-07-15 09:03:58.057634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:105904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.505 [2024-07-15 09:03:58.057649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.505 [2024-07-15 09:03:58.057663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:105912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.505 [2024-07-15 09:03:58.057676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.505 [2024-07-15 09:03:58.057691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:105920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.505 [2024-07-15 09:03:58.057705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.505 [2024-07-15 09:03:58.057719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:105928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.505 [2024-07-15 09:03:58.057732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.505 [2024-07-15 09:03:58.057746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:105936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.505 [2024-07-15 09:03:58.057760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.505 [2024-07-15 09:03:58.057774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:105944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.505 [2024-07-15 09:03:58.057792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.505 [2024-07-15 09:03:58.057808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:105952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.505 [2024-07-15 09:03:58.057821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.505 [2024-07-15 09:03:58.057836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:105960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.505 [2024-07-15 09:03:58.057849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.505 [2024-07-15 09:03:58.057863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:105136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.505 [2024-07-15 09:03:58.057882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.505 [2024-07-15 09:03:58.057917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:105160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.505 [2024-07-15 09:03:58.057931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.505 [2024-07-15 09:03:58.057946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:105224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.505 [2024-07-15 09:03:58.057960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.505 [2024-07-15 09:03:58.057975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:105248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.505 [2024-07-15 09:03:58.057988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.505 [2024-07-15 09:03:58.058004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:105256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.505 [2024-07-15 09:03:58.058021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.505 [2024-07-15 09:03:58.058037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:105272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.505 [2024-07-15 09:03:58.058051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.506 [2024-07-15 09:03:58.058067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:105288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.506 [2024-07-15 09:03:58.058081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.506 [2024-07-15 09:03:58.058096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:105296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.506 [2024-07-15 09:03:58.058110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.506 [2024-07-15 09:03:58.058126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:105968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.506 [2024-07-15 09:03:58.058140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.506 [2024-07-15 09:03:58.058155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:105976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.506 [2024-07-15 09:03:58.058169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.506 [2024-07-15 09:03:58.058184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:105984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.506 [2024-07-15 09:03:58.058213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.506 [2024-07-15 09:03:58.058228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:105992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.506 [2024-07-15 09:03:58.058242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.506 [2024-07-15 09:03:58.058257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:106000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.506 [2024-07-15 09:03:58.058270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.506 [2024-07-15 09:03:58.058285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:105304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.506 [2024-07-15 09:03:58.058299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.506 [2024-07-15 09:03:58.058314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:105312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.506 [2024-07-15 09:03:58.058327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.506 [2024-07-15 09:03:58.058342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:105320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.506 [2024-07-15 09:03:58.058355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.506 [2024-07-15 09:03:58.058370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:105336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.506 [2024-07-15 09:03:58.058382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.506 [2024-07-15 09:03:58.058401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:105352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.506 [2024-07-15 09:03:58.058415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.506 [2024-07-15 09:03:58.058429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:105368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.506 [2024-07-15 09:03:58.058442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.506 [2024-07-15 09:03:58.058457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:105392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.506 [2024-07-15 09:03:58.058470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.506 [2024-07-15 09:03:58.058484] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667600 is same with the state(5) to be set 00:25:24.506 [2024-07-15 09:03:58.058500] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:24.506 [2024-07-15 09:03:58.058512] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:24.506 [2024-07-15 09:03:58.058523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:105408 len:8 PRP1 0x0 PRP2 0x0 00:25:24.506 [2024-07-15 09:03:58.058536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.506 [2024-07-15 09:03:58.058592] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x667600 was disconnected and freed. reset controller. 00:25:24.506 [2024-07-15 09:03:58.058618] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:25:24.506 [2024-07-15 09:03:58.058668] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:24.506 [2024-07-15 09:03:58.058687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.506 [2024-07-15 09:03:58.058702] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:24.506 [2024-07-15 09:03:58.058716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.506 [2024-07-15 09:03:58.058729] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:24.506 [2024-07-15 09:03:58.058742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.506 [2024-07-15 09:03:58.058755] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:24.506 [2024-07-15 09:03:58.058768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.506 [2024-07-15 09:03:58.058782] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:24.506 [2024-07-15 09:03:58.058833] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x648bd0 (9): Bad file descriptor 00:25:24.506 [2024-07-15 09:03:58.061026] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:24.506 [2024-07-15 09:03:58.089300] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:24.506 [2024-07-15 09:04:01.780457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:100000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.506 [2024-07-15 09:04:01.780500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.506 [2024-07-15 09:04:01.780537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:100008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.506 [2024-07-15 09:04:01.780554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.506 [2024-07-15 09:04:01.780570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:100016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.506 [2024-07-15 09:04:01.780585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.506 [2024-07-15 09:04:01.780600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:100024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.506 [2024-07-15 09:04:01.780614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.506 [2024-07-15 09:04:01.780630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:100032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.506 [2024-07-15 09:04:01.780643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.506 [2024-07-15 09:04:01.780658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:100040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.506 [2024-07-15 09:04:01.780672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.506 [2024-07-15 09:04:01.780703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:100072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.506 [2024-07-15 09:04:01.780717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.506 [2024-07-15 09:04:01.780731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:100096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.506 [2024-07-15 09:04:01.780759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.506 [2024-07-15 09:04:01.780774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:100672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.506 [2024-07-15 09:04:01.780787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.506 [2024-07-15 09:04:01.780802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:100688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.506 [2024-07-15 09:04:01.780814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.506 [2024-07-15 09:04:01.780828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:100696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.506 [2024-07-15 09:04:01.780841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.506 [2024-07-15 09:04:01.780855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:100104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.506 [2024-07-15 09:04:01.780873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.506 [2024-07-15 09:04:01.780913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:100128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.506 [2024-07-15 09:04:01.780927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.506 [2024-07-15 09:04:01.780941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:100136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.506 [2024-07-15 09:04:01.780962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.506 [2024-07-15 09:04:01.780978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:100184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.506 [2024-07-15 09:04:01.780991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.506 [2024-07-15 09:04:01.781006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:100200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.506 [2024-07-15 09:04:01.781018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.506 [2024-07-15 09:04:01.781033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:100216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.506 [2024-07-15 09:04:01.781046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.506 [2024-07-15 09:04:01.781061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:100224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.506 [2024-07-15 09:04:01.781074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.506 [2024-07-15 09:04:01.781088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:100304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.506 [2024-07-15 09:04:01.781102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.506 [2024-07-15 09:04:01.781116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:100704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.506 [2024-07-15 09:04:01.781129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.507 [2024-07-15 09:04:01.781143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:100712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.507 [2024-07-15 09:04:01.781157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.507 [2024-07-15 09:04:01.781171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:100720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.507 [2024-07-15 09:04:01.781199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.507 [2024-07-15 09:04:01.781213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:100728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.507 [2024-07-15 09:04:01.781227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.507 [2024-07-15 09:04:01.781242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:100736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.507 [2024-07-15 09:04:01.781254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.507 [2024-07-15 09:04:01.781270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:100744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.507 [2024-07-15 09:04:01.781284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.507 [2024-07-15 09:04:01.781299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:100752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.507 [2024-07-15 09:04:01.781312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.507 [2024-07-15 09:04:01.781330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:100760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.507 [2024-07-15 09:04:01.781343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.507 [2024-07-15 09:04:01.781357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:100768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.507 [2024-07-15 09:04:01.781370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.507 [2024-07-15 09:04:01.781384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:100776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.507 [2024-07-15 09:04:01.781397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.507 [2024-07-15 09:04:01.781411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:100784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.507 [2024-07-15 09:04:01.781423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.507 [2024-07-15 09:04:01.781437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:100792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.507 [2024-07-15 09:04:01.781451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.507 [2024-07-15 09:04:01.781465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:100800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.507 [2024-07-15 09:04:01.781477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.507 [2024-07-15 09:04:01.781491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:100320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.507 [2024-07-15 09:04:01.781505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.507 [2024-07-15 09:04:01.781519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:100328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.507 [2024-07-15 09:04:01.781532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.507 [2024-07-15 09:04:01.781547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:100352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.507 [2024-07-15 09:04:01.781560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.507 [2024-07-15 09:04:01.781574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:100400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.507 [2024-07-15 09:04:01.781587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.507 [2024-07-15 09:04:01.781601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:100408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.507 [2024-07-15 09:04:01.781614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.507 [2024-07-15 09:04:01.781628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:100448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.507 [2024-07-15 09:04:01.781642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.507 [2024-07-15 09:04:01.781656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:100456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.507 [2024-07-15 09:04:01.781669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.507 [2024-07-15 09:04:01.781687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:100488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.507 [2024-07-15 09:04:01.781700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.507 [2024-07-15 09:04:01.781714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:100808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.507 [2024-07-15 09:04:01.781727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.507 [2024-07-15 09:04:01.781741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:100816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.507 [2024-07-15 09:04:01.781754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.507 [2024-07-15 09:04:01.781768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:100824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.507 [2024-07-15 09:04:01.781781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.507 [2024-07-15 09:04:01.781795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:100832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.507 [2024-07-15 09:04:01.781809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.507 [2024-07-15 09:04:01.781824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:100840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.507 [2024-07-15 09:04:01.781837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.507 [2024-07-15 09:04:01.781851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:100848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.507 [2024-07-15 09:04:01.781873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.507 [2024-07-15 09:04:01.781912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:100856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.507 [2024-07-15 09:04:01.781926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.507 [2024-07-15 09:04:01.781941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:100864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.507 [2024-07-15 09:04:01.781954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.508 [2024-07-15 09:04:01.781969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:100872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.508 [2024-07-15 09:04:01.781983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.508 [2024-07-15 09:04:01.781998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:100880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.508 [2024-07-15 09:04:01.782012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.508 [2024-07-15 09:04:01.782027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:100888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.508 [2024-07-15 09:04:01.782040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.508 [2024-07-15 09:04:01.782055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:100896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.508 [2024-07-15 09:04:01.782071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.508 [2024-07-15 09:04:01.782086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:100904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.508 [2024-07-15 09:04:01.782100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.508 [2024-07-15 09:04:01.782115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:100912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.508 [2024-07-15 09:04:01.782128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.508 [2024-07-15 09:04:01.782143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:100920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.508 [2024-07-15 09:04:01.782156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.508 [2024-07-15 09:04:01.782170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:100928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.508 [2024-07-15 09:04:01.782198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.508 [2024-07-15 09:04:01.782213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:100936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.508 [2024-07-15 09:04:01.782226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.508 [2024-07-15 09:04:01.782240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:100944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.508 [2024-07-15 09:04:01.782252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.508 [2024-07-15 09:04:01.782266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:100952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.508 [2024-07-15 09:04:01.782279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.508 [2024-07-15 09:04:01.782293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:100960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.508 [2024-07-15 09:04:01.782306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.508 [2024-07-15 09:04:01.782320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:100968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.508 [2024-07-15 09:04:01.782333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.508 [2024-07-15 09:04:01.782347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:100976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.508 [2024-07-15 09:04:01.782360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.508 [2024-07-15 09:04:01.782373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:100984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.508 [2024-07-15 09:04:01.782386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.508 [2024-07-15 09:04:01.782400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:100992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.508 [2024-07-15 09:04:01.782412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.508 [2024-07-15 09:04:01.782430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:101000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.508 [2024-07-15 09:04:01.782444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.508 [2024-07-15 09:04:01.782458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:101008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.508 [2024-07-15 09:04:01.782471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.508 [2024-07-15 09:04:01.782485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:101016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.508 [2024-07-15 09:04:01.782498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.508 [2024-07-15 09:04:01.782512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:101024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.508 [2024-07-15 09:04:01.782525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.508 [2024-07-15 09:04:01.782539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:101032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.508 [2024-07-15 09:04:01.782551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.508 [2024-07-15 09:04:01.782566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:101040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.508 [2024-07-15 09:04:01.782578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.508 [2024-07-15 09:04:01.782593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:101048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.508 [2024-07-15 09:04:01.782605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.508 [2024-07-15 09:04:01.782619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:101056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.508 [2024-07-15 09:04:01.782632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.508 [2024-07-15 09:04:01.782646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:101064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.508 [2024-07-15 09:04:01.782659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.508 [2024-07-15 09:04:01.782673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:101072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.508 [2024-07-15 09:04:01.782686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.508 [2024-07-15 09:04:01.782700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:101080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.508 [2024-07-15 09:04:01.782713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.508 [2024-07-15 09:04:01.782727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:101088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.508 [2024-07-15 09:04:01.782740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.508 [2024-07-15 09:04:01.782755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:101096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.508 [2024-07-15 09:04:01.782771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.508 [2024-07-15 09:04:01.782785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:101104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.508 [2024-07-15 09:04:01.782799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.508 [2024-07-15 09:04:01.782813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:101112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.508 [2024-07-15 09:04:01.782826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.508 [2024-07-15 09:04:01.782840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:101120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.508 [2024-07-15 09:04:01.782853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.508 [2024-07-15 09:04:01.782874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:101128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.508 [2024-07-15 09:04:01.782910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.508 [2024-07-15 09:04:01.782925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:101136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.508 [2024-07-15 09:04:01.782939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.508 [2024-07-15 09:04:01.782954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:101144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.508 [2024-07-15 09:04:01.782967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.508 [2024-07-15 09:04:01.782982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:101152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.508 [2024-07-15 09:04:01.782995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.508 [2024-07-15 09:04:01.783010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:101160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.508 [2024-07-15 09:04:01.783022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.508 [2024-07-15 09:04:01.783037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:101168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.508 [2024-07-15 09:04:01.783050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.508 [2024-07-15 09:04:01.783065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:101176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.508 [2024-07-15 09:04:01.783077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.508 [2024-07-15 09:04:01.783092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:101184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.508 [2024-07-15 09:04:01.783106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.508 [2024-07-15 09:04:01.783121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:101192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.508 [2024-07-15 09:04:01.783134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.508 [2024-07-15 09:04:01.783152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:101200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.508 [2024-07-15 09:04:01.783166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.509 [2024-07-15 09:04:01.783196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:101208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.509 [2024-07-15 09:04:01.783211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.509 [2024-07-15 09:04:01.783225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:101216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.509 [2024-07-15 09:04:01.783249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.509 [2024-07-15 09:04:01.783263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:101224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.509 [2024-07-15 09:04:01.783276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.509 [2024-07-15 09:04:01.783290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:101232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.509 [2024-07-15 09:04:01.783303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.509 [2024-07-15 09:04:01.783317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:101240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.509 [2024-07-15 09:04:01.783330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.509 [2024-07-15 09:04:01.783344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:101248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.509 [2024-07-15 09:04:01.783357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.509 [2024-07-15 09:04:01.783372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:101256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.509 [2024-07-15 09:04:01.783385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.509 [2024-07-15 09:04:01.783400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:101264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.509 [2024-07-15 09:04:01.783413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.509 [2024-07-15 09:04:01.783427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:101272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.509 [2024-07-15 09:04:01.783440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.509 [2024-07-15 09:04:01.783455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:101280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.509 [2024-07-15 09:04:01.783468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.509 [2024-07-15 09:04:01.783482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:101288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.509 [2024-07-15 09:04:01.783496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.509 [2024-07-15 09:04:01.783510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:101296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.509 [2024-07-15 09:04:01.783525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.509 [2024-07-15 09:04:01.783541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:101304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.509 [2024-07-15 09:04:01.783555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.509 [2024-07-15 09:04:01.783568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:101312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.509 [2024-07-15 09:04:01.783581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.509 [2024-07-15 09:04:01.783595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:101320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.509 [2024-07-15 09:04:01.783608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.509 [2024-07-15 09:04:01.783623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:101328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.509 [2024-07-15 09:04:01.783636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.509 [2024-07-15 09:04:01.783650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:100504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.509 [2024-07-15 09:04:01.783662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.509 [2024-07-15 09:04:01.783677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:100512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.509 [2024-07-15 09:04:01.783689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.509 [2024-07-15 09:04:01.783703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:100520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.509 [2024-07-15 09:04:01.783716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.509 [2024-07-15 09:04:01.783731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:100528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.509 [2024-07-15 09:04:01.783743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.509 [2024-07-15 09:04:01.783758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:100552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.509 [2024-07-15 09:04:01.783771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.509 [2024-07-15 09:04:01.783785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:100576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.509 [2024-07-15 09:04:01.783797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.509 [2024-07-15 09:04:01.783811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:100600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.509 [2024-07-15 09:04:01.783825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.509 [2024-07-15 09:04:01.783839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:100608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.509 [2024-07-15 09:04:01.783852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.509 [2024-07-15 09:04:01.783892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:101336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.509 [2024-07-15 09:04:01.783908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.509 [2024-07-15 09:04:01.783939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:101344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.509 [2024-07-15 09:04:01.783954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.509 [2024-07-15 09:04:01.783970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:101352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.509 [2024-07-15 09:04:01.783984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.509 [2024-07-15 09:04:01.783999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:101360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.509 [2024-07-15 09:04:01.784012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.509 [2024-07-15 09:04:01.784028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:101368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.509 [2024-07-15 09:04:01.784042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.509 [2024-07-15 09:04:01.784057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:101376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.509 [2024-07-15 09:04:01.784071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.509 [2024-07-15 09:04:01.784086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:100616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.509 [2024-07-15 09:04:01.784100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.509 [2024-07-15 09:04:01.784115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:100624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.509 [2024-07-15 09:04:01.784129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.509 [2024-07-15 09:04:01.784144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:100632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.509 [2024-07-15 09:04:01.784158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.509 [2024-07-15 09:04:01.784199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:100640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.509 [2024-07-15 09:04:01.784212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.509 [2024-07-15 09:04:01.784227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:100648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.509 [2024-07-15 09:04:01.784240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.509 [2024-07-15 09:04:01.784270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:100656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.509 [2024-07-15 09:04:01.784283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.509 [2024-07-15 09:04:01.784297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:100664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.509 [2024-07-15 09:04:01.784310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.509 [2024-07-15 09:04:01.784340] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:24.509 [2024-07-15 09:04:01.784370] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:24.509 [2024-07-15 09:04:01.784382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:100680 len:8 PRP1 0x0 PRP2 0x0 00:25:24.510 [2024-07-15 09:04:01.784395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.510 [2024-07-15 09:04:01.784455] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x655050 was disconnected and freed. reset controller. 00:25:24.510 [2024-07-15 09:04:01.784473] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:25:24.510 [2024-07-15 09:04:01.784519] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:24.510 [2024-07-15 09:04:01.784538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.510 [2024-07-15 09:04:01.784553] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:24.510 [2024-07-15 09:04:01.784567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.510 [2024-07-15 09:04:01.784581] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:24.510 [2024-07-15 09:04:01.784594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.510 [2024-07-15 09:04:01.784608] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:24.510 [2024-07-15 09:04:01.784621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.510 [2024-07-15 09:04:01.784635] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:24.510 [2024-07-15 09:04:01.784674] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x648bd0 (9): Bad file descriptor 00:25:24.510 [2024-07-15 09:04:01.786965] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:24.510 [2024-07-15 09:04:01.861140] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:24.510 [2024-07-15 09:04:06.328899] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:24.510 [2024-07-15 09:04:06.328964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.510 [2024-07-15 09:04:06.328983] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:24.510 [2024-07-15 09:04:06.328998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.510 [2024-07-15 09:04:06.329012] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:24.510 [2024-07-15 09:04:06.329025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.510 [2024-07-15 09:04:06.329039] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:24.510 [2024-07-15 09:04:06.329052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.510 [2024-07-15 09:04:06.329065] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x648bd0 is same with the state(5) to be set 00:25:24.510 [2024-07-15 09:04:06.330255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:78456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.510 [2024-07-15 09:04:06.330280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.510 [2024-07-15 09:04:06.330306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:77888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.510 [2024-07-15 09:04:06.330322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.510 [2024-07-15 09:04:06.330338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:77896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.510 [2024-07-15 09:04:06.330351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.510 [2024-07-15 09:04:06.330367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:77904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.510 [2024-07-15 09:04:06.330381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.510 [2024-07-15 09:04:06.330397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:77928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.510 [2024-07-15 09:04:06.330410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.510 [2024-07-15 09:04:06.330425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:77952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.510 [2024-07-15 09:04:06.330439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.510 [2024-07-15 09:04:06.330470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:77968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.510 [2024-07-15 09:04:06.330484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.510 [2024-07-15 09:04:06.330499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:77976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.510 [2024-07-15 09:04:06.330512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.510 [2024-07-15 09:04:06.330542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:77984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.510 [2024-07-15 09:04:06.330555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.510 [2024-07-15 09:04:06.330569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:78512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.510 [2024-07-15 09:04:06.330581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.510 [2024-07-15 09:04:06.330596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:78520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.510 [2024-07-15 09:04:06.330608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.510 [2024-07-15 09:04:06.330622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:78528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.510 [2024-07-15 09:04:06.330635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.510 [2024-07-15 09:04:06.330649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:78536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.510 [2024-07-15 09:04:06.330667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.510 [2024-07-15 09:04:06.330682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:78552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.510 [2024-07-15 09:04:06.330695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.510 [2024-07-15 09:04:06.330709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:78568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.510 [2024-07-15 09:04:06.330722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.510 [2024-07-15 09:04:06.330736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:78584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.510 [2024-07-15 09:04:06.330749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.510 [2024-07-15 09:04:06.330762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:77992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.510 [2024-07-15 09:04:06.330775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.510 [2024-07-15 09:04:06.330790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:78008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.510 [2024-07-15 09:04:06.330802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.510 [2024-07-15 09:04:06.330816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:78016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.510 [2024-07-15 09:04:06.330829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.510 [2024-07-15 09:04:06.330843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:78056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.510 [2024-07-15 09:04:06.330888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.510 [2024-07-15 09:04:06.330907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:78088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.510 [2024-07-15 09:04:06.330920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.510 [2024-07-15 09:04:06.330935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:78104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.510 [2024-07-15 09:04:06.330948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.510 [2024-07-15 09:04:06.330963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:78112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.510 [2024-07-15 09:04:06.330976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.510 [2024-07-15 09:04:06.331006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:78120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.510 [2024-07-15 09:04:06.331021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.510 [2024-07-15 09:04:06.331036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:78592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.510 [2024-07-15 09:04:06.331050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.510 [2024-07-15 09:04:06.331069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:78600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.510 [2024-07-15 09:04:06.331083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.510 [2024-07-15 09:04:06.331097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:78608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.510 [2024-07-15 09:04:06.331111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.510 [2024-07-15 09:04:06.331125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:78616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.510 [2024-07-15 09:04:06.331138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.510 [2024-07-15 09:04:06.331153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:78624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.510 [2024-07-15 09:04:06.331178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.511 [2024-07-15 09:04:06.331208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:78136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.511 [2024-07-15 09:04:06.331221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.511 [2024-07-15 09:04:06.331246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:78144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.511 [2024-07-15 09:04:06.331259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.511 [2024-07-15 09:04:06.331272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:78176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.511 [2024-07-15 09:04:06.331285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.511 [2024-07-15 09:04:06.331310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:78184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.511 [2024-07-15 09:04:06.331323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.511 [2024-07-15 09:04:06.331337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:78200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.511 [2024-07-15 09:04:06.331349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.511 [2024-07-15 09:04:06.331363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:78208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.511 [2024-07-15 09:04:06.331376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.511 [2024-07-15 09:04:06.331390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:78224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.511 [2024-07-15 09:04:06.331403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.511 [2024-07-15 09:04:06.331417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:78240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.511 [2024-07-15 09:04:06.331429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.511 [2024-07-15 09:04:06.331444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:78632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.511 [2024-07-15 09:04:06.331459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.511 [2024-07-15 09:04:06.331474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:78640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.511 [2024-07-15 09:04:06.331488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.511 [2024-07-15 09:04:06.331502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:78648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.511 [2024-07-15 09:04:06.331515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.511 [2024-07-15 09:04:06.331529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:78656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.511 [2024-07-15 09:04:06.331542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.511 [2024-07-15 09:04:06.331556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:78664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.511 [2024-07-15 09:04:06.331569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.511 [2024-07-15 09:04:06.331582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:78672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.511 [2024-07-15 09:04:06.331595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.511 [2024-07-15 09:04:06.331609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:78680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.511 [2024-07-15 09:04:06.331622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.511 [2024-07-15 09:04:06.331635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:78688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.511 [2024-07-15 09:04:06.331648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.511 [2024-07-15 09:04:06.331662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:78696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.511 [2024-07-15 09:04:06.331675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.511 [2024-07-15 09:04:06.331689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:78704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.511 [2024-07-15 09:04:06.331701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.511 [2024-07-15 09:04:06.331715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:78712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.511 [2024-07-15 09:04:06.331728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.511 [2024-07-15 09:04:06.331742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:78720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.511 [2024-07-15 09:04:06.331756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.511 [2024-07-15 09:04:06.331770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:78728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.511 [2024-07-15 09:04:06.331783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.511 [2024-07-15 09:04:06.331797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:78736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.511 [2024-07-15 09:04:06.331813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.511 [2024-07-15 09:04:06.331828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:78744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.511 [2024-07-15 09:04:06.331841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.511 [2024-07-15 09:04:06.331856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:78752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.511 [2024-07-15 09:04:06.331873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.511 [2024-07-15 09:04:06.331910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:78760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.511 [2024-07-15 09:04:06.331925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.511 [2024-07-15 09:04:06.331939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:78768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.511 [2024-07-15 09:04:06.331952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.511 [2024-07-15 09:04:06.331967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:78776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.511 [2024-07-15 09:04:06.331980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.511 [2024-07-15 09:04:06.331995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:78784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.511 [2024-07-15 09:04:06.332008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.511 [2024-07-15 09:04:06.332022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:78792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.511 [2024-07-15 09:04:06.332035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.511 [2024-07-15 09:04:06.332050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:78800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.511 [2024-07-15 09:04:06.332063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.511 [2024-07-15 09:04:06.332077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:78808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.511 [2024-07-15 09:04:06.332090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.511 [2024-07-15 09:04:06.332105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:78816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.511 [2024-07-15 09:04:06.332118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.511 [2024-07-15 09:04:06.332132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:78824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.511 [2024-07-15 09:04:06.332145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.511 [2024-07-15 09:04:06.332159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:78832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.511 [2024-07-15 09:04:06.332173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.511 [2024-07-15 09:04:06.332206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:78248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.511 [2024-07-15 09:04:06.332220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.511 [2024-07-15 09:04:06.332234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:78272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.512 [2024-07-15 09:04:06.332247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.512 [2024-07-15 09:04:06.332261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:78320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.512 [2024-07-15 09:04:06.332273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.512 [2024-07-15 09:04:06.332289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:78328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.512 [2024-07-15 09:04:06.332301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.512 [2024-07-15 09:04:06.332316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:78344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.512 [2024-07-15 09:04:06.332329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.512 [2024-07-15 09:04:06.332343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:78352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.512 [2024-07-15 09:04:06.332356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.512 [2024-07-15 09:04:06.332370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:78360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.512 [2024-07-15 09:04:06.332382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.512 [2024-07-15 09:04:06.332397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:78376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.512 [2024-07-15 09:04:06.332410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.512 [2024-07-15 09:04:06.332424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:78840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.512 [2024-07-15 09:04:06.332437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.512 [2024-07-15 09:04:06.332451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:78848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.512 [2024-07-15 09:04:06.332464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.512 [2024-07-15 09:04:06.332478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:78856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.512 [2024-07-15 09:04:06.332491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.512 [2024-07-15 09:04:06.332511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:78864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.512 [2024-07-15 09:04:06.332525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.512 [2024-07-15 09:04:06.332539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:78872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.512 [2024-07-15 09:04:06.332555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.512 [2024-07-15 09:04:06.332570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:78880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.512 [2024-07-15 09:04:06.332583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.512 [2024-07-15 09:04:06.332597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:78888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.512 [2024-07-15 09:04:06.332610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.512 [2024-07-15 09:04:06.332624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:78896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.512 [2024-07-15 09:04:06.332637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.512 [2024-07-15 09:04:06.332651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:78904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.512 [2024-07-15 09:04:06.332663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.512 [2024-07-15 09:04:06.332677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:78912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.512 [2024-07-15 09:04:06.332691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.512 [2024-07-15 09:04:06.332705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:78920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.512 [2024-07-15 09:04:06.332718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.512 [2024-07-15 09:04:06.332732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:78928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.512 [2024-07-15 09:04:06.332745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.512 [2024-07-15 09:04:06.332759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:78936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.512 [2024-07-15 09:04:06.332771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.512 [2024-07-15 09:04:06.332786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:78944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.512 [2024-07-15 09:04:06.332798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.512 [2024-07-15 09:04:06.332812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:78952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.512 [2024-07-15 09:04:06.332825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.512 [2024-07-15 09:04:06.332839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:78960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.512 [2024-07-15 09:04:06.332851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.512 [2024-07-15 09:04:06.332869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:78968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.512 [2024-07-15 09:04:06.332902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.512 [2024-07-15 09:04:06.332922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:78976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.512 [2024-07-15 09:04:06.332936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.512 [2024-07-15 09:04:06.332951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:78984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.512 [2024-07-15 09:04:06.332965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.512 [2024-07-15 09:04:06.332984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:78992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.512 [2024-07-15 09:04:06.332998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.512 [2024-07-15 09:04:06.333013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:79000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.512 [2024-07-15 09:04:06.333027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.512 [2024-07-15 09:04:06.333042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:79008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.512 [2024-07-15 09:04:06.333055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.512 [2024-07-15 09:04:06.333069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:78400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.512 [2024-07-15 09:04:06.333082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.512 [2024-07-15 09:04:06.333096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:78408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.512 [2024-07-15 09:04:06.333109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.512 [2024-07-15 09:04:06.333124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:78416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.512 [2024-07-15 09:04:06.333137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.512 [2024-07-15 09:04:06.333151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:78424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.512 [2024-07-15 09:04:06.333174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.512 [2024-07-15 09:04:06.333204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:78432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.512 [2024-07-15 09:04:06.333218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.512 [2024-07-15 09:04:06.333232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:78440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.512 [2024-07-15 09:04:06.333244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.512 [2024-07-15 09:04:06.333258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:78448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.512 [2024-07-15 09:04:06.333271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.512 [2024-07-15 09:04:06.333285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:78464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.513 [2024-07-15 09:04:06.333297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.513 [2024-07-15 09:04:06.333315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:79016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.513 [2024-07-15 09:04:06.333328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.513 [2024-07-15 09:04:06.333342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:79024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.513 [2024-07-15 09:04:06.333355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.513 [2024-07-15 09:04:06.333370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:79032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.513 [2024-07-15 09:04:06.333382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.513 [2024-07-15 09:04:06.333396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:79040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.513 [2024-07-15 09:04:06.333408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.513 [2024-07-15 09:04:06.333422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:79048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.513 [2024-07-15 09:04:06.333435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.513 [2024-07-15 09:04:06.333450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:79056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.513 [2024-07-15 09:04:06.333463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.513 [2024-07-15 09:04:06.333477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:79064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.513 [2024-07-15 09:04:06.333490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.513 [2024-07-15 09:04:06.333504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:79072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.513 [2024-07-15 09:04:06.333516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.513 [2024-07-15 09:04:06.333530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:79080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.513 [2024-07-15 09:04:06.333543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.513 [2024-07-15 09:04:06.333557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:79088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.513 [2024-07-15 09:04:06.333570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.513 [2024-07-15 09:04:06.333584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:79096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.513 [2024-07-15 09:04:06.333596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.513 [2024-07-15 09:04:06.333611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:79104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.513 [2024-07-15 09:04:06.333624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.513 [2024-07-15 09:04:06.333638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:79112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.513 [2024-07-15 09:04:06.333654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.513 [2024-07-15 09:04:06.333669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:79120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.513 [2024-07-15 09:04:06.333682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.513 [2024-07-15 09:04:06.333696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:79128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.513 [2024-07-15 09:04:06.333709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.513 [2024-07-15 09:04:06.333724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:79136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.513 [2024-07-15 09:04:06.333737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.513 [2024-07-15 09:04:06.333751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:79144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.513 [2024-07-15 09:04:06.333764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.513 [2024-07-15 09:04:06.333778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:79152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.513 [2024-07-15 09:04:06.333791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.513 [2024-07-15 09:04:06.333806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:79160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.513 [2024-07-15 09:04:06.333818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.513 [2024-07-15 09:04:06.333832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:78472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.513 [2024-07-15 09:04:06.333845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.513 [2024-07-15 09:04:06.333891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:78480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.513 [2024-07-15 09:04:06.333907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.513 [2024-07-15 09:04:06.333922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:78488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.513 [2024-07-15 09:04:06.333935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.513 [2024-07-15 09:04:06.333950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:78496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.513 [2024-07-15 09:04:06.333963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.513 [2024-07-15 09:04:06.333978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:78504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.513 [2024-07-15 09:04:06.333991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.513 [2024-07-15 09:04:06.334006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:78544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.513 [2024-07-15 09:04:06.334019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.513 [2024-07-15 09:04:06.334037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:78560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.513 [2024-07-15 09:04:06.334052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.513 [2024-07-15 09:04:06.334066] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x675540 is same with the state(5) to be set 00:25:24.513 [2024-07-15 09:04:06.334082] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:24.513 [2024-07-15 09:04:06.334093] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:24.513 [2024-07-15 09:04:06.334109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:78576 len:8 PRP1 0x0 PRP2 0x0 00:25:24.513 [2024-07-15 09:04:06.334122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.513 [2024-07-15 09:04:06.334203] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x675540 was disconnected and freed. reset controller. 00:25:24.513 [2024-07-15 09:04:06.334237] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:25:24.513 [2024-07-15 09:04:06.334252] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:24.513 [2024-07-15 09:04:06.336459] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:24.513 [2024-07-15 09:04:06.336498] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x648bd0 (9): Bad file descriptor 00:25:24.513 [2024-07-15 09:04:06.371873] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:24.513 00:25:24.513 Latency(us) 00:25:24.513 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:24.513 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:25:24.513 Verification LBA range: start 0x0 length 0x4000 00:25:24.513 NVMe0n1 : 15.01 12769.20 49.88 517.43 0.00 9617.19 819.20 17670.45 00:25:24.513 =================================================================================================================== 00:25:24.513 Total : 12769.20 49.88 517.43 0.00 9617.19 819.20 17670.45 00:25:24.513 Received shutdown signal, test time was about 15.000000 seconds 00:25:24.513 00:25:24.513 Latency(us) 00:25:24.513 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:24.513 =================================================================================================================== 00:25:24.513 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:24.513 09:04:12 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:25:24.513 09:04:12 -- host/failover.sh@65 -- # count=3 00:25:24.513 09:04:12 -- host/failover.sh@67 -- # (( count != 3 )) 00:25:24.513 09:04:12 -- host/failover.sh@73 -- # bdevperf_pid=1599383 00:25:24.513 09:04:12 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:25:24.513 09:04:12 -- host/failover.sh@75 -- # waitforlisten 1599383 /var/tmp/bdevperf.sock 00:25:24.513 09:04:12 -- common/autotest_common.sh@819 -- # '[' -z 1599383 ']' 00:25:24.513 09:04:12 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:24.513 09:04:12 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:24.513 09:04:12 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:24.513 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:24.513 09:04:12 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:24.513 09:04:12 -- common/autotest_common.sh@10 -- # set +x 00:25:24.770 09:04:13 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:24.770 09:04:13 -- common/autotest_common.sh@852 -- # return 0 00:25:24.770 09:04:13 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:25.026 [2024-07-15 09:04:13.445419] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:25.026 09:04:13 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:25.283 [2024-07-15 09:04:13.722249] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:25:25.283 09:04:13 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:25.846 NVMe0n1 00:25:25.846 09:04:14 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:26.103 00:25:26.103 09:04:14 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:26.377 00:25:26.377 09:04:14 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:26.377 09:04:14 -- host/failover.sh@82 -- # grep -q NVMe0 00:25:26.635 09:04:15 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:26.893 09:04:15 -- host/failover.sh@87 -- # sleep 3 00:25:30.212 09:04:18 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:30.212 09:04:18 -- host/failover.sh@88 -- # grep -q NVMe0 00:25:30.212 09:04:18 -- host/failover.sh@90 -- # run_test_pid=1600197 00:25:30.212 09:04:18 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:30.212 09:04:18 -- host/failover.sh@92 -- # wait 1600197 00:25:31.585 0 00:25:31.585 09:04:19 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:31.585 [2024-07-15 09:04:12.307139] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:25:31.585 [2024-07-15 09:04:12.307251] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1599383 ] 00:25:31.585 EAL: No free 2048 kB hugepages reported on node 1 00:25:31.585 [2024-07-15 09:04:12.366903] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:31.585 [2024-07-15 09:04:12.470551] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:31.585 [2024-07-15 09:04:15.307295] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:25:31.585 [2024-07-15 09:04:15.307389] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.585 [2024-07-15 09:04:15.307411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.585 [2024-07-15 09:04:15.307427] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.585 [2024-07-15 09:04:15.307457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.585 [2024-07-15 09:04:15.307471] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.585 [2024-07-15 09:04:15.307485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.585 [2024-07-15 09:04:15.307499] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.585 [2024-07-15 09:04:15.307513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.585 [2024-07-15 09:04:15.307526] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:31.585 [2024-07-15 09:04:15.307565] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:31.585 [2024-07-15 09:04:15.307596] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1362bd0 (9): Bad file descriptor 00:25:31.585 [2024-07-15 09:04:15.313825] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:31.585 Running I/O for 1 seconds... 00:25:31.585 00:25:31.585 Latency(us) 00:25:31.585 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:31.585 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:25:31.585 Verification LBA range: start 0x0 length 0x4000 00:25:31.585 NVMe0n1 : 1.01 12834.71 50.14 0.00 0.00 9924.36 1159.02 11359.57 00:25:31.585 =================================================================================================================== 00:25:31.585 Total : 12834.71 50.14 0.00 0.00 9924.36 1159.02 11359.57 00:25:31.585 09:04:19 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:31.585 09:04:19 -- host/failover.sh@95 -- # grep -q NVMe0 00:25:31.585 09:04:20 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:31.842 09:04:20 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:31.842 09:04:20 -- host/failover.sh@99 -- # grep -q NVMe0 00:25:32.100 09:04:20 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:32.357 09:04:20 -- host/failover.sh@101 -- # sleep 3 00:25:35.634 09:04:23 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:35.634 09:04:23 -- host/failover.sh@103 -- # grep -q NVMe0 00:25:35.634 09:04:24 -- host/failover.sh@108 -- # killprocess 1599383 00:25:35.634 09:04:24 -- common/autotest_common.sh@926 -- # '[' -z 1599383 ']' 00:25:35.634 09:04:24 -- common/autotest_common.sh@930 -- # kill -0 1599383 00:25:35.634 09:04:24 -- common/autotest_common.sh@931 -- # uname 00:25:35.634 09:04:24 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:35.634 09:04:24 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1599383 00:25:35.634 09:04:24 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:25:35.634 09:04:24 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:25:35.634 09:04:24 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1599383' 00:25:35.634 killing process with pid 1599383 00:25:35.634 09:04:24 -- common/autotest_common.sh@945 -- # kill 1599383 00:25:35.634 09:04:24 -- common/autotest_common.sh@950 -- # wait 1599383 00:25:35.891 09:04:24 -- host/failover.sh@110 -- # sync 00:25:35.891 09:04:24 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:36.148 09:04:24 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:25:36.148 09:04:24 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:36.148 09:04:24 -- host/failover.sh@116 -- # nvmftestfini 00:25:36.148 09:04:24 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:36.148 09:04:24 -- nvmf/common.sh@116 -- # sync 00:25:36.148 09:04:24 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:36.148 09:04:24 -- nvmf/common.sh@119 -- # set +e 00:25:36.148 09:04:24 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:36.148 09:04:24 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:36.148 rmmod nvme_tcp 00:25:36.148 rmmod nvme_fabrics 00:25:36.148 rmmod nvme_keyring 00:25:36.406 09:04:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:36.406 09:04:24 -- nvmf/common.sh@123 -- # set -e 00:25:36.406 09:04:24 -- nvmf/common.sh@124 -- # return 0 00:25:36.406 09:04:24 -- nvmf/common.sh@477 -- # '[' -n 1596890 ']' 00:25:36.406 09:04:24 -- nvmf/common.sh@478 -- # killprocess 1596890 00:25:36.406 09:04:24 -- common/autotest_common.sh@926 -- # '[' -z 1596890 ']' 00:25:36.406 09:04:24 -- common/autotest_common.sh@930 -- # kill -0 1596890 00:25:36.406 09:04:24 -- common/autotest_common.sh@931 -- # uname 00:25:36.406 09:04:24 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:36.406 09:04:24 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1596890 00:25:36.406 09:04:24 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:25:36.406 09:04:24 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:25:36.406 09:04:24 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1596890' 00:25:36.406 killing process with pid 1596890 00:25:36.406 09:04:24 -- common/autotest_common.sh@945 -- # kill 1596890 00:25:36.406 09:04:24 -- common/autotest_common.sh@950 -- # wait 1596890 00:25:36.665 09:04:25 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:36.665 09:04:25 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:36.665 09:04:25 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:36.665 09:04:25 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:36.665 09:04:25 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:36.665 09:04:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:36.665 09:04:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:36.665 09:04:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:38.567 09:04:27 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:38.567 00:25:38.567 real 0m36.655s 00:25:38.567 user 2m8.693s 00:25:38.567 sys 0m6.562s 00:25:38.567 09:04:27 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:25:38.567 09:04:27 -- common/autotest_common.sh@10 -- # set +x 00:25:38.567 ************************************ 00:25:38.567 END TEST nvmf_failover 00:25:38.567 ************************************ 00:25:38.567 09:04:27 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:25:38.567 09:04:27 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:25:38.567 09:04:27 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:25:38.567 09:04:27 -- common/autotest_common.sh@10 -- # set +x 00:25:38.567 ************************************ 00:25:38.567 START TEST nvmf_discovery 00:25:38.567 ************************************ 00:25:38.567 09:04:27 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:25:38.827 * Looking for test storage... 00:25:38.827 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:38.827 09:04:27 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:38.827 09:04:27 -- nvmf/common.sh@7 -- # uname -s 00:25:38.827 09:04:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:38.827 09:04:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:38.827 09:04:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:38.827 09:04:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:38.827 09:04:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:38.827 09:04:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:38.827 09:04:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:38.827 09:04:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:38.827 09:04:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:38.827 09:04:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:38.827 09:04:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:38.827 09:04:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:38.827 09:04:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:38.827 09:04:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:38.827 09:04:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:38.827 09:04:27 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:38.827 09:04:27 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:38.827 09:04:27 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:38.827 09:04:27 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:38.827 09:04:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:38.827 09:04:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:38.827 09:04:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:38.827 09:04:27 -- paths/export.sh@5 -- # export PATH 00:25:38.827 09:04:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:38.827 09:04:27 -- nvmf/common.sh@46 -- # : 0 00:25:38.827 09:04:27 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:38.827 09:04:27 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:38.827 09:04:27 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:38.827 09:04:27 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:38.827 09:04:27 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:38.827 09:04:27 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:38.827 09:04:27 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:38.827 09:04:27 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:38.827 09:04:27 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:25:38.827 09:04:27 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:25:38.827 09:04:27 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:25:38.827 09:04:27 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:25:38.827 09:04:27 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:25:38.827 09:04:27 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:25:38.827 09:04:27 -- host/discovery.sh@25 -- # nvmftestinit 00:25:38.827 09:04:27 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:38.827 09:04:27 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:38.827 09:04:27 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:38.827 09:04:27 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:38.827 09:04:27 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:38.827 09:04:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:38.827 09:04:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:38.827 09:04:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:38.827 09:04:27 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:38.827 09:04:27 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:38.827 09:04:27 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:38.827 09:04:27 -- common/autotest_common.sh@10 -- # set +x 00:25:40.730 09:04:29 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:40.730 09:04:29 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:40.730 09:04:29 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:40.730 09:04:29 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:40.730 09:04:29 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:40.730 09:04:29 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:40.730 09:04:29 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:40.730 09:04:29 -- nvmf/common.sh@294 -- # net_devs=() 00:25:40.730 09:04:29 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:40.730 09:04:29 -- nvmf/common.sh@295 -- # e810=() 00:25:40.730 09:04:29 -- nvmf/common.sh@295 -- # local -ga e810 00:25:40.730 09:04:29 -- nvmf/common.sh@296 -- # x722=() 00:25:40.730 09:04:29 -- nvmf/common.sh@296 -- # local -ga x722 00:25:40.730 09:04:29 -- nvmf/common.sh@297 -- # mlx=() 00:25:40.730 09:04:29 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:40.730 09:04:29 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:40.730 09:04:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:40.730 09:04:29 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:40.730 09:04:29 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:40.730 09:04:29 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:40.730 09:04:29 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:40.730 09:04:29 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:40.730 09:04:29 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:40.730 09:04:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:40.730 09:04:29 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:40.730 09:04:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:40.730 09:04:29 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:40.730 09:04:29 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:40.730 09:04:29 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:40.730 09:04:29 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:40.730 09:04:29 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:40.730 09:04:29 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:40.730 09:04:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:40.730 09:04:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:40.730 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:40.730 09:04:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:40.730 09:04:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:40.730 09:04:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:40.730 09:04:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:40.730 09:04:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:40.730 09:04:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:40.730 09:04:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:40.730 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:40.730 09:04:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:40.730 09:04:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:40.730 09:04:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:40.730 09:04:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:40.730 09:04:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:40.730 09:04:29 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:40.730 09:04:29 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:40.730 09:04:29 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:40.730 09:04:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:40.730 09:04:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:40.730 09:04:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:40.730 09:04:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:40.730 09:04:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:40.730 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:40.730 09:04:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:40.730 09:04:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:40.730 09:04:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:40.730 09:04:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:40.730 09:04:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:40.730 09:04:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:40.730 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:40.730 09:04:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:40.730 09:04:29 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:40.730 09:04:29 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:40.730 09:04:29 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:40.730 09:04:29 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:40.730 09:04:29 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:40.730 09:04:29 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:40.730 09:04:29 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:40.730 09:04:29 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:40.730 09:04:29 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:40.730 09:04:29 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:40.730 09:04:29 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:40.730 09:04:29 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:40.730 09:04:29 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:40.730 09:04:29 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:40.730 09:04:29 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:40.730 09:04:29 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:40.730 09:04:29 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:40.730 09:04:29 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:40.730 09:04:29 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:40.730 09:04:29 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:40.730 09:04:29 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:40.730 09:04:29 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:40.730 09:04:29 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:40.730 09:04:29 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:40.730 09:04:29 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:40.730 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:40.730 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.228 ms 00:25:40.730 00:25:40.730 --- 10.0.0.2 ping statistics --- 00:25:40.730 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:40.730 rtt min/avg/max/mdev = 0.228/0.228/0.228/0.000 ms 00:25:40.730 09:04:29 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:40.730 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:40.730 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.110 ms 00:25:40.730 00:25:40.730 --- 10.0.0.1 ping statistics --- 00:25:40.730 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:40.730 rtt min/avg/max/mdev = 0.110/0.110/0.110/0.000 ms 00:25:40.730 09:04:29 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:40.730 09:04:29 -- nvmf/common.sh@410 -- # return 0 00:25:40.730 09:04:29 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:40.730 09:04:29 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:40.730 09:04:29 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:40.730 09:04:29 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:40.730 09:04:29 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:40.730 09:04:29 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:40.730 09:04:29 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:40.730 09:04:29 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:25:40.730 09:04:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:40.730 09:04:29 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:40.730 09:04:29 -- common/autotest_common.sh@10 -- # set +x 00:25:40.730 09:04:29 -- nvmf/common.sh@469 -- # nvmfpid=1602836 00:25:40.730 09:04:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:25:40.730 09:04:29 -- nvmf/common.sh@470 -- # waitforlisten 1602836 00:25:40.730 09:04:29 -- common/autotest_common.sh@819 -- # '[' -z 1602836 ']' 00:25:40.731 09:04:29 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:40.731 09:04:29 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:40.731 09:04:29 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:40.731 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:40.731 09:04:29 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:40.731 09:04:29 -- common/autotest_common.sh@10 -- # set +x 00:25:40.731 [2024-07-15 09:04:29.265871] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:25:40.731 [2024-07-15 09:04:29.265955] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:40.991 EAL: No free 2048 kB hugepages reported on node 1 00:25:40.991 [2024-07-15 09:04:29.332347] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:40.991 [2024-07-15 09:04:29.446170] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:40.991 [2024-07-15 09:04:29.446342] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:40.991 [2024-07-15 09:04:29.446362] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:40.991 [2024-07-15 09:04:29.446376] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:40.991 [2024-07-15 09:04:29.446412] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:41.927 09:04:30 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:41.927 09:04:30 -- common/autotest_common.sh@852 -- # return 0 00:25:41.927 09:04:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:41.927 09:04:30 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:41.927 09:04:30 -- common/autotest_common.sh@10 -- # set +x 00:25:41.927 09:04:30 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:41.927 09:04:30 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:41.927 09:04:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:41.927 09:04:30 -- common/autotest_common.sh@10 -- # set +x 00:25:41.927 [2024-07-15 09:04:30.234020] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:41.927 09:04:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:41.927 09:04:30 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:25:41.927 09:04:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:41.927 09:04:30 -- common/autotest_common.sh@10 -- # set +x 00:25:41.927 [2024-07-15 09:04:30.242173] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:25:41.927 09:04:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:41.927 09:04:30 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:25:41.927 09:04:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:41.927 09:04:30 -- common/autotest_common.sh@10 -- # set +x 00:25:41.927 null0 00:25:41.927 09:04:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:41.927 09:04:30 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:25:41.927 09:04:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:41.927 09:04:30 -- common/autotest_common.sh@10 -- # set +x 00:25:41.927 null1 00:25:41.927 09:04:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:41.927 09:04:30 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:25:41.927 09:04:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:41.927 09:04:30 -- common/autotest_common.sh@10 -- # set +x 00:25:41.927 09:04:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:41.927 09:04:30 -- host/discovery.sh@45 -- # hostpid=1602991 00:25:41.927 09:04:30 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:25:41.927 09:04:30 -- host/discovery.sh@46 -- # waitforlisten 1602991 /tmp/host.sock 00:25:41.927 09:04:30 -- common/autotest_common.sh@819 -- # '[' -z 1602991 ']' 00:25:41.927 09:04:30 -- common/autotest_common.sh@823 -- # local rpc_addr=/tmp/host.sock 00:25:41.927 09:04:30 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:41.927 09:04:30 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:25:41.927 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:25:41.927 09:04:30 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:41.927 09:04:30 -- common/autotest_common.sh@10 -- # set +x 00:25:41.927 [2024-07-15 09:04:30.310385] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:25:41.927 [2024-07-15 09:04:30.310447] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1602991 ] 00:25:41.927 EAL: No free 2048 kB hugepages reported on node 1 00:25:41.927 [2024-07-15 09:04:30.371405] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:42.185 [2024-07-15 09:04:30.486436] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:42.185 [2024-07-15 09:04:30.486619] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:42.751 09:04:31 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:42.751 09:04:31 -- common/autotest_common.sh@852 -- # return 0 00:25:42.751 09:04:31 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:42.751 09:04:31 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:25:42.751 09:04:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:42.751 09:04:31 -- common/autotest_common.sh@10 -- # set +x 00:25:42.751 09:04:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:42.751 09:04:31 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:25:42.751 09:04:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:42.751 09:04:31 -- common/autotest_common.sh@10 -- # set +x 00:25:42.751 09:04:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:42.751 09:04:31 -- host/discovery.sh@72 -- # notify_id=0 00:25:42.751 09:04:31 -- host/discovery.sh@78 -- # get_subsystem_names 00:25:42.751 09:04:31 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:42.751 09:04:31 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:42.751 09:04:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:42.751 09:04:31 -- common/autotest_common.sh@10 -- # set +x 00:25:42.751 09:04:31 -- host/discovery.sh@59 -- # sort 00:25:42.751 09:04:31 -- host/discovery.sh@59 -- # xargs 00:25:42.751 09:04:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:43.008 09:04:31 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:25:43.008 09:04:31 -- host/discovery.sh@79 -- # get_bdev_list 00:25:43.008 09:04:31 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:43.008 09:04:31 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:43.008 09:04:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:43.008 09:04:31 -- common/autotest_common.sh@10 -- # set +x 00:25:43.008 09:04:31 -- host/discovery.sh@55 -- # sort 00:25:43.008 09:04:31 -- host/discovery.sh@55 -- # xargs 00:25:43.008 09:04:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:43.008 09:04:31 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:25:43.008 09:04:31 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:25:43.008 09:04:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:43.008 09:04:31 -- common/autotest_common.sh@10 -- # set +x 00:25:43.008 09:04:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:43.009 09:04:31 -- host/discovery.sh@82 -- # get_subsystem_names 00:25:43.009 09:04:31 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:43.009 09:04:31 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:43.009 09:04:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:43.009 09:04:31 -- host/discovery.sh@59 -- # sort 00:25:43.009 09:04:31 -- common/autotest_common.sh@10 -- # set +x 00:25:43.009 09:04:31 -- host/discovery.sh@59 -- # xargs 00:25:43.009 09:04:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:43.009 09:04:31 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:25:43.009 09:04:31 -- host/discovery.sh@83 -- # get_bdev_list 00:25:43.009 09:04:31 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:43.009 09:04:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:43.009 09:04:31 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:43.009 09:04:31 -- common/autotest_common.sh@10 -- # set +x 00:25:43.009 09:04:31 -- host/discovery.sh@55 -- # sort 00:25:43.009 09:04:31 -- host/discovery.sh@55 -- # xargs 00:25:43.009 09:04:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:43.009 09:04:31 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:25:43.009 09:04:31 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:25:43.009 09:04:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:43.009 09:04:31 -- common/autotest_common.sh@10 -- # set +x 00:25:43.009 09:04:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:43.009 09:04:31 -- host/discovery.sh@86 -- # get_subsystem_names 00:25:43.009 09:04:31 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:43.009 09:04:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:43.009 09:04:31 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:43.009 09:04:31 -- host/discovery.sh@59 -- # sort 00:25:43.009 09:04:31 -- common/autotest_common.sh@10 -- # set +x 00:25:43.009 09:04:31 -- host/discovery.sh@59 -- # xargs 00:25:43.009 09:04:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:43.009 09:04:31 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:25:43.009 09:04:31 -- host/discovery.sh@87 -- # get_bdev_list 00:25:43.009 09:04:31 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:43.009 09:04:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:43.009 09:04:31 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:43.009 09:04:31 -- common/autotest_common.sh@10 -- # set +x 00:25:43.009 09:04:31 -- host/discovery.sh@55 -- # sort 00:25:43.009 09:04:31 -- host/discovery.sh@55 -- # xargs 00:25:43.009 09:04:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:43.009 09:04:31 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:25:43.009 09:04:31 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:25:43.009 09:04:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:43.009 09:04:31 -- common/autotest_common.sh@10 -- # set +x 00:25:43.009 [2024-07-15 09:04:31.529650] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:43.009 09:04:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:43.009 09:04:31 -- host/discovery.sh@92 -- # get_subsystem_names 00:25:43.009 09:04:31 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:43.009 09:04:31 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:43.009 09:04:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:43.009 09:04:31 -- common/autotest_common.sh@10 -- # set +x 00:25:43.009 09:04:31 -- host/discovery.sh@59 -- # sort 00:25:43.009 09:04:31 -- host/discovery.sh@59 -- # xargs 00:25:43.009 09:04:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:43.267 09:04:31 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:25:43.267 09:04:31 -- host/discovery.sh@93 -- # get_bdev_list 00:25:43.267 09:04:31 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:43.267 09:04:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:43.267 09:04:31 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:43.267 09:04:31 -- common/autotest_common.sh@10 -- # set +x 00:25:43.267 09:04:31 -- host/discovery.sh@55 -- # sort 00:25:43.267 09:04:31 -- host/discovery.sh@55 -- # xargs 00:25:43.267 09:04:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:43.267 09:04:31 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:25:43.267 09:04:31 -- host/discovery.sh@94 -- # get_notification_count 00:25:43.267 09:04:31 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:25:43.267 09:04:31 -- host/discovery.sh@74 -- # jq '. | length' 00:25:43.267 09:04:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:43.267 09:04:31 -- common/autotest_common.sh@10 -- # set +x 00:25:43.267 09:04:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:43.267 09:04:31 -- host/discovery.sh@74 -- # notification_count=0 00:25:43.267 09:04:31 -- host/discovery.sh@75 -- # notify_id=0 00:25:43.267 09:04:31 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:25:43.267 09:04:31 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:25:43.267 09:04:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:43.267 09:04:31 -- common/autotest_common.sh@10 -- # set +x 00:25:43.267 09:04:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:43.267 09:04:31 -- host/discovery.sh@100 -- # sleep 1 00:25:43.832 [2024-07-15 09:04:32.263245] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:25:43.832 [2024-07-15 09:04:32.263280] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:25:43.832 [2024-07-15 09:04:32.263306] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:25:43.832 [2024-07-15 09:04:32.349579] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:25:44.090 [2024-07-15 09:04:32.453405] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:25:44.090 [2024-07-15 09:04:32.453432] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:25:44.357 09:04:32 -- host/discovery.sh@101 -- # get_subsystem_names 00:25:44.357 09:04:32 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:44.357 09:04:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:44.357 09:04:32 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:44.357 09:04:32 -- common/autotest_common.sh@10 -- # set +x 00:25:44.357 09:04:32 -- host/discovery.sh@59 -- # sort 00:25:44.357 09:04:32 -- host/discovery.sh@59 -- # xargs 00:25:44.357 09:04:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:44.357 09:04:32 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:25:44.357 09:04:32 -- host/discovery.sh@102 -- # get_bdev_list 00:25:44.357 09:04:32 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:44.357 09:04:32 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:44.357 09:04:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:44.357 09:04:32 -- common/autotest_common.sh@10 -- # set +x 00:25:44.357 09:04:32 -- host/discovery.sh@55 -- # sort 00:25:44.357 09:04:32 -- host/discovery.sh@55 -- # xargs 00:25:44.357 09:04:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:44.357 09:04:32 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:25:44.357 09:04:32 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:25:44.357 09:04:32 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:25:44.357 09:04:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:44.357 09:04:32 -- common/autotest_common.sh@10 -- # set +x 00:25:44.357 09:04:32 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:25:44.357 09:04:32 -- host/discovery.sh@63 -- # sort -n 00:25:44.357 09:04:32 -- host/discovery.sh@63 -- # xargs 00:25:44.357 09:04:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:44.357 09:04:32 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:25:44.357 09:04:32 -- host/discovery.sh@104 -- # get_notification_count 00:25:44.357 09:04:32 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:25:44.357 09:04:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:44.357 09:04:32 -- host/discovery.sh@74 -- # jq '. | length' 00:25:44.357 09:04:32 -- common/autotest_common.sh@10 -- # set +x 00:25:44.357 09:04:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:44.357 09:04:32 -- host/discovery.sh@74 -- # notification_count=1 00:25:44.357 09:04:32 -- host/discovery.sh@75 -- # notify_id=1 00:25:44.357 09:04:32 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:25:44.357 09:04:32 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:25:44.357 09:04:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:44.357 09:04:32 -- common/autotest_common.sh@10 -- # set +x 00:25:44.357 09:04:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:44.357 09:04:32 -- host/discovery.sh@109 -- # sleep 1 00:25:45.351 09:04:33 -- host/discovery.sh@110 -- # get_bdev_list 00:25:45.351 09:04:33 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:45.351 09:04:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:45.351 09:04:33 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:45.351 09:04:33 -- common/autotest_common.sh@10 -- # set +x 00:25:45.351 09:04:33 -- host/discovery.sh@55 -- # sort 00:25:45.351 09:04:33 -- host/discovery.sh@55 -- # xargs 00:25:45.351 09:04:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:45.351 09:04:33 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:25:45.351 09:04:33 -- host/discovery.sh@111 -- # get_notification_count 00:25:45.351 09:04:33 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:25:45.351 09:04:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:45.351 09:04:33 -- host/discovery.sh@74 -- # jq '. | length' 00:25:45.351 09:04:33 -- common/autotest_common.sh@10 -- # set +x 00:25:45.351 09:04:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:45.610 09:04:33 -- host/discovery.sh@74 -- # notification_count=1 00:25:45.610 09:04:33 -- host/discovery.sh@75 -- # notify_id=2 00:25:45.610 09:04:33 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:25:45.610 09:04:33 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:25:45.610 09:04:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:45.610 09:04:33 -- common/autotest_common.sh@10 -- # set +x 00:25:45.610 [2024-07-15 09:04:33.924811] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:45.610 [2024-07-15 09:04:33.925698] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:25:45.610 [2024-07-15 09:04:33.925736] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:25:45.610 09:04:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:45.610 09:04:33 -- host/discovery.sh@117 -- # sleep 1 00:25:45.610 [2024-07-15 09:04:34.013984] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:25:45.610 [2024-07-15 09:04:34.118716] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:25:45.610 [2024-07-15 09:04:34.118743] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:25:45.610 [2024-07-15 09:04:34.118754] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:25:46.545 09:04:34 -- host/discovery.sh@118 -- # get_subsystem_names 00:25:46.545 09:04:34 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:46.545 09:04:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:46.545 09:04:34 -- common/autotest_common.sh@10 -- # set +x 00:25:46.545 09:04:34 -- host/discovery.sh@59 -- # sort 00:25:46.545 09:04:34 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:46.545 09:04:34 -- host/discovery.sh@59 -- # xargs 00:25:46.545 09:04:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:46.545 09:04:34 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:25:46.545 09:04:34 -- host/discovery.sh@119 -- # get_bdev_list 00:25:46.545 09:04:34 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:46.545 09:04:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:46.545 09:04:34 -- common/autotest_common.sh@10 -- # set +x 00:25:46.545 09:04:34 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:46.545 09:04:34 -- host/discovery.sh@55 -- # sort 00:25:46.545 09:04:34 -- host/discovery.sh@55 -- # xargs 00:25:46.545 09:04:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:46.545 09:04:35 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:25:46.545 09:04:35 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:25:46.545 09:04:35 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:25:46.545 09:04:35 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:25:46.545 09:04:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:46.545 09:04:35 -- common/autotest_common.sh@10 -- # set +x 00:25:46.545 09:04:35 -- host/discovery.sh@63 -- # xargs 00:25:46.545 09:04:35 -- host/discovery.sh@63 -- # sort -n 00:25:46.545 09:04:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:46.545 09:04:35 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:25:46.545 09:04:35 -- host/discovery.sh@121 -- # get_notification_count 00:25:46.545 09:04:35 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:25:46.545 09:04:35 -- host/discovery.sh@74 -- # jq '. | length' 00:25:46.545 09:04:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:46.545 09:04:35 -- common/autotest_common.sh@10 -- # set +x 00:25:46.545 09:04:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:46.803 09:04:35 -- host/discovery.sh@74 -- # notification_count=0 00:25:46.803 09:04:35 -- host/discovery.sh@75 -- # notify_id=2 00:25:46.803 09:04:35 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:25:46.803 09:04:35 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:25:46.803 09:04:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:46.803 09:04:35 -- common/autotest_common.sh@10 -- # set +x 00:25:46.803 [2024-07-15 09:04:35.104924] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:25:46.803 [2024-07-15 09:04:35.104965] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:25:46.803 09:04:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:46.803 09:04:35 -- host/discovery.sh@127 -- # sleep 1 00:25:46.803 [2024-07-15 09:04:35.113650] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:46.803 [2024-07-15 09:04:35.113686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.803 [2024-07-15 09:04:35.113706] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:46.803 [2024-07-15 09:04:35.113722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.803 [2024-07-15 09:04:35.113737] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:46.803 [2024-07-15 09:04:35.113752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.803 [2024-07-15 09:04:35.113767] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:46.803 [2024-07-15 09:04:35.113782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.803 [2024-07-15 09:04:35.113796] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21aeb80 is same with the state(5) to be set 00:25:46.803 [2024-07-15 09:04:35.123655] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x21aeb80 (9): Bad file descriptor 00:25:46.803 [2024-07-15 09:04:35.133704] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:46.804 [2024-07-15 09:04:35.133965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:46.804 [2024-07-15 09:04:35.134131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:46.804 [2024-07-15 09:04:35.134159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x21aeb80 with addr=10.0.0.2, port=4420 00:25:46.804 [2024-07-15 09:04:35.134177] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21aeb80 is same with the state(5) to be set 00:25:46.804 [2024-07-15 09:04:35.134229] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x21aeb80 (9): Bad file descriptor 00:25:46.804 [2024-07-15 09:04:35.134282] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:46.804 [2024-07-15 09:04:35.134304] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:46.804 [2024-07-15 09:04:35.134320] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:46.804 [2024-07-15 09:04:35.134344] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:46.804 [2024-07-15 09:04:35.143786] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:46.804 [2024-07-15 09:04:35.144002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:46.804 [2024-07-15 09:04:35.144166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:46.804 [2024-07-15 09:04:35.144193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x21aeb80 with addr=10.0.0.2, port=4420 00:25:46.804 [2024-07-15 09:04:35.144210] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21aeb80 is same with the state(5) to be set 00:25:46.804 [2024-07-15 09:04:35.144233] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x21aeb80 (9): Bad file descriptor 00:25:46.804 [2024-07-15 09:04:35.144253] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:46.804 [2024-07-15 09:04:35.144267] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:46.804 [2024-07-15 09:04:35.144280] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:46.804 [2024-07-15 09:04:35.144314] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:46.804 [2024-07-15 09:04:35.153866] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:46.804 [2024-07-15 09:04:35.154099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:46.804 [2024-07-15 09:04:35.154299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:46.804 [2024-07-15 09:04:35.154330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x21aeb80 with addr=10.0.0.2, port=4420 00:25:46.804 [2024-07-15 09:04:35.154347] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21aeb80 is same with the state(5) to be set 00:25:46.804 [2024-07-15 09:04:35.154373] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x21aeb80 (9): Bad file descriptor 00:25:46.804 [2024-07-15 09:04:35.154421] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:46.804 [2024-07-15 09:04:35.154443] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:46.804 [2024-07-15 09:04:35.154458] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:46.804 [2024-07-15 09:04:35.154480] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:46.804 [2024-07-15 09:04:35.163964] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:46.804 [2024-07-15 09:04:35.164277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:46.804 [2024-07-15 09:04:35.164444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:46.804 [2024-07-15 09:04:35.164472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x21aeb80 with addr=10.0.0.2, port=4420 00:25:46.804 [2024-07-15 09:04:35.164489] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21aeb80 is same with the state(5) to be set 00:25:46.804 [2024-07-15 09:04:35.164514] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x21aeb80 (9): Bad file descriptor 00:25:46.804 [2024-07-15 09:04:35.164558] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:46.804 [2024-07-15 09:04:35.164579] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:46.804 [2024-07-15 09:04:35.164595] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:46.804 [2024-07-15 09:04:35.164617] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:46.804 [2024-07-15 09:04:35.174044] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:46.804 [2024-07-15 09:04:35.174248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:46.804 [2024-07-15 09:04:35.174437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:46.804 [2024-07-15 09:04:35.174467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x21aeb80 with addr=10.0.0.2, port=4420 00:25:46.804 [2024-07-15 09:04:35.174485] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21aeb80 is same with the state(5) to be set 00:25:46.804 [2024-07-15 09:04:35.174511] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x21aeb80 (9): Bad file descriptor 00:25:46.804 [2024-07-15 09:04:35.174546] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:46.804 [2024-07-15 09:04:35.174566] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:46.804 [2024-07-15 09:04:35.174581] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:46.804 [2024-07-15 09:04:35.174616] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:46.804 [2024-07-15 09:04:35.184113] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:46.804 [2024-07-15 09:04:35.184340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:46.804 [2024-07-15 09:04:35.184503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:46.804 [2024-07-15 09:04:35.184531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x21aeb80 with addr=10.0.0.2, port=4420 00:25:46.804 [2024-07-15 09:04:35.184564] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21aeb80 is same with the state(5) to be set 00:25:46.804 [2024-07-15 09:04:35.184587] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x21aeb80 (9): Bad file descriptor 00:25:46.804 [2024-07-15 09:04:35.184634] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:46.804 [2024-07-15 09:04:35.184653] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:46.804 [2024-07-15 09:04:35.184666] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:46.804 [2024-07-15 09:04:35.184699] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:46.804 [2024-07-15 09:04:35.191635] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:25:46.804 [2024-07-15 09:04:35.191669] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:25:47.739 09:04:36 -- host/discovery.sh@128 -- # get_subsystem_names 00:25:47.739 09:04:36 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:47.739 09:04:36 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:47.739 09:04:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:47.739 09:04:36 -- common/autotest_common.sh@10 -- # set +x 00:25:47.739 09:04:36 -- host/discovery.sh@59 -- # sort 00:25:47.739 09:04:36 -- host/discovery.sh@59 -- # xargs 00:25:47.739 09:04:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:47.739 09:04:36 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:25:47.739 09:04:36 -- host/discovery.sh@129 -- # get_bdev_list 00:25:47.739 09:04:36 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:47.739 09:04:36 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:47.739 09:04:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:47.739 09:04:36 -- common/autotest_common.sh@10 -- # set +x 00:25:47.739 09:04:36 -- host/discovery.sh@55 -- # sort 00:25:47.739 09:04:36 -- host/discovery.sh@55 -- # xargs 00:25:47.739 09:04:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:47.739 09:04:36 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:25:47.739 09:04:36 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:25:47.739 09:04:36 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:25:47.739 09:04:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:47.740 09:04:36 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:25:47.740 09:04:36 -- common/autotest_common.sh@10 -- # set +x 00:25:47.740 09:04:36 -- host/discovery.sh@63 -- # sort -n 00:25:47.740 09:04:36 -- host/discovery.sh@63 -- # xargs 00:25:47.740 09:04:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:47.740 09:04:36 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:25:47.740 09:04:36 -- host/discovery.sh@131 -- # get_notification_count 00:25:47.740 09:04:36 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:25:47.740 09:04:36 -- host/discovery.sh@74 -- # jq '. | length' 00:25:47.740 09:04:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:47.740 09:04:36 -- common/autotest_common.sh@10 -- # set +x 00:25:47.740 09:04:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:47.740 09:04:36 -- host/discovery.sh@74 -- # notification_count=0 00:25:47.740 09:04:36 -- host/discovery.sh@75 -- # notify_id=2 00:25:47.740 09:04:36 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:25:47.740 09:04:36 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:25:47.740 09:04:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:47.740 09:04:36 -- common/autotest_common.sh@10 -- # set +x 00:25:47.999 09:04:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:47.999 09:04:36 -- host/discovery.sh@135 -- # sleep 1 00:25:48.936 09:04:37 -- host/discovery.sh@136 -- # get_subsystem_names 00:25:48.936 09:04:37 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:48.936 09:04:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:48.936 09:04:37 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:48.936 09:04:37 -- common/autotest_common.sh@10 -- # set +x 00:25:48.936 09:04:37 -- host/discovery.sh@59 -- # sort 00:25:48.936 09:04:37 -- host/discovery.sh@59 -- # xargs 00:25:48.936 09:04:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:48.936 09:04:37 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:25:48.936 09:04:37 -- host/discovery.sh@137 -- # get_bdev_list 00:25:48.936 09:04:37 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:48.936 09:04:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:48.936 09:04:37 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:48.936 09:04:37 -- common/autotest_common.sh@10 -- # set +x 00:25:48.936 09:04:37 -- host/discovery.sh@55 -- # sort 00:25:48.936 09:04:37 -- host/discovery.sh@55 -- # xargs 00:25:48.936 09:04:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:48.936 09:04:37 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:25:48.936 09:04:37 -- host/discovery.sh@138 -- # get_notification_count 00:25:48.936 09:04:37 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:25:48.936 09:04:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:48.936 09:04:37 -- host/discovery.sh@74 -- # jq '. | length' 00:25:48.936 09:04:37 -- common/autotest_common.sh@10 -- # set +x 00:25:48.936 09:04:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:48.936 09:04:37 -- host/discovery.sh@74 -- # notification_count=2 00:25:48.936 09:04:37 -- host/discovery.sh@75 -- # notify_id=4 00:25:48.936 09:04:37 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:25:48.936 09:04:37 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:48.936 09:04:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:48.936 09:04:37 -- common/autotest_common.sh@10 -- # set +x 00:25:50.314 [2024-07-15 09:04:38.469670] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:25:50.314 [2024-07-15 09:04:38.469696] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:25:50.314 [2024-07-15 09:04:38.469728] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:25:50.314 [2024-07-15 09:04:38.598136] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:25:50.314 [2024-07-15 09:04:38.664316] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:25:50.314 [2024-07-15 09:04:38.664356] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:25:50.314 09:04:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:50.314 09:04:38 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:50.314 09:04:38 -- common/autotest_common.sh@640 -- # local es=0 00:25:50.314 09:04:38 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:50.314 09:04:38 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:25:50.314 09:04:38 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:25:50.314 09:04:38 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:25:50.314 09:04:38 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:25:50.314 09:04:38 -- common/autotest_common.sh@643 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:50.314 09:04:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:50.314 09:04:38 -- common/autotest_common.sh@10 -- # set +x 00:25:50.314 request: 00:25:50.314 { 00:25:50.314 "name": "nvme", 00:25:50.315 "trtype": "tcp", 00:25:50.315 "traddr": "10.0.0.2", 00:25:50.315 "hostnqn": "nqn.2021-12.io.spdk:test", 00:25:50.315 "adrfam": "ipv4", 00:25:50.315 "trsvcid": "8009", 00:25:50.315 "wait_for_attach": true, 00:25:50.315 "method": "bdev_nvme_start_discovery", 00:25:50.315 "req_id": 1 00:25:50.315 } 00:25:50.315 Got JSON-RPC error response 00:25:50.315 response: 00:25:50.315 { 00:25:50.315 "code": -17, 00:25:50.315 "message": "File exists" 00:25:50.315 } 00:25:50.315 09:04:38 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:25:50.315 09:04:38 -- common/autotest_common.sh@643 -- # es=1 00:25:50.315 09:04:38 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:25:50.315 09:04:38 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:25:50.315 09:04:38 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:25:50.315 09:04:38 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:25:50.315 09:04:38 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:25:50.315 09:04:38 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:25:50.315 09:04:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:50.315 09:04:38 -- host/discovery.sh@67 -- # sort 00:25:50.315 09:04:38 -- common/autotest_common.sh@10 -- # set +x 00:25:50.315 09:04:38 -- host/discovery.sh@67 -- # xargs 00:25:50.315 09:04:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:50.315 09:04:38 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:25:50.315 09:04:38 -- host/discovery.sh@147 -- # get_bdev_list 00:25:50.315 09:04:38 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:50.315 09:04:38 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:50.315 09:04:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:50.315 09:04:38 -- common/autotest_common.sh@10 -- # set +x 00:25:50.315 09:04:38 -- host/discovery.sh@55 -- # sort 00:25:50.315 09:04:38 -- host/discovery.sh@55 -- # xargs 00:25:50.315 09:04:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:50.315 09:04:38 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:25:50.315 09:04:38 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:50.315 09:04:38 -- common/autotest_common.sh@640 -- # local es=0 00:25:50.315 09:04:38 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:50.315 09:04:38 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:25:50.315 09:04:38 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:25:50.315 09:04:38 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:25:50.315 09:04:38 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:25:50.315 09:04:38 -- common/autotest_common.sh@643 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:50.315 09:04:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:50.315 09:04:38 -- common/autotest_common.sh@10 -- # set +x 00:25:50.315 request: 00:25:50.315 { 00:25:50.315 "name": "nvme_second", 00:25:50.315 "trtype": "tcp", 00:25:50.315 "traddr": "10.0.0.2", 00:25:50.315 "hostnqn": "nqn.2021-12.io.spdk:test", 00:25:50.315 "adrfam": "ipv4", 00:25:50.315 "trsvcid": "8009", 00:25:50.315 "wait_for_attach": true, 00:25:50.315 "method": "bdev_nvme_start_discovery", 00:25:50.315 "req_id": 1 00:25:50.315 } 00:25:50.315 Got JSON-RPC error response 00:25:50.315 response: 00:25:50.315 { 00:25:50.315 "code": -17, 00:25:50.315 "message": "File exists" 00:25:50.315 } 00:25:50.315 09:04:38 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:25:50.315 09:04:38 -- common/autotest_common.sh@643 -- # es=1 00:25:50.315 09:04:38 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:25:50.315 09:04:38 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:25:50.315 09:04:38 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:25:50.315 09:04:38 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:25:50.315 09:04:38 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:25:50.315 09:04:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:50.315 09:04:38 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:25:50.315 09:04:38 -- common/autotest_common.sh@10 -- # set +x 00:25:50.315 09:04:38 -- host/discovery.sh@67 -- # sort 00:25:50.315 09:04:38 -- host/discovery.sh@67 -- # xargs 00:25:50.315 09:04:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:50.315 09:04:38 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:25:50.315 09:04:38 -- host/discovery.sh@153 -- # get_bdev_list 00:25:50.315 09:04:38 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:50.315 09:04:38 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:50.315 09:04:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:50.315 09:04:38 -- common/autotest_common.sh@10 -- # set +x 00:25:50.315 09:04:38 -- host/discovery.sh@55 -- # sort 00:25:50.315 09:04:38 -- host/discovery.sh@55 -- # xargs 00:25:50.315 09:04:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:50.575 09:04:38 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:25:50.575 09:04:38 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:25:50.575 09:04:38 -- common/autotest_common.sh@640 -- # local es=0 00:25:50.575 09:04:38 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:25:50.575 09:04:38 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:25:50.575 09:04:38 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:25:50.575 09:04:38 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:25:50.575 09:04:38 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:25:50.575 09:04:38 -- common/autotest_common.sh@643 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:25:50.575 09:04:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:50.575 09:04:38 -- common/autotest_common.sh@10 -- # set +x 00:25:51.514 [2024-07-15 09:04:39.884888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:51.514 [2024-07-15 09:04:39.885070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:51.514 [2024-07-15 09:04:39.885099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x21a4070 with addr=10.0.0.2, port=8010 00:25:51.514 [2024-07-15 09:04:39.885130] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:25:51.514 [2024-07-15 09:04:39.885146] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:25:51.514 [2024-07-15 09:04:39.885159] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:25:52.453 [2024-07-15 09:04:40.887199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:52.453 [2024-07-15 09:04:40.887411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:52.453 [2024-07-15 09:04:40.887439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x21a4070 with addr=10.0.0.2, port=8010 00:25:52.453 [2024-07-15 09:04:40.887478] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:25:52.453 [2024-07-15 09:04:40.887495] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:25:52.453 [2024-07-15 09:04:40.887509] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:25:53.389 [2024-07-15 09:04:41.889420] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:25:53.389 request: 00:25:53.389 { 00:25:53.389 "name": "nvme_second", 00:25:53.389 "trtype": "tcp", 00:25:53.389 "traddr": "10.0.0.2", 00:25:53.389 "hostnqn": "nqn.2021-12.io.spdk:test", 00:25:53.389 "adrfam": "ipv4", 00:25:53.389 "trsvcid": "8010", 00:25:53.389 "attach_timeout_ms": 3000, 00:25:53.389 "method": "bdev_nvme_start_discovery", 00:25:53.389 "req_id": 1 00:25:53.389 } 00:25:53.389 Got JSON-RPC error response 00:25:53.389 response: 00:25:53.389 { 00:25:53.389 "code": -110, 00:25:53.389 "message": "Connection timed out" 00:25:53.389 } 00:25:53.389 09:04:41 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:25:53.389 09:04:41 -- common/autotest_common.sh@643 -- # es=1 00:25:53.389 09:04:41 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:25:53.389 09:04:41 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:25:53.389 09:04:41 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:25:53.389 09:04:41 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:25:53.389 09:04:41 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:25:53.389 09:04:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:53.389 09:04:41 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:25:53.389 09:04:41 -- common/autotest_common.sh@10 -- # set +x 00:25:53.389 09:04:41 -- host/discovery.sh@67 -- # sort 00:25:53.389 09:04:41 -- host/discovery.sh@67 -- # xargs 00:25:53.389 09:04:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:53.649 09:04:41 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:25:53.649 09:04:41 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:25:53.649 09:04:41 -- host/discovery.sh@162 -- # kill 1602991 00:25:53.649 09:04:41 -- host/discovery.sh@163 -- # nvmftestfini 00:25:53.649 09:04:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:53.649 09:04:41 -- nvmf/common.sh@116 -- # sync 00:25:53.649 09:04:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:53.649 09:04:41 -- nvmf/common.sh@119 -- # set +e 00:25:53.649 09:04:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:53.649 09:04:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:53.649 rmmod nvme_tcp 00:25:53.649 rmmod nvme_fabrics 00:25:53.649 rmmod nvme_keyring 00:25:53.649 09:04:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:53.649 09:04:41 -- nvmf/common.sh@123 -- # set -e 00:25:53.649 09:04:41 -- nvmf/common.sh@124 -- # return 0 00:25:53.649 09:04:41 -- nvmf/common.sh@477 -- # '[' -n 1602836 ']' 00:25:53.649 09:04:41 -- nvmf/common.sh@478 -- # killprocess 1602836 00:25:53.649 09:04:41 -- common/autotest_common.sh@926 -- # '[' -z 1602836 ']' 00:25:53.649 09:04:41 -- common/autotest_common.sh@930 -- # kill -0 1602836 00:25:53.649 09:04:41 -- common/autotest_common.sh@931 -- # uname 00:25:53.649 09:04:41 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:53.649 09:04:41 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1602836 00:25:53.649 09:04:42 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:25:53.649 09:04:42 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:25:53.649 09:04:42 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1602836' 00:25:53.649 killing process with pid 1602836 00:25:53.649 09:04:42 -- common/autotest_common.sh@945 -- # kill 1602836 00:25:53.649 09:04:42 -- common/autotest_common.sh@950 -- # wait 1602836 00:25:53.910 09:04:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:53.910 09:04:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:53.910 09:04:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:53.910 09:04:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:53.910 09:04:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:53.910 09:04:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:53.910 09:04:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:53.910 09:04:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:55.826 09:04:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:55.826 00:25:55.826 real 0m17.266s 00:25:55.826 user 0m26.784s 00:25:55.826 sys 0m2.918s 00:25:55.826 09:04:44 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:25:55.826 09:04:44 -- common/autotest_common.sh@10 -- # set +x 00:25:55.826 ************************************ 00:25:55.826 END TEST nvmf_discovery 00:25:55.826 ************************************ 00:25:55.826 09:04:44 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:25:55.826 09:04:44 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:25:55.826 09:04:44 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:25:55.826 09:04:44 -- common/autotest_common.sh@10 -- # set +x 00:25:55.826 ************************************ 00:25:55.826 START TEST nvmf_discovery_remove_ifc 00:25:55.826 ************************************ 00:25:55.826 09:04:44 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:25:56.083 * Looking for test storage... 00:25:56.083 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:56.083 09:04:44 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:56.083 09:04:44 -- nvmf/common.sh@7 -- # uname -s 00:25:56.083 09:04:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:56.083 09:04:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:56.083 09:04:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:56.083 09:04:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:56.083 09:04:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:56.083 09:04:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:56.083 09:04:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:56.083 09:04:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:56.083 09:04:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:56.083 09:04:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:56.083 09:04:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:56.083 09:04:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:56.083 09:04:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:56.083 09:04:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:56.084 09:04:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:56.084 09:04:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:56.084 09:04:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:56.084 09:04:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:56.084 09:04:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:56.084 09:04:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:56.084 09:04:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:56.084 09:04:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:56.084 09:04:44 -- paths/export.sh@5 -- # export PATH 00:25:56.084 09:04:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:56.084 09:04:44 -- nvmf/common.sh@46 -- # : 0 00:25:56.084 09:04:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:56.084 09:04:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:56.084 09:04:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:56.084 09:04:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:56.084 09:04:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:56.084 09:04:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:56.084 09:04:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:56.084 09:04:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:56.084 09:04:44 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:25:56.084 09:04:44 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:25:56.084 09:04:44 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:25:56.084 09:04:44 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:25:56.084 09:04:44 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:25:56.084 09:04:44 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:25:56.084 09:04:44 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:25:56.084 09:04:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:56.084 09:04:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:56.084 09:04:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:56.084 09:04:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:56.084 09:04:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:56.084 09:04:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:56.084 09:04:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:56.084 09:04:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:56.084 09:04:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:56.084 09:04:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:56.084 09:04:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:56.084 09:04:44 -- common/autotest_common.sh@10 -- # set +x 00:25:57.986 09:04:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:57.986 09:04:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:57.986 09:04:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:57.986 09:04:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:57.986 09:04:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:57.986 09:04:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:57.986 09:04:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:57.986 09:04:46 -- nvmf/common.sh@294 -- # net_devs=() 00:25:57.986 09:04:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:57.986 09:04:46 -- nvmf/common.sh@295 -- # e810=() 00:25:57.986 09:04:46 -- nvmf/common.sh@295 -- # local -ga e810 00:25:57.986 09:04:46 -- nvmf/common.sh@296 -- # x722=() 00:25:57.986 09:04:46 -- nvmf/common.sh@296 -- # local -ga x722 00:25:57.986 09:04:46 -- nvmf/common.sh@297 -- # mlx=() 00:25:57.986 09:04:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:57.986 09:04:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:57.986 09:04:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:57.986 09:04:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:57.986 09:04:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:57.986 09:04:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:57.986 09:04:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:57.986 09:04:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:57.986 09:04:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:57.986 09:04:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:57.986 09:04:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:57.986 09:04:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:57.986 09:04:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:57.986 09:04:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:57.986 09:04:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:57.986 09:04:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:57.986 09:04:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:57.986 09:04:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:57.986 09:04:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:57.986 09:04:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:57.986 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:57.986 09:04:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:57.986 09:04:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:57.986 09:04:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:57.986 09:04:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:57.986 09:04:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:57.986 09:04:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:57.986 09:04:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:57.986 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:57.986 09:04:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:57.986 09:04:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:57.986 09:04:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:57.986 09:04:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:57.986 09:04:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:57.986 09:04:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:57.986 09:04:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:57.986 09:04:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:57.986 09:04:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:57.986 09:04:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:57.986 09:04:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:57.986 09:04:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:57.986 09:04:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:57.986 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:57.986 09:04:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:57.986 09:04:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:57.986 09:04:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:57.986 09:04:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:57.986 09:04:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:57.986 09:04:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:57.986 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:57.986 09:04:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:57.986 09:04:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:57.986 09:04:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:57.986 09:04:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:57.986 09:04:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:57.986 09:04:46 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:57.986 09:04:46 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:57.986 09:04:46 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:57.986 09:04:46 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:57.986 09:04:46 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:57.986 09:04:46 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:57.986 09:04:46 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:57.986 09:04:46 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:57.986 09:04:46 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:57.986 09:04:46 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:57.986 09:04:46 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:57.986 09:04:46 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:57.986 09:04:46 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:57.986 09:04:46 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:57.986 09:04:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:57.986 09:04:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:57.986 09:04:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:57.986 09:04:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:58.245 09:04:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:58.245 09:04:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:58.245 09:04:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:58.245 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:58.245 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.125 ms 00:25:58.245 00:25:58.245 --- 10.0.0.2 ping statistics --- 00:25:58.245 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:58.245 rtt min/avg/max/mdev = 0.125/0.125/0.125/0.000 ms 00:25:58.245 09:04:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:58.245 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:58.245 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.072 ms 00:25:58.245 00:25:58.245 --- 10.0.0.1 ping statistics --- 00:25:58.245 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:58.245 rtt min/avg/max/mdev = 0.072/0.072/0.072/0.000 ms 00:25:58.245 09:04:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:58.245 09:04:46 -- nvmf/common.sh@410 -- # return 0 00:25:58.245 09:04:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:58.245 09:04:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:58.245 09:04:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:58.245 09:04:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:58.245 09:04:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:58.245 09:04:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:58.245 09:04:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:58.245 09:04:46 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:25:58.245 09:04:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:58.245 09:04:46 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:58.245 09:04:46 -- common/autotest_common.sh@10 -- # set +x 00:25:58.245 09:04:46 -- nvmf/common.sh@469 -- # nvmfpid=1606464 00:25:58.245 09:04:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:25:58.245 09:04:46 -- nvmf/common.sh@470 -- # waitforlisten 1606464 00:25:58.245 09:04:46 -- common/autotest_common.sh@819 -- # '[' -z 1606464 ']' 00:25:58.245 09:04:46 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:58.245 09:04:46 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:58.245 09:04:46 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:58.245 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:58.245 09:04:46 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:58.245 09:04:46 -- common/autotest_common.sh@10 -- # set +x 00:25:58.245 [2024-07-15 09:04:46.627017] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:25:58.245 [2024-07-15 09:04:46.627091] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:58.245 EAL: No free 2048 kB hugepages reported on node 1 00:25:58.245 [2024-07-15 09:04:46.696223] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:58.503 [2024-07-15 09:04:46.813003] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:58.503 [2024-07-15 09:04:46.813152] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:58.503 [2024-07-15 09:04:46.813196] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:58.503 [2024-07-15 09:04:46.813211] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:58.503 [2024-07-15 09:04:46.813258] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:59.439 09:04:47 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:59.439 09:04:47 -- common/autotest_common.sh@852 -- # return 0 00:25:59.439 09:04:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:59.439 09:04:47 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:59.439 09:04:47 -- common/autotest_common.sh@10 -- # set +x 00:25:59.439 09:04:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:59.439 09:04:47 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:25:59.439 09:04:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:59.439 09:04:47 -- common/autotest_common.sh@10 -- # set +x 00:25:59.439 [2024-07-15 09:04:47.689535] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:59.439 [2024-07-15 09:04:47.697705] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:25:59.439 null0 00:25:59.439 [2024-07-15 09:04:47.729669] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:59.439 09:04:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:59.439 09:04:47 -- host/discovery_remove_ifc.sh@59 -- # hostpid=1606619 00:25:59.439 09:04:47 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:25:59.439 09:04:47 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 1606619 /tmp/host.sock 00:25:59.439 09:04:47 -- common/autotest_common.sh@819 -- # '[' -z 1606619 ']' 00:25:59.439 09:04:47 -- common/autotest_common.sh@823 -- # local rpc_addr=/tmp/host.sock 00:25:59.439 09:04:47 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:59.439 09:04:47 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:25:59.439 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:25:59.439 09:04:47 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:59.439 09:04:47 -- common/autotest_common.sh@10 -- # set +x 00:25:59.439 [2024-07-15 09:04:47.789661] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:25:59.439 [2024-07-15 09:04:47.789736] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1606619 ] 00:25:59.439 EAL: No free 2048 kB hugepages reported on node 1 00:25:59.439 [2024-07-15 09:04:47.845728] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:59.439 [2024-07-15 09:04:47.950476] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:59.439 [2024-07-15 09:04:47.950663] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:59.697 09:04:48 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:59.697 09:04:48 -- common/autotest_common.sh@852 -- # return 0 00:25:59.697 09:04:48 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:59.697 09:04:48 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:25:59.697 09:04:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:59.697 09:04:48 -- common/autotest_common.sh@10 -- # set +x 00:25:59.697 09:04:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:59.697 09:04:48 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:25:59.697 09:04:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:59.697 09:04:48 -- common/autotest_common.sh@10 -- # set +x 00:25:59.697 09:04:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:59.697 09:04:48 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:25:59.697 09:04:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:59.697 09:04:48 -- common/autotest_common.sh@10 -- # set +x 00:26:00.705 [2024-07-15 09:04:49.198065] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:00.705 [2024-07-15 09:04:49.198095] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:00.705 [2024-07-15 09:04:49.198119] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:00.965 [2024-07-15 09:04:49.284412] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:26:00.965 [2024-07-15 09:04:49.347954] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:26:00.965 [2024-07-15 09:04:49.348001] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:26:00.965 [2024-07-15 09:04:49.348036] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:26:00.965 [2024-07-15 09:04:49.348058] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:00.965 [2024-07-15 09:04:49.348082] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:00.965 09:04:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:00.965 09:04:49 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:26:00.965 09:04:49 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:00.965 09:04:49 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:00.965 09:04:49 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:00.965 09:04:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:00.965 09:04:49 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:00.965 09:04:49 -- common/autotest_common.sh@10 -- # set +x 00:26:00.965 09:04:49 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:00.965 09:04:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:00.965 09:04:49 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:26:00.965 09:04:49 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:26:00.965 [2024-07-15 09:04:49.396665] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0xf2c1f0 was disconnected and freed. delete nvme_qpair. 00:26:00.965 09:04:49 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:26:00.965 09:04:49 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:26:00.965 09:04:49 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:00.965 09:04:49 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:00.965 09:04:49 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:00.965 09:04:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:00.965 09:04:49 -- common/autotest_common.sh@10 -- # set +x 00:26:00.965 09:04:49 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:00.965 09:04:49 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:00.965 09:04:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:00.965 09:04:49 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:00.965 09:04:49 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:02.341 09:04:50 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:02.341 09:04:50 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:02.341 09:04:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:02.341 09:04:50 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:02.341 09:04:50 -- common/autotest_common.sh@10 -- # set +x 00:26:02.341 09:04:50 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:02.341 09:04:50 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:02.341 09:04:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:02.341 09:04:50 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:02.341 09:04:50 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:03.275 09:04:51 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:03.276 09:04:51 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:03.276 09:04:51 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:03.276 09:04:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:03.276 09:04:51 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:03.276 09:04:51 -- common/autotest_common.sh@10 -- # set +x 00:26:03.276 09:04:51 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:03.276 09:04:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:03.276 09:04:51 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:03.276 09:04:51 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:04.209 09:04:52 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:04.209 09:04:52 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:04.209 09:04:52 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:04.209 09:04:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:04.209 09:04:52 -- common/autotest_common.sh@10 -- # set +x 00:26:04.209 09:04:52 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:04.209 09:04:52 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:04.209 09:04:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:04.209 09:04:52 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:04.209 09:04:52 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:05.146 09:04:53 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:05.146 09:04:53 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:05.146 09:04:53 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:05.146 09:04:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:05.146 09:04:53 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:05.146 09:04:53 -- common/autotest_common.sh@10 -- # set +x 00:26:05.146 09:04:53 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:05.146 09:04:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:05.146 09:04:53 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:05.146 09:04:53 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:06.518 09:04:54 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:06.518 09:04:54 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:06.518 09:04:54 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:06.518 09:04:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:06.518 09:04:54 -- common/autotest_common.sh@10 -- # set +x 00:26:06.518 09:04:54 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:06.518 09:04:54 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:06.518 09:04:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:06.518 09:04:54 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:06.518 09:04:54 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:06.518 [2024-07-15 09:04:54.789022] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:26:06.518 [2024-07-15 09:04:54.789090] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:06.518 [2024-07-15 09:04:54.789110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:06.518 [2024-07-15 09:04:54.789125] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:06.518 [2024-07-15 09:04:54.789138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:06.518 [2024-07-15 09:04:54.789152] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:06.518 [2024-07-15 09:04:54.789164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:06.518 [2024-07-15 09:04:54.789177] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:06.518 [2024-07-15 09:04:54.789189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:06.518 [2024-07-15 09:04:54.789217] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:06.518 [2024-07-15 09:04:54.789233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:06.518 [2024-07-15 09:04:54.789247] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xef2810 is same with the state(5) to be set 00:26:06.518 [2024-07-15 09:04:54.799042] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xef2810 (9): Bad file descriptor 00:26:06.518 [2024-07-15 09:04:54.809090] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:07.457 09:04:55 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:07.457 09:04:55 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:07.457 09:04:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:07.457 09:04:55 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:07.457 09:04:55 -- common/autotest_common.sh@10 -- # set +x 00:26:07.457 09:04:55 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:07.457 09:04:55 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:07.457 [2024-07-15 09:04:55.826939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:26:08.395 [2024-07-15 09:04:56.850929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:26:08.395 [2024-07-15 09:04:56.851004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xef2810 with addr=10.0.0.2, port=4420 00:26:08.395 [2024-07-15 09:04:56.851032] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xef2810 is same with the state(5) to be set 00:26:08.395 [2024-07-15 09:04:56.851080] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:08.395 [2024-07-15 09:04:56.851099] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:08.395 [2024-07-15 09:04:56.851114] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:08.395 [2024-07-15 09:04:56.851129] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:26:08.395 [2024-07-15 09:04:56.851579] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xef2810 (9): Bad file descriptor 00:26:08.395 [2024-07-15 09:04:56.851624] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:08.395 [2024-07-15 09:04:56.851671] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:26:08.395 [2024-07-15 09:04:56.851711] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:08.395 [2024-07-15 09:04:56.851735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:08.395 [2024-07-15 09:04:56.851754] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:08.395 [2024-07-15 09:04:56.851769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:08.395 [2024-07-15 09:04:56.851785] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:08.395 [2024-07-15 09:04:56.851799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:08.395 [2024-07-15 09:04:56.851814] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:08.395 [2024-07-15 09:04:56.851828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:08.395 [2024-07-15 09:04:56.851844] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:08.395 [2024-07-15 09:04:56.851858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:08.395 [2024-07-15 09:04:56.851872] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:26:08.395 [2024-07-15 09:04:56.852080] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xef2c20 (9): Bad file descriptor 00:26:08.395 [2024-07-15 09:04:56.853098] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:26:08.395 [2024-07-15 09:04:56.853119] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:26:08.395 09:04:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:08.395 09:04:56 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:08.395 09:04:56 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:09.330 09:04:57 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:09.330 09:04:57 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:09.330 09:04:57 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:09.331 09:04:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:09.331 09:04:57 -- common/autotest_common.sh@10 -- # set +x 00:26:09.331 09:04:57 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:09.331 09:04:57 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:09.589 09:04:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:09.589 09:04:57 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:26:09.589 09:04:57 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:09.589 09:04:57 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:09.589 09:04:57 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:26:09.589 09:04:57 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:09.589 09:04:57 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:09.589 09:04:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:09.589 09:04:57 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:09.589 09:04:57 -- common/autotest_common.sh@10 -- # set +x 00:26:09.589 09:04:57 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:09.589 09:04:57 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:09.589 09:04:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:09.589 09:04:57 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:26:09.589 09:04:57 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:10.528 [2024-07-15 09:04:58.904785] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:10.528 [2024-07-15 09:04:58.904815] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:10.528 [2024-07-15 09:04:58.904841] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:10.528 09:04:58 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:10.528 09:04:58 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:10.528 09:04:58 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:10.528 09:04:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:10.528 09:04:58 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:10.528 09:04:58 -- common/autotest_common.sh@10 -- # set +x 00:26:10.528 09:04:58 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:10.528 09:04:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:10.528 [2024-07-15 09:04:59.033311] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:26:10.528 09:04:59 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:26:10.528 09:04:59 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:10.786 [2024-07-15 09:04:59.214647] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:26:10.786 [2024-07-15 09:04:59.214690] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:26:10.786 [2024-07-15 09:04:59.214720] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:26:10.786 [2024-07-15 09:04:59.214740] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:26:10.786 [2024-07-15 09:04:59.214753] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:10.786 [2024-07-15 09:04:59.221953] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0xf016e0 was disconnected and freed. delete nvme_qpair. 00:26:11.721 09:05:00 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:11.721 09:05:00 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:11.721 09:05:00 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:11.721 09:05:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:11.721 09:05:00 -- common/autotest_common.sh@10 -- # set +x 00:26:11.721 09:05:00 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:11.721 09:05:00 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:11.721 09:05:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:11.721 09:05:00 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:26:11.721 09:05:00 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:26:11.721 09:05:00 -- host/discovery_remove_ifc.sh@90 -- # killprocess 1606619 00:26:11.721 09:05:00 -- common/autotest_common.sh@926 -- # '[' -z 1606619 ']' 00:26:11.721 09:05:00 -- common/autotest_common.sh@930 -- # kill -0 1606619 00:26:11.721 09:05:00 -- common/autotest_common.sh@931 -- # uname 00:26:11.721 09:05:00 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:11.721 09:05:00 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1606619 00:26:11.721 09:05:00 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:26:11.721 09:05:00 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:26:11.721 09:05:00 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1606619' 00:26:11.721 killing process with pid 1606619 00:26:11.721 09:05:00 -- common/autotest_common.sh@945 -- # kill 1606619 00:26:11.721 09:05:00 -- common/autotest_common.sh@950 -- # wait 1606619 00:26:11.981 09:05:00 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:26:11.981 09:05:00 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:11.981 09:05:00 -- nvmf/common.sh@116 -- # sync 00:26:11.981 09:05:00 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:11.981 09:05:00 -- nvmf/common.sh@119 -- # set +e 00:26:11.981 09:05:00 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:11.981 09:05:00 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:11.981 rmmod nvme_tcp 00:26:11.981 rmmod nvme_fabrics 00:26:11.981 rmmod nvme_keyring 00:26:11.981 09:05:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:11.981 09:05:00 -- nvmf/common.sh@123 -- # set -e 00:26:11.981 09:05:00 -- nvmf/common.sh@124 -- # return 0 00:26:11.981 09:05:00 -- nvmf/common.sh@477 -- # '[' -n 1606464 ']' 00:26:11.981 09:05:00 -- nvmf/common.sh@478 -- # killprocess 1606464 00:26:11.981 09:05:00 -- common/autotest_common.sh@926 -- # '[' -z 1606464 ']' 00:26:11.981 09:05:00 -- common/autotest_common.sh@930 -- # kill -0 1606464 00:26:11.981 09:05:00 -- common/autotest_common.sh@931 -- # uname 00:26:11.981 09:05:00 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:11.981 09:05:00 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1606464 00:26:11.981 09:05:00 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:26:11.981 09:05:00 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:26:11.981 09:05:00 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1606464' 00:26:11.981 killing process with pid 1606464 00:26:11.981 09:05:00 -- common/autotest_common.sh@945 -- # kill 1606464 00:26:11.981 09:05:00 -- common/autotest_common.sh@950 -- # wait 1606464 00:26:12.240 09:05:00 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:12.240 09:05:00 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:12.240 09:05:00 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:12.240 09:05:00 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:12.240 09:05:00 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:12.240 09:05:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:12.240 09:05:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:12.240 09:05:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:14.790 09:05:02 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:14.790 00:26:14.790 real 0m18.421s 00:26:14.790 user 0m25.568s 00:26:14.790 sys 0m2.999s 00:26:14.790 09:05:02 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:26:14.790 09:05:02 -- common/autotest_common.sh@10 -- # set +x 00:26:14.790 ************************************ 00:26:14.790 END TEST nvmf_discovery_remove_ifc 00:26:14.790 ************************************ 00:26:14.790 09:05:02 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:26:14.790 09:05:02 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:26:14.790 09:05:02 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:26:14.790 09:05:02 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:26:14.790 09:05:02 -- common/autotest_common.sh@10 -- # set +x 00:26:14.790 ************************************ 00:26:14.790 START TEST nvmf_digest 00:26:14.790 ************************************ 00:26:14.790 09:05:02 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:26:14.790 * Looking for test storage... 00:26:14.790 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:14.790 09:05:02 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:14.790 09:05:02 -- nvmf/common.sh@7 -- # uname -s 00:26:14.790 09:05:02 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:14.790 09:05:02 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:14.791 09:05:02 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:14.791 09:05:02 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:14.791 09:05:02 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:14.791 09:05:02 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:14.791 09:05:02 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:14.791 09:05:02 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:14.791 09:05:02 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:14.791 09:05:02 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:14.791 09:05:02 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:14.791 09:05:02 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:14.791 09:05:02 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:14.791 09:05:02 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:14.791 09:05:02 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:14.791 09:05:02 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:14.791 09:05:02 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:14.791 09:05:02 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:14.791 09:05:02 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:14.791 09:05:02 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:14.791 09:05:02 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:14.791 09:05:02 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:14.791 09:05:02 -- paths/export.sh@5 -- # export PATH 00:26:14.791 09:05:02 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:14.791 09:05:02 -- nvmf/common.sh@46 -- # : 0 00:26:14.791 09:05:02 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:14.791 09:05:02 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:14.791 09:05:02 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:14.791 09:05:02 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:14.791 09:05:02 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:14.791 09:05:02 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:14.791 09:05:02 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:14.791 09:05:02 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:14.791 09:05:02 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:26:14.791 09:05:02 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:26:14.791 09:05:02 -- host/digest.sh@16 -- # runtime=2 00:26:14.791 09:05:02 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:26:14.791 09:05:02 -- host/digest.sh@132 -- # nvmftestinit 00:26:14.791 09:05:02 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:14.791 09:05:02 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:14.791 09:05:02 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:14.791 09:05:02 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:14.791 09:05:02 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:14.791 09:05:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:14.791 09:05:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:14.791 09:05:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:14.791 09:05:02 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:14.791 09:05:02 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:14.791 09:05:02 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:14.791 09:05:02 -- common/autotest_common.sh@10 -- # set +x 00:26:16.728 09:05:04 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:16.728 09:05:04 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:16.728 09:05:04 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:16.728 09:05:04 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:16.728 09:05:04 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:16.728 09:05:04 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:16.728 09:05:04 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:16.728 09:05:04 -- nvmf/common.sh@294 -- # net_devs=() 00:26:16.728 09:05:04 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:16.728 09:05:04 -- nvmf/common.sh@295 -- # e810=() 00:26:16.728 09:05:04 -- nvmf/common.sh@295 -- # local -ga e810 00:26:16.728 09:05:04 -- nvmf/common.sh@296 -- # x722=() 00:26:16.728 09:05:04 -- nvmf/common.sh@296 -- # local -ga x722 00:26:16.728 09:05:04 -- nvmf/common.sh@297 -- # mlx=() 00:26:16.728 09:05:04 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:16.728 09:05:04 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:16.728 09:05:04 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:16.728 09:05:04 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:16.728 09:05:04 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:16.728 09:05:04 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:16.728 09:05:04 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:16.728 09:05:04 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:16.728 09:05:04 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:16.728 09:05:04 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:16.728 09:05:04 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:16.728 09:05:04 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:16.728 09:05:04 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:16.728 09:05:04 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:16.728 09:05:04 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:16.728 09:05:04 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:16.728 09:05:04 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:16.728 09:05:04 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:16.728 09:05:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:16.728 09:05:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:16.728 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:16.728 09:05:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:16.728 09:05:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:16.728 09:05:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:16.728 09:05:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:16.728 09:05:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:16.728 09:05:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:16.728 09:05:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:16.728 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:16.728 09:05:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:16.728 09:05:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:16.728 09:05:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:16.728 09:05:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:16.728 09:05:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:16.728 09:05:04 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:16.728 09:05:04 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:16.728 09:05:04 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:16.728 09:05:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:16.728 09:05:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:16.728 09:05:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:16.728 09:05:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:16.728 09:05:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:16.728 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:16.728 09:05:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:16.728 09:05:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:16.728 09:05:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:16.728 09:05:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:16.728 09:05:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:16.728 09:05:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:16.728 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:16.728 09:05:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:16.728 09:05:04 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:16.728 09:05:04 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:16.728 09:05:04 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:16.728 09:05:04 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:16.728 09:05:04 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:16.728 09:05:04 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:16.728 09:05:04 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:16.728 09:05:04 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:16.728 09:05:04 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:16.728 09:05:04 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:16.728 09:05:04 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:16.728 09:05:04 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:16.728 09:05:04 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:16.728 09:05:04 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:16.728 09:05:04 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:16.728 09:05:04 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:16.728 09:05:04 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:16.728 09:05:04 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:16.728 09:05:04 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:16.728 09:05:04 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:16.728 09:05:04 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:16.728 09:05:04 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:16.728 09:05:04 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:16.728 09:05:04 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:16.728 09:05:04 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:16.728 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:16.728 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.238 ms 00:26:16.728 00:26:16.728 --- 10.0.0.2 ping statistics --- 00:26:16.728 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:16.728 rtt min/avg/max/mdev = 0.238/0.238/0.238/0.000 ms 00:26:16.728 09:05:04 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:16.728 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:16.728 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.183 ms 00:26:16.728 00:26:16.728 --- 10.0.0.1 ping statistics --- 00:26:16.728 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:16.728 rtt min/avg/max/mdev = 0.183/0.183/0.183/0.000 ms 00:26:16.728 09:05:04 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:16.728 09:05:04 -- nvmf/common.sh@410 -- # return 0 00:26:16.728 09:05:04 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:16.728 09:05:04 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:16.728 09:05:04 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:16.728 09:05:04 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:16.728 09:05:04 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:16.728 09:05:04 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:16.728 09:05:04 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:16.728 09:05:04 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:26:16.728 09:05:04 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:26:16.728 09:05:04 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:26:16.728 09:05:04 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:26:16.728 09:05:04 -- common/autotest_common.sh@10 -- # set +x 00:26:16.728 ************************************ 00:26:16.728 START TEST nvmf_digest_clean 00:26:16.728 ************************************ 00:26:16.728 09:05:04 -- common/autotest_common.sh@1104 -- # run_digest 00:26:16.728 09:05:04 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:26:16.728 09:05:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:16.728 09:05:04 -- common/autotest_common.sh@712 -- # xtrace_disable 00:26:16.728 09:05:04 -- common/autotest_common.sh@10 -- # set +x 00:26:16.728 09:05:04 -- nvmf/common.sh@469 -- # nvmfpid=1610156 00:26:16.728 09:05:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:26:16.728 09:05:04 -- nvmf/common.sh@470 -- # waitforlisten 1610156 00:26:16.728 09:05:04 -- common/autotest_common.sh@819 -- # '[' -z 1610156 ']' 00:26:16.728 09:05:04 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:16.728 09:05:04 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:16.728 09:05:04 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:16.728 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:16.728 09:05:04 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:16.728 09:05:04 -- common/autotest_common.sh@10 -- # set +x 00:26:16.728 [2024-07-15 09:05:04.946795] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:26:16.728 [2024-07-15 09:05:04.946886] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:16.728 EAL: No free 2048 kB hugepages reported on node 1 00:26:16.728 [2024-07-15 09:05:05.015665] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:16.728 [2024-07-15 09:05:05.121155] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:16.728 [2024-07-15 09:05:05.121321] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:16.728 [2024-07-15 09:05:05.121339] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:16.728 [2024-07-15 09:05:05.121351] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:16.728 [2024-07-15 09:05:05.121389] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:16.728 09:05:05 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:16.728 09:05:05 -- common/autotest_common.sh@852 -- # return 0 00:26:16.728 09:05:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:16.728 09:05:05 -- common/autotest_common.sh@718 -- # xtrace_disable 00:26:16.729 09:05:05 -- common/autotest_common.sh@10 -- # set +x 00:26:16.729 09:05:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:16.729 09:05:05 -- host/digest.sh@120 -- # common_target_config 00:26:16.729 09:05:05 -- host/digest.sh@43 -- # rpc_cmd 00:26:16.729 09:05:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:16.729 09:05:05 -- common/autotest_common.sh@10 -- # set +x 00:26:16.987 null0 00:26:16.987 [2024-07-15 09:05:05.285458] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:16.987 [2024-07-15 09:05:05.309691] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:16.987 09:05:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:16.987 09:05:05 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:26:16.987 09:05:05 -- host/digest.sh@77 -- # local rw bs qd 00:26:16.987 09:05:05 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:16.987 09:05:05 -- host/digest.sh@80 -- # rw=randread 00:26:16.987 09:05:05 -- host/digest.sh@80 -- # bs=4096 00:26:16.987 09:05:05 -- host/digest.sh@80 -- # qd=128 00:26:16.987 09:05:05 -- host/digest.sh@82 -- # bperfpid=1610284 00:26:16.987 09:05:05 -- host/digest.sh@83 -- # waitforlisten 1610284 /var/tmp/bperf.sock 00:26:16.987 09:05:05 -- common/autotest_common.sh@819 -- # '[' -z 1610284 ']' 00:26:16.987 09:05:05 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:16.987 09:05:05 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:16.987 09:05:05 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:16.987 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:16.987 09:05:05 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:26:16.987 09:05:05 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:16.987 09:05:05 -- common/autotest_common.sh@10 -- # set +x 00:26:16.987 [2024-07-15 09:05:05.354215] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:26:16.987 [2024-07-15 09:05:05.354288] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1610284 ] 00:26:16.987 EAL: No free 2048 kB hugepages reported on node 1 00:26:16.987 [2024-07-15 09:05:05.412375] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:16.987 [2024-07-15 09:05:05.519692] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:17.247 09:05:05 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:17.247 09:05:05 -- common/autotest_common.sh@852 -- # return 0 00:26:17.247 09:05:05 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:17.247 09:05:05 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:17.247 09:05:05 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:17.505 09:05:05 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:17.506 09:05:05 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:18.074 nvme0n1 00:26:18.074 09:05:06 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:18.074 09:05:06 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:18.074 Running I/O for 2 seconds... 00:26:19.979 00:26:19.979 Latency(us) 00:26:19.979 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:19.979 Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:26:19.979 nvme0n1 : 2.01 14857.41 58.04 0.00 0.00 8607.26 7427.41 24466.77 00:26:19.979 =================================================================================================================== 00:26:19.979 Total : 14857.41 58.04 0.00 0.00 8607.26 7427.41 24466.77 00:26:19.979 0 00:26:20.238 09:05:08 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:20.238 09:05:08 -- host/digest.sh@92 -- # get_accel_stats 00:26:20.238 09:05:08 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:20.238 09:05:08 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:20.238 09:05:08 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:20.238 | select(.opcode=="crc32c") 00:26:20.238 | "\(.module_name) \(.executed)"' 00:26:20.238 09:05:08 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:20.238 09:05:08 -- host/digest.sh@93 -- # exp_module=software 00:26:20.238 09:05:08 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:20.238 09:05:08 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:20.238 09:05:08 -- host/digest.sh@97 -- # killprocess 1610284 00:26:20.238 09:05:08 -- common/autotest_common.sh@926 -- # '[' -z 1610284 ']' 00:26:20.238 09:05:08 -- common/autotest_common.sh@930 -- # kill -0 1610284 00:26:20.238 09:05:08 -- common/autotest_common.sh@931 -- # uname 00:26:20.238 09:05:08 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:20.238 09:05:08 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1610284 00:26:20.496 09:05:08 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:26:20.496 09:05:08 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:26:20.496 09:05:08 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1610284' 00:26:20.496 killing process with pid 1610284 00:26:20.496 09:05:08 -- common/autotest_common.sh@945 -- # kill 1610284 00:26:20.496 Received shutdown signal, test time was about 2.000000 seconds 00:26:20.496 00:26:20.496 Latency(us) 00:26:20.496 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:20.496 =================================================================================================================== 00:26:20.496 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:20.496 09:05:08 -- common/autotest_common.sh@950 -- # wait 1610284 00:26:20.496 09:05:09 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:26:20.496 09:05:09 -- host/digest.sh@77 -- # local rw bs qd 00:26:20.496 09:05:09 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:20.496 09:05:09 -- host/digest.sh@80 -- # rw=randread 00:26:20.496 09:05:09 -- host/digest.sh@80 -- # bs=131072 00:26:20.754 09:05:09 -- host/digest.sh@80 -- # qd=16 00:26:20.754 09:05:09 -- host/digest.sh@82 -- # bperfpid=1610706 00:26:20.754 09:05:09 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:26:20.754 09:05:09 -- host/digest.sh@83 -- # waitforlisten 1610706 /var/tmp/bperf.sock 00:26:20.754 09:05:09 -- common/autotest_common.sh@819 -- # '[' -z 1610706 ']' 00:26:20.754 09:05:09 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:20.754 09:05:09 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:20.754 09:05:09 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:20.754 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:20.754 09:05:09 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:20.754 09:05:09 -- common/autotest_common.sh@10 -- # set +x 00:26:20.754 [2024-07-15 09:05:09.075864] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:26:20.754 [2024-07-15 09:05:09.075968] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1610706 ] 00:26:20.754 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:20.754 Zero copy mechanism will not be used. 00:26:20.754 EAL: No free 2048 kB hugepages reported on node 1 00:26:20.754 [2024-07-15 09:05:09.134463] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:20.754 [2024-07-15 09:05:09.241070] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:20.754 09:05:09 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:20.754 09:05:09 -- common/autotest_common.sh@852 -- # return 0 00:26:20.754 09:05:09 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:20.754 09:05:09 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:20.754 09:05:09 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:21.323 09:05:09 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:21.323 09:05:09 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:21.584 nvme0n1 00:26:21.584 09:05:09 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:21.584 09:05:09 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:21.584 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:21.584 Zero copy mechanism will not be used. 00:26:21.584 Running I/O for 2 seconds... 00:26:23.492 00:26:23.492 Latency(us) 00:26:23.492 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:23.492 Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:26:23.492 nvme0n1 : 2.00 3528.97 441.12 0.00 0.00 4529.68 3932.16 13689.74 00:26:23.492 =================================================================================================================== 00:26:23.492 Total : 3528.97 441.12 0.00 0.00 4529.68 3932.16 13689.74 00:26:23.492 0 00:26:23.750 09:05:12 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:23.750 09:05:12 -- host/digest.sh@92 -- # get_accel_stats 00:26:23.750 09:05:12 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:23.750 09:05:12 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:23.750 09:05:12 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:23.750 | select(.opcode=="crc32c") 00:26:23.750 | "\(.module_name) \(.executed)"' 00:26:23.750 09:05:12 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:23.750 09:05:12 -- host/digest.sh@93 -- # exp_module=software 00:26:23.750 09:05:12 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:23.750 09:05:12 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:23.750 09:05:12 -- host/digest.sh@97 -- # killprocess 1610706 00:26:23.750 09:05:12 -- common/autotest_common.sh@926 -- # '[' -z 1610706 ']' 00:26:23.750 09:05:12 -- common/autotest_common.sh@930 -- # kill -0 1610706 00:26:23.750 09:05:12 -- common/autotest_common.sh@931 -- # uname 00:26:23.750 09:05:12 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:23.750 09:05:12 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1610706 00:26:24.008 09:05:12 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:26:24.008 09:05:12 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:26:24.008 09:05:12 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1610706' 00:26:24.008 killing process with pid 1610706 00:26:24.008 09:05:12 -- common/autotest_common.sh@945 -- # kill 1610706 00:26:24.008 Received shutdown signal, test time was about 2.000000 seconds 00:26:24.008 00:26:24.008 Latency(us) 00:26:24.008 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:24.008 =================================================================================================================== 00:26:24.008 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:24.008 09:05:12 -- common/autotest_common.sh@950 -- # wait 1610706 00:26:24.265 09:05:12 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:26:24.265 09:05:12 -- host/digest.sh@77 -- # local rw bs qd 00:26:24.265 09:05:12 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:24.265 09:05:12 -- host/digest.sh@80 -- # rw=randwrite 00:26:24.265 09:05:12 -- host/digest.sh@80 -- # bs=4096 00:26:24.265 09:05:12 -- host/digest.sh@80 -- # qd=128 00:26:24.265 09:05:12 -- host/digest.sh@82 -- # bperfpid=1611128 00:26:24.265 09:05:12 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:26:24.265 09:05:12 -- host/digest.sh@83 -- # waitforlisten 1611128 /var/tmp/bperf.sock 00:26:24.265 09:05:12 -- common/autotest_common.sh@819 -- # '[' -z 1611128 ']' 00:26:24.265 09:05:12 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:24.265 09:05:12 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:24.265 09:05:12 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:24.265 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:24.265 09:05:12 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:24.265 09:05:12 -- common/autotest_common.sh@10 -- # set +x 00:26:24.265 [2024-07-15 09:05:12.591359] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:26:24.265 [2024-07-15 09:05:12.591432] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1611128 ] 00:26:24.265 EAL: No free 2048 kB hugepages reported on node 1 00:26:24.265 [2024-07-15 09:05:12.653234] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:24.266 [2024-07-15 09:05:12.758134] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:24.525 09:05:12 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:24.525 09:05:12 -- common/autotest_common.sh@852 -- # return 0 00:26:24.525 09:05:12 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:24.525 09:05:12 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:24.525 09:05:12 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:24.783 09:05:13 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:24.783 09:05:13 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:25.040 nvme0n1 00:26:25.040 09:05:13 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:25.040 09:05:13 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:25.297 Running I/O for 2 seconds... 00:26:27.200 00:26:27.200 Latency(us) 00:26:27.200 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:27.200 Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:26:27.200 nvme0n1 : 2.00 20816.47 81.31 0.00 0.00 6140.40 3070.48 18155.90 00:26:27.200 =================================================================================================================== 00:26:27.200 Total : 20816.47 81.31 0.00 0.00 6140.40 3070.48 18155.90 00:26:27.200 0 00:26:27.200 09:05:15 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:27.200 09:05:15 -- host/digest.sh@92 -- # get_accel_stats 00:26:27.200 09:05:15 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:27.200 09:05:15 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:27.200 09:05:15 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:27.200 | select(.opcode=="crc32c") 00:26:27.200 | "\(.module_name) \(.executed)"' 00:26:27.459 09:05:15 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:27.459 09:05:15 -- host/digest.sh@93 -- # exp_module=software 00:26:27.459 09:05:15 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:27.459 09:05:15 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:27.459 09:05:15 -- host/digest.sh@97 -- # killprocess 1611128 00:26:27.459 09:05:15 -- common/autotest_common.sh@926 -- # '[' -z 1611128 ']' 00:26:27.459 09:05:15 -- common/autotest_common.sh@930 -- # kill -0 1611128 00:26:27.459 09:05:15 -- common/autotest_common.sh@931 -- # uname 00:26:27.459 09:05:15 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:27.459 09:05:15 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1611128 00:26:27.459 09:05:15 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:26:27.459 09:05:15 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:26:27.459 09:05:15 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1611128' 00:26:27.459 killing process with pid 1611128 00:26:27.459 09:05:15 -- common/autotest_common.sh@945 -- # kill 1611128 00:26:27.459 Received shutdown signal, test time was about 2.000000 seconds 00:26:27.459 00:26:27.459 Latency(us) 00:26:27.459 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:27.459 =================================================================================================================== 00:26:27.459 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:27.459 09:05:15 -- common/autotest_common.sh@950 -- # wait 1611128 00:26:27.717 09:05:16 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:26:27.717 09:05:16 -- host/digest.sh@77 -- # local rw bs qd 00:26:27.717 09:05:16 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:27.717 09:05:16 -- host/digest.sh@80 -- # rw=randwrite 00:26:27.717 09:05:16 -- host/digest.sh@80 -- # bs=131072 00:26:27.717 09:05:16 -- host/digest.sh@80 -- # qd=16 00:26:27.717 09:05:16 -- host/digest.sh@82 -- # bperfpid=1611544 00:26:27.717 09:05:16 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:26:27.717 09:05:16 -- host/digest.sh@83 -- # waitforlisten 1611544 /var/tmp/bperf.sock 00:26:27.717 09:05:16 -- common/autotest_common.sh@819 -- # '[' -z 1611544 ']' 00:26:27.717 09:05:16 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:27.717 09:05:16 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:27.717 09:05:16 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:27.717 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:27.717 09:05:16 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:27.717 09:05:16 -- common/autotest_common.sh@10 -- # set +x 00:26:27.717 [2024-07-15 09:05:16.168650] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:26:27.717 [2024-07-15 09:05:16.168730] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1611544 ] 00:26:27.717 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:27.717 Zero copy mechanism will not be used. 00:26:27.717 EAL: No free 2048 kB hugepages reported on node 1 00:26:27.717 [2024-07-15 09:05:16.230955] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:27.975 [2024-07-15 09:05:16.339028] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:27.975 09:05:16 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:27.975 09:05:16 -- common/autotest_common.sh@852 -- # return 0 00:26:27.975 09:05:16 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:27.975 09:05:16 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:27.975 09:05:16 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:28.234 09:05:16 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:28.234 09:05:16 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:28.802 nvme0n1 00:26:28.802 09:05:17 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:28.802 09:05:17 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:28.802 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:28.802 Zero copy mechanism will not be used. 00:26:28.802 Running I/O for 2 seconds... 00:26:31.338 00:26:31.338 Latency(us) 00:26:31.338 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:31.338 Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:26:31.338 nvme0n1 : 2.01 3277.74 409.72 0.00 0.00 4869.41 3373.89 9077.95 00:26:31.338 =================================================================================================================== 00:26:31.338 Total : 3277.74 409.72 0.00 0.00 4869.41 3373.89 9077.95 00:26:31.338 0 00:26:31.338 09:05:19 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:31.338 09:05:19 -- host/digest.sh@92 -- # get_accel_stats 00:26:31.338 09:05:19 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:31.338 09:05:19 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:31.338 | select(.opcode=="crc32c") 00:26:31.338 | "\(.module_name) \(.executed)"' 00:26:31.338 09:05:19 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:31.338 09:05:19 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:31.338 09:05:19 -- host/digest.sh@93 -- # exp_module=software 00:26:31.338 09:05:19 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:31.338 09:05:19 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:31.338 09:05:19 -- host/digest.sh@97 -- # killprocess 1611544 00:26:31.338 09:05:19 -- common/autotest_common.sh@926 -- # '[' -z 1611544 ']' 00:26:31.338 09:05:19 -- common/autotest_common.sh@930 -- # kill -0 1611544 00:26:31.338 09:05:19 -- common/autotest_common.sh@931 -- # uname 00:26:31.338 09:05:19 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:31.338 09:05:19 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1611544 00:26:31.338 09:05:19 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:26:31.338 09:05:19 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:26:31.338 09:05:19 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1611544' 00:26:31.338 killing process with pid 1611544 00:26:31.338 09:05:19 -- common/autotest_common.sh@945 -- # kill 1611544 00:26:31.338 Received shutdown signal, test time was about 2.000000 seconds 00:26:31.338 00:26:31.338 Latency(us) 00:26:31.338 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:31.338 =================================================================================================================== 00:26:31.338 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:31.338 09:05:19 -- common/autotest_common.sh@950 -- # wait 1611544 00:26:31.338 09:05:19 -- host/digest.sh@126 -- # killprocess 1610156 00:26:31.338 09:05:19 -- common/autotest_common.sh@926 -- # '[' -z 1610156 ']' 00:26:31.338 09:05:19 -- common/autotest_common.sh@930 -- # kill -0 1610156 00:26:31.338 09:05:19 -- common/autotest_common.sh@931 -- # uname 00:26:31.338 09:05:19 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:31.338 09:05:19 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1610156 00:26:31.338 09:05:19 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:26:31.338 09:05:19 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:26:31.338 09:05:19 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1610156' 00:26:31.338 killing process with pid 1610156 00:26:31.338 09:05:19 -- common/autotest_common.sh@945 -- # kill 1610156 00:26:31.338 09:05:19 -- common/autotest_common.sh@950 -- # wait 1610156 00:26:31.596 00:26:31.596 real 0m15.223s 00:26:31.596 user 0m30.092s 00:26:31.596 sys 0m4.022s 00:26:31.596 09:05:20 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:26:31.596 09:05:20 -- common/autotest_common.sh@10 -- # set +x 00:26:31.596 ************************************ 00:26:31.596 END TEST nvmf_digest_clean 00:26:31.596 ************************************ 00:26:31.855 09:05:20 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:26:31.855 09:05:20 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:26:31.855 09:05:20 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:26:31.855 09:05:20 -- common/autotest_common.sh@10 -- # set +x 00:26:31.855 ************************************ 00:26:31.855 START TEST nvmf_digest_error 00:26:31.855 ************************************ 00:26:31.855 09:05:20 -- common/autotest_common.sh@1104 -- # run_digest_error 00:26:31.855 09:05:20 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:26:31.855 09:05:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:31.855 09:05:20 -- common/autotest_common.sh@712 -- # xtrace_disable 00:26:31.855 09:05:20 -- common/autotest_common.sh@10 -- # set +x 00:26:31.855 09:05:20 -- nvmf/common.sh@469 -- # nvmfpid=1612115 00:26:31.855 09:05:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:26:31.855 09:05:20 -- nvmf/common.sh@470 -- # waitforlisten 1612115 00:26:31.855 09:05:20 -- common/autotest_common.sh@819 -- # '[' -z 1612115 ']' 00:26:31.855 09:05:20 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:31.855 09:05:20 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:31.855 09:05:20 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:31.855 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:31.855 09:05:20 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:31.855 09:05:20 -- common/autotest_common.sh@10 -- # set +x 00:26:31.855 [2024-07-15 09:05:20.197544] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:26:31.855 [2024-07-15 09:05:20.197635] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:31.855 EAL: No free 2048 kB hugepages reported on node 1 00:26:31.855 [2024-07-15 09:05:20.259632] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:31.855 [2024-07-15 09:05:20.364332] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:31.855 [2024-07-15 09:05:20.364489] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:31.855 [2024-07-15 09:05:20.364511] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:31.855 [2024-07-15 09:05:20.364525] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:31.855 [2024-07-15 09:05:20.364559] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:31.855 09:05:20 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:31.855 09:05:20 -- common/autotest_common.sh@852 -- # return 0 00:26:31.855 09:05:20 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:31.855 09:05:20 -- common/autotest_common.sh@718 -- # xtrace_disable 00:26:31.855 09:05:20 -- common/autotest_common.sh@10 -- # set +x 00:26:32.114 09:05:20 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:32.114 09:05:20 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:26:32.114 09:05:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:32.114 09:05:20 -- common/autotest_common.sh@10 -- # set +x 00:26:32.114 [2024-07-15 09:05:20.425126] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:26:32.114 09:05:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:32.114 09:05:20 -- host/digest.sh@104 -- # common_target_config 00:26:32.114 09:05:20 -- host/digest.sh@43 -- # rpc_cmd 00:26:32.114 09:05:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:32.114 09:05:20 -- common/autotest_common.sh@10 -- # set +x 00:26:32.114 null0 00:26:32.114 [2024-07-15 09:05:20.547591] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:32.114 [2024-07-15 09:05:20.571827] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:32.114 09:05:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:32.114 09:05:20 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:26:32.114 09:05:20 -- host/digest.sh@54 -- # local rw bs qd 00:26:32.114 09:05:20 -- host/digest.sh@56 -- # rw=randread 00:26:32.114 09:05:20 -- host/digest.sh@56 -- # bs=4096 00:26:32.114 09:05:20 -- host/digest.sh@56 -- # qd=128 00:26:32.114 09:05:20 -- host/digest.sh@58 -- # bperfpid=1612137 00:26:32.114 09:05:20 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:26:32.114 09:05:20 -- host/digest.sh@60 -- # waitforlisten 1612137 /var/tmp/bperf.sock 00:26:32.114 09:05:20 -- common/autotest_common.sh@819 -- # '[' -z 1612137 ']' 00:26:32.114 09:05:20 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:32.114 09:05:20 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:32.114 09:05:20 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:32.114 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:32.114 09:05:20 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:32.114 09:05:20 -- common/autotest_common.sh@10 -- # set +x 00:26:32.114 [2024-07-15 09:05:20.613304] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:26:32.114 [2024-07-15 09:05:20.613365] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1612137 ] 00:26:32.114 EAL: No free 2048 kB hugepages reported on node 1 00:26:32.388 [2024-07-15 09:05:20.675187] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:32.388 [2024-07-15 09:05:20.790465] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:33.329 09:05:21 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:33.329 09:05:21 -- common/autotest_common.sh@852 -- # return 0 00:26:33.329 09:05:21 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:33.329 09:05:21 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:33.329 09:05:21 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:26:33.329 09:05:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:33.329 09:05:21 -- common/autotest_common.sh@10 -- # set +x 00:26:33.329 09:05:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:33.329 09:05:21 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:33.329 09:05:21 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:33.892 nvme0n1 00:26:33.892 09:05:22 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:26:33.892 09:05:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:33.892 09:05:22 -- common/autotest_common.sh@10 -- # set +x 00:26:33.892 09:05:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:33.892 09:05:22 -- host/digest.sh@69 -- # bperf_py perform_tests 00:26:33.892 09:05:22 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:33.892 Running I/O for 2 seconds... 00:26:33.892 [2024-07-15 09:05:22.327199] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:33.892 [2024-07-15 09:05:22.327266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:22923 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.892 [2024-07-15 09:05:22.327288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.892 [2024-07-15 09:05:22.344097] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:33.892 [2024-07-15 09:05:22.344129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:12329 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.892 [2024-07-15 09:05:22.344146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.892 [2024-07-15 09:05:22.360435] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:33.892 [2024-07-15 09:05:22.360470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:460 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.892 [2024-07-15 09:05:22.360489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.892 [2024-07-15 09:05:22.377385] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:33.892 [2024-07-15 09:05:22.377420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:14015 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.892 [2024-07-15 09:05:22.377440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.892 [2024-07-15 09:05:22.394080] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:33.892 [2024-07-15 09:05:22.394109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:21148 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.892 [2024-07-15 09:05:22.394141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.892 [2024-07-15 09:05:22.410950] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:33.892 [2024-07-15 09:05:22.410980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:13149 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.892 [2024-07-15 09:05:22.410998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:33.892 [2024-07-15 09:05:22.427837] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:33.892 [2024-07-15 09:05:22.427871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:22770 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:33.892 [2024-07-15 09:05:22.427900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.148 [2024-07-15 09:05:22.444348] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.148 [2024-07-15 09:05:22.444383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:14375 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.148 [2024-07-15 09:05:22.444412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.148 [2024-07-15 09:05:22.461110] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.148 [2024-07-15 09:05:22.461146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:18123 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.148 [2024-07-15 09:05:22.461177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.148 [2024-07-15 09:05:22.477957] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.148 [2024-07-15 09:05:22.477984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:3577 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.148 [2024-07-15 09:05:22.478000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.148 [2024-07-15 09:05:22.494525] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.148 [2024-07-15 09:05:22.494559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:13906 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.148 [2024-07-15 09:05:22.494578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.148 [2024-07-15 09:05:22.511352] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.148 [2024-07-15 09:05:22.511385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16664 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.148 [2024-07-15 09:05:22.511404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.148 [2024-07-15 09:05:22.527684] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.148 [2024-07-15 09:05:22.527717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:18445 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.148 [2024-07-15 09:05:22.527736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.148 [2024-07-15 09:05:22.544084] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.148 [2024-07-15 09:05:22.544112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:14557 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.148 [2024-07-15 09:05:22.544142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.148 [2024-07-15 09:05:22.560341] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.148 [2024-07-15 09:05:22.560375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:5140 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.148 [2024-07-15 09:05:22.560393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.148 [2024-07-15 09:05:22.576887] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.148 [2024-07-15 09:05:22.576932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:11881 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.148 [2024-07-15 09:05:22.576948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.148 [2024-07-15 09:05:22.593665] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.148 [2024-07-15 09:05:22.593700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:1599 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.148 [2024-07-15 09:05:22.593719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.148 [2024-07-15 09:05:22.610170] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.148 [2024-07-15 09:05:22.610199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:25172 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.148 [2024-07-15 09:05:22.610215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.148 [2024-07-15 09:05:22.626649] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.148 [2024-07-15 09:05:22.626682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:13652 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.148 [2024-07-15 09:05:22.626702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.149 [2024-07-15 09:05:22.643032] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.149 [2024-07-15 09:05:22.643061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:23902 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.149 [2024-07-15 09:05:22.643091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.149 [2024-07-15 09:05:22.659442] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.149 [2024-07-15 09:05:22.659478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:4407 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.149 [2024-07-15 09:05:22.659497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.149 [2024-07-15 09:05:22.675983] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.149 [2024-07-15 09:05:22.676013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:23581 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.149 [2024-07-15 09:05:22.676043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.405 [2024-07-15 09:05:22.692242] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.405 [2024-07-15 09:05:22.692275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:21531 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.405 [2024-07-15 09:05:22.692295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.405 [2024-07-15 09:05:22.708703] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.405 [2024-07-15 09:05:22.708736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:23982 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.405 [2024-07-15 09:05:22.708755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.405 [2024-07-15 09:05:22.725245] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.405 [2024-07-15 09:05:22.725279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:5811 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.405 [2024-07-15 09:05:22.725304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.405 [2024-07-15 09:05:22.741144] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.405 [2024-07-15 09:05:22.741172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:12645 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.405 [2024-07-15 09:05:22.741202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.405 [2024-07-15 09:05:22.758383] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.405 [2024-07-15 09:05:22.758416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:25441 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.405 [2024-07-15 09:05:22.758434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.405 [2024-07-15 09:05:22.774579] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.405 [2024-07-15 09:05:22.774612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:7039 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.405 [2024-07-15 09:05:22.774630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.405 [2024-07-15 09:05:22.790648] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.405 [2024-07-15 09:05:22.790680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24678 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.405 [2024-07-15 09:05:22.790699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.405 [2024-07-15 09:05:22.807057] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.405 [2024-07-15 09:05:22.807084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:13516 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.405 [2024-07-15 09:05:22.807115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.405 [2024-07-15 09:05:22.823593] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.405 [2024-07-15 09:05:22.823626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:18706 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.405 [2024-07-15 09:05:22.823644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.405 [2024-07-15 09:05:22.839629] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.405 [2024-07-15 09:05:22.839662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:4452 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.405 [2024-07-15 09:05:22.839680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.405 [2024-07-15 09:05:22.856074] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.405 [2024-07-15 09:05:22.856105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:14835 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.405 [2024-07-15 09:05:22.856137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.405 [2024-07-15 09:05:22.872957] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.405 [2024-07-15 09:05:22.872990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:6746 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.405 [2024-07-15 09:05:22.873023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.405 [2024-07-15 09:05:22.889591] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.406 [2024-07-15 09:05:22.889623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:12294 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.406 [2024-07-15 09:05:22.889642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.406 [2024-07-15 09:05:22.906384] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.406 [2024-07-15 09:05:22.906419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:13925 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.406 [2024-07-15 09:05:22.906438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.406 [2024-07-15 09:05:22.923487] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.406 [2024-07-15 09:05:22.923520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:18153 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.406 [2024-07-15 09:05:22.923539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.406 [2024-07-15 09:05:22.938665] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.406 [2024-07-15 09:05:22.938698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:21905 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.406 [2024-07-15 09:05:22.938717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.662 [2024-07-15 09:05:22.955630] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.662 [2024-07-15 09:05:22.955663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:23046 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.662 [2024-07-15 09:05:22.955682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.662 [2024-07-15 09:05:22.971147] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.662 [2024-07-15 09:05:22.971175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:3063 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.662 [2024-07-15 09:05:22.971208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.662 [2024-07-15 09:05:22.987715] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.662 [2024-07-15 09:05:22.987751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:13513 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.662 [2024-07-15 09:05:22.987770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.662 [2024-07-15 09:05:23.004250] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.662 [2024-07-15 09:05:23.004284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:13150 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.662 [2024-07-15 09:05:23.004302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.662 [2024-07-15 09:05:23.020771] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.662 [2024-07-15 09:05:23.020806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:25036 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.662 [2024-07-15 09:05:23.020825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.662 [2024-07-15 09:05:23.038328] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.662 [2024-07-15 09:05:23.038363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:16381 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.662 [2024-07-15 09:05:23.038381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.662 [2024-07-15 09:05:23.054544] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.662 [2024-07-15 09:05:23.054578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:9479 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.662 [2024-07-15 09:05:23.054596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.662 [2024-07-15 09:05:23.070821] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.662 [2024-07-15 09:05:23.070855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:15389 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.662 [2024-07-15 09:05:23.070874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.662 [2024-07-15 09:05:23.086527] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.662 [2024-07-15 09:05:23.086560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:13570 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.662 [2024-07-15 09:05:23.086579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.662 [2024-07-15 09:05:23.103550] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.662 [2024-07-15 09:05:23.103585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:18128 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.662 [2024-07-15 09:05:23.103604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.662 [2024-07-15 09:05:23.119022] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.662 [2024-07-15 09:05:23.119050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:22275 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.662 [2024-07-15 09:05:23.119067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.662 [2024-07-15 09:05:23.136253] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.662 [2024-07-15 09:05:23.136288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:14749 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.662 [2024-07-15 09:05:23.136307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.662 [2024-07-15 09:05:23.152942] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.662 [2024-07-15 09:05:23.152970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:16961 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.662 [2024-07-15 09:05:23.153005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.662 [2024-07-15 09:05:23.168576] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.662 [2024-07-15 09:05:23.168608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:12596 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.662 [2024-07-15 09:05:23.168627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.662 [2024-07-15 09:05:23.185724] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.662 [2024-07-15 09:05:23.185757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:25104 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.662 [2024-07-15 09:05:23.185775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.662 [2024-07-15 09:05:23.201884] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.662 [2024-07-15 09:05:23.201931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:16666 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.662 [2024-07-15 09:05:23.201948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.919 [2024-07-15 09:05:23.218271] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.919 [2024-07-15 09:05:23.218304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:19218 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.919 [2024-07-15 09:05:23.218322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.919 [2024-07-15 09:05:23.234580] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.919 [2024-07-15 09:05:23.234614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:18013 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.919 [2024-07-15 09:05:23.234632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.919 [2024-07-15 09:05:23.251129] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.919 [2024-07-15 09:05:23.251172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:1901 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.919 [2024-07-15 09:05:23.251188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.919 [2024-07-15 09:05:23.267676] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.919 [2024-07-15 09:05:23.267704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:18754 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.919 [2024-07-15 09:05:23.267719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.919 [2024-07-15 09:05:23.284011] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.919 [2024-07-15 09:05:23.284058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:496 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.919 [2024-07-15 09:05:23.284074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.919 [2024-07-15 09:05:23.300263] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.919 [2024-07-15 09:05:23.300296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24052 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.919 [2024-07-15 09:05:23.300315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.919 [2024-07-15 09:05:23.316966] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.919 [2024-07-15 09:05:23.317008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:10317 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.919 [2024-07-15 09:05:23.317023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.919 [2024-07-15 09:05:23.332978] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.919 [2024-07-15 09:05:23.333007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:8244 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.919 [2024-07-15 09:05:23.333024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.919 [2024-07-15 09:05:23.348983] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.919 [2024-07-15 09:05:23.349011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:17475 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.919 [2024-07-15 09:05:23.349027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.919 [2024-07-15 09:05:23.371666] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.919 [2024-07-15 09:05:23.371700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:19979 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.919 [2024-07-15 09:05:23.371718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.919 [2024-07-15 09:05:23.388530] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.919 [2024-07-15 09:05:23.388564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:9169 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.919 [2024-07-15 09:05:23.388583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.919 [2024-07-15 09:05:23.405110] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.919 [2024-07-15 09:05:23.405157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:21883 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.919 [2024-07-15 09:05:23.405173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.919 [2024-07-15 09:05:23.420959] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.919 [2024-07-15 09:05:23.421002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:16486 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.919 [2024-07-15 09:05:23.421018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.919 [2024-07-15 09:05:23.437866] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.919 [2024-07-15 09:05:23.437921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:1322 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.919 [2024-07-15 09:05:23.437943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:34.919 [2024-07-15 09:05:23.454573] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:34.919 [2024-07-15 09:05:23.454606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:13580 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:34.919 [2024-07-15 09:05:23.454624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.176 [2024-07-15 09:05:23.471127] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.176 [2024-07-15 09:05:23.471174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:9238 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.176 [2024-07-15 09:05:23.471193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.176 [2024-07-15 09:05:23.487543] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.176 [2024-07-15 09:05:23.487575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:928 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.176 [2024-07-15 09:05:23.487594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.176 [2024-07-15 09:05:23.504049] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.176 [2024-07-15 09:05:23.504078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:16453 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.176 [2024-07-15 09:05:23.504094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.176 [2024-07-15 09:05:23.520031] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.176 [2024-07-15 09:05:23.520059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:21758 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.176 [2024-07-15 09:05:23.520090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.176 [2024-07-15 09:05:23.536592] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.176 [2024-07-15 09:05:23.536625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:21618 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.176 [2024-07-15 09:05:23.536643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.176 [2024-07-15 09:05:23.552801] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.176 [2024-07-15 09:05:23.552834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:17454 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.176 [2024-07-15 09:05:23.552853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.176 [2024-07-15 09:05:23.568693] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.176 [2024-07-15 09:05:23.568726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:2242 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.176 [2024-07-15 09:05:23.568744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.176 [2024-07-15 09:05:23.586187] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.176 [2024-07-15 09:05:23.586234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:11417 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.176 [2024-07-15 09:05:23.586255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.176 [2024-07-15 09:05:23.602719] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.176 [2024-07-15 09:05:23.602753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:19053 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.176 [2024-07-15 09:05:23.602772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.176 [2024-07-15 09:05:23.619135] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.176 [2024-07-15 09:05:23.619182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:18230 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.176 [2024-07-15 09:05:23.619202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.176 [2024-07-15 09:05:23.635137] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.176 [2024-07-15 09:05:23.635174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:5750 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.176 [2024-07-15 09:05:23.635207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.176 [2024-07-15 09:05:23.651947] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.176 [2024-07-15 09:05:23.651993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7869 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.176 [2024-07-15 09:05:23.652010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.176 [2024-07-15 09:05:23.668194] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.176 [2024-07-15 09:05:23.668228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:6996 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.176 [2024-07-15 09:05:23.668246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.176 [2024-07-15 09:05:23.684418] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.176 [2024-07-15 09:05:23.684452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:9940 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.176 [2024-07-15 09:05:23.684471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.176 [2024-07-15 09:05:23.700516] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.176 [2024-07-15 09:05:23.700548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:4520 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.176 [2024-07-15 09:05:23.700566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.176 [2024-07-15 09:05:23.717029] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.176 [2024-07-15 09:05:23.717059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:3647 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.176 [2024-07-15 09:05:23.717075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.434 [2024-07-15 09:05:23.733319] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.434 [2024-07-15 09:05:23.733351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:19429 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.434 [2024-07-15 09:05:23.733370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.434 [2024-07-15 09:05:23.749445] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.434 [2024-07-15 09:05:23.749477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:8209 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.434 [2024-07-15 09:05:23.749496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.434 [2024-07-15 09:05:23.766088] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.434 [2024-07-15 09:05:23.766116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:14603 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.434 [2024-07-15 09:05:23.766132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.434 [2024-07-15 09:05:23.782492] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.434 [2024-07-15 09:05:23.782525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:5085 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.434 [2024-07-15 09:05:23.782544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.434 [2024-07-15 09:05:23.799096] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.434 [2024-07-15 09:05:23.799123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:3662 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.434 [2024-07-15 09:05:23.799154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.434 [2024-07-15 09:05:23.815777] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.434 [2024-07-15 09:05:23.815810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:5350 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.434 [2024-07-15 09:05:23.815828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.434 [2024-07-15 09:05:23.832358] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.434 [2024-07-15 09:05:23.832392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:24519 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.434 [2024-07-15 09:05:23.832410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.434 [2024-07-15 09:05:23.848435] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.434 [2024-07-15 09:05:23.848468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:74 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.434 [2024-07-15 09:05:23.848486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.434 [2024-07-15 09:05:23.864596] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.434 [2024-07-15 09:05:23.864629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:14378 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.434 [2024-07-15 09:05:23.864654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.434 [2024-07-15 09:05:23.881179] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.434 [2024-07-15 09:05:23.881226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:4668 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.434 [2024-07-15 09:05:23.881244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.434 [2024-07-15 09:05:23.897795] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.434 [2024-07-15 09:05:23.897828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:22385 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.434 [2024-07-15 09:05:23.897846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.434 [2024-07-15 09:05:23.914357] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.434 [2024-07-15 09:05:23.914391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:24104 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.434 [2024-07-15 09:05:23.914410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.434 [2024-07-15 09:05:23.930859] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.434 [2024-07-15 09:05:23.930903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:13449 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.434 [2024-07-15 09:05:23.930935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.434 [2024-07-15 09:05:23.947460] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.434 [2024-07-15 09:05:23.947494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:11757 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.434 [2024-07-15 09:05:23.947512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.434 [2024-07-15 09:05:23.963571] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.434 [2024-07-15 09:05:23.963604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:8717 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.434 [2024-07-15 09:05:23.963623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.692 [2024-07-15 09:05:23.980335] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.692 [2024-07-15 09:05:23.980369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:17415 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.692 [2024-07-15 09:05:23.980387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.692 [2024-07-15 09:05:23.996608] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.692 [2024-07-15 09:05:23.996641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:2537 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.692 [2024-07-15 09:05:23.996660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.692 [2024-07-15 09:05:24.013458] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.692 [2024-07-15 09:05:24.013491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:19651 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.692 [2024-07-15 09:05:24.013510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.692 [2024-07-15 09:05:24.029626] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.692 [2024-07-15 09:05:24.029658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:14354 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.692 [2024-07-15 09:05:24.029677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.692 [2024-07-15 09:05:24.045312] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.692 [2024-07-15 09:05:24.045344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:17002 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.692 [2024-07-15 09:05:24.045363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.692 [2024-07-15 09:05:24.062208] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.692 [2024-07-15 09:05:24.062236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:7221 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.692 [2024-07-15 09:05:24.062265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.692 [2024-07-15 09:05:24.079077] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.692 [2024-07-15 09:05:24.079103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:6263 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.692 [2024-07-15 09:05:24.079134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.692 [2024-07-15 09:05:24.095463] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.692 [2024-07-15 09:05:24.095496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:14949 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.692 [2024-07-15 09:05:24.095514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.692 [2024-07-15 09:05:24.113348] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.692 [2024-07-15 09:05:24.113381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25025 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.692 [2024-07-15 09:05:24.113399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.692 [2024-07-15 09:05:24.129640] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.692 [2024-07-15 09:05:24.129675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:4812 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.692 [2024-07-15 09:05:24.129693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.692 [2024-07-15 09:05:24.145298] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.692 [2024-07-15 09:05:24.145331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:8626 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.692 [2024-07-15 09:05:24.145356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.692 [2024-07-15 09:05:24.162694] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.692 [2024-07-15 09:05:24.162728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:17500 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.692 [2024-07-15 09:05:24.162747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.692 [2024-07-15 09:05:24.179120] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.692 [2024-07-15 09:05:24.179166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:18544 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.692 [2024-07-15 09:05:24.179182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.692 [2024-07-15 09:05:24.196097] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.692 [2024-07-15 09:05:24.196125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:7803 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.692 [2024-07-15 09:05:24.196156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.692 [2024-07-15 09:05:24.212667] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.692 [2024-07-15 09:05:24.212701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:1551 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.692 [2024-07-15 09:05:24.212720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.692 [2024-07-15 09:05:24.229067] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.692 [2024-07-15 09:05:24.229095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:15803 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.692 [2024-07-15 09:05:24.229125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.949 [2024-07-15 09:05:24.245682] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.949 [2024-07-15 09:05:24.245715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:13509 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.949 [2024-07-15 09:05:24.245735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.949 [2024-07-15 09:05:24.262257] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.949 [2024-07-15 09:05:24.262289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:12159 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.949 [2024-07-15 09:05:24.262307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.949 [2024-07-15 09:05:24.278845] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.949 [2024-07-15 09:05:24.278886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:25110 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.949 [2024-07-15 09:05:24.278922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.949 [2024-07-15 09:05:24.295410] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x22f3f00) 00:26:35.949 [2024-07-15 09:05:24.295448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:2233 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.949 [2024-07-15 09:05:24.295468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.949 00:26:35.949 Latency(us) 00:26:35.949 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:35.949 Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:26:35.949 nvme0n1 : 2.00 15357.84 59.99 0.00 0.00 8325.46 3252.53 25437.68 00:26:35.949 =================================================================================================================== 00:26:35.949 Total : 15357.84 59.99 0.00 0.00 8325.46 3252.53 25437.68 00:26:35.949 0 00:26:35.949 09:05:24 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:26:35.949 09:05:24 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:26:35.949 09:05:24 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:26:35.949 09:05:24 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:26:35.949 | .driver_specific 00:26:35.949 | .nvme_error 00:26:35.949 | .status_code 00:26:35.949 | .command_transient_transport_error' 00:26:36.207 09:05:24 -- host/digest.sh@71 -- # (( 120 > 0 )) 00:26:36.207 09:05:24 -- host/digest.sh@73 -- # killprocess 1612137 00:26:36.207 09:05:24 -- common/autotest_common.sh@926 -- # '[' -z 1612137 ']' 00:26:36.207 09:05:24 -- common/autotest_common.sh@930 -- # kill -0 1612137 00:26:36.207 09:05:24 -- common/autotest_common.sh@931 -- # uname 00:26:36.207 09:05:24 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:36.207 09:05:24 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1612137 00:26:36.207 09:05:24 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:26:36.207 09:05:24 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:26:36.207 09:05:24 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1612137' 00:26:36.207 killing process with pid 1612137 00:26:36.207 09:05:24 -- common/autotest_common.sh@945 -- # kill 1612137 00:26:36.207 Received shutdown signal, test time was about 2.000000 seconds 00:26:36.207 00:26:36.207 Latency(us) 00:26:36.207 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:36.207 =================================================================================================================== 00:26:36.207 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:36.207 09:05:24 -- common/autotest_common.sh@950 -- # wait 1612137 00:26:36.464 09:05:24 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:26:36.464 09:05:24 -- host/digest.sh@54 -- # local rw bs qd 00:26:36.464 09:05:24 -- host/digest.sh@56 -- # rw=randread 00:26:36.464 09:05:24 -- host/digest.sh@56 -- # bs=131072 00:26:36.464 09:05:24 -- host/digest.sh@56 -- # qd=16 00:26:36.464 09:05:24 -- host/digest.sh@58 -- # bperfpid=1612693 00:26:36.464 09:05:24 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:26:36.464 09:05:24 -- host/digest.sh@60 -- # waitforlisten 1612693 /var/tmp/bperf.sock 00:26:36.464 09:05:24 -- common/autotest_common.sh@819 -- # '[' -z 1612693 ']' 00:26:36.464 09:05:24 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:36.464 09:05:24 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:36.464 09:05:24 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:36.464 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:36.464 09:05:24 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:36.464 09:05:24 -- common/autotest_common.sh@10 -- # set +x 00:26:36.464 [2024-07-15 09:05:24.891597] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:26:36.464 [2024-07-15 09:05:24.891673] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1612693 ] 00:26:36.464 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:36.464 Zero copy mechanism will not be used. 00:26:36.464 EAL: No free 2048 kB hugepages reported on node 1 00:26:36.464 [2024-07-15 09:05:24.954497] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:36.722 [2024-07-15 09:05:25.067361] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:37.657 09:05:25 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:37.657 09:05:25 -- common/autotest_common.sh@852 -- # return 0 00:26:37.657 09:05:25 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:37.657 09:05:25 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:37.657 09:05:26 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:26:37.657 09:05:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:37.657 09:05:26 -- common/autotest_common.sh@10 -- # set +x 00:26:37.657 09:05:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:37.657 09:05:26 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:37.657 09:05:26 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:37.915 nvme0n1 00:26:37.915 09:05:26 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:26:37.915 09:05:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:37.915 09:05:26 -- common/autotest_common.sh@10 -- # set +x 00:26:37.915 09:05:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:37.915 09:05:26 -- host/digest.sh@69 -- # bperf_py perform_tests 00:26:37.915 09:05:26 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:38.172 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:38.172 Zero copy mechanism will not be used. 00:26:38.172 Running I/O for 2 seconds... 00:26:38.172 [2024-07-15 09:05:26.580352] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.172 [2024-07-15 09:05:26.580409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.172 [2024-07-15 09:05:26.580434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.173 [2024-07-15 09:05:26.589436] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.173 [2024-07-15 09:05:26.589472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.173 [2024-07-15 09:05:26.589492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.173 [2024-07-15 09:05:26.598342] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.173 [2024-07-15 09:05:26.598377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.173 [2024-07-15 09:05:26.598397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.173 [2024-07-15 09:05:26.607405] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.173 [2024-07-15 09:05:26.607438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.173 [2024-07-15 09:05:26.607458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.173 [2024-07-15 09:05:26.616395] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.173 [2024-07-15 09:05:26.616429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.173 [2024-07-15 09:05:26.616448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.173 [2024-07-15 09:05:26.625420] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.173 [2024-07-15 09:05:26.625453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.173 [2024-07-15 09:05:26.625473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.173 [2024-07-15 09:05:26.634422] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.173 [2024-07-15 09:05:26.634455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.173 [2024-07-15 09:05:26.634474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.173 [2024-07-15 09:05:26.643615] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.173 [2024-07-15 09:05:26.643649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.173 [2024-07-15 09:05:26.643669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.173 [2024-07-15 09:05:26.652467] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.173 [2024-07-15 09:05:26.652500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.173 [2024-07-15 09:05:26.652520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.173 [2024-07-15 09:05:26.661289] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.173 [2024-07-15 09:05:26.661321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.173 [2024-07-15 09:05:26.661341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.173 [2024-07-15 09:05:26.670557] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.173 [2024-07-15 09:05:26.670590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.173 [2024-07-15 09:05:26.670610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.173 [2024-07-15 09:05:26.680163] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.173 [2024-07-15 09:05:26.680212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.173 [2024-07-15 09:05:26.680232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.173 [2024-07-15 09:05:26.689309] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.173 [2024-07-15 09:05:26.689343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.173 [2024-07-15 09:05:26.689369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.173 [2024-07-15 09:05:26.698356] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.173 [2024-07-15 09:05:26.698389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.173 [2024-07-15 09:05:26.698407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.173 [2024-07-15 09:05:26.708105] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.173 [2024-07-15 09:05:26.708149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.173 [2024-07-15 09:05:26.708166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.431 [2024-07-15 09:05:26.717033] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.431 [2024-07-15 09:05:26.717064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.431 [2024-07-15 09:05:26.717082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.431 [2024-07-15 09:05:26.725704] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.431 [2024-07-15 09:05:26.725739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.431 [2024-07-15 09:05:26.725758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.431 [2024-07-15 09:05:26.734623] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.431 [2024-07-15 09:05:26.734655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.431 [2024-07-15 09:05:26.734674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.431 [2024-07-15 09:05:26.743296] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.431 [2024-07-15 09:05:26.743330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.431 [2024-07-15 09:05:26.743350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.431 [2024-07-15 09:05:26.752396] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.431 [2024-07-15 09:05:26.752431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.431 [2024-07-15 09:05:26.752451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.431 [2024-07-15 09:05:26.761187] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.431 [2024-07-15 09:05:26.761232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.431 [2024-07-15 09:05:26.761252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.431 [2024-07-15 09:05:26.769922] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.431 [2024-07-15 09:05:26.769952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.431 [2024-07-15 09:05:26.769970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.431 [2024-07-15 09:05:26.778865] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.431 [2024-07-15 09:05:26.778905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.431 [2024-07-15 09:05:26.778939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.431 [2024-07-15 09:05:26.787615] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.431 [2024-07-15 09:05:26.787648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.431 [2024-07-15 09:05:26.787666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.431 [2024-07-15 09:05:26.796358] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.431 [2024-07-15 09:05:26.796391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.431 [2024-07-15 09:05:26.796409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.431 [2024-07-15 09:05:26.805266] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.431 [2024-07-15 09:05:26.805298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.431 [2024-07-15 09:05:26.805317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.431 [2024-07-15 09:05:26.814212] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.431 [2024-07-15 09:05:26.814245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.431 [2024-07-15 09:05:26.814263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.431 [2024-07-15 09:05:26.823279] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.431 [2024-07-15 09:05:26.823312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.431 [2024-07-15 09:05:26.823331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.431 [2024-07-15 09:05:26.831964] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.431 [2024-07-15 09:05:26.832007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.431 [2024-07-15 09:05:26.832023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.431 [2024-07-15 09:05:26.840713] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.431 [2024-07-15 09:05:26.840747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.431 [2024-07-15 09:05:26.840772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.431 [2024-07-15 09:05:26.849547] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.431 [2024-07-15 09:05:26.849579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.431 [2024-07-15 09:05:26.849597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.431 [2024-07-15 09:05:26.858348] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.431 [2024-07-15 09:05:26.858381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.431 [2024-07-15 09:05:26.858400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.431 [2024-07-15 09:05:26.867456] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.431 [2024-07-15 09:05:26.867489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.431 [2024-07-15 09:05:26.867508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.431 [2024-07-15 09:05:26.876591] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.431 [2024-07-15 09:05:26.876624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.431 [2024-07-15 09:05:26.876643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.431 [2024-07-15 09:05:26.885366] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.431 [2024-07-15 09:05:26.885398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.431 [2024-07-15 09:05:26.885417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.431 [2024-07-15 09:05:26.894707] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.431 [2024-07-15 09:05:26.894740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.431 [2024-07-15 09:05:26.894759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.431 [2024-07-15 09:05:26.904426] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.431 [2024-07-15 09:05:26.904461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.432 [2024-07-15 09:05:26.904481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.432 [2024-07-15 09:05:26.913572] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.432 [2024-07-15 09:05:26.913604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.432 [2024-07-15 09:05:26.913624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.432 [2024-07-15 09:05:26.922719] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.432 [2024-07-15 09:05:26.922761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.432 [2024-07-15 09:05:26.922781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.432 [2024-07-15 09:05:26.931600] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.432 [2024-07-15 09:05:26.931633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.432 [2024-07-15 09:05:26.931652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.432 [2024-07-15 09:05:26.940396] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.432 [2024-07-15 09:05:26.940429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.432 [2024-07-15 09:05:26.940449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.432 [2024-07-15 09:05:26.949743] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.432 [2024-07-15 09:05:26.949777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.432 [2024-07-15 09:05:26.949796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.432 [2024-07-15 09:05:26.959268] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.432 [2024-07-15 09:05:26.959301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.432 [2024-07-15 09:05:26.959320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.432 [2024-07-15 09:05:26.968208] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.432 [2024-07-15 09:05:26.968241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.432 [2024-07-15 09:05:26.968260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.712 [2024-07-15 09:05:26.977239] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.712 [2024-07-15 09:05:26.977271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.712 [2024-07-15 09:05:26.977303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.712 [2024-07-15 09:05:26.985739] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.712 [2024-07-15 09:05:26.985772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.712 [2024-07-15 09:05:26.985791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.712 [2024-07-15 09:05:26.994147] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.712 [2024-07-15 09:05:26.994178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.712 [2024-07-15 09:05:26.994195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.712 [2024-07-15 09:05:27.001981] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.712 [2024-07-15 09:05:27.002011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.712 [2024-07-15 09:05:27.002028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.712 [2024-07-15 09:05:27.009902] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.712 [2024-07-15 09:05:27.009931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.712 [2024-07-15 09:05:27.009949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.712 [2024-07-15 09:05:27.018161] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.712 [2024-07-15 09:05:27.018208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.712 [2024-07-15 09:05:27.018225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.712 [2024-07-15 09:05:27.026053] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.712 [2024-07-15 09:05:27.026083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.712 [2024-07-15 09:05:27.026099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.712 [2024-07-15 09:05:27.034081] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.712 [2024-07-15 09:05:27.034110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.712 [2024-07-15 09:05:27.034127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.712 [2024-07-15 09:05:27.042115] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.712 [2024-07-15 09:05:27.042144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.712 [2024-07-15 09:05:27.042161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.712 [2024-07-15 09:05:27.050101] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.712 [2024-07-15 09:05:27.050131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.712 [2024-07-15 09:05:27.050147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.712 [2024-07-15 09:05:27.058066] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.712 [2024-07-15 09:05:27.058096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.712 [2024-07-15 09:05:27.058113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.712 [2024-07-15 09:05:27.066367] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.712 [2024-07-15 09:05:27.066412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.712 [2024-07-15 09:05:27.066435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.712 [2024-07-15 09:05:27.075096] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.712 [2024-07-15 09:05:27.075126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.712 [2024-07-15 09:05:27.075159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.712 [2024-07-15 09:05:27.083853] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.712 [2024-07-15 09:05:27.083904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.712 [2024-07-15 09:05:27.083937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.712 [2024-07-15 09:05:27.092587] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.712 [2024-07-15 09:05:27.092617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.712 [2024-07-15 09:05:27.092650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.712 [2024-07-15 09:05:27.101595] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.712 [2024-07-15 09:05:27.101639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.712 [2024-07-15 09:05:27.101656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.712 [2024-07-15 09:05:27.111146] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.712 [2024-07-15 09:05:27.111190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.712 [2024-07-15 09:05:27.111207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.712 [2024-07-15 09:05:27.121798] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.712 [2024-07-15 09:05:27.121829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.712 [2024-07-15 09:05:27.121862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.712 [2024-07-15 09:05:27.131828] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.712 [2024-07-15 09:05:27.131871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.712 [2024-07-15 09:05:27.131899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.712 [2024-07-15 09:05:27.142580] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.713 [2024-07-15 09:05:27.142612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.713 [2024-07-15 09:05:27.142629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.713 [2024-07-15 09:05:27.152460] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.713 [2024-07-15 09:05:27.152489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.713 [2024-07-15 09:05:27.152522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.713 [2024-07-15 09:05:27.161111] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.713 [2024-07-15 09:05:27.161142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.713 [2024-07-15 09:05:27.161159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.713 [2024-07-15 09:05:27.169148] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.713 [2024-07-15 09:05:27.169177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.713 [2024-07-15 09:05:27.169194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.713 [2024-07-15 09:05:27.177260] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.713 [2024-07-15 09:05:27.177303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.713 [2024-07-15 09:05:27.177319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.713 [2024-07-15 09:05:27.185239] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.713 [2024-07-15 09:05:27.185284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.713 [2024-07-15 09:05:27.185301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.713 [2024-07-15 09:05:27.193313] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.713 [2024-07-15 09:05:27.193343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.713 [2024-07-15 09:05:27.193359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.713 [2024-07-15 09:05:27.201171] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.713 [2024-07-15 09:05:27.201214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.713 [2024-07-15 09:05:27.201230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.713 [2024-07-15 09:05:27.209242] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.713 [2024-07-15 09:05:27.209285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.713 [2024-07-15 09:05:27.209302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.713 [2024-07-15 09:05:27.217249] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.713 [2024-07-15 09:05:27.217292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.713 [2024-07-15 09:05:27.217316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.713 [2024-07-15 09:05:27.225245] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.713 [2024-07-15 09:05:27.225288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.713 [2024-07-15 09:05:27.225305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.713 [2024-07-15 09:05:27.233141] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.713 [2024-07-15 09:05:27.233185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.713 [2024-07-15 09:05:27.233202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.713 [2024-07-15 09:05:27.241266] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.713 [2024-07-15 09:05:27.241309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.713 [2024-07-15 09:05:27.241326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.713 [2024-07-15 09:05:27.249087] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.713 [2024-07-15 09:05:27.249116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.713 [2024-07-15 09:05:27.249133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.972 [2024-07-15 09:05:27.257353] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.972 [2024-07-15 09:05:27.257397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.972 [2024-07-15 09:05:27.257413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.972 [2024-07-15 09:05:27.265444] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.972 [2024-07-15 09:05:27.265487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.973 [2024-07-15 09:05:27.265503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.973 [2024-07-15 09:05:27.273324] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.973 [2024-07-15 09:05:27.273367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.973 [2024-07-15 09:05:27.273383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.973 [2024-07-15 09:05:27.281261] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.973 [2024-07-15 09:05:27.281289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.973 [2024-07-15 09:05:27.281306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.973 [2024-07-15 09:05:27.289111] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.973 [2024-07-15 09:05:27.289148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.973 [2024-07-15 09:05:27.289180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.973 [2024-07-15 09:05:27.297126] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.973 [2024-07-15 09:05:27.297155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.973 [2024-07-15 09:05:27.297187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.973 [2024-07-15 09:05:27.305093] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.973 [2024-07-15 09:05:27.305122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.973 [2024-07-15 09:05:27.305139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.973 [2024-07-15 09:05:27.313036] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.973 [2024-07-15 09:05:27.313065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.973 [2024-07-15 09:05:27.313082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.973 [2024-07-15 09:05:27.320932] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.973 [2024-07-15 09:05:27.320961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.973 [2024-07-15 09:05:27.320978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.973 [2024-07-15 09:05:27.328982] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.973 [2024-07-15 09:05:27.329011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.973 [2024-07-15 09:05:27.329028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.973 [2024-07-15 09:05:27.336931] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.973 [2024-07-15 09:05:27.336959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.973 [2024-07-15 09:05:27.336991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.973 [2024-07-15 09:05:27.345053] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.973 [2024-07-15 09:05:27.345084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.973 [2024-07-15 09:05:27.345101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.973 [2024-07-15 09:05:27.352946] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.973 [2024-07-15 09:05:27.352976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.973 [2024-07-15 09:05:27.352992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.973 [2024-07-15 09:05:27.361073] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.973 [2024-07-15 09:05:27.361101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.973 [2024-07-15 09:05:27.361133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.973 [2024-07-15 09:05:27.369188] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.973 [2024-07-15 09:05:27.369216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.973 [2024-07-15 09:05:27.369246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.973 [2024-07-15 09:05:27.377196] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.973 [2024-07-15 09:05:27.377225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.973 [2024-07-15 09:05:27.377242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.973 [2024-07-15 09:05:27.385107] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.973 [2024-07-15 09:05:27.385137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.973 [2024-07-15 09:05:27.385154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.973 [2024-07-15 09:05:27.393090] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.973 [2024-07-15 09:05:27.393118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.973 [2024-07-15 09:05:27.393135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.973 [2024-07-15 09:05:27.401114] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.973 [2024-07-15 09:05:27.401143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.973 [2024-07-15 09:05:27.401160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.973 [2024-07-15 09:05:27.409012] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.973 [2024-07-15 09:05:27.409041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.973 [2024-07-15 09:05:27.409057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.973 [2024-07-15 09:05:27.417004] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.973 [2024-07-15 09:05:27.417031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.973 [2024-07-15 09:05:27.417048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.973 [2024-07-15 09:05:27.424954] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.973 [2024-07-15 09:05:27.424983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.973 [2024-07-15 09:05:27.425007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.973 [2024-07-15 09:05:27.432937] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.973 [2024-07-15 09:05:27.432978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.973 [2024-07-15 09:05:27.432994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.973 [2024-07-15 09:05:27.441013] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.973 [2024-07-15 09:05:27.441041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.973 [2024-07-15 09:05:27.441073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.973 [2024-07-15 09:05:27.449141] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.973 [2024-07-15 09:05:27.449169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.973 [2024-07-15 09:05:27.449186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.973 [2024-07-15 09:05:27.457291] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.973 [2024-07-15 09:05:27.457318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.973 [2024-07-15 09:05:27.457333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.973 [2024-07-15 09:05:27.465211] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.973 [2024-07-15 09:05:27.465238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.973 [2024-07-15 09:05:27.465270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.973 [2024-07-15 09:05:27.473219] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.973 [2024-07-15 09:05:27.473247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.973 [2024-07-15 09:05:27.473263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.973 [2024-07-15 09:05:27.481221] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.973 [2024-07-15 09:05:27.481247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.973 [2024-07-15 09:05:27.481278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:38.973 [2024-07-15 09:05:27.489235] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.973 [2024-07-15 09:05:27.489278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.973 [2024-07-15 09:05:27.489294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:38.973 [2024-07-15 09:05:27.497006] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.973 [2024-07-15 09:05:27.497035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.973 [2024-07-15 09:05:27.497052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:38.973 [2024-07-15 09:05:27.504956] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.973 [2024-07-15 09:05:27.504985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.973 [2024-07-15 09:05:27.505002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:38.973 [2024-07-15 09:05:27.513000] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:38.973 [2024-07-15 09:05:27.513029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.973 [2024-07-15 09:05:27.513046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.232 [2024-07-15 09:05:27.521217] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.232 [2024-07-15 09:05:27.521246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.232 [2024-07-15 09:05:27.521278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.232 [2024-07-15 09:05:27.529220] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.232 [2024-07-15 09:05:27.529262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.232 [2024-07-15 09:05:27.529279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.232 [2024-07-15 09:05:27.537184] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.232 [2024-07-15 09:05:27.537212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.232 [2024-07-15 09:05:27.537227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.232 [2024-07-15 09:05:27.545109] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.232 [2024-07-15 09:05:27.545137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.232 [2024-07-15 09:05:27.545168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.232 [2024-07-15 09:05:27.553102] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.232 [2024-07-15 09:05:27.553132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.232 [2024-07-15 09:05:27.553149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.232 [2024-07-15 09:05:27.559873] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.232 [2024-07-15 09:05:27.559923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.233 [2024-07-15 09:05:27.559947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.233 [2024-07-15 09:05:27.566853] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.233 [2024-07-15 09:05:27.566890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.233 [2024-07-15 09:05:27.566909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.233 [2024-07-15 09:05:27.573918] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.233 [2024-07-15 09:05:27.573948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.233 [2024-07-15 09:05:27.573967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.233 [2024-07-15 09:05:27.580922] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.233 [2024-07-15 09:05:27.580964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.233 [2024-07-15 09:05:27.580981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.233 [2024-07-15 09:05:27.587987] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.233 [2024-07-15 09:05:27.588018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.233 [2024-07-15 09:05:27.588035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.233 [2024-07-15 09:05:27.595069] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.233 [2024-07-15 09:05:27.595102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.233 [2024-07-15 09:05:27.595119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.233 [2024-07-15 09:05:27.602228] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.233 [2024-07-15 09:05:27.602258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.233 [2024-07-15 09:05:27.602276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.233 [2024-07-15 09:05:27.609387] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.233 [2024-07-15 09:05:27.609416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.233 [2024-07-15 09:05:27.609433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.233 [2024-07-15 09:05:27.616482] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.233 [2024-07-15 09:05:27.616511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.233 [2024-07-15 09:05:27.616528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.233 [2024-07-15 09:05:27.623546] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.233 [2024-07-15 09:05:27.623582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.233 [2024-07-15 09:05:27.623600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.233 [2024-07-15 09:05:27.633613] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.233 [2024-07-15 09:05:27.633644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.233 [2024-07-15 09:05:27.633661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.233 [2024-07-15 09:05:27.640750] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.233 [2024-07-15 09:05:27.640784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.233 [2024-07-15 09:05:27.640801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.233 [2024-07-15 09:05:27.645293] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.233 [2024-07-15 09:05:27.645320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.233 [2024-07-15 09:05:27.645352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.233 [2024-07-15 09:05:27.653738] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.233 [2024-07-15 09:05:27.653767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.233 [2024-07-15 09:05:27.653798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.233 [2024-07-15 09:05:27.661863] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.233 [2024-07-15 09:05:27.661915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.233 [2024-07-15 09:05:27.661945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.233 [2024-07-15 09:05:27.669974] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.233 [2024-07-15 09:05:27.670002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.233 [2024-07-15 09:05:27.670033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.233 [2024-07-15 09:05:27.678184] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.233 [2024-07-15 09:05:27.678213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.233 [2024-07-15 09:05:27.678229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.233 [2024-07-15 09:05:27.686091] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.233 [2024-07-15 09:05:27.686119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.233 [2024-07-15 09:05:27.686157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.233 [2024-07-15 09:05:27.694081] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.233 [2024-07-15 09:05:27.694111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.233 [2024-07-15 09:05:27.694128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.233 [2024-07-15 09:05:27.702081] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.233 [2024-07-15 09:05:27.702111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.233 [2024-07-15 09:05:27.702127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.233 [2024-07-15 09:05:27.710228] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.233 [2024-07-15 09:05:27.710270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.233 [2024-07-15 09:05:27.710285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.233 [2024-07-15 09:05:27.718110] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.233 [2024-07-15 09:05:27.718139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.233 [2024-07-15 09:05:27.718170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.233 [2024-07-15 09:05:27.726086] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.233 [2024-07-15 09:05:27.726129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.233 [2024-07-15 09:05:27.726149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.233 [2024-07-15 09:05:27.734307] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.233 [2024-07-15 09:05:27.734335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.233 [2024-07-15 09:05:27.734351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.233 [2024-07-15 09:05:27.742476] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.233 [2024-07-15 09:05:27.742518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.233 [2024-07-15 09:05:27.742534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.233 [2024-07-15 09:05:27.750507] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.233 [2024-07-15 09:05:27.750547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.233 [2024-07-15 09:05:27.750563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.233 [2024-07-15 09:05:27.758661] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.233 [2024-07-15 09:05:27.758688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.233 [2024-07-15 09:05:27.758724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.233 [2024-07-15 09:05:27.766835] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.233 [2024-07-15 09:05:27.766885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.233 [2024-07-15 09:05:27.766928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.233 [2024-07-15 09:05:27.775213] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.234 [2024-07-15 09:05:27.775256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.234 [2024-07-15 09:05:27.775272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.492 [2024-07-15 09:05:27.783337] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.492 [2024-07-15 09:05:27.783363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.492 [2024-07-15 09:05:27.783378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.492 [2024-07-15 09:05:27.791350] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.492 [2024-07-15 09:05:27.791378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.492 [2024-07-15 09:05:27.791409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.492 [2024-07-15 09:05:27.799273] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.492 [2024-07-15 09:05:27.799299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.492 [2024-07-15 09:05:27.799331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.492 [2024-07-15 09:05:27.807122] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.492 [2024-07-15 09:05:27.807150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.492 [2024-07-15 09:05:27.807181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.492 [2024-07-15 09:05:27.815133] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.492 [2024-07-15 09:05:27.815176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.492 [2024-07-15 09:05:27.815193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.492 [2024-07-15 09:05:27.823235] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.492 [2024-07-15 09:05:27.823261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.492 [2024-07-15 09:05:27.823292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.492 [2024-07-15 09:05:27.831103] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.492 [2024-07-15 09:05:27.831132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.492 [2024-07-15 09:05:27.831149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.492 [2024-07-15 09:05:27.839041] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.492 [2024-07-15 09:05:27.839069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.492 [2024-07-15 09:05:27.839102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.492 [2024-07-15 09:05:27.846957] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.492 [2024-07-15 09:05:27.846988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.492 [2024-07-15 09:05:27.847006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.492 [2024-07-15 09:05:27.854980] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.492 [2024-07-15 09:05:27.855010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.492 [2024-07-15 09:05:27.855027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.493 [2024-07-15 09:05:27.863059] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.493 [2024-07-15 09:05:27.863088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.493 [2024-07-15 09:05:27.863105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.493 [2024-07-15 09:05:27.871214] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.493 [2024-07-15 09:05:27.871242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.493 [2024-07-15 09:05:27.871258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.493 [2024-07-15 09:05:27.879063] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.493 [2024-07-15 09:05:27.879105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.493 [2024-07-15 09:05:27.879122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.493 [2024-07-15 09:05:27.887159] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.493 [2024-07-15 09:05:27.887187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.493 [2024-07-15 09:05:27.887204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.493 [2024-07-15 09:05:27.895477] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.493 [2024-07-15 09:05:27.895504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.493 [2024-07-15 09:05:27.895540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.493 [2024-07-15 09:05:27.903653] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.493 [2024-07-15 09:05:27.903680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.493 [2024-07-15 09:05:27.903712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.493 [2024-07-15 09:05:27.912049] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.493 [2024-07-15 09:05:27.912076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.493 [2024-07-15 09:05:27.912109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.493 [2024-07-15 09:05:27.920396] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.493 [2024-07-15 09:05:27.920424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.493 [2024-07-15 09:05:27.920457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.493 [2024-07-15 09:05:27.928439] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.493 [2024-07-15 09:05:27.928465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.493 [2024-07-15 09:05:27.928496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.493 [2024-07-15 09:05:27.936726] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.493 [2024-07-15 09:05:27.936754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.493 [2024-07-15 09:05:27.936771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.493 [2024-07-15 09:05:27.944914] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.493 [2024-07-15 09:05:27.944942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.493 [2024-07-15 09:05:27.944974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.493 [2024-07-15 09:05:27.952999] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.493 [2024-07-15 09:05:27.953027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.493 [2024-07-15 09:05:27.953043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.493 [2024-07-15 09:05:27.961051] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.493 [2024-07-15 09:05:27.961080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.493 [2024-07-15 09:05:27.961112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.493 [2024-07-15 09:05:27.969252] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.493 [2024-07-15 09:05:27.969289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.493 [2024-07-15 09:05:27.969307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.493 [2024-07-15 09:05:27.977257] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.493 [2024-07-15 09:05:27.977284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.493 [2024-07-15 09:05:27.977300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.493 [2024-07-15 09:05:27.985249] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.493 [2024-07-15 09:05:27.985275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.493 [2024-07-15 09:05:27.985307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.493 [2024-07-15 09:05:27.993314] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.493 [2024-07-15 09:05:27.993341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.493 [2024-07-15 09:05:27.993357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.493 [2024-07-15 09:05:28.001296] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.493 [2024-07-15 09:05:28.001336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.493 [2024-07-15 09:05:28.001352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.493 [2024-07-15 09:05:28.009228] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.493 [2024-07-15 09:05:28.009255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:25472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.493 [2024-07-15 09:05:28.009288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.493 [2024-07-15 09:05:28.017362] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.493 [2024-07-15 09:05:28.017403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.493 [2024-07-15 09:05:28.017419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.493 [2024-07-15 09:05:28.025295] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.493 [2024-07-15 09:05:28.025337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.493 [2024-07-15 09:05:28.025354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.493 [2024-07-15 09:05:28.033339] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.493 [2024-07-15 09:05:28.033368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.493 [2024-07-15 09:05:28.033385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.751 [2024-07-15 09:05:28.041449] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.751 [2024-07-15 09:05:28.041477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.751 [2024-07-15 09:05:28.041493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.751 [2024-07-15 09:05:28.049446] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.751 [2024-07-15 09:05:28.049491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.751 [2024-07-15 09:05:28.049509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.751 [2024-07-15 09:05:28.057492] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.751 [2024-07-15 09:05:28.057520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.751 [2024-07-15 09:05:28.057552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.751 [2024-07-15 09:05:28.065432] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.751 [2024-07-15 09:05:28.065459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.752 [2024-07-15 09:05:28.065490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.752 [2024-07-15 09:05:28.073531] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.752 [2024-07-15 09:05:28.073558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.752 [2024-07-15 09:05:28.073590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.752 [2024-07-15 09:05:28.081667] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.752 [2024-07-15 09:05:28.081709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.752 [2024-07-15 09:05:28.081725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.752 [2024-07-15 09:05:28.089709] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.752 [2024-07-15 09:05:28.089753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.752 [2024-07-15 09:05:28.089769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.752 [2024-07-15 09:05:28.097658] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.752 [2024-07-15 09:05:28.097689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.752 [2024-07-15 09:05:28.097720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.752 [2024-07-15 09:05:28.105940] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.752 [2024-07-15 09:05:28.105968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.752 [2024-07-15 09:05:28.105992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.752 [2024-07-15 09:05:28.114129] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.752 [2024-07-15 09:05:28.114157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.752 [2024-07-15 09:05:28.114173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.752 [2024-07-15 09:05:28.122058] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.752 [2024-07-15 09:05:28.122086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.752 [2024-07-15 09:05:28.122119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.752 [2024-07-15 09:05:28.130273] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.752 [2024-07-15 09:05:28.130306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.752 [2024-07-15 09:05:28.130325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.752 [2024-07-15 09:05:28.139645] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.752 [2024-07-15 09:05:28.139679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.752 [2024-07-15 09:05:28.139698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.752 [2024-07-15 09:05:28.148896] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.752 [2024-07-15 09:05:28.148941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.752 [2024-07-15 09:05:28.148959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.752 [2024-07-15 09:05:28.158492] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.752 [2024-07-15 09:05:28.158524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.752 [2024-07-15 09:05:28.158543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.752 [2024-07-15 09:05:28.167201] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.752 [2024-07-15 09:05:28.167229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.752 [2024-07-15 09:05:28.167246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.752 [2024-07-15 09:05:28.176358] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.752 [2024-07-15 09:05:28.176391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:25216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.752 [2024-07-15 09:05:28.176410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.752 [2024-07-15 09:05:28.185221] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.752 [2024-07-15 09:05:28.185254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.752 [2024-07-15 09:05:28.185288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.752 [2024-07-15 09:05:28.194129] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.752 [2024-07-15 09:05:28.194156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.752 [2024-07-15 09:05:28.194189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.752 [2024-07-15 09:05:28.203192] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.752 [2024-07-15 09:05:28.203225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.752 [2024-07-15 09:05:28.203244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.752 [2024-07-15 09:05:28.212106] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.752 [2024-07-15 09:05:28.212135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.752 [2024-07-15 09:05:28.212172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.752 [2024-07-15 09:05:28.221168] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.752 [2024-07-15 09:05:28.221197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.752 [2024-07-15 09:05:28.221230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.752 [2024-07-15 09:05:28.230116] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.752 [2024-07-15 09:05:28.230144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.752 [2024-07-15 09:05:28.230176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.752 [2024-07-15 09:05:28.239214] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.752 [2024-07-15 09:05:28.239245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.752 [2024-07-15 09:05:28.239264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.752 [2024-07-15 09:05:28.248243] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.752 [2024-07-15 09:05:28.248284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.752 [2024-07-15 09:05:28.248300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.752 [2024-07-15 09:05:28.258199] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.752 [2024-07-15 09:05:28.258233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.752 [2024-07-15 09:05:28.258252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.752 [2024-07-15 09:05:28.267186] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.752 [2024-07-15 09:05:28.267216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.752 [2024-07-15 09:05:28.267233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.752 [2024-07-15 09:05:28.275433] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.752 [2024-07-15 09:05:28.275462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.752 [2024-07-15 09:05:28.275494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.752 [2024-07-15 09:05:28.284409] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.752 [2024-07-15 09:05:28.284442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.752 [2024-07-15 09:05:28.284461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.752 [2024-07-15 09:05:28.293182] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:39.752 [2024-07-15 09:05:28.293211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.752 [2024-07-15 09:05:28.293228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.013 [2024-07-15 09:05:28.301406] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:40.013 [2024-07-15 09:05:28.301434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.013 [2024-07-15 09:05:28.301450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.013 [2024-07-15 09:05:28.310313] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:40.013 [2024-07-15 09:05:28.310346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.013 [2024-07-15 09:05:28.310365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.013 [2024-07-15 09:05:28.319263] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:40.013 [2024-07-15 09:05:28.319295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.013 [2024-07-15 09:05:28.319313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.014 [2024-07-15 09:05:28.328356] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:40.014 [2024-07-15 09:05:28.328388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.014 [2024-07-15 09:05:28.328406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.014 [2024-07-15 09:05:28.337316] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:40.014 [2024-07-15 09:05:28.337347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.014 [2024-07-15 09:05:28.337371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.014 [2024-07-15 09:05:28.346460] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:40.014 [2024-07-15 09:05:28.346492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.014 [2024-07-15 09:05:28.346511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.014 [2024-07-15 09:05:28.355195] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:40.014 [2024-07-15 09:05:28.355239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.014 [2024-07-15 09:05:28.355259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.014 [2024-07-15 09:05:28.363969] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:40.014 [2024-07-15 09:05:28.364013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.014 [2024-07-15 09:05:28.364030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.014 [2024-07-15 09:05:28.372603] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:40.014 [2024-07-15 09:05:28.372634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.014 [2024-07-15 09:05:28.372653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.014 [2024-07-15 09:05:28.381575] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:40.014 [2024-07-15 09:05:28.381607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.014 [2024-07-15 09:05:28.381625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.014 [2024-07-15 09:05:28.390536] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:40.014 [2024-07-15 09:05:28.390567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.014 [2024-07-15 09:05:28.390586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.014 [2024-07-15 09:05:28.400008] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:40.014 [2024-07-15 09:05:28.400038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.014 [2024-07-15 09:05:28.400055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.014 [2024-07-15 09:05:28.409307] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:40.014 [2024-07-15 09:05:28.409340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.014 [2024-07-15 09:05:28.409359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.014 [2024-07-15 09:05:28.418384] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:40.014 [2024-07-15 09:05:28.418421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.014 [2024-07-15 09:05:28.418441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.014 [2024-07-15 09:05:28.427382] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:40.014 [2024-07-15 09:05:28.427414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.014 [2024-07-15 09:05:28.427432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.014 [2024-07-15 09:05:28.436840] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:40.014 [2024-07-15 09:05:28.436873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.014 [2024-07-15 09:05:28.436902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.014 [2024-07-15 09:05:28.446340] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:40.014 [2024-07-15 09:05:28.446373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.014 [2024-07-15 09:05:28.446392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.014 [2024-07-15 09:05:28.455125] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:40.014 [2024-07-15 09:05:28.455153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.014 [2024-07-15 09:05:28.455187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.014 [2024-07-15 09:05:28.464130] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:40.014 [2024-07-15 09:05:28.464158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.014 [2024-07-15 09:05:28.464174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.014 [2024-07-15 09:05:28.472901] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:40.014 [2024-07-15 09:05:28.472948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.014 [2024-07-15 09:05:28.472964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.014 [2024-07-15 09:05:28.481794] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:40.014 [2024-07-15 09:05:28.481825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.014 [2024-07-15 09:05:28.481843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.014 [2024-07-15 09:05:28.490530] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:40.014 [2024-07-15 09:05:28.490562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.014 [2024-07-15 09:05:28.490580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.014 [2024-07-15 09:05:28.499534] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:40.014 [2024-07-15 09:05:28.499567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.014 [2024-07-15 09:05:28.499586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.014 [2024-07-15 09:05:28.508286] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:40.014 [2024-07-15 09:05:28.508319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.014 [2024-07-15 09:05:28.508337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.014 [2024-07-15 09:05:28.517320] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:40.014 [2024-07-15 09:05:28.517353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.014 [2024-07-15 09:05:28.517371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.014 [2024-07-15 09:05:28.526596] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:40.014 [2024-07-15 09:05:28.526630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.014 [2024-07-15 09:05:28.526649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.014 [2024-07-15 09:05:28.535482] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:40.014 [2024-07-15 09:05:28.535515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.014 [2024-07-15 09:05:28.535535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.014 [2024-07-15 09:05:28.544230] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:40.014 [2024-07-15 09:05:28.544264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.015 [2024-07-15 09:05:28.544283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.015 [2024-07-15 09:05:28.552935] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:40.015 [2024-07-15 09:05:28.552964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.015 [2024-07-15 09:05:28.552996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.272 [2024-07-15 09:05:28.560937] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:40.272 [2024-07-15 09:05:28.560965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.272 [2024-07-15 09:05:28.560982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.272 [2024-07-15 09:05:28.569278] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20c3880) 00:26:40.272 [2024-07-15 09:05:28.569311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.272 [2024-07-15 09:05:28.569343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.272 00:26:40.272 Latency(us) 00:26:40.273 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:40.273 Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:26:40.273 nvme0n1 : 2.00 3673.04 459.13 0.00 0.00 4351.91 558.27 11019.76 00:26:40.273 =================================================================================================================== 00:26:40.273 Total : 3673.04 459.13 0.00 0.00 4351.91 558.27 11019.76 00:26:40.273 0 00:26:40.273 09:05:28 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:26:40.273 09:05:28 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:26:40.273 09:05:28 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:26:40.273 | .driver_specific 00:26:40.273 | .nvme_error 00:26:40.273 | .status_code 00:26:40.273 | .command_transient_transport_error' 00:26:40.273 09:05:28 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:26:40.529 09:05:28 -- host/digest.sh@71 -- # (( 237 > 0 )) 00:26:40.529 09:05:28 -- host/digest.sh@73 -- # killprocess 1612693 00:26:40.529 09:05:28 -- common/autotest_common.sh@926 -- # '[' -z 1612693 ']' 00:26:40.529 09:05:28 -- common/autotest_common.sh@930 -- # kill -0 1612693 00:26:40.529 09:05:28 -- common/autotest_common.sh@931 -- # uname 00:26:40.529 09:05:28 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:40.529 09:05:28 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1612693 00:26:40.529 09:05:28 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:26:40.529 09:05:28 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:26:40.529 09:05:28 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1612693' 00:26:40.529 killing process with pid 1612693 00:26:40.529 09:05:28 -- common/autotest_common.sh@945 -- # kill 1612693 00:26:40.529 Received shutdown signal, test time was about 2.000000 seconds 00:26:40.529 00:26:40.529 Latency(us) 00:26:40.529 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:40.529 =================================================================================================================== 00:26:40.529 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:40.529 09:05:28 -- common/autotest_common.sh@950 -- # wait 1612693 00:26:40.787 09:05:29 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:26:40.787 09:05:29 -- host/digest.sh@54 -- # local rw bs qd 00:26:40.787 09:05:29 -- host/digest.sh@56 -- # rw=randwrite 00:26:40.787 09:05:29 -- host/digest.sh@56 -- # bs=4096 00:26:40.787 09:05:29 -- host/digest.sh@56 -- # qd=128 00:26:40.787 09:05:29 -- host/digest.sh@58 -- # bperfpid=1613242 00:26:40.787 09:05:29 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:26:40.787 09:05:29 -- host/digest.sh@60 -- # waitforlisten 1613242 /var/tmp/bperf.sock 00:26:40.787 09:05:29 -- common/autotest_common.sh@819 -- # '[' -z 1613242 ']' 00:26:40.787 09:05:29 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:40.787 09:05:29 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:40.787 09:05:29 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:40.787 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:40.787 09:05:29 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:40.787 09:05:29 -- common/autotest_common.sh@10 -- # set +x 00:26:40.787 [2024-07-15 09:05:29.191275] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:26:40.787 [2024-07-15 09:05:29.191345] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1613242 ] 00:26:40.787 EAL: No free 2048 kB hugepages reported on node 1 00:26:40.787 [2024-07-15 09:05:29.250268] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:41.045 [2024-07-15 09:05:29.357168] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:41.610 09:05:30 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:41.610 09:05:30 -- common/autotest_common.sh@852 -- # return 0 00:26:41.610 09:05:30 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:41.610 09:05:30 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:42.176 09:05:30 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:26:42.176 09:05:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:42.176 09:05:30 -- common/autotest_common.sh@10 -- # set +x 00:26:42.176 09:05:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:42.176 09:05:30 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:42.176 09:05:30 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:42.433 nvme0n1 00:26:42.433 09:05:30 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:26:42.433 09:05:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:42.433 09:05:30 -- common/autotest_common.sh@10 -- # set +x 00:26:42.433 09:05:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:42.433 09:05:30 -- host/digest.sh@69 -- # bperf_py perform_tests 00:26:42.433 09:05:30 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:42.433 Running I/O for 2 seconds... 00:26:42.433 [2024-07-15 09:05:30.912680] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190edd58 00:26:42.433 [2024-07-15 09:05:30.914096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:12326 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.433 [2024-07-15 09:05:30.914147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:004a p:0 m:0 dnr:0 00:26:42.433 [2024-07-15 09:05:30.925444] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e99d8 00:26:42.433 [2024-07-15 09:05:30.926348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:1510 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.433 [2024-07-15 09:05:30.926380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:26:42.433 [2024-07-15 09:05:30.937789] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190f2510 00:26:42.433 [2024-07-15 09:05:30.938421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:17624 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.433 [2024-07-15 09:05:30.938454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:26:42.433 [2024-07-15 09:05:30.950268] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e8088 00:26:42.433 [2024-07-15 09:05:30.950830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:9709 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.433 [2024-07-15 09:05:30.950872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:26:42.433 [2024-07-15 09:05:30.962757] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190eee38 00:26:42.433 [2024-07-15 09:05:30.963340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:3972 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.433 [2024-07-15 09:05:30.963380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:26:42.433 [2024-07-15 09:05:30.975321] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190f1430 00:26:42.433 [2024-07-15 09:05:30.975784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:10181 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.434 [2024-07-15 09:05:30.975816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:26:42.691 [2024-07-15 09:05:30.987634] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190f35f0 00:26:42.691 [2024-07-15 09:05:30.988063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15881 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.691 [2024-07-15 09:05:30.988092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:26:42.691 [2024-07-15 09:05:30.999814] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190f31b8 00:26:42.691 [2024-07-15 09:05:31.000202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:5641 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.691 [2024-07-15 09:05:31.000258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:26:42.691 [2024-07-15 09:05:31.012793] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:42.691 [2024-07-15 09:05:31.013354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:16099 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.691 [2024-07-15 09:05:31.013386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:42.691 [2024-07-15 09:05:31.026290] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:42.691 [2024-07-15 09:05:31.026567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:7845 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.691 [2024-07-15 09:05:31.026598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:42.691 [2024-07-15 09:05:31.039767] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:42.691 [2024-07-15 09:05:31.040072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:14943 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.691 [2024-07-15 09:05:31.040101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:42.691 [2024-07-15 09:05:31.053250] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:42.691 [2024-07-15 09:05:31.053552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:11662 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.691 [2024-07-15 09:05:31.053583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:42.691 [2024-07-15 09:05:31.066732] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:42.691 [2024-07-15 09:05:31.067044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:24262 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.691 [2024-07-15 09:05:31.067072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:42.691 [2024-07-15 09:05:31.080382] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:42.691 [2024-07-15 09:05:31.080696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:10865 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.691 [2024-07-15 09:05:31.080728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:42.691 [2024-07-15 09:05:31.094164] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:42.691 [2024-07-15 09:05:31.094490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:21395 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.691 [2024-07-15 09:05:31.094521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:42.691 [2024-07-15 09:05:31.107975] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:42.692 [2024-07-15 09:05:31.108345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:12641 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.692 [2024-07-15 09:05:31.108375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:42.692 [2024-07-15 09:05:31.121581] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:42.692 [2024-07-15 09:05:31.121899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:7069 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.692 [2024-07-15 09:05:31.121942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:42.692 [2024-07-15 09:05:31.135376] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:42.692 [2024-07-15 09:05:31.135687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:8840 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.692 [2024-07-15 09:05:31.135718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:42.692 [2024-07-15 09:05:31.149110] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:42.692 [2024-07-15 09:05:31.149417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:21070 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.692 [2024-07-15 09:05:31.149448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:42.692 [2024-07-15 09:05:31.162759] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:42.692 [2024-07-15 09:05:31.163068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:22744 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.692 [2024-07-15 09:05:31.163096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:42.692 [2024-07-15 09:05:31.176143] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:42.692 [2024-07-15 09:05:31.176466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:21452 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.692 [2024-07-15 09:05:31.176498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:42.692 [2024-07-15 09:05:31.189633] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:42.692 [2024-07-15 09:05:31.189960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:23479 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.692 [2024-07-15 09:05:31.189989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:42.692 [2024-07-15 09:05:31.203298] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:42.692 [2024-07-15 09:05:31.203601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:43 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.692 [2024-07-15 09:05:31.203632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:42.692 [2024-07-15 09:05:31.216910] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:42.692 [2024-07-15 09:05:31.217294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:2999 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.692 [2024-07-15 09:05:31.217325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:42.692 [2024-07-15 09:05:31.230468] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:42.692 [2024-07-15 09:05:31.230777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:5537 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.692 [2024-07-15 09:05:31.230809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:42.949 [2024-07-15 09:05:31.244135] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:42.950 [2024-07-15 09:05:31.244450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:12859 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.950 [2024-07-15 09:05:31.244480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:42.950 [2024-07-15 09:05:31.257690] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:42.950 [2024-07-15 09:05:31.258000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:15794 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.950 [2024-07-15 09:05:31.258031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:42.950 [2024-07-15 09:05:31.271448] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:42.950 [2024-07-15 09:05:31.271758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:16437 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.950 [2024-07-15 09:05:31.271789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:42.950 [2024-07-15 09:05:31.285021] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:42.950 [2024-07-15 09:05:31.285294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:13665 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.950 [2024-07-15 09:05:31.285324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:42.950 [2024-07-15 09:05:31.298633] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:42.950 [2024-07-15 09:05:31.298964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:19396 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.950 [2024-07-15 09:05:31.298993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:42.950 [2024-07-15 09:05:31.312405] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:42.950 [2024-07-15 09:05:31.312717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:7261 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.950 [2024-07-15 09:05:31.312753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:42.950 [2024-07-15 09:05:31.326115] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:42.950 [2024-07-15 09:05:31.326434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:2294 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.950 [2024-07-15 09:05:31.326464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:42.950 [2024-07-15 09:05:31.339859] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:42.950 [2024-07-15 09:05:31.340205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:24378 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.950 [2024-07-15 09:05:31.340236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:42.950 [2024-07-15 09:05:31.353554] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:42.950 [2024-07-15 09:05:31.353855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:6509 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.950 [2024-07-15 09:05:31.353893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:42.950 [2024-07-15 09:05:31.367248] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:42.950 [2024-07-15 09:05:31.367549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:23703 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.950 [2024-07-15 09:05:31.367579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:42.950 [2024-07-15 09:05:31.380823] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:42.950 [2024-07-15 09:05:31.381130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:6930 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.950 [2024-07-15 09:05:31.381159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:42.950 [2024-07-15 09:05:31.394563] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:42.950 [2024-07-15 09:05:31.394865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:337 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.950 [2024-07-15 09:05:31.394918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:42.950 [2024-07-15 09:05:31.408275] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:42.950 [2024-07-15 09:05:31.408580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:452 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.950 [2024-07-15 09:05:31.408610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:42.950 [2024-07-15 09:05:31.422013] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:42.950 [2024-07-15 09:05:31.422384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:5047 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.950 [2024-07-15 09:05:31.422414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:42.950 [2024-07-15 09:05:31.435451] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:42.950 [2024-07-15 09:05:31.435765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:10252 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.950 [2024-07-15 09:05:31.435796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:42.950 [2024-07-15 09:05:31.449005] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:42.950 [2024-07-15 09:05:31.449330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:20917 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.950 [2024-07-15 09:05:31.449361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:42.950 [2024-07-15 09:05:31.462616] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:42.950 [2024-07-15 09:05:31.462949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:4807 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.950 [2024-07-15 09:05:31.462977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:42.950 [2024-07-15 09:05:31.476251] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:42.950 [2024-07-15 09:05:31.476558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:19975 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.950 [2024-07-15 09:05:31.476589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:42.950 [2024-07-15 09:05:31.489913] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:42.950 [2024-07-15 09:05:31.490229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:16346 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:42.950 [2024-07-15 09:05:31.490259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.207 [2024-07-15 09:05:31.503423] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.207 [2024-07-15 09:05:31.503727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:12393 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.207 [2024-07-15 09:05:31.503758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.207 [2024-07-15 09:05:31.517016] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.207 [2024-07-15 09:05:31.517442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:22499 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.207 [2024-07-15 09:05:31.517472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.207 [2024-07-15 09:05:31.530677] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.207 [2024-07-15 09:05:31.531006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:24771 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.207 [2024-07-15 09:05:31.531034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.207 [2024-07-15 09:05:31.544395] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.207 [2024-07-15 09:05:31.544695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:19172 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.207 [2024-07-15 09:05:31.544725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.207 [2024-07-15 09:05:31.558001] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.207 [2024-07-15 09:05:31.558378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:4445 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.207 [2024-07-15 09:05:31.558409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.207 [2024-07-15 09:05:31.571701] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.208 [2024-07-15 09:05:31.572016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:4086 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.208 [2024-07-15 09:05:31.572044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.208 [2024-07-15 09:05:31.585371] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.208 [2024-07-15 09:05:31.585672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:12305 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.208 [2024-07-15 09:05:31.585704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.208 [2024-07-15 09:05:31.598929] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.208 [2024-07-15 09:05:31.599239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:11259 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.208 [2024-07-15 09:05:31.599270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.208 [2024-07-15 09:05:31.612617] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.208 [2024-07-15 09:05:31.612955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:6772 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.208 [2024-07-15 09:05:31.612983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.208 [2024-07-15 09:05:31.626333] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.208 [2024-07-15 09:05:31.626648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:18253 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.208 [2024-07-15 09:05:31.626679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.208 [2024-07-15 09:05:31.639982] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.208 [2024-07-15 09:05:31.640348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:23821 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.208 [2024-07-15 09:05:31.640378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.208 [2024-07-15 09:05:31.653564] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.208 [2024-07-15 09:05:31.653868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:15976 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.208 [2024-07-15 09:05:31.653908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.208 [2024-07-15 09:05:31.667330] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.208 [2024-07-15 09:05:31.667643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:2430 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.208 [2024-07-15 09:05:31.667681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.208 [2024-07-15 09:05:31.680897] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.208 [2024-07-15 09:05:31.681270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:7589 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.208 [2024-07-15 09:05:31.681301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.208 [2024-07-15 09:05:31.694390] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.208 [2024-07-15 09:05:31.694701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:7102 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.208 [2024-07-15 09:05:31.694733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.208 [2024-07-15 09:05:31.707925] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.208 [2024-07-15 09:05:31.708227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:13280 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.208 [2024-07-15 09:05:31.708258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.208 [2024-07-15 09:05:31.721629] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.208 [2024-07-15 09:05:31.721951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:6718 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.208 [2024-07-15 09:05:31.721980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.208 [2024-07-15 09:05:31.735172] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.208 [2024-07-15 09:05:31.735489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:15405 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.208 [2024-07-15 09:05:31.735519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.208 [2024-07-15 09:05:31.748621] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.208 [2024-07-15 09:05:31.748947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:3361 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.208 [2024-07-15 09:05:31.748975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.467 [2024-07-15 09:05:31.762193] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.467 [2024-07-15 09:05:31.762511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:4744 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.467 [2024-07-15 09:05:31.762541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.467 [2024-07-15 09:05:31.776012] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.467 [2024-07-15 09:05:31.776379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:17509 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.467 [2024-07-15 09:05:31.776409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.467 [2024-07-15 09:05:31.789705] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.467 [2024-07-15 09:05:31.790017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:22402 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.467 [2024-07-15 09:05:31.790045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.467 [2024-07-15 09:05:31.803106] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.467 [2024-07-15 09:05:31.803423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:8477 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.467 [2024-07-15 09:05:31.803454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.467 [2024-07-15 09:05:31.816571] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.467 [2024-07-15 09:05:31.816871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:16117 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.467 [2024-07-15 09:05:31.816911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.467 [2024-07-15 09:05:31.830082] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.467 [2024-07-15 09:05:31.830390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:9620 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.467 [2024-07-15 09:05:31.830419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.467 [2024-07-15 09:05:31.843587] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.467 [2024-07-15 09:05:31.843897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:17841 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.467 [2024-07-15 09:05:31.843940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.467 [2024-07-15 09:05:31.857286] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.467 [2024-07-15 09:05:31.857594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:4236 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.467 [2024-07-15 09:05:31.857625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.467 [2024-07-15 09:05:31.870885] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.467 [2024-07-15 09:05:31.871184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:25133 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.467 [2024-07-15 09:05:31.871228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.467 [2024-07-15 09:05:31.884436] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.467 [2024-07-15 09:05:31.884737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:3934 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.467 [2024-07-15 09:05:31.884767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.467 [2024-07-15 09:05:31.897982] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.467 [2024-07-15 09:05:31.898285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:10296 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.467 [2024-07-15 09:05:31.898315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.467 [2024-07-15 09:05:31.911703] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.467 [2024-07-15 09:05:31.911993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:22327 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.467 [2024-07-15 09:05:31.912021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.467 [2024-07-15 09:05:31.925329] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.467 [2024-07-15 09:05:31.925636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:23462 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.467 [2024-07-15 09:05:31.925664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.468 [2024-07-15 09:05:31.938802] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.468 [2024-07-15 09:05:31.939124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:8515 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.468 [2024-07-15 09:05:31.939151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.468 [2024-07-15 09:05:31.952155] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.468 [2024-07-15 09:05:31.952476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:6659 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.468 [2024-07-15 09:05:31.952507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.468 [2024-07-15 09:05:31.965640] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.468 [2024-07-15 09:05:31.965974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:7641 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.468 [2024-07-15 09:05:31.966002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.468 [2024-07-15 09:05:31.979168] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.468 [2024-07-15 09:05:31.979493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:20293 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.468 [2024-07-15 09:05:31.979523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.468 [2024-07-15 09:05:31.992718] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.468 [2024-07-15 09:05:31.993031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:12980 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.468 [2024-07-15 09:05:31.993060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.468 [2024-07-15 09:05:32.006418] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.468 [2024-07-15 09:05:32.006721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:2418 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.468 [2024-07-15 09:05:32.006751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.726 [2024-07-15 09:05:32.019997] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.726 [2024-07-15 09:05:32.020297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:13339 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.726 [2024-07-15 09:05:32.020334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.726 [2024-07-15 09:05:32.033620] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.726 [2024-07-15 09:05:32.033955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:7006 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.726 [2024-07-15 09:05:32.033983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.726 [2024-07-15 09:05:32.047361] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.726 [2024-07-15 09:05:32.047665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:8467 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.726 [2024-07-15 09:05:32.047696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.726 [2024-07-15 09:05:32.061225] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.726 [2024-07-15 09:05:32.061538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:16977 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.726 [2024-07-15 09:05:32.061569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.726 [2024-07-15 09:05:32.074865] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.726 [2024-07-15 09:05:32.075174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:3733 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.726 [2024-07-15 09:05:32.075220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.726 [2024-07-15 09:05:32.088578] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.726 [2024-07-15 09:05:32.088890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:11962 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.726 [2024-07-15 09:05:32.088935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.726 [2024-07-15 09:05:32.102334] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.726 [2024-07-15 09:05:32.102642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:25011 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.726 [2024-07-15 09:05:32.102673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.726 [2024-07-15 09:05:32.115795] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.726 [2024-07-15 09:05:32.116111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:23518 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.726 [2024-07-15 09:05:32.116139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.726 [2024-07-15 09:05:32.129578] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.726 [2024-07-15 09:05:32.129895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:5330 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.726 [2024-07-15 09:05:32.129951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.726 [2024-07-15 09:05:32.143252] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.726 [2024-07-15 09:05:32.143563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:21131 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.726 [2024-07-15 09:05:32.143598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.726 [2024-07-15 09:05:32.156874] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.726 [2024-07-15 09:05:32.157176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:15316 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.726 [2024-07-15 09:05:32.157219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.726 [2024-07-15 09:05:32.170648] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.726 [2024-07-15 09:05:32.170975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:15046 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.726 [2024-07-15 09:05:32.171003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.726 [2024-07-15 09:05:32.184282] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.726 [2024-07-15 09:05:32.184596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:21323 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.726 [2024-07-15 09:05:32.184628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.726 [2024-07-15 09:05:32.197838] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.726 [2024-07-15 09:05:32.198118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:8313 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.726 [2024-07-15 09:05:32.198146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.726 [2024-07-15 09:05:32.211270] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.726 [2024-07-15 09:05:32.211576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:17064 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.726 [2024-07-15 09:05:32.211609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.726 [2024-07-15 09:05:32.224765] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.726 [2024-07-15 09:05:32.225076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:22310 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.726 [2024-07-15 09:05:32.225104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.726 [2024-07-15 09:05:32.238476] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.726 [2024-07-15 09:05:32.238778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:11625 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.726 [2024-07-15 09:05:32.238808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.726 [2024-07-15 09:05:32.252160] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.726 [2024-07-15 09:05:32.252477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:22680 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.726 [2024-07-15 09:05:32.252508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.726 [2024-07-15 09:05:32.265764] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.726 [2024-07-15 09:05:32.266077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:17232 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.726 [2024-07-15 09:05:32.266105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.983 [2024-07-15 09:05:32.279392] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.984 [2024-07-15 09:05:32.279694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:5774 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.984 [2024-07-15 09:05:32.279724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.984 [2024-07-15 09:05:32.293005] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.984 [2024-07-15 09:05:32.293313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:8072 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.984 [2024-07-15 09:05:32.293344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.984 [2024-07-15 09:05:32.306534] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.984 [2024-07-15 09:05:32.306834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:17262 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.984 [2024-07-15 09:05:32.306865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.984 [2024-07-15 09:05:32.320194] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.984 [2024-07-15 09:05:32.320511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:16094 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.984 [2024-07-15 09:05:32.320542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.984 [2024-07-15 09:05:32.333796] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.984 [2024-07-15 09:05:32.334121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:6647 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.984 [2024-07-15 09:05:32.334148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.984 [2024-07-15 09:05:32.347515] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.984 [2024-07-15 09:05:32.347817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:2287 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.984 [2024-07-15 09:05:32.347848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.984 [2024-07-15 09:05:32.361125] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.984 [2024-07-15 09:05:32.361470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:20464 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.984 [2024-07-15 09:05:32.361501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.984 [2024-07-15 09:05:32.374816] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.984 [2024-07-15 09:05:32.375195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:23635 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.984 [2024-07-15 09:05:32.375226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.984 [2024-07-15 09:05:32.388599] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.984 [2024-07-15 09:05:32.388933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:24531 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.984 [2024-07-15 09:05:32.388962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.984 [2024-07-15 09:05:32.402272] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.984 [2024-07-15 09:05:32.402575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:11735 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.984 [2024-07-15 09:05:32.402605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.984 [2024-07-15 09:05:32.415870] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.984 [2024-07-15 09:05:32.416210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:11653 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.984 [2024-07-15 09:05:32.416240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.984 [2024-07-15 09:05:32.429510] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.984 [2024-07-15 09:05:32.429784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:10913 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.984 [2024-07-15 09:05:32.429815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.984 [2024-07-15 09:05:32.443190] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.984 [2024-07-15 09:05:32.443511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:2558 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.984 [2024-07-15 09:05:32.443542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.984 [2024-07-15 09:05:32.456804] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.984 [2024-07-15 09:05:32.457117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:19819 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.984 [2024-07-15 09:05:32.457145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.984 [2024-07-15 09:05:32.470256] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.984 [2024-07-15 09:05:32.470569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:9729 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.984 [2024-07-15 09:05:32.470601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.984 [2024-07-15 09:05:32.483796] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.984 [2024-07-15 09:05:32.484112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:17066 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.984 [2024-07-15 09:05:32.484140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.984 [2024-07-15 09:05:32.497506] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.984 [2024-07-15 09:05:32.497819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:6085 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.984 [2024-07-15 09:05:32.497855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.984 [2024-07-15 09:05:32.511182] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.984 [2024-07-15 09:05:32.511510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:4036 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.984 [2024-07-15 09:05:32.511542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:43.984 [2024-07-15 09:05:32.524816] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:43.984 [2024-07-15 09:05:32.525132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:23466 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:43.984 [2024-07-15 09:05:32.525160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:44.241 [2024-07-15 09:05:32.538418] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:44.241 [2024-07-15 09:05:32.538721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:16702 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.241 [2024-07-15 09:05:32.538752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:44.241 [2024-07-15 09:05:32.552111] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:44.241 [2024-07-15 09:05:32.552433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:20453 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.241 [2024-07-15 09:05:32.552464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:44.241 [2024-07-15 09:05:32.565838] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:44.241 [2024-07-15 09:05:32.566204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:6124 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.241 [2024-07-15 09:05:32.566235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:44.241 [2024-07-15 09:05:32.579501] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:44.241 [2024-07-15 09:05:32.579805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:15157 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.241 [2024-07-15 09:05:32.579836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:44.241 [2024-07-15 09:05:32.593258] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:44.241 [2024-07-15 09:05:32.593571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:14624 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.241 [2024-07-15 09:05:32.593602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:44.242 [2024-07-15 09:05:32.606857] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:44.242 [2024-07-15 09:05:32.607269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:7821 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.242 [2024-07-15 09:05:32.607300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:44.242 [2024-07-15 09:05:32.620673] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:44.242 [2024-07-15 09:05:32.621009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:10716 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.242 [2024-07-15 09:05:32.621037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:44.242 [2024-07-15 09:05:32.634298] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:44.242 [2024-07-15 09:05:32.634608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:17864 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.242 [2024-07-15 09:05:32.634638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:44.242 [2024-07-15 09:05:32.647997] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:44.242 [2024-07-15 09:05:32.648371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:3329 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.242 [2024-07-15 09:05:32.648401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:44.242 [2024-07-15 09:05:32.661606] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:44.242 [2024-07-15 09:05:32.661932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:9049 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.242 [2024-07-15 09:05:32.661959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:44.242 [2024-07-15 09:05:32.675268] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:44.242 [2024-07-15 09:05:32.675567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:23678 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.242 [2024-07-15 09:05:32.675598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:44.242 [2024-07-15 09:05:32.688934] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:44.242 [2024-07-15 09:05:32.689238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:14074 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.242 [2024-07-15 09:05:32.689269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:44.242 [2024-07-15 09:05:32.702487] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:44.242 [2024-07-15 09:05:32.702793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:19842 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.242 [2024-07-15 09:05:32.702824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:44.242 [2024-07-15 09:05:32.716216] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:44.242 [2024-07-15 09:05:32.716520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:20312 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.242 [2024-07-15 09:05:32.716551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:44.242 [2024-07-15 09:05:32.729686] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:44.242 [2024-07-15 09:05:32.730012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:19371 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.242 [2024-07-15 09:05:32.730041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:44.242 [2024-07-15 09:05:32.742702] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:44.242 [2024-07-15 09:05:32.742983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:5838 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.242 [2024-07-15 09:05:32.743011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:44.242 [2024-07-15 09:05:32.755788] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:44.242 [2024-07-15 09:05:32.756072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:821 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.242 [2024-07-15 09:05:32.756100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:44.242 [2024-07-15 09:05:32.768909] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:44.242 [2024-07-15 09:05:32.769248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:19207 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.242 [2024-07-15 09:05:32.769275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:44.242 [2024-07-15 09:05:32.782244] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:44.242 [2024-07-15 09:05:32.782520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:22060 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.242 [2024-07-15 09:05:32.782549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:44.507 [2024-07-15 09:05:32.795288] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:44.507 [2024-07-15 09:05:32.795672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:6074 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.507 [2024-07-15 09:05:32.795700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:44.507 [2024-07-15 09:05:32.808700] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:44.507 [2024-07-15 09:05:32.809052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:15515 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.507 [2024-07-15 09:05:32.809080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:44.507 [2024-07-15 09:05:32.822087] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:44.507 [2024-07-15 09:05:32.822433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:15442 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.507 [2024-07-15 09:05:32.822460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:44.507 [2024-07-15 09:05:32.835344] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:44.507 [2024-07-15 09:05:32.835654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:1979 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.507 [2024-07-15 09:05:32.835682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:44.507 [2024-07-15 09:05:32.848739] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:44.507 [2024-07-15 09:05:32.849081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:20645 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.507 [2024-07-15 09:05:32.849115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:44.507 [2024-07-15 09:05:32.862082] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:44.507 [2024-07-15 09:05:32.862329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:15398 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.507 [2024-07-15 09:05:32.862357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:44.507 [2024-07-15 09:05:32.875258] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:44.507 [2024-07-15 09:05:32.875544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:13465 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.507 [2024-07-15 09:05:32.875571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:44.507 [2024-07-15 09:05:32.888618] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:44.507 [2024-07-15 09:05:32.888971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:8962 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.507 [2024-07-15 09:05:32.889001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:44.507 [2024-07-15 09:05:32.902101] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xd111a0) with pdu=0x2000190e6fa8 00:26:44.507 [2024-07-15 09:05:32.902425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:1762 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.507 [2024-07-15 09:05:32.902454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:44.507 00:26:44.507 Latency(us) 00:26:44.507 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:44.507 Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:26:44.507 nvme0n1 : 2.01 18859.33 73.67 0.00 0.00 6772.92 3046.21 13883.92 00:26:44.507 =================================================================================================================== 00:26:44.507 Total : 18859.33 73.67 0.00 0.00 6772.92 3046.21 13883.92 00:26:44.507 0 00:26:44.507 09:05:32 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:26:44.507 09:05:32 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:26:44.507 09:05:32 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:26:44.507 09:05:32 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:26:44.507 | .driver_specific 00:26:44.507 | .nvme_error 00:26:44.507 | .status_code 00:26:44.507 | .command_transient_transport_error' 00:26:44.788 09:05:33 -- host/digest.sh@71 -- # (( 148 > 0 )) 00:26:44.788 09:05:33 -- host/digest.sh@73 -- # killprocess 1613242 00:26:44.788 09:05:33 -- common/autotest_common.sh@926 -- # '[' -z 1613242 ']' 00:26:44.788 09:05:33 -- common/autotest_common.sh@930 -- # kill -0 1613242 00:26:44.788 09:05:33 -- common/autotest_common.sh@931 -- # uname 00:26:44.788 09:05:33 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:44.788 09:05:33 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1613242 00:26:44.788 09:05:33 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:26:44.788 09:05:33 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:26:44.788 09:05:33 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1613242' 00:26:44.788 killing process with pid 1613242 00:26:44.788 09:05:33 -- common/autotest_common.sh@945 -- # kill 1613242 00:26:44.788 Received shutdown signal, test time was about 2.000000 seconds 00:26:44.788 00:26:44.788 Latency(us) 00:26:44.788 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:44.788 =================================================================================================================== 00:26:44.788 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:44.788 09:05:33 -- common/autotest_common.sh@950 -- # wait 1613242 00:26:45.044 09:05:33 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:26:45.044 09:05:33 -- host/digest.sh@54 -- # local rw bs qd 00:26:45.044 09:05:33 -- host/digest.sh@56 -- # rw=randwrite 00:26:45.044 09:05:33 -- host/digest.sh@56 -- # bs=131072 00:26:45.044 09:05:33 -- host/digest.sh@56 -- # qd=16 00:26:45.044 09:05:33 -- host/digest.sh@58 -- # bperfpid=1613791 00:26:45.044 09:05:33 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:26:45.044 09:05:33 -- host/digest.sh@60 -- # waitforlisten 1613791 /var/tmp/bperf.sock 00:26:45.044 09:05:33 -- common/autotest_common.sh@819 -- # '[' -z 1613791 ']' 00:26:45.044 09:05:33 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:45.044 09:05:33 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:45.044 09:05:33 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:45.044 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:45.044 09:05:33 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:45.044 09:05:33 -- common/autotest_common.sh@10 -- # set +x 00:26:45.044 [2024-07-15 09:05:33.489312] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:26:45.044 [2024-07-15 09:05:33.489391] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1613791 ] 00:26:45.044 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:45.044 Zero copy mechanism will not be used. 00:26:45.044 EAL: No free 2048 kB hugepages reported on node 1 00:26:45.044 [2024-07-15 09:05:33.546311] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:45.301 [2024-07-15 09:05:33.652140] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:46.232 09:05:34 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:46.232 09:05:34 -- common/autotest_common.sh@852 -- # return 0 00:26:46.232 09:05:34 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:46.232 09:05:34 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:46.232 09:05:34 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:26:46.232 09:05:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:46.232 09:05:34 -- common/autotest_common.sh@10 -- # set +x 00:26:46.232 09:05:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:46.232 09:05:34 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:46.232 09:05:34 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:46.798 nvme0n1 00:26:46.798 09:05:35 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:26:46.798 09:05:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:46.798 09:05:35 -- common/autotest_common.sh@10 -- # set +x 00:26:46.798 09:05:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:46.798 09:05:35 -- host/digest.sh@69 -- # bperf_py perform_tests 00:26:46.798 09:05:35 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:46.798 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:46.798 Zero copy mechanism will not be used. 00:26:46.798 Running I/O for 2 seconds... 00:26:47.056 [2024-07-15 09:05:35.356450] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.056 [2024-07-15 09:05:35.356809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.056 [2024-07-15 09:05:35.356853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.056 [2024-07-15 09:05:35.367630] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.056 [2024-07-15 09:05:35.367995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.056 [2024-07-15 09:05:35.368028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.056 [2024-07-15 09:05:35.378409] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.056 [2024-07-15 09:05:35.378721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.056 [2024-07-15 09:05:35.378751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.056 [2024-07-15 09:05:35.389130] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.056 [2024-07-15 09:05:35.389332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.056 [2024-07-15 09:05:35.389361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.056 [2024-07-15 09:05:35.397018] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.056 [2024-07-15 09:05:35.397254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.056 [2024-07-15 09:05:35.397283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.056 [2024-07-15 09:05:35.407115] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.056 [2024-07-15 09:05:35.407344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.056 [2024-07-15 09:05:35.407373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.056 [2024-07-15 09:05:35.417186] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.056 [2024-07-15 09:05:35.417404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.056 [2024-07-15 09:05:35.417432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.056 [2024-07-15 09:05:35.426575] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.056 [2024-07-15 09:05:35.426808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.056 [2024-07-15 09:05:35.426837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.056 [2024-07-15 09:05:35.435773] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.056 [2024-07-15 09:05:35.436102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.056 [2024-07-15 09:05:35.436131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.056 [2024-07-15 09:05:35.445816] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.056 [2024-07-15 09:05:35.446117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.056 [2024-07-15 09:05:35.446146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.056 [2024-07-15 09:05:35.456218] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.056 [2024-07-15 09:05:35.456494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.056 [2024-07-15 09:05:35.456522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.056 [2024-07-15 09:05:35.466114] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.056 [2024-07-15 09:05:35.466322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.056 [2024-07-15 09:05:35.466350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.056 [2024-07-15 09:05:35.475503] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.056 [2024-07-15 09:05:35.475764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.056 [2024-07-15 09:05:35.475793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.056 [2024-07-15 09:05:35.484970] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.056 [2024-07-15 09:05:35.485216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.056 [2024-07-15 09:05:35.485244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.056 [2024-07-15 09:05:35.493523] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.056 [2024-07-15 09:05:35.493811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.056 [2024-07-15 09:05:35.493846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.056 [2024-07-15 09:05:35.502900] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.056 [2024-07-15 09:05:35.503044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.056 [2024-07-15 09:05:35.503073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.056 [2024-07-15 09:05:35.511256] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.057 [2024-07-15 09:05:35.511631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.057 [2024-07-15 09:05:35.511660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.057 [2024-07-15 09:05:35.521260] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.057 [2024-07-15 09:05:35.521410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.057 [2024-07-15 09:05:35.521445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.057 [2024-07-15 09:05:35.529522] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.057 [2024-07-15 09:05:35.529748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.057 [2024-07-15 09:05:35.529776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.057 [2024-07-15 09:05:35.538488] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.057 [2024-07-15 09:05:35.538634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.057 [2024-07-15 09:05:35.538662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.057 [2024-07-15 09:05:35.548024] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.057 [2024-07-15 09:05:35.548285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.057 [2024-07-15 09:05:35.548314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.057 [2024-07-15 09:05:35.557863] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.057 [2024-07-15 09:05:35.558211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.057 [2024-07-15 09:05:35.558239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.057 [2024-07-15 09:05:35.566443] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.057 [2024-07-15 09:05:35.566752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.057 [2024-07-15 09:05:35.566780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.057 [2024-07-15 09:05:35.575812] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.057 [2024-07-15 09:05:35.576069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.057 [2024-07-15 09:05:35.576099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.057 [2024-07-15 09:05:35.585164] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.057 [2024-07-15 09:05:35.585367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.057 [2024-07-15 09:05:35.585395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.057 [2024-07-15 09:05:35.594508] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.057 [2024-07-15 09:05:35.594748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.057 [2024-07-15 09:05:35.594776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.313 [2024-07-15 09:05:35.604049] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.313 [2024-07-15 09:05:35.604292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.313 [2024-07-15 09:05:35.604321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.313 [2024-07-15 09:05:35.613845] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.313 [2024-07-15 09:05:35.614065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.313 [2024-07-15 09:05:35.614093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.313 [2024-07-15 09:05:35.623468] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.313 [2024-07-15 09:05:35.623705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.313 [2024-07-15 09:05:35.623734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.313 [2024-07-15 09:05:35.633446] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.313 [2024-07-15 09:05:35.633725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.313 [2024-07-15 09:05:35.633753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.313 [2024-07-15 09:05:35.643073] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.313 [2024-07-15 09:05:35.643348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.313 [2024-07-15 09:05:35.643391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.313 [2024-07-15 09:05:35.653445] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.313 [2024-07-15 09:05:35.653763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.313 [2024-07-15 09:05:35.653792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.313 [2024-07-15 09:05:35.662667] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.313 [2024-07-15 09:05:35.662974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.313 [2024-07-15 09:05:35.663008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.313 [2024-07-15 09:05:35.672369] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.314 [2024-07-15 09:05:35.672671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.314 [2024-07-15 09:05:35.672713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.314 [2024-07-15 09:05:35.682134] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.314 [2024-07-15 09:05:35.682443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.314 [2024-07-15 09:05:35.682471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.314 [2024-07-15 09:05:35.692162] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.314 [2024-07-15 09:05:35.692398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.314 [2024-07-15 09:05:35.692426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.314 [2024-07-15 09:05:35.701453] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.314 [2024-07-15 09:05:35.701837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.314 [2024-07-15 09:05:35.701885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.314 [2024-07-15 09:05:35.710944] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.314 [2024-07-15 09:05:35.711180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.314 [2024-07-15 09:05:35.711208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.314 [2024-07-15 09:05:35.721394] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.314 [2024-07-15 09:05:35.721652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.314 [2024-07-15 09:05:35.721681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.314 [2024-07-15 09:05:35.731496] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.314 [2024-07-15 09:05:35.731846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.314 [2024-07-15 09:05:35.731874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.314 [2024-07-15 09:05:35.741898] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.314 [2024-07-15 09:05:35.742162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.314 [2024-07-15 09:05:35.742190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.314 [2024-07-15 09:05:35.751927] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.314 [2024-07-15 09:05:35.752110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.314 [2024-07-15 09:05:35.752138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.314 [2024-07-15 09:05:35.762228] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.314 [2024-07-15 09:05:35.762532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.314 [2024-07-15 09:05:35.762558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.314 [2024-07-15 09:05:35.772129] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.314 [2024-07-15 09:05:35.772257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.314 [2024-07-15 09:05:35.772293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.314 [2024-07-15 09:05:35.782008] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.314 [2024-07-15 09:05:35.782184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.314 [2024-07-15 09:05:35.782212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.314 [2024-07-15 09:05:35.791770] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.314 [2024-07-15 09:05:35.792019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.314 [2024-07-15 09:05:35.792047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.314 [2024-07-15 09:05:35.802105] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.314 [2024-07-15 09:05:35.802385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.314 [2024-07-15 09:05:35.802413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.314 [2024-07-15 09:05:35.812353] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.314 [2024-07-15 09:05:35.812690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.314 [2024-07-15 09:05:35.812719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.314 [2024-07-15 09:05:35.822604] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.314 [2024-07-15 09:05:35.822964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.314 [2024-07-15 09:05:35.822994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.314 [2024-07-15 09:05:35.832718] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.314 [2024-07-15 09:05:35.833034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.314 [2024-07-15 09:05:35.833063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.314 [2024-07-15 09:05:35.842196] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.314 [2024-07-15 09:05:35.842410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.314 [2024-07-15 09:05:35.842437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.314 [2024-07-15 09:05:35.852191] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.314 [2024-07-15 09:05:35.852521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.314 [2024-07-15 09:05:35.852548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.573 [2024-07-15 09:05:35.861998] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.573 [2024-07-15 09:05:35.862235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.573 [2024-07-15 09:05:35.862263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.573 [2024-07-15 09:05:35.871886] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.573 [2024-07-15 09:05:35.872169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.573 [2024-07-15 09:05:35.872197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.573 [2024-07-15 09:05:35.881570] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.573 [2024-07-15 09:05:35.881948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.573 [2024-07-15 09:05:35.881977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.573 [2024-07-15 09:05:35.891414] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.573 [2024-07-15 09:05:35.891715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.573 [2024-07-15 09:05:35.891744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.573 [2024-07-15 09:05:35.901309] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.573 [2024-07-15 09:05:35.901565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.573 [2024-07-15 09:05:35.901594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.573 [2024-07-15 09:05:35.910622] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.573 [2024-07-15 09:05:35.910827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.573 [2024-07-15 09:05:35.910855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.573 [2024-07-15 09:05:35.920579] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.573 [2024-07-15 09:05:35.920790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.573 [2024-07-15 09:05:35.920819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.573 [2024-07-15 09:05:35.929909] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.573 [2024-07-15 09:05:35.930167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.573 [2024-07-15 09:05:35.930195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.573 [2024-07-15 09:05:35.939715] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.573 [2024-07-15 09:05:35.939900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.573 [2024-07-15 09:05:35.939928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.573 [2024-07-15 09:05:35.948340] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.573 [2024-07-15 09:05:35.948668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.573 [2024-07-15 09:05:35.948710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.573 [2024-07-15 09:05:35.958922] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.573 [2024-07-15 09:05:35.959153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.573 [2024-07-15 09:05:35.959181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.573 [2024-07-15 09:05:35.968405] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.573 [2024-07-15 09:05:35.968671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.573 [2024-07-15 09:05:35.968713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.573 [2024-07-15 09:05:35.978818] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.573 [2024-07-15 09:05:35.979157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.573 [2024-07-15 09:05:35.979185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.573 [2024-07-15 09:05:35.989373] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.573 [2024-07-15 09:05:35.989583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.573 [2024-07-15 09:05:35.989609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.573 [2024-07-15 09:05:35.999061] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.573 [2024-07-15 09:05:35.999325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.573 [2024-07-15 09:05:35.999353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.573 [2024-07-15 09:05:36.008765] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.573 [2024-07-15 09:05:36.008905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.573 [2024-07-15 09:05:36.008933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.573 [2024-07-15 09:05:36.018434] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.573 [2024-07-15 09:05:36.018805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.574 [2024-07-15 09:05:36.018832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.574 [2024-07-15 09:05:36.029118] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.574 [2024-07-15 09:05:36.029314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.574 [2024-07-15 09:05:36.029347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.574 [2024-07-15 09:05:36.037959] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.574 [2024-07-15 09:05:36.038122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.574 [2024-07-15 09:05:36.038150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.574 [2024-07-15 09:05:36.047022] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.574 [2024-07-15 09:05:36.047296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.574 [2024-07-15 09:05:36.047325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.574 [2024-07-15 09:05:36.056867] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.574 [2024-07-15 09:05:36.057166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.574 [2024-07-15 09:05:36.057193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.574 [2024-07-15 09:05:36.066901] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.574 [2024-07-15 09:05:36.067178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.574 [2024-07-15 09:05:36.067220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.574 [2024-07-15 09:05:36.076360] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.574 [2024-07-15 09:05:36.076683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.574 [2024-07-15 09:05:36.076711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.574 [2024-07-15 09:05:36.085665] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.574 [2024-07-15 09:05:36.085996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.574 [2024-07-15 09:05:36.086025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.574 [2024-07-15 09:05:36.096020] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.574 [2024-07-15 09:05:36.096176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.574 [2024-07-15 09:05:36.096218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.574 [2024-07-15 09:05:36.105509] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.574 [2024-07-15 09:05:36.105784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.574 [2024-07-15 09:05:36.105812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.574 [2024-07-15 09:05:36.115120] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.574 [2024-07-15 09:05:36.115366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.574 [2024-07-15 09:05:36.115393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.838 [2024-07-15 09:05:36.124910] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.838 [2024-07-15 09:05:36.125210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.838 [2024-07-15 09:05:36.125238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.838 [2024-07-15 09:05:36.134872] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.838 [2024-07-15 09:05:36.135137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.838 [2024-07-15 09:05:36.135167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.838 [2024-07-15 09:05:36.144797] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.838 [2024-07-15 09:05:36.145124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.838 [2024-07-15 09:05:36.145167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.838 [2024-07-15 09:05:36.153925] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.838 [2024-07-15 09:05:36.154112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.838 [2024-07-15 09:05:36.154141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.838 [2024-07-15 09:05:36.163949] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.838 [2024-07-15 09:05:36.164174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.838 [2024-07-15 09:05:36.164202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.838 [2024-07-15 09:05:36.173809] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.838 [2024-07-15 09:05:36.174150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.838 [2024-07-15 09:05:36.174182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.838 [2024-07-15 09:05:36.183769] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.838 [2024-07-15 09:05:36.184190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.838 [2024-07-15 09:05:36.184217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.838 [2024-07-15 09:05:36.193312] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.838 [2024-07-15 09:05:36.193630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.839 [2024-07-15 09:05:36.193678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.839 [2024-07-15 09:05:36.203685] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.839 [2024-07-15 09:05:36.203948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.839 [2024-07-15 09:05:36.203977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.839 [2024-07-15 09:05:36.213690] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.839 [2024-07-15 09:05:36.214065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.839 [2024-07-15 09:05:36.214094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.839 [2024-07-15 09:05:36.223480] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.839 [2024-07-15 09:05:36.223701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.839 [2024-07-15 09:05:36.223729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.839 [2024-07-15 09:05:36.233507] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.839 [2024-07-15 09:05:36.233790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.839 [2024-07-15 09:05:36.233818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.839 [2024-07-15 09:05:36.243085] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.839 [2024-07-15 09:05:36.243372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.839 [2024-07-15 09:05:36.243400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.839 [2024-07-15 09:05:36.252755] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.839 [2024-07-15 09:05:36.253071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.839 [2024-07-15 09:05:36.253100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.839 [2024-07-15 09:05:36.263737] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.839 [2024-07-15 09:05:36.263939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.839 [2024-07-15 09:05:36.263967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.839 [2024-07-15 09:05:36.273347] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.839 [2024-07-15 09:05:36.273567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.839 [2024-07-15 09:05:36.273594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.839 [2024-07-15 09:05:36.283526] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.839 [2024-07-15 09:05:36.283845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.839 [2024-07-15 09:05:36.283874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.839 [2024-07-15 09:05:36.294053] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.839 [2024-07-15 09:05:36.294408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.839 [2024-07-15 09:05:36.294436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.839 [2024-07-15 09:05:36.303354] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.839 [2024-07-15 09:05:36.303546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.839 [2024-07-15 09:05:36.303574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.839 [2024-07-15 09:05:36.313298] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.839 [2024-07-15 09:05:36.313568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.839 [2024-07-15 09:05:36.313611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.839 [2024-07-15 09:05:36.323153] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.839 [2024-07-15 09:05:36.323478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.839 [2024-07-15 09:05:36.323506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.839 [2024-07-15 09:05:36.333442] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.839 [2024-07-15 09:05:36.333718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.839 [2024-07-15 09:05:36.333746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:47.839 [2024-07-15 09:05:36.342683] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.839 [2024-07-15 09:05:36.342926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.839 [2024-07-15 09:05:36.342954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:47.839 [2024-07-15 09:05:36.352264] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.839 [2024-07-15 09:05:36.352515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.839 [2024-07-15 09:05:36.352543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:47.839 [2024-07-15 09:05:36.362481] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.839 [2024-07-15 09:05:36.362845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.839 [2024-07-15 09:05:36.362872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:47.839 [2024-07-15 09:05:36.371780] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:47.839 [2024-07-15 09:05:36.372093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:47.839 [2024-07-15 09:05:36.372122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.097 [2024-07-15 09:05:36.382270] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.097 [2024-07-15 09:05:36.382534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.097 [2024-07-15 09:05:36.382563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.097 [2024-07-15 09:05:36.392835] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.097 [2024-07-15 09:05:36.393150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.097 [2024-07-15 09:05:36.393179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.097 [2024-07-15 09:05:36.403095] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.097 [2024-07-15 09:05:36.403430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.097 [2024-07-15 09:05:36.403457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.097 [2024-07-15 09:05:36.412905] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.097 [2024-07-15 09:05:36.413225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.097 [2024-07-15 09:05:36.413253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.097 [2024-07-15 09:05:36.423645] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.097 [2024-07-15 09:05:36.423924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.097 [2024-07-15 09:05:36.423952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.097 [2024-07-15 09:05:36.433580] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.097 [2024-07-15 09:05:36.433837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.097 [2024-07-15 09:05:36.433866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.097 [2024-07-15 09:05:36.443294] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.097 [2024-07-15 09:05:36.443538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.097 [2024-07-15 09:05:36.443567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.097 [2024-07-15 09:05:36.452201] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.097 [2024-07-15 09:05:36.452538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.097 [2024-07-15 09:05:36.452571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.097 [2024-07-15 09:05:36.462324] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.097 [2024-07-15 09:05:36.462621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.097 [2024-07-15 09:05:36.462650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.097 [2024-07-15 09:05:36.472977] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.097 [2024-07-15 09:05:36.473259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.097 [2024-07-15 09:05:36.473286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.097 [2024-07-15 09:05:36.483286] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.097 [2024-07-15 09:05:36.483655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.097 [2024-07-15 09:05:36.483682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.097 [2024-07-15 09:05:36.493704] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.097 [2024-07-15 09:05:36.493953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.097 [2024-07-15 09:05:36.493981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.097 [2024-07-15 09:05:36.503348] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.097 [2024-07-15 09:05:36.503638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.097 [2024-07-15 09:05:36.503665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.097 [2024-07-15 09:05:36.512991] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.097 [2024-07-15 09:05:36.513340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.098 [2024-07-15 09:05:36.513367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.098 [2024-07-15 09:05:36.523477] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.098 [2024-07-15 09:05:36.523742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.098 [2024-07-15 09:05:36.523769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.098 [2024-07-15 09:05:36.533385] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.098 [2024-07-15 09:05:36.533625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.098 [2024-07-15 09:05:36.533654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.098 [2024-07-15 09:05:36.542554] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.098 [2024-07-15 09:05:36.542835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.098 [2024-07-15 09:05:36.542884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.098 [2024-07-15 09:05:36.553020] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.098 [2024-07-15 09:05:36.553366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.098 [2024-07-15 09:05:36.553394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.098 [2024-07-15 09:05:36.562976] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.098 [2024-07-15 09:05:36.563248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.098 [2024-07-15 09:05:36.563275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.098 [2024-07-15 09:05:36.574018] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.098 [2024-07-15 09:05:36.574287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.098 [2024-07-15 09:05:36.574315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.098 [2024-07-15 09:05:36.583302] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.098 [2024-07-15 09:05:36.583583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.098 [2024-07-15 09:05:36.583610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.098 [2024-07-15 09:05:36.593025] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.098 [2024-07-15 09:05:36.593339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.098 [2024-07-15 09:05:36.593367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.098 [2024-07-15 09:05:36.603230] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.098 [2024-07-15 09:05:36.603548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.098 [2024-07-15 09:05:36.603577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.098 [2024-07-15 09:05:36.612558] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.098 [2024-07-15 09:05:36.613010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.098 [2024-07-15 09:05:36.613037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.098 [2024-07-15 09:05:36.622693] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.098 [2024-07-15 09:05:36.623020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.098 [2024-07-15 09:05:36.623048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.098 [2024-07-15 09:05:36.631948] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.098 [2024-07-15 09:05:36.632192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.098 [2024-07-15 09:05:36.632220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.356 [2024-07-15 09:05:36.640729] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.356 [2024-07-15 09:05:36.640898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.356 [2024-07-15 09:05:36.640936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.356 [2024-07-15 09:05:36.650375] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.356 [2024-07-15 09:05:36.650664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.356 [2024-07-15 09:05:36.650694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.356 [2024-07-15 09:05:36.659606] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.357 [2024-07-15 09:05:36.659849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-07-15 09:05:36.659884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.357 [2024-07-15 09:05:36.669100] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.357 [2024-07-15 09:05:36.669377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-07-15 09:05:36.669418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.357 [2024-07-15 09:05:36.678119] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.357 [2024-07-15 09:05:36.678362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-07-15 09:05:36.678389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.357 [2024-07-15 09:05:36.688124] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.357 [2024-07-15 09:05:36.688405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-07-15 09:05:36.688459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.357 [2024-07-15 09:05:36.698293] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.357 [2024-07-15 09:05:36.698596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-07-15 09:05:36.698624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.357 [2024-07-15 09:05:36.708503] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.357 [2024-07-15 09:05:36.708737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-07-15 09:05:36.708772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.357 [2024-07-15 09:05:36.718271] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.357 [2024-07-15 09:05:36.718562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-07-15 09:05:36.718589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.357 [2024-07-15 09:05:36.728564] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.357 [2024-07-15 09:05:36.728829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-07-15 09:05:36.728857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.357 [2024-07-15 09:05:36.738663] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.357 [2024-07-15 09:05:36.739041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-07-15 09:05:36.739069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.357 [2024-07-15 09:05:36.748339] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.357 [2024-07-15 09:05:36.748667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-07-15 09:05:36.748694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.357 [2024-07-15 09:05:36.757773] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.357 [2024-07-15 09:05:36.758078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-07-15 09:05:36.758106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.357 [2024-07-15 09:05:36.767334] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.357 [2024-07-15 09:05:36.767678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-07-15 09:05:36.767705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.357 [2024-07-15 09:05:36.777242] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.357 [2024-07-15 09:05:36.777524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-07-15 09:05:36.777566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.357 [2024-07-15 09:05:36.787471] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.357 [2024-07-15 09:05:36.787691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-07-15 09:05:36.787718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.357 [2024-07-15 09:05:36.796820] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.357 [2024-07-15 09:05:36.796994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-07-15 09:05:36.797022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.357 [2024-07-15 09:05:36.806484] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.357 [2024-07-15 09:05:36.806676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-07-15 09:05:36.806704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.357 [2024-07-15 09:05:36.814924] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.357 [2024-07-15 09:05:36.815141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-07-15 09:05:36.815183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.357 [2024-07-15 09:05:36.824415] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.357 [2024-07-15 09:05:36.824725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-07-15 09:05:36.824752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.357 [2024-07-15 09:05:36.834797] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.357 [2024-07-15 09:05:36.835079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-07-15 09:05:36.835108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.357 [2024-07-15 09:05:36.844398] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.357 [2024-07-15 09:05:36.844642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-07-15 09:05:36.844670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.357 [2024-07-15 09:05:36.853642] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.357 [2024-07-15 09:05:36.853970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-07-15 09:05:36.853999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.357 [2024-07-15 09:05:36.863187] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.357 [2024-07-15 09:05:36.863405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-07-15 09:05:36.863432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.357 [2024-07-15 09:05:36.873079] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.357 [2024-07-15 09:05:36.873312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-07-15 09:05:36.873340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.357 [2024-07-15 09:05:36.882544] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.357 [2024-07-15 09:05:36.882907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-07-15 09:05:36.882935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.357 [2024-07-15 09:05:36.891927] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.357 [2024-07-15 09:05:36.892130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-07-15 09:05:36.892158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.615 [2024-07-15 09:05:36.902337] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.615 [2024-07-15 09:05:36.902631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.615 [2024-07-15 09:05:36.902660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.615 [2024-07-15 09:05:36.912485] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.615 [2024-07-15 09:05:36.912776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.615 [2024-07-15 09:05:36.912803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.615 [2024-07-15 09:05:36.922871] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.615 [2024-07-15 09:05:36.923232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.615 [2024-07-15 09:05:36.923260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.615 [2024-07-15 09:05:36.933133] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.615 [2024-07-15 09:05:36.933510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.615 [2024-07-15 09:05:36.933552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.615 [2024-07-15 09:05:36.943435] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.615 [2024-07-15 09:05:36.943659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.615 [2024-07-15 09:05:36.943688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.615 [2024-07-15 09:05:36.953108] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.615 [2024-07-15 09:05:36.953325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.615 [2024-07-15 09:05:36.953352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.615 [2024-07-15 09:05:36.963363] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.615 [2024-07-15 09:05:36.963581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.615 [2024-07-15 09:05:36.963614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.615 [2024-07-15 09:05:36.973590] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.615 [2024-07-15 09:05:36.973811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.615 [2024-07-15 09:05:36.973839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.615 [2024-07-15 09:05:36.984206] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.615 [2024-07-15 09:05:36.984502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.615 [2024-07-15 09:05:36.984530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.615 [2024-07-15 09:05:36.993035] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.615 [2024-07-15 09:05:36.993307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.615 [2024-07-15 09:05:36.993335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.615 [2024-07-15 09:05:37.002727] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.615 [2024-07-15 09:05:37.003062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.615 [2024-07-15 09:05:37.003091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.615 [2024-07-15 09:05:37.013157] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.615 [2024-07-15 09:05:37.013547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.615 [2024-07-15 09:05:37.013575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.615 [2024-07-15 09:05:37.022320] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.615 [2024-07-15 09:05:37.022698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.615 [2024-07-15 09:05:37.022740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.615 [2024-07-15 09:05:37.032530] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.615 [2024-07-15 09:05:37.032790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.615 [2024-07-15 09:05:37.032818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.615 [2024-07-15 09:05:37.042321] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.615 [2024-07-15 09:05:37.042498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.615 [2024-07-15 09:05:37.042527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.615 [2024-07-15 09:05:37.051805] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.615 [2024-07-15 09:05:37.052019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.615 [2024-07-15 09:05:37.052046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.615 [2024-07-15 09:05:37.062350] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.615 [2024-07-15 09:05:37.062616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.615 [2024-07-15 09:05:37.062644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.615 [2024-07-15 09:05:37.071287] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.615 [2024-07-15 09:05:37.071598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.615 [2024-07-15 09:05:37.071626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.615 [2024-07-15 09:05:37.080604] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.615 [2024-07-15 09:05:37.080905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.615 [2024-07-15 09:05:37.080934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.615 [2024-07-15 09:05:37.090821] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.615 [2024-07-15 09:05:37.091194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.616 [2024-07-15 09:05:37.091223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.616 [2024-07-15 09:05:37.101250] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.616 [2024-07-15 09:05:37.101521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.616 [2024-07-15 09:05:37.101549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.616 [2024-07-15 09:05:37.111414] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.616 [2024-07-15 09:05:37.111633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.616 [2024-07-15 09:05:37.111661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.616 [2024-07-15 09:05:37.121407] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.616 [2024-07-15 09:05:37.121715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.616 [2024-07-15 09:05:37.121743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.616 [2024-07-15 09:05:37.131136] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.616 [2024-07-15 09:05:37.131289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.616 [2024-07-15 09:05:37.131317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.616 [2024-07-15 09:05:37.140659] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.616 [2024-07-15 09:05:37.140909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.616 [2024-07-15 09:05:37.140937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.616 [2024-07-15 09:05:37.149840] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.616 [2024-07-15 09:05:37.150080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.616 [2024-07-15 09:05:37.150109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.873 [2024-07-15 09:05:37.159248] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.873 [2024-07-15 09:05:37.159507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.873 [2024-07-15 09:05:37.159536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.873 [2024-07-15 09:05:37.169620] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.873 [2024-07-15 09:05:37.169956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.873 [2024-07-15 09:05:37.169984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.873 [2024-07-15 09:05:37.179725] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.873 [2024-07-15 09:05:37.180040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.873 [2024-07-15 09:05:37.180069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.873 [2024-07-15 09:05:37.189777] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.873 [2024-07-15 09:05:37.190105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.873 [2024-07-15 09:05:37.190133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.873 [2024-07-15 09:05:37.198952] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.873 [2024-07-15 09:05:37.199181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.873 [2024-07-15 09:05:37.199209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.873 [2024-07-15 09:05:37.208805] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.873 [2024-07-15 09:05:37.208958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.873 [2024-07-15 09:05:37.208985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.873 [2024-07-15 09:05:37.218929] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.874 [2024-07-15 09:05:37.219219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.874 [2024-07-15 09:05:37.219252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.874 [2024-07-15 09:05:37.229128] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.874 [2024-07-15 09:05:37.229352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.874 [2024-07-15 09:05:37.229396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.874 [2024-07-15 09:05:37.239400] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.874 [2024-07-15 09:05:37.239735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.874 [2024-07-15 09:05:37.239764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.874 [2024-07-15 09:05:37.249478] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.874 [2024-07-15 09:05:37.249741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.874 [2024-07-15 09:05:37.249769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.874 [2024-07-15 09:05:37.259555] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.874 [2024-07-15 09:05:37.259783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.874 [2024-07-15 09:05:37.259810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.874 [2024-07-15 09:05:37.269448] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.874 [2024-07-15 09:05:37.269734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.874 [2024-07-15 09:05:37.269762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.874 [2024-07-15 09:05:37.279508] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.874 [2024-07-15 09:05:37.279747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.874 [2024-07-15 09:05:37.279775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.874 [2024-07-15 09:05:37.288645] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.874 [2024-07-15 09:05:37.288858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.874 [2024-07-15 09:05:37.288901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.874 [2024-07-15 09:05:37.299033] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.874 [2024-07-15 09:05:37.299228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.874 [2024-07-15 09:05:37.299255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.874 [2024-07-15 09:05:37.308977] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.874 [2024-07-15 09:05:37.309256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.874 [2024-07-15 09:05:37.309285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.874 [2024-07-15 09:05:37.318973] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.874 [2024-07-15 09:05:37.319210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.874 [2024-07-15 09:05:37.319238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.874 [2024-07-15 09:05:37.328053] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.874 [2024-07-15 09:05:37.328354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.874 [2024-07-15 09:05:37.328383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.874 [2024-07-15 09:05:37.337716] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xb7f210) with pdu=0x2000190fef90 00:26:48.874 [2024-07-15 09:05:37.337945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.874 [2024-07-15 09:05:37.337974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:48.874 00:26:48.874 Latency(us) 00:26:48.874 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:48.874 Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:26:48.874 nvme0n1 : 2.00 3153.44 394.18 0.00 0.00 5062.37 3252.53 15340.28 00:26:48.874 =================================================================================================================== 00:26:48.874 Total : 3153.44 394.18 0.00 0.00 5062.37 3252.53 15340.28 00:26:48.874 0 00:26:48.874 09:05:37 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:26:48.874 09:05:37 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:26:48.874 09:05:37 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:26:48.874 | .driver_specific 00:26:48.874 | .nvme_error 00:26:48.874 | .status_code 00:26:48.874 | .command_transient_transport_error' 00:26:48.874 09:05:37 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:26:49.132 09:05:37 -- host/digest.sh@71 -- # (( 203 > 0 )) 00:26:49.132 09:05:37 -- host/digest.sh@73 -- # killprocess 1613791 00:26:49.132 09:05:37 -- common/autotest_common.sh@926 -- # '[' -z 1613791 ']' 00:26:49.132 09:05:37 -- common/autotest_common.sh@930 -- # kill -0 1613791 00:26:49.132 09:05:37 -- common/autotest_common.sh@931 -- # uname 00:26:49.132 09:05:37 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:49.132 09:05:37 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1613791 00:26:49.132 09:05:37 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:26:49.132 09:05:37 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:26:49.132 09:05:37 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1613791' 00:26:49.132 killing process with pid 1613791 00:26:49.132 09:05:37 -- common/autotest_common.sh@945 -- # kill 1613791 00:26:49.132 Received shutdown signal, test time was about 2.000000 seconds 00:26:49.132 00:26:49.132 Latency(us) 00:26:49.132 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:49.132 =================================================================================================================== 00:26:49.132 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:49.132 09:05:37 -- common/autotest_common.sh@950 -- # wait 1613791 00:26:49.388 09:05:37 -- host/digest.sh@115 -- # killprocess 1612115 00:26:49.388 09:05:37 -- common/autotest_common.sh@926 -- # '[' -z 1612115 ']' 00:26:49.388 09:05:37 -- common/autotest_common.sh@930 -- # kill -0 1612115 00:26:49.388 09:05:37 -- common/autotest_common.sh@931 -- # uname 00:26:49.388 09:05:37 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:49.388 09:05:37 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1612115 00:26:49.646 09:05:37 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:26:49.646 09:05:37 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:26:49.646 09:05:37 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1612115' 00:26:49.646 killing process with pid 1612115 00:26:49.646 09:05:37 -- common/autotest_common.sh@945 -- # kill 1612115 00:26:49.646 09:05:37 -- common/autotest_common.sh@950 -- # wait 1612115 00:26:49.902 00:26:49.902 real 0m18.063s 00:26:49.902 user 0m36.657s 00:26:49.902 sys 0m4.344s 00:26:49.902 09:05:38 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:26:49.902 09:05:38 -- common/autotest_common.sh@10 -- # set +x 00:26:49.902 ************************************ 00:26:49.902 END TEST nvmf_digest_error 00:26:49.902 ************************************ 00:26:49.903 09:05:38 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:26:49.903 09:05:38 -- host/digest.sh@139 -- # nvmftestfini 00:26:49.903 09:05:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:49.903 09:05:38 -- nvmf/common.sh@116 -- # sync 00:26:49.903 09:05:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:49.903 09:05:38 -- nvmf/common.sh@119 -- # set +e 00:26:49.903 09:05:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:49.903 09:05:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:49.903 rmmod nvme_tcp 00:26:49.903 rmmod nvme_fabrics 00:26:49.903 rmmod nvme_keyring 00:26:49.903 09:05:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:49.903 09:05:38 -- nvmf/common.sh@123 -- # set -e 00:26:49.903 09:05:38 -- nvmf/common.sh@124 -- # return 0 00:26:49.903 09:05:38 -- nvmf/common.sh@477 -- # '[' -n 1612115 ']' 00:26:49.903 09:05:38 -- nvmf/common.sh@478 -- # killprocess 1612115 00:26:49.903 09:05:38 -- common/autotest_common.sh@926 -- # '[' -z 1612115 ']' 00:26:49.903 09:05:38 -- common/autotest_common.sh@930 -- # kill -0 1612115 00:26:49.903 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (1612115) - No such process 00:26:49.903 09:05:38 -- common/autotest_common.sh@953 -- # echo 'Process with pid 1612115 is not found' 00:26:49.903 Process with pid 1612115 is not found 00:26:49.903 09:05:38 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:49.903 09:05:38 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:49.903 09:05:38 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:49.903 09:05:38 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:49.903 09:05:38 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:49.903 09:05:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:49.903 09:05:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:49.903 09:05:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:51.800 09:05:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:51.800 00:26:51.800 real 0m37.525s 00:26:51.800 user 1m7.536s 00:26:51.800 sys 0m9.816s 00:26:51.800 09:05:40 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:26:51.800 09:05:40 -- common/autotest_common.sh@10 -- # set +x 00:26:51.800 ************************************ 00:26:51.800 END TEST nvmf_digest 00:26:51.800 ************************************ 00:26:52.058 09:05:40 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:26:52.058 09:05:40 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:26:52.058 09:05:40 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:26:52.058 09:05:40 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:26:52.058 09:05:40 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:26:52.058 09:05:40 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:26:52.058 09:05:40 -- common/autotest_common.sh@10 -- # set +x 00:26:52.058 ************************************ 00:26:52.058 START TEST nvmf_bdevperf 00:26:52.058 ************************************ 00:26:52.058 09:05:40 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:26:52.058 * Looking for test storage... 00:26:52.058 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:52.058 09:05:40 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:52.058 09:05:40 -- nvmf/common.sh@7 -- # uname -s 00:26:52.058 09:05:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:52.058 09:05:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:52.058 09:05:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:52.058 09:05:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:52.058 09:05:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:52.058 09:05:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:52.058 09:05:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:52.058 09:05:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:52.058 09:05:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:52.058 09:05:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:52.058 09:05:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:52.058 09:05:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:52.058 09:05:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:52.058 09:05:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:52.058 09:05:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:52.058 09:05:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:52.058 09:05:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:52.058 09:05:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:52.058 09:05:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:52.058 09:05:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:52.058 09:05:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:52.058 09:05:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:52.058 09:05:40 -- paths/export.sh@5 -- # export PATH 00:26:52.058 09:05:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:52.058 09:05:40 -- nvmf/common.sh@46 -- # : 0 00:26:52.058 09:05:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:52.058 09:05:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:52.058 09:05:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:52.058 09:05:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:52.058 09:05:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:52.058 09:05:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:52.058 09:05:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:52.058 09:05:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:52.058 09:05:40 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:26:52.058 09:05:40 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:26:52.058 09:05:40 -- host/bdevperf.sh@24 -- # nvmftestinit 00:26:52.058 09:05:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:52.058 09:05:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:52.058 09:05:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:52.058 09:05:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:52.058 09:05:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:52.058 09:05:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:52.058 09:05:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:52.058 09:05:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:52.058 09:05:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:52.058 09:05:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:52.058 09:05:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:52.058 09:05:40 -- common/autotest_common.sh@10 -- # set +x 00:26:53.959 09:05:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:53.959 09:05:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:53.959 09:05:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:53.959 09:05:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:53.959 09:05:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:53.959 09:05:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:53.959 09:05:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:53.959 09:05:42 -- nvmf/common.sh@294 -- # net_devs=() 00:26:53.959 09:05:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:53.959 09:05:42 -- nvmf/common.sh@295 -- # e810=() 00:26:53.959 09:05:42 -- nvmf/common.sh@295 -- # local -ga e810 00:26:53.959 09:05:42 -- nvmf/common.sh@296 -- # x722=() 00:26:53.959 09:05:42 -- nvmf/common.sh@296 -- # local -ga x722 00:26:53.959 09:05:42 -- nvmf/common.sh@297 -- # mlx=() 00:26:53.959 09:05:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:53.959 09:05:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:53.959 09:05:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:53.959 09:05:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:53.959 09:05:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:53.959 09:05:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:53.959 09:05:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:53.959 09:05:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:53.959 09:05:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:53.959 09:05:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:53.959 09:05:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:53.959 09:05:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:53.959 09:05:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:53.959 09:05:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:53.959 09:05:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:53.959 09:05:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:53.959 09:05:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:53.959 09:05:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:53.959 09:05:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:53.959 09:05:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:53.959 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:53.959 09:05:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:53.959 09:05:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:53.959 09:05:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:53.959 09:05:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:53.959 09:05:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:53.959 09:05:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:53.959 09:05:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:53.959 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:53.959 09:05:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:53.959 09:05:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:53.959 09:05:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:53.959 09:05:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:53.959 09:05:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:53.959 09:05:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:53.959 09:05:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:53.959 09:05:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:53.959 09:05:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:53.959 09:05:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:53.959 09:05:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:53.959 09:05:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:53.959 09:05:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:53.959 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:53.959 09:05:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:53.959 09:05:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:53.959 09:05:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:53.959 09:05:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:53.959 09:05:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:53.959 09:05:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:53.959 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:53.959 09:05:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:53.959 09:05:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:53.959 09:05:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:53.959 09:05:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:53.959 09:05:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:53.959 09:05:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:53.959 09:05:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:53.959 09:05:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:53.959 09:05:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:53.959 09:05:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:53.959 09:05:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:53.959 09:05:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:53.960 09:05:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:53.960 09:05:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:53.960 09:05:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:53.960 09:05:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:53.960 09:05:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:53.960 09:05:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:53.960 09:05:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:53.960 09:05:42 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:53.960 09:05:42 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:53.960 09:05:42 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:53.960 09:05:42 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:53.960 09:05:42 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:53.960 09:05:42 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:53.960 09:05:42 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:53.960 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:53.960 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.156 ms 00:26:53.960 00:26:53.960 --- 10.0.0.2 ping statistics --- 00:26:53.960 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:53.960 rtt min/avg/max/mdev = 0.156/0.156/0.156/0.000 ms 00:26:53.960 09:05:42 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:54.218 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:54.218 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.102 ms 00:26:54.218 00:26:54.218 --- 10.0.0.1 ping statistics --- 00:26:54.218 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:54.218 rtt min/avg/max/mdev = 0.102/0.102/0.102/0.000 ms 00:26:54.218 09:05:42 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:54.218 09:05:42 -- nvmf/common.sh@410 -- # return 0 00:26:54.218 09:05:42 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:54.218 09:05:42 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:54.218 09:05:42 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:54.218 09:05:42 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:54.218 09:05:42 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:54.218 09:05:42 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:54.218 09:05:42 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:54.218 09:05:42 -- host/bdevperf.sh@25 -- # tgt_init 00:26:54.218 09:05:42 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:26:54.218 09:05:42 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:54.218 09:05:42 -- common/autotest_common.sh@712 -- # xtrace_disable 00:26:54.218 09:05:42 -- common/autotest_common.sh@10 -- # set +x 00:26:54.218 09:05:42 -- nvmf/common.sh@469 -- # nvmfpid=1616306 00:26:54.218 09:05:42 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:26:54.218 09:05:42 -- nvmf/common.sh@470 -- # waitforlisten 1616306 00:26:54.218 09:05:42 -- common/autotest_common.sh@819 -- # '[' -z 1616306 ']' 00:26:54.218 09:05:42 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:54.218 09:05:42 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:54.218 09:05:42 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:54.218 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:54.218 09:05:42 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:54.218 09:05:42 -- common/autotest_common.sh@10 -- # set +x 00:26:54.218 [2024-07-15 09:05:42.572933] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:26:54.218 [2024-07-15 09:05:42.573002] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:54.218 EAL: No free 2048 kB hugepages reported on node 1 00:26:54.218 [2024-07-15 09:05:42.654131] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:26:54.477 [2024-07-15 09:05:42.785868] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:54.478 [2024-07-15 09:05:42.786066] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:54.478 [2024-07-15 09:05:42.786094] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:54.478 [2024-07-15 09:05:42.786119] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:54.478 [2024-07-15 09:05:42.786228] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:54.478 [2024-07-15 09:05:42.786293] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:54.478 [2024-07-15 09:05:42.786302] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:55.410 09:05:43 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:55.410 09:05:43 -- common/autotest_common.sh@852 -- # return 0 00:26:55.410 09:05:43 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:55.410 09:05:43 -- common/autotest_common.sh@718 -- # xtrace_disable 00:26:55.410 09:05:43 -- common/autotest_common.sh@10 -- # set +x 00:26:55.410 09:05:43 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:55.410 09:05:43 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:55.410 09:05:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:55.410 09:05:43 -- common/autotest_common.sh@10 -- # set +x 00:26:55.410 [2024-07-15 09:05:43.685819] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:55.410 09:05:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:55.410 09:05:43 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:26:55.410 09:05:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:55.410 09:05:43 -- common/autotest_common.sh@10 -- # set +x 00:26:55.410 Malloc0 00:26:55.410 09:05:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:55.410 09:05:43 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:55.410 09:05:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:55.410 09:05:43 -- common/autotest_common.sh@10 -- # set +x 00:26:55.410 09:05:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:55.410 09:05:43 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:26:55.410 09:05:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:55.410 09:05:43 -- common/autotest_common.sh@10 -- # set +x 00:26:55.410 09:05:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:55.410 09:05:43 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:55.410 09:05:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:55.410 09:05:43 -- common/autotest_common.sh@10 -- # set +x 00:26:55.410 [2024-07-15 09:05:43.752007] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:55.410 09:05:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:55.410 09:05:43 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:26:55.410 09:05:43 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:26:55.411 09:05:43 -- nvmf/common.sh@520 -- # config=() 00:26:55.411 09:05:43 -- nvmf/common.sh@520 -- # local subsystem config 00:26:55.411 09:05:43 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:55.411 09:05:43 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:55.411 { 00:26:55.411 "params": { 00:26:55.411 "name": "Nvme$subsystem", 00:26:55.411 "trtype": "$TEST_TRANSPORT", 00:26:55.411 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:55.411 "adrfam": "ipv4", 00:26:55.411 "trsvcid": "$NVMF_PORT", 00:26:55.411 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:55.411 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:55.411 "hdgst": ${hdgst:-false}, 00:26:55.411 "ddgst": ${ddgst:-false} 00:26:55.411 }, 00:26:55.411 "method": "bdev_nvme_attach_controller" 00:26:55.411 } 00:26:55.411 EOF 00:26:55.411 )") 00:26:55.411 09:05:43 -- nvmf/common.sh@542 -- # cat 00:26:55.411 09:05:43 -- nvmf/common.sh@544 -- # jq . 00:26:55.411 09:05:43 -- nvmf/common.sh@545 -- # IFS=, 00:26:55.411 09:05:43 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:26:55.411 "params": { 00:26:55.411 "name": "Nvme1", 00:26:55.411 "trtype": "tcp", 00:26:55.411 "traddr": "10.0.0.2", 00:26:55.411 "adrfam": "ipv4", 00:26:55.411 "trsvcid": "4420", 00:26:55.411 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:55.411 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:26:55.411 "hdgst": false, 00:26:55.411 "ddgst": false 00:26:55.411 }, 00:26:55.411 "method": "bdev_nvme_attach_controller" 00:26:55.411 }' 00:26:55.411 [2024-07-15 09:05:43.796779] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:26:55.411 [2024-07-15 09:05:43.796846] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1616461 ] 00:26:55.411 EAL: No free 2048 kB hugepages reported on node 1 00:26:55.411 [2024-07-15 09:05:43.856134] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:55.668 [2024-07-15 09:05:43.967013] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:55.926 Running I/O for 1 seconds... 00:26:56.860 00:26:56.860 Latency(us) 00:26:56.860 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:56.860 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:26:56.860 Verification LBA range: start 0x0 length 0x4000 00:26:56.860 Nvme1n1 : 1.01 12894.88 50.37 0.00 0.00 9883.71 1262.17 16602.45 00:26:56.860 =================================================================================================================== 00:26:56.860 Total : 12894.88 50.37 0.00 0.00 9883.71 1262.17 16602.45 00:26:57.119 09:05:45 -- host/bdevperf.sh@30 -- # bdevperfpid=1616615 00:26:57.119 09:05:45 -- host/bdevperf.sh@32 -- # sleep 3 00:26:57.119 09:05:45 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:26:57.119 09:05:45 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:26:57.119 09:05:45 -- nvmf/common.sh@520 -- # config=() 00:26:57.119 09:05:45 -- nvmf/common.sh@520 -- # local subsystem config 00:26:57.119 09:05:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:57.119 09:05:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:57.119 { 00:26:57.119 "params": { 00:26:57.119 "name": "Nvme$subsystem", 00:26:57.119 "trtype": "$TEST_TRANSPORT", 00:26:57.119 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:57.119 "adrfam": "ipv4", 00:26:57.119 "trsvcid": "$NVMF_PORT", 00:26:57.119 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:57.119 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:57.119 "hdgst": ${hdgst:-false}, 00:26:57.119 "ddgst": ${ddgst:-false} 00:26:57.119 }, 00:26:57.119 "method": "bdev_nvme_attach_controller" 00:26:57.119 } 00:26:57.119 EOF 00:26:57.119 )") 00:26:57.119 09:05:45 -- nvmf/common.sh@542 -- # cat 00:26:57.119 09:05:45 -- nvmf/common.sh@544 -- # jq . 00:26:57.119 09:05:45 -- nvmf/common.sh@545 -- # IFS=, 00:26:57.119 09:05:45 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:26:57.119 "params": { 00:26:57.119 "name": "Nvme1", 00:26:57.119 "trtype": "tcp", 00:26:57.119 "traddr": "10.0.0.2", 00:26:57.119 "adrfam": "ipv4", 00:26:57.119 "trsvcid": "4420", 00:26:57.119 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:57.119 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:26:57.119 "hdgst": false, 00:26:57.119 "ddgst": false 00:26:57.119 }, 00:26:57.119 "method": "bdev_nvme_attach_controller" 00:26:57.119 }' 00:26:57.119 [2024-07-15 09:05:45.578510] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:26:57.119 [2024-07-15 09:05:45.578581] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1616615 ] 00:26:57.119 EAL: No free 2048 kB hugepages reported on node 1 00:26:57.119 [2024-07-15 09:05:45.637438] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:57.376 [2024-07-15 09:05:45.746571] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:57.377 Running I/O for 15 seconds... 00:27:00.734 09:05:48 -- host/bdevperf.sh@33 -- # kill -9 1616306 00:27:00.734 09:05:48 -- host/bdevperf.sh@35 -- # sleep 3 00:27:00.734 [2024-07-15 09:05:48.552602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:12592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.734 [2024-07-15 09:05:48.552655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.734 [2024-07-15 09:05:48.552689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:12600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.734 [2024-07-15 09:05:48.552710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.734 [2024-07-15 09:05:48.552730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:13072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.734 [2024-07-15 09:05:48.552747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.734 [2024-07-15 09:05:48.552767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:13080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.734 [2024-07-15 09:05:48.552784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.734 [2024-07-15 09:05:48.552803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:13088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.734 [2024-07-15 09:05:48.552820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.734 [2024-07-15 09:05:48.552837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:13096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.734 [2024-07-15 09:05:48.552853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.734 [2024-07-15 09:05:48.552871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:13104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.734 [2024-07-15 09:05:48.552895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.734 [2024-07-15 09:05:48.552929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:13112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.734 [2024-07-15 09:05:48.552946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.734 [2024-07-15 09:05:48.552962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:13120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.734 [2024-07-15 09:05:48.552978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.734 [2024-07-15 09:05:48.552996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:13128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.734 [2024-07-15 09:05:48.553020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.734 [2024-07-15 09:05:48.553037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:13136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.734 [2024-07-15 09:05:48.553053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.734 [2024-07-15 09:05:48.553069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:13144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.734 [2024-07-15 09:05:48.553083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.734 [2024-07-15 09:05:48.553100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:13152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.734 [2024-07-15 09:05:48.553115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.734 [2024-07-15 09:05:48.553131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:13160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.734 [2024-07-15 09:05:48.553145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.734 [2024-07-15 09:05:48.553176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:13168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.734 [2024-07-15 09:05:48.553192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.734 [2024-07-15 09:05:48.553210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:13176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.734 [2024-07-15 09:05:48.553225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.734 [2024-07-15 09:05:48.553242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:13184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.734 [2024-07-15 09:05:48.553257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.734 [2024-07-15 09:05:48.553276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:13192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.735 [2024-07-15 09:05:48.553291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.735 [2024-07-15 09:05:48.553308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:13200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.735 [2024-07-15 09:05:48.553324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.735 [2024-07-15 09:05:48.553341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:13208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.735 [2024-07-15 09:05:48.553356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.735 [2024-07-15 09:05:48.553374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:13216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.735 [2024-07-15 09:05:48.553389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.735 [2024-07-15 09:05:48.553407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:13224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.735 [2024-07-15 09:05:48.553422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.735 [2024-07-15 09:05:48.553443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:13232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.735 [2024-07-15 09:05:48.553460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.735 [2024-07-15 09:05:48.553477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:13240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.735 [2024-07-15 09:05:48.553494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.735 [2024-07-15 09:05:48.553511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:13248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.735 [2024-07-15 09:05:48.553526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.735 [2024-07-15 09:05:48.553544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:13256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.735 [2024-07-15 09:05:48.553560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.735 [2024-07-15 09:05:48.553576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:12616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.735 [2024-07-15 09:05:48.553592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.735 [2024-07-15 09:05:48.553610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:12624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.735 [2024-07-15 09:05:48.553625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.735 [2024-07-15 09:05:48.553642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:12648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.735 [2024-07-15 09:05:48.553658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.735 [2024-07-15 09:05:48.553676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:12672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.735 [2024-07-15 09:05:48.553691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.735 [2024-07-15 09:05:48.553708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:12680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.735 [2024-07-15 09:05:48.553723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.735 [2024-07-15 09:05:48.553740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:12688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.735 [2024-07-15 09:05:48.553756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.735 [2024-07-15 09:05:48.553773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:12712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.735 [2024-07-15 09:05:48.553788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.735 [2024-07-15 09:05:48.553806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:12728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.735 [2024-07-15 09:05:48.553822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.735 [2024-07-15 09:05:48.553839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:13264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.735 [2024-07-15 09:05:48.553854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.735 [2024-07-15 09:05:48.553882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:13272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.735 [2024-07-15 09:05:48.553900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.735 [2024-07-15 09:05:48.553918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:13280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.735 [2024-07-15 09:05:48.553948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.735 [2024-07-15 09:05:48.553963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:13288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.735 [2024-07-15 09:05:48.553978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.735 [2024-07-15 09:05:48.553994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:13296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.735 [2024-07-15 09:05:48.554008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.735 [2024-07-15 09:05:48.554024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:13304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.735 [2024-07-15 09:05:48.554037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.735 [2024-07-15 09:05:48.554053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:13312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.735 [2024-07-15 09:05:48.554067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.735 [2024-07-15 09:05:48.554082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:12736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.735 [2024-07-15 09:05:48.554097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.735 [2024-07-15 09:05:48.554112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:12752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.735 [2024-07-15 09:05:48.554126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.735 [2024-07-15 09:05:48.554142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:12792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.735 [2024-07-15 09:05:48.554171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.735 [2024-07-15 09:05:48.554189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:12808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.735 [2024-07-15 09:05:48.554205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.735 [2024-07-15 09:05:48.554222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:12832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.735 [2024-07-15 09:05:48.554237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.735 [2024-07-15 09:05:48.554255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:12840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.735 [2024-07-15 09:05:48.554271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.735 [2024-07-15 09:05:48.554288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:12856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.735 [2024-07-15 09:05:48.554307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.735 [2024-07-15 09:05:48.554324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:12872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.735 [2024-07-15 09:05:48.554340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.735 [2024-07-15 09:05:48.554358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:13320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.735 [2024-07-15 09:05:48.554374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.735 [2024-07-15 09:05:48.554392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:13328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.735 [2024-07-15 09:05:48.554407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.735 [2024-07-15 09:05:48.554425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:13336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.735 [2024-07-15 09:05:48.554441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.735 [2024-07-15 09:05:48.554458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:13344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.735 [2024-07-15 09:05:48.554473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.735 [2024-07-15 09:05:48.554490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:13352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.735 [2024-07-15 09:05:48.554506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.735 [2024-07-15 09:05:48.554523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:13360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.735 [2024-07-15 09:05:48.554538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.735 [2024-07-15 09:05:48.554556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:13368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.735 [2024-07-15 09:05:48.554571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.735 [2024-07-15 09:05:48.554588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:12880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.735 [2024-07-15 09:05:48.554603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.735 [2024-07-15 09:05:48.554620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.735 [2024-07-15 09:05:48.554635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.735 [2024-07-15 09:05:48.554652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.735 [2024-07-15 09:05:48.554667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.735 [2024-07-15 09:05:48.554684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:12936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.735 [2024-07-15 09:05:48.554699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.554720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:12944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.736 [2024-07-15 09:05:48.554736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.554753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:13032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.736 [2024-07-15 09:05:48.554769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.554786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:13056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.736 [2024-07-15 09:05:48.554802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.554818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:13064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.736 [2024-07-15 09:05:48.554834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.554851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:13376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.736 [2024-07-15 09:05:48.554866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.554891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:13384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.736 [2024-07-15 09:05:48.554909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.554940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:13392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.736 [2024-07-15 09:05:48.554955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.554971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:13400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.736 [2024-07-15 09:05:48.554986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.555001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:13408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.736 [2024-07-15 09:05:48.555015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.555030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:13416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.736 [2024-07-15 09:05:48.555044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.555060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:13424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.736 [2024-07-15 09:05:48.555074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.555090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:13432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.736 [2024-07-15 09:05:48.555104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.555120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:13440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.736 [2024-07-15 09:05:48.555137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.555168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:13448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.736 [2024-07-15 09:05:48.555184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.555201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:13456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.736 [2024-07-15 09:05:48.555217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.555234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:13464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.736 [2024-07-15 09:05:48.555250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.555267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:13472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.736 [2024-07-15 09:05:48.555282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.555299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:13480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.736 [2024-07-15 09:05:48.555315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.555332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:13488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.736 [2024-07-15 09:05:48.555347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.555365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:13496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.736 [2024-07-15 09:05:48.555380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.555397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:13504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.736 [2024-07-15 09:05:48.555412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.555438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:13512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.736 [2024-07-15 09:05:48.555454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.555472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:13520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.736 [2024-07-15 09:05:48.555488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.555505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:13528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.736 [2024-07-15 09:05:48.555520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.555537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:13536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.736 [2024-07-15 09:05:48.555552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.555569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:13544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.736 [2024-07-15 09:05:48.555588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.555606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:13552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.736 [2024-07-15 09:05:48.555622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.555639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:13560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.736 [2024-07-15 09:05:48.555654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.555671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:13568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.736 [2024-07-15 09:05:48.555686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.555703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:13576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.736 [2024-07-15 09:05:48.555718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.555735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:13584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.736 [2024-07-15 09:05:48.555750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.555767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:13592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.736 [2024-07-15 09:05:48.555782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.555799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:13600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.736 [2024-07-15 09:05:48.555814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.555832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:13608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.736 [2024-07-15 09:05:48.555847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.555864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:13616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.736 [2024-07-15 09:05:48.555886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.555905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:13624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.736 [2024-07-15 09:05:48.555936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.555953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:13632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.736 [2024-07-15 09:05:48.555967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.555984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:13640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.736 [2024-07-15 09:05:48.555998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.556020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.736 [2024-07-15 09:05:48.556036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.556051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:13656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.736 [2024-07-15 09:05:48.556066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.556081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:13664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.736 [2024-07-15 09:05:48.556095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.556111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.736 [2024-07-15 09:05:48.556125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.736 [2024-07-15 09:05:48.556141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:13680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.736 [2024-07-15 09:05:48.556171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.737 [2024-07-15 09:05:48.556190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:13688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.737 [2024-07-15 09:05:48.556205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.737 [2024-07-15 09:05:48.556222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:13696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.737 [2024-07-15 09:05:48.556238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.737 [2024-07-15 09:05:48.556255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:13704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.737 [2024-07-15 09:05:48.556271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.737 [2024-07-15 09:05:48.556288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:13712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.737 [2024-07-15 09:05:48.556303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.737 [2024-07-15 09:05:48.556320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:13720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.737 [2024-07-15 09:05:48.556336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.737 [2024-07-15 09:05:48.556353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:13728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.737 [2024-07-15 09:05:48.556369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.737 [2024-07-15 09:05:48.556386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:13736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.737 [2024-07-15 09:05:48.556401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.737 [2024-07-15 09:05:48.556418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:13744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.737 [2024-07-15 09:05:48.556438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.737 [2024-07-15 09:05:48.556456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:13752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.737 [2024-07-15 09:05:48.556472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.737 [2024-07-15 09:05:48.556489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:13760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.737 [2024-07-15 09:05:48.556505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.737 [2024-07-15 09:05:48.556522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:13768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.737 [2024-07-15 09:05:48.556538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.737 [2024-07-15 09:05:48.556555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:13776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.737 [2024-07-15 09:05:48.556571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.737 [2024-07-15 09:05:48.556588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:13784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.737 [2024-07-15 09:05:48.556603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.737 [2024-07-15 09:05:48.556620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:13792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.737 [2024-07-15 09:05:48.556636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.737 [2024-07-15 09:05:48.556653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:13800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.737 [2024-07-15 09:05:48.556667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.737 [2024-07-15 09:05:48.556684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:13808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.737 [2024-07-15 09:05:48.556699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.737 [2024-07-15 09:05:48.556717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:13816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.737 [2024-07-15 09:05:48.556732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.737 [2024-07-15 09:05:48.556749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:13824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.737 [2024-07-15 09:05:48.556764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.737 [2024-07-15 09:05:48.556781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:13832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.737 [2024-07-15 09:05:48.556797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.737 [2024-07-15 09:05:48.556814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:13840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.737 [2024-07-15 09:05:48.556830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.737 [2024-07-15 09:05:48.556850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:13848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.737 [2024-07-15 09:05:48.556866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.737 [2024-07-15 09:05:48.556892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:13856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.737 [2024-07-15 09:05:48.556909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.737 [2024-07-15 09:05:48.556940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:13864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.737 [2024-07-15 09:05:48.556955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.737 [2024-07-15 09:05:48.556971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:13872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:00.737 [2024-07-15 09:05:48.556985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.737 [2024-07-15 09:05:48.557000] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c6e3a0 is same with the state(5) to be set 00:27:00.737 [2024-07-15 09:05:48.557016] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:00.737 [2024-07-15 09:05:48.557033] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:00.737 [2024-07-15 09:05:48.557046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13880 len:8 PRP1 0x0 PRP2 0x0 00:27:00.737 [2024-07-15 09:05:48.557059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:00.737 [2024-07-15 09:05:48.557123] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1c6e3a0 was disconnected and freed. reset controller. 00:27:00.737 [2024-07-15 09:05:48.559374] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.737 [2024-07-15 09:05:48.559446] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.737 [2024-07-15 09:05:48.559990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.737 [2024-07-15 09:05:48.560152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.737 [2024-07-15 09:05:48.560177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.737 [2024-07-15 09:05:48.560194] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.737 [2024-07-15 09:05:48.560414] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.737 [2024-07-15 09:05:48.560628] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.737 [2024-07-15 09:05:48.560652] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.737 [2024-07-15 09:05:48.560669] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.737 [2024-07-15 09:05:48.563196] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.737 [2024-07-15 09:05:48.572063] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.737 [2024-07-15 09:05:48.572402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.737 [2024-07-15 09:05:48.572594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.737 [2024-07-15 09:05:48.572623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.737 [2024-07-15 09:05:48.572646] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.737 [2024-07-15 09:05:48.572849] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.737 [2024-07-15 09:05:48.573016] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.737 [2024-07-15 09:05:48.573038] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.737 [2024-07-15 09:05:48.573051] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.737 [2024-07-15 09:05:48.575553] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.737 [2024-07-15 09:05:48.584786] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.737 [2024-07-15 09:05:48.585107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.737 [2024-07-15 09:05:48.585298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.737 [2024-07-15 09:05:48.585328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.737 [2024-07-15 09:05:48.585345] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.737 [2024-07-15 09:05:48.585493] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.737 [2024-07-15 09:05:48.585663] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.737 [2024-07-15 09:05:48.585687] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.737 [2024-07-15 09:05:48.585702] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.737 [2024-07-15 09:05:48.588049] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.737 [2024-07-15 09:05:48.597292] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.737 [2024-07-15 09:05:48.597636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.737 [2024-07-15 09:05:48.597842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.737 [2024-07-15 09:05:48.597868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.737 [2024-07-15 09:05:48.597894] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.737 [2024-07-15 09:05:48.598025] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.738 [2024-07-15 09:05:48.598214] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.738 [2024-07-15 09:05:48.598238] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.738 [2024-07-15 09:05:48.598255] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.738 [2024-07-15 09:05:48.600456] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.738 [2024-07-15 09:05:48.609823] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.738 [2024-07-15 09:05:48.610172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.738 [2024-07-15 09:05:48.610315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.738 [2024-07-15 09:05:48.610344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.738 [2024-07-15 09:05:48.610363] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.738 [2024-07-15 09:05:48.610516] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.738 [2024-07-15 09:05:48.610705] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.738 [2024-07-15 09:05:48.610729] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.738 [2024-07-15 09:05:48.610745] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.738 [2024-07-15 09:05:48.612959] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.738 [2024-07-15 09:05:48.622453] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.738 [2024-07-15 09:05:48.622849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.738 [2024-07-15 09:05:48.622994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.738 [2024-07-15 09:05:48.623023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.738 [2024-07-15 09:05:48.623042] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.738 [2024-07-15 09:05:48.623208] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.738 [2024-07-15 09:05:48.623395] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.738 [2024-07-15 09:05:48.623420] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.738 [2024-07-15 09:05:48.623436] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.738 [2024-07-15 09:05:48.625785] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.738 [2024-07-15 09:05:48.635066] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.738 [2024-07-15 09:05:48.635430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.738 [2024-07-15 09:05:48.635749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.738 [2024-07-15 09:05:48.635801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.738 [2024-07-15 09:05:48.635819] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.738 [2024-07-15 09:05:48.635995] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.738 [2024-07-15 09:05:48.636183] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.738 [2024-07-15 09:05:48.636207] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.738 [2024-07-15 09:05:48.636224] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.738 [2024-07-15 09:05:48.638553] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.738 [2024-07-15 09:05:48.647574] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.738 [2024-07-15 09:05:48.647891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.738 [2024-07-15 09:05:48.648050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.738 [2024-07-15 09:05:48.648079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.738 [2024-07-15 09:05:48.648097] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.738 [2024-07-15 09:05:48.648226] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.738 [2024-07-15 09:05:48.648365] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.738 [2024-07-15 09:05:48.648390] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.738 [2024-07-15 09:05:48.648406] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.738 [2024-07-15 09:05:48.650684] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.738 [2024-07-15 09:05:48.659933] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.738 [2024-07-15 09:05:48.660324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.738 [2024-07-15 09:05:48.660537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.738 [2024-07-15 09:05:48.660590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.738 [2024-07-15 09:05:48.660608] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.738 [2024-07-15 09:05:48.660738] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.738 [2024-07-15 09:05:48.660918] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.738 [2024-07-15 09:05:48.660943] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.738 [2024-07-15 09:05:48.660959] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.738 [2024-07-15 09:05:48.663071] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.738 [2024-07-15 09:05:48.672465] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.738 [2024-07-15 09:05:48.672833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.738 [2024-07-15 09:05:48.673006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.738 [2024-07-15 09:05:48.673036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.738 [2024-07-15 09:05:48.673054] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.738 [2024-07-15 09:05:48.673219] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.738 [2024-07-15 09:05:48.673371] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.738 [2024-07-15 09:05:48.673396] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.738 [2024-07-15 09:05:48.673412] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.738 [2024-07-15 09:05:48.675777] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.738 [2024-07-15 09:05:48.685044] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.738 [2024-07-15 09:05:48.685462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.738 [2024-07-15 09:05:48.685793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.738 [2024-07-15 09:05:48.685851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.738 [2024-07-15 09:05:48.685869] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.738 [2024-07-15 09:05:48.686068] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.738 [2024-07-15 09:05:48.686220] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.738 [2024-07-15 09:05:48.686250] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.738 [2024-07-15 09:05:48.686267] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.738 [2024-07-15 09:05:48.688779] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.738 [2024-07-15 09:05:48.697492] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.738 [2024-07-15 09:05:48.697861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.738 [2024-07-15 09:05:48.698064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.738 [2024-07-15 09:05:48.698091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.738 [2024-07-15 09:05:48.698107] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.738 [2024-07-15 09:05:48.698316] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.738 [2024-07-15 09:05:48.698450] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.739 [2024-07-15 09:05:48.698474] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.739 [2024-07-15 09:05:48.698490] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.739 [2024-07-15 09:05:48.700746] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.739 [2024-07-15 09:05:48.710251] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.739 [2024-07-15 09:05:48.710590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.739 [2024-07-15 09:05:48.710830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.739 [2024-07-15 09:05:48.710859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.739 [2024-07-15 09:05:48.710886] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.739 [2024-07-15 09:05:48.711072] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.739 [2024-07-15 09:05:48.711260] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.739 [2024-07-15 09:05:48.711284] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.739 [2024-07-15 09:05:48.711301] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.739 [2024-07-15 09:05:48.713890] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.739 [2024-07-15 09:05:48.722910] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.739 [2024-07-15 09:05:48.723322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.739 [2024-07-15 09:05:48.723566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.739 [2024-07-15 09:05:48.723606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.739 [2024-07-15 09:05:48.723622] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.739 [2024-07-15 09:05:48.723803] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.739 [2024-07-15 09:05:48.724014] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.739 [2024-07-15 09:05:48.724039] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.739 [2024-07-15 09:05:48.724061] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.739 [2024-07-15 09:05:48.726249] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.739 [2024-07-15 09:05:48.735751] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.739 [2024-07-15 09:05:48.736104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.739 [2024-07-15 09:05:48.736255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.739 [2024-07-15 09:05:48.736284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.739 [2024-07-15 09:05:48.736301] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.739 [2024-07-15 09:05:48.736503] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.739 [2024-07-15 09:05:48.736690] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.739 [2024-07-15 09:05:48.736714] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.739 [2024-07-15 09:05:48.736730] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.739 [2024-07-15 09:05:48.738959] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.739 [2024-07-15 09:05:48.748409] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.739 [2024-07-15 09:05:48.748715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.739 [2024-07-15 09:05:48.748890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.739 [2024-07-15 09:05:48.748919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.739 [2024-07-15 09:05:48.748938] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.739 [2024-07-15 09:05:48.749085] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.739 [2024-07-15 09:05:48.749237] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.739 [2024-07-15 09:05:48.749261] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.739 [2024-07-15 09:05:48.749278] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.739 [2024-07-15 09:05:48.751588] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.739 [2024-07-15 09:05:48.761120] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.739 [2024-07-15 09:05:48.761447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.739 [2024-07-15 09:05:48.761709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.739 [2024-07-15 09:05:48.761758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.739 [2024-07-15 09:05:48.761777] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.739 [2024-07-15 09:05:48.761953] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.739 [2024-07-15 09:05:48.762159] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.739 [2024-07-15 09:05:48.762184] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.739 [2024-07-15 09:05:48.762200] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.739 [2024-07-15 09:05:48.764443] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.739 [2024-07-15 09:05:48.773887] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.739 [2024-07-15 09:05:48.774289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.739 [2024-07-15 09:05:48.774527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.739 [2024-07-15 09:05:48.774589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.739 [2024-07-15 09:05:48.774608] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.739 [2024-07-15 09:05:48.774755] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.739 [2024-07-15 09:05:48.774972] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.739 [2024-07-15 09:05:48.774997] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.739 [2024-07-15 09:05:48.775013] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.739 [2024-07-15 09:05:48.777360] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.739 [2024-07-15 09:05:48.786454] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.739 [2024-07-15 09:05:48.786802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.739 [2024-07-15 09:05:48.786972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.739 [2024-07-15 09:05:48.787003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.739 [2024-07-15 09:05:48.787021] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.739 [2024-07-15 09:05:48.787241] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.739 [2024-07-15 09:05:48.787430] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.739 [2024-07-15 09:05:48.787455] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.739 [2024-07-15 09:05:48.787471] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.739 [2024-07-15 09:05:48.789711] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.739 [2024-07-15 09:05:48.799098] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.739 [2024-07-15 09:05:48.799396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.739 [2024-07-15 09:05:48.799584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.739 [2024-07-15 09:05:48.799613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.739 [2024-07-15 09:05:48.799631] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.739 [2024-07-15 09:05:48.799798] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.739 [2024-07-15 09:05:48.799962] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.739 [2024-07-15 09:05:48.799987] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.739 [2024-07-15 09:05:48.800003] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.739 [2024-07-15 09:05:48.802186] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.739 [2024-07-15 09:05:48.811590] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.739 [2024-07-15 09:05:48.811935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.739 [2024-07-15 09:05:48.812097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.739 [2024-07-15 09:05:48.812127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.739 [2024-07-15 09:05:48.812145] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.739 [2024-07-15 09:05:48.812330] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.739 [2024-07-15 09:05:48.812500] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.739 [2024-07-15 09:05:48.812525] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.739 [2024-07-15 09:05:48.812542] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.739 [2024-07-15 09:05:48.814918] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.739 [2024-07-15 09:05:48.824135] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.739 [2024-07-15 09:05:48.824457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.739 [2024-07-15 09:05:48.824655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.739 [2024-07-15 09:05:48.824684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.739 [2024-07-15 09:05:48.824702] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.739 [2024-07-15 09:05:48.824868] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.739 [2024-07-15 09:05:48.825084] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.739 [2024-07-15 09:05:48.825109] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.740 [2024-07-15 09:05:48.825125] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.740 [2024-07-15 09:05:48.827439] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.740 [2024-07-15 09:05:48.836835] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.740 [2024-07-15 09:05:48.837148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.740 [2024-07-15 09:05:48.837332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.740 [2024-07-15 09:05:48.837378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.740 [2024-07-15 09:05:48.837396] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.740 [2024-07-15 09:05:48.837562] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.740 [2024-07-15 09:05:48.837768] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.740 [2024-07-15 09:05:48.837792] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.740 [2024-07-15 09:05:48.837808] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.740 [2024-07-15 09:05:48.840019] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.740 [2024-07-15 09:05:48.849391] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.740 [2024-07-15 09:05:48.849738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.740 [2024-07-15 09:05:48.849916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.740 [2024-07-15 09:05:48.849946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.740 [2024-07-15 09:05:48.849965] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.740 [2024-07-15 09:05:48.850113] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.740 [2024-07-15 09:05:48.850283] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.740 [2024-07-15 09:05:48.850307] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.740 [2024-07-15 09:05:48.850323] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.740 [2024-07-15 09:05:48.852641] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.740 [2024-07-15 09:05:48.861896] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.740 [2024-07-15 09:05:48.862249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.740 [2024-07-15 09:05:48.862508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.740 [2024-07-15 09:05:48.862562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.740 [2024-07-15 09:05:48.862581] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.740 [2024-07-15 09:05:48.862784] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.740 [2024-07-15 09:05:48.862953] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.740 [2024-07-15 09:05:48.862979] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.740 [2024-07-15 09:05:48.862996] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.740 [2024-07-15 09:05:48.865383] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.740 [2024-07-15 09:05:48.874509] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.740 [2024-07-15 09:05:48.874898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.740 [2024-07-15 09:05:48.875129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.740 [2024-07-15 09:05:48.875183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.740 [2024-07-15 09:05:48.875201] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.740 [2024-07-15 09:05:48.875350] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.740 [2024-07-15 09:05:48.875483] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.740 [2024-07-15 09:05:48.875509] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.740 [2024-07-15 09:05:48.875525] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.740 [2024-07-15 09:05:48.877732] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.740 [2024-07-15 09:05:48.887224] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.740 [2024-07-15 09:05:48.887617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.740 [2024-07-15 09:05:48.887778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.740 [2024-07-15 09:05:48.887814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.740 [2024-07-15 09:05:48.887834] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.740 [2024-07-15 09:05:48.888048] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.740 [2024-07-15 09:05:48.888238] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.740 [2024-07-15 09:05:48.888264] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.740 [2024-07-15 09:05:48.888281] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.740 [2024-07-15 09:05:48.890648] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.740 [2024-07-15 09:05:48.899893] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.740 [2024-07-15 09:05:48.900230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.740 [2024-07-15 09:05:48.900505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.740 [2024-07-15 09:05:48.900546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.740 [2024-07-15 09:05:48.900563] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.740 [2024-07-15 09:05:48.900744] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.740 [2024-07-15 09:05:48.900951] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.740 [2024-07-15 09:05:48.900977] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.740 [2024-07-15 09:05:48.900994] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.740 [2024-07-15 09:05:48.903231] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.740 [2024-07-15 09:05:48.912274] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.740 [2024-07-15 09:05:48.912693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.740 [2024-07-15 09:05:48.912901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.740 [2024-07-15 09:05:48.912941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.740 [2024-07-15 09:05:48.912961] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.740 [2024-07-15 09:05:48.913109] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.740 [2024-07-15 09:05:48.913279] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.740 [2024-07-15 09:05:48.913303] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.740 [2024-07-15 09:05:48.913319] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.740 [2024-07-15 09:05:48.915667] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.740 [2024-07-15 09:05:48.924983] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.740 [2024-07-15 09:05:48.925424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.740 [2024-07-15 09:05:48.925687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.740 [2024-07-15 09:05:48.925737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.740 [2024-07-15 09:05:48.925761] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.740 [2024-07-15 09:05:48.925954] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.740 [2024-07-15 09:05:48.926090] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.740 [2024-07-15 09:05:48.926114] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.740 [2024-07-15 09:05:48.926130] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.740 [2024-07-15 09:05:48.928496] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.740 [2024-07-15 09:05:48.937617] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.740 [2024-07-15 09:05:48.937940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.740 [2024-07-15 09:05:48.938130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.740 [2024-07-15 09:05:48.938158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.740 [2024-07-15 09:05:48.938176] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.740 [2024-07-15 09:05:48.938324] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.740 [2024-07-15 09:05:48.938475] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.740 [2024-07-15 09:05:48.938501] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.740 [2024-07-15 09:05:48.938517] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.740 [2024-07-15 09:05:48.940889] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.740 [2024-07-15 09:05:48.950159] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.740 [2024-07-15 09:05:48.950501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.740 [2024-07-15 09:05:48.950820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.740 [2024-07-15 09:05:48.950871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.740 [2024-07-15 09:05:48.950901] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.740 [2024-07-15 09:05:48.951054] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.740 [2024-07-15 09:05:48.951207] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.740 [2024-07-15 09:05:48.951231] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.740 [2024-07-15 09:05:48.951247] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.741 [2024-07-15 09:05:48.953451] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.741 [2024-07-15 09:05:48.962770] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.741 [2024-07-15 09:05:48.963104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.741 [2024-07-15 09:05:48.963342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.741 [2024-07-15 09:05:48.963384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.741 [2024-07-15 09:05:48.963400] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.741 [2024-07-15 09:05:48.963577] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.741 [2024-07-15 09:05:48.963767] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.741 [2024-07-15 09:05:48.963792] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.741 [2024-07-15 09:05:48.963809] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.741 [2024-07-15 09:05:48.966315] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.741 [2024-07-15 09:05:48.975256] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.741 [2024-07-15 09:05:48.975771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.741 [2024-07-15 09:05:48.975993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.741 [2024-07-15 09:05:48.976023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.741 [2024-07-15 09:05:48.976042] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.741 [2024-07-15 09:05:48.976224] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.741 [2024-07-15 09:05:48.976394] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.741 [2024-07-15 09:05:48.976419] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.741 [2024-07-15 09:05:48.976434] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.741 [2024-07-15 09:05:48.978642] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.741 [2024-07-15 09:05:48.987979] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.741 [2024-07-15 09:05:48.988329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.741 [2024-07-15 09:05:48.988495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.741 [2024-07-15 09:05:48.988524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.741 [2024-07-15 09:05:48.988541] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.741 [2024-07-15 09:05:48.988743] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.741 [2024-07-15 09:05:48.988906] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.741 [2024-07-15 09:05:48.988942] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.741 [2024-07-15 09:05:48.988957] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.741 [2024-07-15 09:05:48.991134] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.741 [2024-07-15 09:05:49.000337] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.741 [2024-07-15 09:05:49.000756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.741 [2024-07-15 09:05:49.000967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.741 [2024-07-15 09:05:49.000996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.741 [2024-07-15 09:05:49.001025] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.741 [2024-07-15 09:05:49.001191] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.741 [2024-07-15 09:05:49.001349] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.741 [2024-07-15 09:05:49.001374] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.741 [2024-07-15 09:05:49.001390] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.741 [2024-07-15 09:05:49.003811] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.741 [2024-07-15 09:05:49.012953] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.741 [2024-07-15 09:05:49.013426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.741 [2024-07-15 09:05:49.013716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.741 [2024-07-15 09:05:49.013768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.741 [2024-07-15 09:05:49.013786] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.741 [2024-07-15 09:05:49.013983] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.741 [2024-07-15 09:05:49.014163] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.741 [2024-07-15 09:05:49.014188] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.741 [2024-07-15 09:05:49.014205] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.741 [2024-07-15 09:05:49.016574] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.741 [2024-07-15 09:05:49.025423] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.741 [2024-07-15 09:05:49.025812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.741 [2024-07-15 09:05:49.026002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.741 [2024-07-15 09:05:49.026033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.741 [2024-07-15 09:05:49.026051] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.741 [2024-07-15 09:05:49.026182] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.741 [2024-07-15 09:05:49.026387] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.741 [2024-07-15 09:05:49.026412] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.741 [2024-07-15 09:05:49.026429] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.741 [2024-07-15 09:05:49.028580] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.741 [2024-07-15 09:05:49.037839] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.741 [2024-07-15 09:05:49.038230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.741 [2024-07-15 09:05:49.038394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.741 [2024-07-15 09:05:49.038423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.741 [2024-07-15 09:05:49.038441] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.741 [2024-07-15 09:05:49.038588] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.741 [2024-07-15 09:05:49.038775] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.741 [2024-07-15 09:05:49.038807] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.741 [2024-07-15 09:05:49.038824] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.741 [2024-07-15 09:05:49.041176] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.741 [2024-07-15 09:05:49.050452] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.741 [2024-07-15 09:05:49.050809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.741 [2024-07-15 09:05:49.050985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.741 [2024-07-15 09:05:49.051011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.741 [2024-07-15 09:05:49.051028] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.741 [2024-07-15 09:05:49.051251] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.741 [2024-07-15 09:05:49.051448] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.741 [2024-07-15 09:05:49.051473] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.741 [2024-07-15 09:05:49.051489] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.741 [2024-07-15 09:05:49.053782] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.741 [2024-07-15 09:05:49.063120] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.741 [2024-07-15 09:05:49.063480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.741 [2024-07-15 09:05:49.063620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.741 [2024-07-15 09:05:49.063650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.741 [2024-07-15 09:05:49.063669] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.741 [2024-07-15 09:05:49.063799] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.741 [2024-07-15 09:05:49.064001] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.741 [2024-07-15 09:05:49.064028] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.741 [2024-07-15 09:05:49.064044] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.741 [2024-07-15 09:05:49.066359] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.741 [2024-07-15 09:05:49.075668] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.741 [2024-07-15 09:05:49.076034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.741 [2024-07-15 09:05:49.076161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.741 [2024-07-15 09:05:49.076192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.741 [2024-07-15 09:05:49.076211] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.741 [2024-07-15 09:05:49.076413] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.741 [2024-07-15 09:05:49.076546] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.742 [2024-07-15 09:05:49.076571] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.742 [2024-07-15 09:05:49.076593] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.742 [2024-07-15 09:05:49.078919] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.742 [2024-07-15 09:05:49.088338] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.742 [2024-07-15 09:05:49.088665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.742 [2024-07-15 09:05:49.088794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.742 [2024-07-15 09:05:49.088824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.742 [2024-07-15 09:05:49.088843] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.742 [2024-07-15 09:05:49.089009] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.742 [2024-07-15 09:05:49.089199] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.742 [2024-07-15 09:05:49.089224] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.742 [2024-07-15 09:05:49.089241] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.742 [2024-07-15 09:05:49.091629] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.742 [2024-07-15 09:05:49.100973] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.742 [2024-07-15 09:05:49.101302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.742 [2024-07-15 09:05:49.101475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.742 [2024-07-15 09:05:49.101504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.742 [2024-07-15 09:05:49.101521] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.742 [2024-07-15 09:05:49.101652] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.742 [2024-07-15 09:05:49.101839] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.742 [2024-07-15 09:05:49.101864] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.742 [2024-07-15 09:05:49.101895] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.742 [2024-07-15 09:05:49.104124] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.742 [2024-07-15 09:05:49.113345] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.742 [2024-07-15 09:05:49.113676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.742 [2024-07-15 09:05:49.113843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.742 [2024-07-15 09:05:49.113872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.742 [2024-07-15 09:05:49.113901] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.742 [2024-07-15 09:05:49.114086] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.742 [2024-07-15 09:05:49.114292] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.742 [2024-07-15 09:05:49.114317] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.742 [2024-07-15 09:05:49.114333] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.742 [2024-07-15 09:05:49.116671] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.742 [2024-07-15 09:05:49.125929] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.742 [2024-07-15 09:05:49.126344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.742 [2024-07-15 09:05:49.126483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.742 [2024-07-15 09:05:49.126510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.742 [2024-07-15 09:05:49.126528] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.742 [2024-07-15 09:05:49.126659] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.742 [2024-07-15 09:05:49.126864] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.742 [2024-07-15 09:05:49.126903] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.742 [2024-07-15 09:05:49.126921] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.742 [2024-07-15 09:05:49.129210] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.742 [2024-07-15 09:05:49.138575] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.742 [2024-07-15 09:05:49.138920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.742 [2024-07-15 09:05:49.139110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.742 [2024-07-15 09:05:49.139138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.742 [2024-07-15 09:05:49.139157] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.742 [2024-07-15 09:05:49.139306] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.742 [2024-07-15 09:05:49.139529] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.742 [2024-07-15 09:05:49.139555] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.742 [2024-07-15 09:05:49.139570] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.742 [2024-07-15 09:05:49.141950] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.742 [2024-07-15 09:05:49.150988] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.742 [2024-07-15 09:05:49.151345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.742 [2024-07-15 09:05:49.151512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.742 [2024-07-15 09:05:49.151541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.742 [2024-07-15 09:05:49.151560] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.742 [2024-07-15 09:05:49.151726] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.742 [2024-07-15 09:05:49.151892] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.742 [2024-07-15 09:05:49.151916] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.742 [2024-07-15 09:05:49.151932] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.742 [2024-07-15 09:05:49.154438] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.742 [2024-07-15 09:05:49.163758] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.742 [2024-07-15 09:05:49.164514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.742 [2024-07-15 09:05:49.164683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.742 [2024-07-15 09:05:49.164714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.742 [2024-07-15 09:05:49.164733] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.742 [2024-07-15 09:05:49.164931] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.742 [2024-07-15 09:05:49.165083] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.742 [2024-07-15 09:05:49.165105] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.742 [2024-07-15 09:05:49.165119] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.742 [2024-07-15 09:05:49.167472] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.742 [2024-07-15 09:05:49.176260] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.742 [2024-07-15 09:05:49.176677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.742 [2024-07-15 09:05:49.176851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.742 [2024-07-15 09:05:49.176884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.742 [2024-07-15 09:05:49.176902] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.742 [2024-07-15 09:05:49.177035] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.742 [2024-07-15 09:05:49.177244] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.742 [2024-07-15 09:05:49.177270] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.742 [2024-07-15 09:05:49.177286] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.742 [2024-07-15 09:05:49.179489] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.742 [2024-07-15 09:05:49.188798] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.742 [2024-07-15 09:05:49.189089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.742 [2024-07-15 09:05:49.189216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.742 [2024-07-15 09:05:49.189241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.742 [2024-07-15 09:05:49.189256] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.742 [2024-07-15 09:05:49.189402] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.742 [2024-07-15 09:05:49.189597] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.742 [2024-07-15 09:05:49.189623] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.742 [2024-07-15 09:05:49.189640] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.742 [2024-07-15 09:05:49.192123] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.742 [2024-07-15 09:05:49.201437] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.742 [2024-07-15 09:05:49.201724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.742 [2024-07-15 09:05:49.201965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.742 [2024-07-15 09:05:49.201993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.742 [2024-07-15 09:05:49.202009] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.743 [2024-07-15 09:05:49.202126] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.743 [2024-07-15 09:05:49.202306] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.743 [2024-07-15 09:05:49.202332] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.743 [2024-07-15 09:05:49.202348] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.743 [2024-07-15 09:05:49.204729] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.743 [2024-07-15 09:05:49.213856] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.743 [2024-07-15 09:05:49.214202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.743 [2024-07-15 09:05:49.214363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.743 [2024-07-15 09:05:49.214391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.743 [2024-07-15 09:05:49.214408] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.743 [2024-07-15 09:05:49.214556] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.743 [2024-07-15 09:05:49.214761] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.743 [2024-07-15 09:05:49.214787] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.743 [2024-07-15 09:05:49.214802] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.743 [2024-07-15 09:05:49.217114] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.743 [2024-07-15 09:05:49.226434] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.743 [2024-07-15 09:05:49.226848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.743 [2024-07-15 09:05:49.227000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.743 [2024-07-15 09:05:49.227026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.743 [2024-07-15 09:05:49.227042] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.743 [2024-07-15 09:05:49.227208] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.743 [2024-07-15 09:05:49.227363] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.743 [2024-07-15 09:05:49.227389] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.743 [2024-07-15 09:05:49.227406] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.743 [2024-07-15 09:05:49.229727] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.743 [2024-07-15 09:05:49.238692] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.743 [2024-07-15 09:05:49.239070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.743 [2024-07-15 09:05:49.239232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.743 [2024-07-15 09:05:49.239297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.743 [2024-07-15 09:05:49.239314] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.743 [2024-07-15 09:05:49.239521] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.743 [2024-07-15 09:05:49.239692] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.743 [2024-07-15 09:05:49.239725] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.743 [2024-07-15 09:05:49.239741] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.743 [2024-07-15 09:05:49.242080] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.743 [2024-07-15 09:05:49.251469] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.743 [2024-07-15 09:05:49.251834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.743 [2024-07-15 09:05:49.252014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.743 [2024-07-15 09:05:49.252040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.743 [2024-07-15 09:05:49.252057] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.743 [2024-07-15 09:05:49.252172] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.743 [2024-07-15 09:05:49.252362] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.743 [2024-07-15 09:05:49.252386] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.743 [2024-07-15 09:05:49.252402] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.743 [2024-07-15 09:05:49.254745] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:00.743 [2024-07-15 09:05:49.264049] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:00.743 [2024-07-15 09:05:49.264436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.743 [2024-07-15 09:05:49.264636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:00.743 [2024-07-15 09:05:49.264682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:00.743 [2024-07-15 09:05:49.264701] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:00.743 [2024-07-15 09:05:49.264813] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:00.743 [2024-07-15 09:05:49.265012] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:00.743 [2024-07-15 09:05:49.265038] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:00.743 [2024-07-15 09:05:49.265054] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:00.743 [2024-07-15 09:05:49.267264] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.002 [2024-07-15 09:05:49.276703] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.002 [2024-07-15 09:05:49.277058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.002 [2024-07-15 09:05:49.277223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.002 [2024-07-15 09:05:49.277253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.002 [2024-07-15 09:05:49.277276] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.002 [2024-07-15 09:05:49.277407] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.002 [2024-07-15 09:05:49.277577] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.002 [2024-07-15 09:05:49.277601] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.002 [2024-07-15 09:05:49.277617] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.002 [2024-07-15 09:05:49.279774] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.002 [2024-07-15 09:05:49.289097] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.002 [2024-07-15 09:05:49.289468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.002 [2024-07-15 09:05:49.289660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.002 [2024-07-15 09:05:49.289691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.002 [2024-07-15 09:05:49.289710] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.002 [2024-07-15 09:05:49.289886] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.002 [2024-07-15 09:05:49.290056] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.002 [2024-07-15 09:05:49.290081] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.002 [2024-07-15 09:05:49.290097] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.002 [2024-07-15 09:05:49.292455] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.002 [2024-07-15 09:05:49.301823] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.002 [2024-07-15 09:05:49.302216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.002 [2024-07-15 09:05:49.302377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.002 [2024-07-15 09:05:49.302407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.002 [2024-07-15 09:05:49.302425] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.002 [2024-07-15 09:05:49.302573] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.002 [2024-07-15 09:05:49.302760] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.002 [2024-07-15 09:05:49.302785] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.002 [2024-07-15 09:05:49.302801] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.002 [2024-07-15 09:05:49.305199] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.002 [2024-07-15 09:05:49.314489] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.002 [2024-07-15 09:05:49.314765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.002 [2024-07-15 09:05:49.314961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.002 [2024-07-15 09:05:49.314991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.003 [2024-07-15 09:05:49.315019] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.003 [2024-07-15 09:05:49.315143] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.003 [2024-07-15 09:05:49.315293] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.003 [2024-07-15 09:05:49.315318] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.003 [2024-07-15 09:05:49.315334] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.003 [2024-07-15 09:05:49.317738] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.003 [2024-07-15 09:05:49.326970] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.003 [2024-07-15 09:05:49.327334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.003 [2024-07-15 09:05:49.327513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.003 [2024-07-15 09:05:49.327562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.003 [2024-07-15 09:05:49.327581] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.003 [2024-07-15 09:05:49.327729] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.003 [2024-07-15 09:05:49.327928] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.003 [2024-07-15 09:05:49.327953] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.003 [2024-07-15 09:05:49.327969] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.003 [2024-07-15 09:05:49.330174] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.003 [2024-07-15 09:05:49.339596] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.003 [2024-07-15 09:05:49.340030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.003 [2024-07-15 09:05:49.340258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.003 [2024-07-15 09:05:49.340308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.003 [2024-07-15 09:05:49.340326] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.003 [2024-07-15 09:05:49.340457] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.003 [2024-07-15 09:05:49.340627] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.003 [2024-07-15 09:05:49.340652] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.003 [2024-07-15 09:05:49.340668] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.003 [2024-07-15 09:05:49.343067] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.003 [2024-07-15 09:05:49.352157] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.003 [2024-07-15 09:05:49.352507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.003 [2024-07-15 09:05:49.352671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.003 [2024-07-15 09:05:49.352699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.003 [2024-07-15 09:05:49.352717] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.003 [2024-07-15 09:05:49.352948] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.003 [2024-07-15 09:05:49.353123] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.003 [2024-07-15 09:05:49.353149] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.003 [2024-07-15 09:05:49.353164] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.003 [2024-07-15 09:05:49.355514] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.003 [2024-07-15 09:05:49.364649] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.003 [2024-07-15 09:05:49.365061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.003 [2024-07-15 09:05:49.365191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.003 [2024-07-15 09:05:49.365219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.003 [2024-07-15 09:05:49.365237] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.003 [2024-07-15 09:05:49.365366] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.003 [2024-07-15 09:05:49.365536] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.003 [2024-07-15 09:05:49.365559] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.003 [2024-07-15 09:05:49.365575] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.003 [2024-07-15 09:05:49.367935] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.003 [2024-07-15 09:05:49.377090] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.003 [2024-07-15 09:05:49.377461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.003 [2024-07-15 09:05:49.377661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.003 [2024-07-15 09:05:49.377691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.003 [2024-07-15 09:05:49.377708] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.003 [2024-07-15 09:05:49.377856] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.003 [2024-07-15 09:05:49.378002] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.003 [2024-07-15 09:05:49.378027] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.003 [2024-07-15 09:05:49.378044] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.003 [2024-07-15 09:05:49.380323] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.003 [2024-07-15 09:05:49.389744] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.003 [2024-07-15 09:05:49.390092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.003 [2024-07-15 09:05:49.390259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.003 [2024-07-15 09:05:49.390288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.003 [2024-07-15 09:05:49.390305] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.003 [2024-07-15 09:05:49.390472] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.003 [2024-07-15 09:05:49.390670] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.003 [2024-07-15 09:05:49.390703] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.003 [2024-07-15 09:05:49.390720] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.003 [2024-07-15 09:05:49.392992] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.003 [2024-07-15 09:05:49.402204] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.003 [2024-07-15 09:05:49.402571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.003 [2024-07-15 09:05:49.402731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.003 [2024-07-15 09:05:49.402761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.003 [2024-07-15 09:05:49.402779] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.003 [2024-07-15 09:05:49.402977] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.003 [2024-07-15 09:05:49.403129] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.003 [2024-07-15 09:05:49.403155] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.003 [2024-07-15 09:05:49.403171] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.003 [2024-07-15 09:05:49.405428] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.003 [2024-07-15 09:05:49.414767] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.003 [2024-07-15 09:05:49.415127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.003 [2024-07-15 09:05:49.415313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.003 [2024-07-15 09:05:49.415359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.003 [2024-07-15 09:05:49.415377] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.003 [2024-07-15 09:05:49.415561] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.003 [2024-07-15 09:05:49.415748] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.003 [2024-07-15 09:05:49.415773] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.003 [2024-07-15 09:05:49.415790] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.003 [2024-07-15 09:05:49.418186] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.003 [2024-07-15 09:05:49.427301] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.003 [2024-07-15 09:05:49.427685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.003 [2024-07-15 09:05:49.427847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.003 [2024-07-15 09:05:49.427887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.003 [2024-07-15 09:05:49.427908] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.003 [2024-07-15 09:05:49.428128] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.003 [2024-07-15 09:05:49.428264] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.003 [2024-07-15 09:05:49.428289] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.003 [2024-07-15 09:05:49.428310] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.003 [2024-07-15 09:05:49.430643] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.003 [2024-07-15 09:05:49.439910] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.003 [2024-07-15 09:05:49.440254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.003 [2024-07-15 09:05:49.440507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.003 [2024-07-15 09:05:49.440554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.004 [2024-07-15 09:05:49.440572] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.004 [2024-07-15 09:05:49.440721] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.004 [2024-07-15 09:05:49.440873] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.004 [2024-07-15 09:05:49.440910] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.004 [2024-07-15 09:05:49.440927] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.004 [2024-07-15 09:05:49.443311] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.004 [2024-07-15 09:05:49.452198] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.004 [2024-07-15 09:05:49.452612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.004 [2024-07-15 09:05:49.452799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.004 [2024-07-15 09:05:49.452827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.004 [2024-07-15 09:05:49.452845] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.004 [2024-07-15 09:05:49.453004] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.004 [2024-07-15 09:05:49.453228] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.004 [2024-07-15 09:05:49.453254] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.004 [2024-07-15 09:05:49.453270] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.004 [2024-07-15 09:05:49.455437] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.004 [2024-07-15 09:05:49.464517] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.004 [2024-07-15 09:05:49.464857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.004 [2024-07-15 09:05:49.465029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.004 [2024-07-15 09:05:49.465058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.004 [2024-07-15 09:05:49.465075] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.004 [2024-07-15 09:05:49.465259] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.004 [2024-07-15 09:05:49.465429] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.004 [2024-07-15 09:05:49.465454] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.004 [2024-07-15 09:05:49.465470] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.004 [2024-07-15 09:05:49.467740] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.004 [2024-07-15 09:05:49.477281] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.004 [2024-07-15 09:05:49.477646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.004 [2024-07-15 09:05:49.477803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.004 [2024-07-15 09:05:49.477833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.004 [2024-07-15 09:05:49.477851] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.004 [2024-07-15 09:05:49.478030] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.004 [2024-07-15 09:05:49.478182] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.004 [2024-07-15 09:05:49.478208] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.004 [2024-07-15 09:05:49.478224] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.004 [2024-07-15 09:05:49.480664] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.004 [2024-07-15 09:05:49.489832] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.004 [2024-07-15 09:05:49.490283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.004 [2024-07-15 09:05:49.490493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.004 [2024-07-15 09:05:49.490523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.004 [2024-07-15 09:05:49.490541] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.004 [2024-07-15 09:05:49.490690] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.004 [2024-07-15 09:05:49.490890] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.004 [2024-07-15 09:05:49.490916] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.004 [2024-07-15 09:05:49.490933] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.004 [2024-07-15 09:05:49.493389] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.004 [2024-07-15 09:05:49.502295] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.004 [2024-07-15 09:05:49.502657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.004 [2024-07-15 09:05:49.502847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.004 [2024-07-15 09:05:49.502888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.004 [2024-07-15 09:05:49.502908] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.004 [2024-07-15 09:05:49.503094] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.004 [2024-07-15 09:05:49.503281] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.004 [2024-07-15 09:05:49.503307] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.004 [2024-07-15 09:05:49.503323] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.004 [2024-07-15 09:05:49.505457] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.004 [2024-07-15 09:05:49.514899] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.004 [2024-07-15 09:05:49.515301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.004 [2024-07-15 09:05:49.515513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.004 [2024-07-15 09:05:49.515542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.004 [2024-07-15 09:05:49.515560] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.004 [2024-07-15 09:05:49.515690] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.004 [2024-07-15 09:05:49.515909] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.004 [2024-07-15 09:05:49.515935] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.004 [2024-07-15 09:05:49.515951] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.004 [2024-07-15 09:05:49.518118] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.004 [2024-07-15 09:05:49.527541] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.004 [2024-07-15 09:05:49.527961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.004 [2024-07-15 09:05:49.528138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.004 [2024-07-15 09:05:49.528165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.004 [2024-07-15 09:05:49.528197] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.004 [2024-07-15 09:05:49.528354] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.004 [2024-07-15 09:05:49.528538] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.004 [2024-07-15 09:05:49.528563] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.004 [2024-07-15 09:05:49.528580] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.004 [2024-07-15 09:05:49.531046] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.004 [2024-07-15 09:05:49.539912] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.004 [2024-07-15 09:05:49.540264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.004 [2024-07-15 09:05:49.540399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.004 [2024-07-15 09:05:49.540427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.004 [2024-07-15 09:05:49.540445] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.004 [2024-07-15 09:05:49.540610] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.004 [2024-07-15 09:05:49.540815] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.004 [2024-07-15 09:05:49.540840] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.004 [2024-07-15 09:05:49.540856] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.004 [2024-07-15 09:05:49.543164] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.263 [2024-07-15 09:05:49.552519] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.263 [2024-07-15 09:05:49.552828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.263 [2024-07-15 09:05:49.553030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.263 [2024-07-15 09:05:49.553060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.263 [2024-07-15 09:05:49.553077] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.263 [2024-07-15 09:05:49.553244] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.263 [2024-07-15 09:05:49.553431] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.263 [2024-07-15 09:05:49.553454] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.263 [2024-07-15 09:05:49.553470] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.263 [2024-07-15 09:05:49.555752] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.263 [2024-07-15 09:05:49.565057] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.263 [2024-07-15 09:05:49.565487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.263 [2024-07-15 09:05:49.565736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.263 [2024-07-15 09:05:49.565795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.263 [2024-07-15 09:05:49.565813] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.263 [2024-07-15 09:05:49.565993] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.263 [2024-07-15 09:05:49.566162] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.264 [2024-07-15 09:05:49.566187] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.264 [2024-07-15 09:05:49.566203] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.264 [2024-07-15 09:05:49.568519] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.264 [2024-07-15 09:05:49.577529] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.264 [2024-07-15 09:05:49.577971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.264 [2024-07-15 09:05:49.578179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.264 [2024-07-15 09:05:49.578206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.264 [2024-07-15 09:05:49.578238] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.264 [2024-07-15 09:05:49.578458] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.264 [2024-07-15 09:05:49.578629] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.264 [2024-07-15 09:05:49.578655] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.264 [2024-07-15 09:05:49.578671] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.264 [2024-07-15 09:05:49.581022] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.264 [2024-07-15 09:05:49.590164] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.264 [2024-07-15 09:05:49.590534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.264 [2024-07-15 09:05:49.590699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.264 [2024-07-15 09:05:49.590732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.264 [2024-07-15 09:05:49.590751] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.264 [2024-07-15 09:05:49.590947] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.264 [2024-07-15 09:05:49.591135] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.264 [2024-07-15 09:05:49.591161] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.264 [2024-07-15 09:05:49.591177] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.264 [2024-07-15 09:05:49.593712] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.264 [2024-07-15 09:05:49.602654] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.264 [2024-07-15 09:05:49.602990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.264 [2024-07-15 09:05:49.603174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.264 [2024-07-15 09:05:49.603204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.264 [2024-07-15 09:05:49.603222] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.264 [2024-07-15 09:05:49.603406] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.264 [2024-07-15 09:05:49.603557] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.264 [2024-07-15 09:05:49.603582] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.264 [2024-07-15 09:05:49.603599] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.264 [2024-07-15 09:05:49.605922] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.264 [2024-07-15 09:05:49.615281] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.264 [2024-07-15 09:05:49.615647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.264 [2024-07-15 09:05:49.615838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.264 [2024-07-15 09:05:49.615866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.264 [2024-07-15 09:05:49.615894] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.264 [2024-07-15 09:05:49.616082] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.264 [2024-07-15 09:05:49.616215] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.264 [2024-07-15 09:05:49.616240] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.264 [2024-07-15 09:05:49.616257] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.264 [2024-07-15 09:05:49.618515] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.264 [2024-07-15 09:05:49.628005] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.264 [2024-07-15 09:05:49.628356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.264 [2024-07-15 09:05:49.628617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.264 [2024-07-15 09:05:49.628647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.264 [2024-07-15 09:05:49.628670] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.264 [2024-07-15 09:05:49.628837] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.264 [2024-07-15 09:05:49.629002] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.264 [2024-07-15 09:05:49.629028] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.264 [2024-07-15 09:05:49.629044] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.264 [2024-07-15 09:05:49.631194] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.264 [2024-07-15 09:05:49.640515] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.264 [2024-07-15 09:05:49.640862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.264 [2024-07-15 09:05:49.641065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.264 [2024-07-15 09:05:49.641090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.264 [2024-07-15 09:05:49.641106] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.264 [2024-07-15 09:05:49.641325] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.264 [2024-07-15 09:05:49.641477] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.264 [2024-07-15 09:05:49.641503] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.264 [2024-07-15 09:05:49.641519] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.264 [2024-07-15 09:05:49.643872] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.264 [2024-07-15 09:05:49.652998] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.264 [2024-07-15 09:05:49.653339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.264 [2024-07-15 09:05:49.653607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.264 [2024-07-15 09:05:49.653661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.264 [2024-07-15 09:05:49.653680] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.264 [2024-07-15 09:05:49.653846] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.264 [2024-07-15 09:05:49.654031] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.264 [2024-07-15 09:05:49.654057] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.264 [2024-07-15 09:05:49.654073] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.264 [2024-07-15 09:05:49.656315] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.264 [2024-07-15 09:05:49.665539] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.264 [2024-07-15 09:05:49.665856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.264 [2024-07-15 09:05:49.666055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.264 [2024-07-15 09:05:49.666083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.264 [2024-07-15 09:05:49.666102] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.264 [2024-07-15 09:05:49.666292] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.264 [2024-07-15 09:05:49.666444] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.264 [2024-07-15 09:05:49.666469] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.264 [2024-07-15 09:05:49.666485] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.264 [2024-07-15 09:05:49.668899] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.264 [2024-07-15 09:05:49.678230] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.264 [2024-07-15 09:05:49.678564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.264 [2024-07-15 09:05:49.678727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.264 [2024-07-15 09:05:49.678756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.264 [2024-07-15 09:05:49.678774] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.264 [2024-07-15 09:05:49.678986] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.264 [2024-07-15 09:05:49.679139] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.264 [2024-07-15 09:05:49.679164] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.264 [2024-07-15 09:05:49.679180] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.264 [2024-07-15 09:05:49.681566] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.264 [2024-07-15 09:05:49.690734] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.264 [2024-07-15 09:05:49.691094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.264 [2024-07-15 09:05:49.691288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.264 [2024-07-15 09:05:49.691316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.264 [2024-07-15 09:05:49.691334] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.264 [2024-07-15 09:05:49.691463] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.264 [2024-07-15 09:05:49.691669] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.265 [2024-07-15 09:05:49.691695] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.265 [2024-07-15 09:05:49.691711] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.265 [2024-07-15 09:05:49.693927] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.265 [2024-07-15 09:05:49.703194] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.265 [2024-07-15 09:05:49.703560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.265 [2024-07-15 09:05:49.703725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.265 [2024-07-15 09:05:49.703753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.265 [2024-07-15 09:05:49.703771] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.265 [2024-07-15 09:05:49.703969] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.265 [2024-07-15 09:05:49.704144] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.265 [2024-07-15 09:05:49.704169] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.265 [2024-07-15 09:05:49.704184] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.265 [2024-07-15 09:05:49.706426] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.265 [2024-07-15 09:05:49.715737] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.265 [2024-07-15 09:05:49.716079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.265 [2024-07-15 09:05:49.716241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.265 [2024-07-15 09:05:49.716269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.265 [2024-07-15 09:05:49.716286] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.265 [2024-07-15 09:05:49.716470] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.265 [2024-07-15 09:05:49.716639] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.265 [2024-07-15 09:05:49.716664] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.265 [2024-07-15 09:05:49.716680] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.265 [2024-07-15 09:05:49.719079] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.265 [2024-07-15 09:05:49.728413] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.265 [2024-07-15 09:05:49.728776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.265 [2024-07-15 09:05:49.728955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.265 [2024-07-15 09:05:49.728981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.265 [2024-07-15 09:05:49.728997] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.265 [2024-07-15 09:05:49.729146] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.265 [2024-07-15 09:05:49.729316] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.265 [2024-07-15 09:05:49.729341] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.265 [2024-07-15 09:05:49.729357] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.265 [2024-07-15 09:05:49.731778] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.265 [2024-07-15 09:05:49.741099] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.265 [2024-07-15 09:05:49.741399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.265 [2024-07-15 09:05:49.741677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.265 [2024-07-15 09:05:49.741730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.265 [2024-07-15 09:05:49.741748] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.265 [2024-07-15 09:05:49.741947] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.265 [2024-07-15 09:05:49.742117] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.265 [2024-07-15 09:05:49.742145] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.265 [2024-07-15 09:05:49.742162] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.265 [2024-07-15 09:05:49.744494] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.265 [2024-07-15 09:05:49.753545] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.265 [2024-07-15 09:05:49.753908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.265 [2024-07-15 09:05:49.754219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.265 [2024-07-15 09:05:49.754272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.265 [2024-07-15 09:05:49.754290] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.265 [2024-07-15 09:05:49.754438] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.265 [2024-07-15 09:05:49.754606] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.265 [2024-07-15 09:05:49.754630] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.265 [2024-07-15 09:05:49.754646] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.265 [2024-07-15 09:05:49.756973] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.265 [2024-07-15 09:05:49.766059] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.265 [2024-07-15 09:05:49.766401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.265 [2024-07-15 09:05:49.766683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.265 [2024-07-15 09:05:49.766734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.265 [2024-07-15 09:05:49.766752] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.265 [2024-07-15 09:05:49.766915] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.265 [2024-07-15 09:05:49.767085] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.265 [2024-07-15 09:05:49.767110] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.265 [2024-07-15 09:05:49.767126] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.265 [2024-07-15 09:05:49.769550] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.265 [2024-07-15 09:05:49.778516] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.265 [2024-07-15 09:05:49.778952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.265 [2024-07-15 09:05:49.779191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.265 [2024-07-15 09:05:49.779221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.265 [2024-07-15 09:05:49.779240] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.265 [2024-07-15 09:05:49.779370] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.265 [2024-07-15 09:05:49.779521] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.265 [2024-07-15 09:05:49.779546] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.265 [2024-07-15 09:05:49.779567] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.265 [2024-07-15 09:05:49.781848] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.265 [2024-07-15 09:05:49.790984] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.265 [2024-07-15 09:05:49.791354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.265 [2024-07-15 09:05:49.791529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.265 [2024-07-15 09:05:49.791556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.265 [2024-07-15 09:05:49.791572] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.265 [2024-07-15 09:05:49.791788] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.265 [2024-07-15 09:05:49.791974] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.265 [2024-07-15 09:05:49.792000] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.265 [2024-07-15 09:05:49.792016] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.265 [2024-07-15 09:05:49.794258] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.265 [2024-07-15 09:05:49.803688] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.265 [2024-07-15 09:05:49.803999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.265 [2024-07-15 09:05:49.804151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.265 [2024-07-15 09:05:49.804180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.265 [2024-07-15 09:05:49.804198] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.265 [2024-07-15 09:05:49.804382] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.265 [2024-07-15 09:05:49.804552] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.265 [2024-07-15 09:05:49.804577] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.265 [2024-07-15 09:05:49.804593] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.524 [2024-07-15 09:05:49.806841] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.524 [2024-07-15 09:05:49.816004] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.524 [2024-07-15 09:05:49.816337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.524 [2024-07-15 09:05:49.816502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.524 [2024-07-15 09:05:49.816532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.524 [2024-07-15 09:05:49.816550] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.524 [2024-07-15 09:05:49.816734] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.524 [2024-07-15 09:05:49.816919] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.524 [2024-07-15 09:05:49.816945] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.524 [2024-07-15 09:05:49.816961] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.524 [2024-07-15 09:05:49.819351] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.524 [2024-07-15 09:05:49.828646] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.524 [2024-07-15 09:05:49.828923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.524 [2024-07-15 09:05:49.829162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.524 [2024-07-15 09:05:49.829215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.524 [2024-07-15 09:05:49.829234] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.524 [2024-07-15 09:05:49.829436] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.524 [2024-07-15 09:05:49.829661] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.524 [2024-07-15 09:05:49.829686] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.524 [2024-07-15 09:05:49.829702] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.524 [2024-07-15 09:05:49.832112] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.524 [2024-07-15 09:05:49.841361] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.524 [2024-07-15 09:05:49.841721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.524 [2024-07-15 09:05:49.841946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.524 [2024-07-15 09:05:49.841976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.524 [2024-07-15 09:05:49.841994] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.524 [2024-07-15 09:05:49.842141] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.524 [2024-07-15 09:05:49.842365] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.524 [2024-07-15 09:05:49.842390] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.524 [2024-07-15 09:05:49.842406] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.524 [2024-07-15 09:05:49.844816] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.524 [2024-07-15 09:05:49.853727] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.524 [2024-07-15 09:05:49.854101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.524 [2024-07-15 09:05:49.854293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.524 [2024-07-15 09:05:49.854323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.524 [2024-07-15 09:05:49.854341] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.524 [2024-07-15 09:05:49.854507] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.524 [2024-07-15 09:05:49.854731] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.524 [2024-07-15 09:05:49.854756] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.524 [2024-07-15 09:05:49.854772] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.524 [2024-07-15 09:05:49.857107] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.524 [2024-07-15 09:05:49.866440] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.524 [2024-07-15 09:05:49.866787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.524 [2024-07-15 09:05:49.866986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.524 [2024-07-15 09:05:49.867012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.524 [2024-07-15 09:05:49.867029] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.524 [2024-07-15 09:05:49.867227] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.524 [2024-07-15 09:05:49.867456] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.524 [2024-07-15 09:05:49.867481] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.524 [2024-07-15 09:05:49.867497] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.524 [2024-07-15 09:05:49.869770] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.524 [2024-07-15 09:05:49.879189] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.524 [2024-07-15 09:05:49.879551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.524 [2024-07-15 09:05:49.879688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.524 [2024-07-15 09:05:49.879717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.524 [2024-07-15 09:05:49.879735] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.524 [2024-07-15 09:05:49.879946] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.524 [2024-07-15 09:05:49.880118] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.524 [2024-07-15 09:05:49.880142] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.524 [2024-07-15 09:05:49.880158] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.524 [2024-07-15 09:05:49.882611] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.524 [2024-07-15 09:05:49.891707] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.524 [2024-07-15 09:05:49.892096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.524 [2024-07-15 09:05:49.892358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.524 [2024-07-15 09:05:49.892388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.524 [2024-07-15 09:05:49.892406] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.524 [2024-07-15 09:05:49.892589] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.524 [2024-07-15 09:05:49.892742] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.524 [2024-07-15 09:05:49.892767] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.524 [2024-07-15 09:05:49.892782] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.524 [2024-07-15 09:05:49.895190] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.524 [2024-07-15 09:05:49.904328] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.524 [2024-07-15 09:05:49.904683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.524 [2024-07-15 09:05:49.904890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.524 [2024-07-15 09:05:49.904920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.524 [2024-07-15 09:05:49.904938] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.524 [2024-07-15 09:05:49.905087] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.524 [2024-07-15 09:05:49.905257] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.524 [2024-07-15 09:05:49.905281] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.524 [2024-07-15 09:05:49.905296] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.524 [2024-07-15 09:05:49.907553] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.524 [2024-07-15 09:05:49.917039] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.524 [2024-07-15 09:05:49.917351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.524 [2024-07-15 09:05:49.917516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.525 [2024-07-15 09:05:49.917545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.525 [2024-07-15 09:05:49.917564] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.525 [2024-07-15 09:05:49.917730] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.525 [2024-07-15 09:05:49.917893] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.525 [2024-07-15 09:05:49.917917] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.525 [2024-07-15 09:05:49.917933] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.525 [2024-07-15 09:05:49.920242] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.525 [2024-07-15 09:05:49.929568] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.525 [2024-07-15 09:05:49.929951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.525 [2024-07-15 09:05:49.930226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.525 [2024-07-15 09:05:49.930256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.525 [2024-07-15 09:05:49.930274] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.525 [2024-07-15 09:05:49.930439] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.525 [2024-07-15 09:05:49.930628] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.525 [2024-07-15 09:05:49.930652] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.525 [2024-07-15 09:05:49.930668] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.525 [2024-07-15 09:05:49.933131] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.525 [2024-07-15 09:05:49.942033] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.525 [2024-07-15 09:05:49.942367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.525 [2024-07-15 09:05:49.942604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.525 [2024-07-15 09:05:49.942671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.525 [2024-07-15 09:05:49.942691] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.525 [2024-07-15 09:05:49.942874] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.525 [2024-07-15 09:05:49.943092] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.525 [2024-07-15 09:05:49.943117] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.525 [2024-07-15 09:05:49.943133] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.525 [2024-07-15 09:05:49.945406] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.525 [2024-07-15 09:05:49.954660] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.525 [2024-07-15 09:05:49.954975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.525 [2024-07-15 09:05:49.955193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.525 [2024-07-15 09:05:49.955222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.525 [2024-07-15 09:05:49.955240] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.525 [2024-07-15 09:05:49.955370] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.525 [2024-07-15 09:05:49.955558] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.525 [2024-07-15 09:05:49.955583] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.525 [2024-07-15 09:05:49.955599] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.525 [2024-07-15 09:05:49.958063] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.525 [2024-07-15 09:05:49.967146] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.525 [2024-07-15 09:05:49.967507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.525 [2024-07-15 09:05:49.967693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.525 [2024-07-15 09:05:49.967722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.525 [2024-07-15 09:05:49.967741] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.525 [2024-07-15 09:05:49.967971] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.525 [2024-07-15 09:05:49.968196] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.525 [2024-07-15 09:05:49.968221] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.525 [2024-07-15 09:05:49.968237] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.525 [2024-07-15 09:05:49.970367] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.525 [2024-07-15 09:05:49.979721] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.525 [2024-07-15 09:05:49.980049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.525 [2024-07-15 09:05:49.980312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.525 [2024-07-15 09:05:49.980341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.525 [2024-07-15 09:05:49.980364] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.525 [2024-07-15 09:05:49.980531] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.525 [2024-07-15 09:05:49.980664] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.525 [2024-07-15 09:05:49.980689] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.525 [2024-07-15 09:05:49.980705] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.525 [2024-07-15 09:05:49.983065] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.525 [2024-07-15 09:05:49.992239] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.525 [2024-07-15 09:05:49.992668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.525 [2024-07-15 09:05:49.992891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.525 [2024-07-15 09:05:49.992937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.525 [2024-07-15 09:05:49.992955] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.525 [2024-07-15 09:05:49.993168] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.525 [2024-07-15 09:05:49.993309] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.525 [2024-07-15 09:05:49.993330] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.525 [2024-07-15 09:05:49.993344] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.525 [2024-07-15 09:05:49.995292] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.525 [2024-07-15 09:05:50.005184] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.525 [2024-07-15 09:05:50.005621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.525 [2024-07-15 09:05:50.005866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.525 [2024-07-15 09:05:50.005931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.525 [2024-07-15 09:05:50.005956] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.525 [2024-07-15 09:05:50.006168] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.525 [2024-07-15 09:05:50.006396] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.525 [2024-07-15 09:05:50.006431] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.525 [2024-07-15 09:05:50.006457] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.525 [2024-07-15 09:05:50.009480] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.525 [2024-07-15 09:05:50.018539] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.525 [2024-07-15 09:05:50.018945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.525 [2024-07-15 09:05:50.019123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.525 [2024-07-15 09:05:50.019180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.525 [2024-07-15 09:05:50.019211] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.525 [2024-07-15 09:05:50.019409] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.525 [2024-07-15 09:05:50.019668] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.525 [2024-07-15 09:05:50.019703] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.525 [2024-07-15 09:05:50.019729] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.525 [2024-07-15 09:05:50.022759] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.525 [2024-07-15 09:05:50.032001] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.525 [2024-07-15 09:05:50.032432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.525 [2024-07-15 09:05:50.032639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.525 [2024-07-15 09:05:50.032675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.525 [2024-07-15 09:05:50.032701] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.525 [2024-07-15 09:05:50.032921] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.525 [2024-07-15 09:05:50.033179] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.525 [2024-07-15 09:05:50.033213] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.525 [2024-07-15 09:05:50.033244] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.525 [2024-07-15 09:05:50.036369] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.525 [2024-07-15 09:05:50.045511] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.526 [2024-07-15 09:05:50.045959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.526 [2024-07-15 09:05:50.046137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.526 [2024-07-15 09:05:50.046182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.526 [2024-07-15 09:05:50.046210] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.526 [2024-07-15 09:05:50.046379] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.526 [2024-07-15 09:05:50.046617] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.526 [2024-07-15 09:05:50.046652] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.526 [2024-07-15 09:05:50.046675] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.526 [2024-07-15 09:05:50.049779] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.526 [2024-07-15 09:05:50.058751] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.526 [2024-07-15 09:05:50.059191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.526 [2024-07-15 09:05:50.059417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.526 [2024-07-15 09:05:50.059472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.526 [2024-07-15 09:05:50.059512] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.526 [2024-07-15 09:05:50.059698] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.526 [2024-07-15 09:05:50.059927] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.526 [2024-07-15 09:05:50.059958] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.526 [2024-07-15 09:05:50.059982] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.526 [2024-07-15 09:05:50.062733] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.784 [2024-07-15 09:05:50.071888] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.784 [2024-07-15 09:05:50.072380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.785 [2024-07-15 09:05:50.072588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.785 [2024-07-15 09:05:50.072622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.785 [2024-07-15 09:05:50.072649] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.785 [2024-07-15 09:05:50.072838] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.785 [2024-07-15 09:05:50.072973] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.785 [2024-07-15 09:05:50.073002] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.785 [2024-07-15 09:05:50.073026] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.785 [2024-07-15 09:05:50.075614] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.785 [2024-07-15 09:05:50.084589] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.785 [2024-07-15 09:05:50.084963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.785 [2024-07-15 09:05:50.085134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.785 [2024-07-15 09:05:50.085198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.785 [2024-07-15 09:05:50.085225] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.785 [2024-07-15 09:05:50.085485] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.785 [2024-07-15 09:05:50.085660] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.785 [2024-07-15 09:05:50.085687] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.785 [2024-07-15 09:05:50.085709] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.785 [2024-07-15 09:05:50.088143] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.785 [2024-07-15 09:05:50.097035] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.785 [2024-07-15 09:05:50.097420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.785 [2024-07-15 09:05:50.097627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.785 [2024-07-15 09:05:50.097654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.785 [2024-07-15 09:05:50.097671] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.785 [2024-07-15 09:05:50.097874] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.785 [2024-07-15 09:05:50.098282] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.785 [2024-07-15 09:05:50.098310] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.785 [2024-07-15 09:05:50.098325] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.785 [2024-07-15 09:05:50.100461] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.785 [2024-07-15 09:05:50.109473] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.785 [2024-07-15 09:05:50.109821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.785 [2024-07-15 09:05:50.110017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.785 [2024-07-15 09:05:50.110045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.785 [2024-07-15 09:05:50.110062] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.785 [2024-07-15 09:05:50.110250] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.785 [2024-07-15 09:05:50.110408] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.785 [2024-07-15 09:05:50.110432] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.785 [2024-07-15 09:05:50.110446] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.785 [2024-07-15 09:05:50.112328] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.785 [2024-07-15 09:05:50.121844] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.785 [2024-07-15 09:05:50.122138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.785 [2024-07-15 09:05:50.122367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.785 [2024-07-15 09:05:50.122393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.785 [2024-07-15 09:05:50.122425] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.785 [2024-07-15 09:05:50.122563] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.785 [2024-07-15 09:05:50.122703] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.785 [2024-07-15 09:05:50.122727] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.785 [2024-07-15 09:05:50.122741] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.785 [2024-07-15 09:05:50.124952] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.785 [2024-07-15 09:05:50.134234] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.785 [2024-07-15 09:05:50.134538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.785 [2024-07-15 09:05:50.134694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.785 [2024-07-15 09:05:50.134721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.785 [2024-07-15 09:05:50.134738] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.785 [2024-07-15 09:05:50.134902] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.785 [2024-07-15 09:05:50.135077] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.785 [2024-07-15 09:05:50.135100] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.785 [2024-07-15 09:05:50.135121] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.785 [2024-07-15 09:05:50.137309] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.785 [2024-07-15 09:05:50.146720] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.785 [2024-07-15 09:05:50.147084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.785 [2024-07-15 09:05:50.147265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.785 [2024-07-15 09:05:50.147290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.785 [2024-07-15 09:05:50.147305] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.785 [2024-07-15 09:05:50.147477] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.785 [2024-07-15 09:05:50.147627] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.785 [2024-07-15 09:05:50.147650] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.785 [2024-07-15 09:05:50.147665] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.785 [2024-07-15 09:05:50.149817] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.785 [2024-07-15 09:05:50.159371] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.785 [2024-07-15 09:05:50.159735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.785 [2024-07-15 09:05:50.159901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.785 [2024-07-15 09:05:50.159943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.785 [2024-07-15 09:05:50.159960] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.785 [2024-07-15 09:05:50.160114] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.785 [2024-07-15 09:05:50.160256] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.785 [2024-07-15 09:05:50.160279] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.785 [2024-07-15 09:05:50.160293] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.785 [2024-07-15 09:05:50.162430] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.785 [2024-07-15 09:05:50.171850] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.785 [2024-07-15 09:05:50.172245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.785 [2024-07-15 09:05:50.172427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.785 [2024-07-15 09:05:50.172467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.785 [2024-07-15 09:05:50.172483] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.785 [2024-07-15 09:05:50.172656] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.785 [2024-07-15 09:05:50.172840] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.785 [2024-07-15 09:05:50.172863] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.785 [2024-07-15 09:05:50.172888] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.785 [2024-07-15 09:05:50.175215] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.785 [2024-07-15 09:05:50.184248] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.785 [2024-07-15 09:05:50.184665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.785 [2024-07-15 09:05:50.184840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.785 [2024-07-15 09:05:50.184867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.785 [2024-07-15 09:05:50.184894] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.785 [2024-07-15 09:05:50.185083] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.785 [2024-07-15 09:05:50.185225] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.785 [2024-07-15 09:05:50.185247] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.785 [2024-07-15 09:05:50.185262] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.785 [2024-07-15 09:05:50.187503] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.785 [2024-07-15 09:05:50.196541] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.785 [2024-07-15 09:05:50.196912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.786 [2024-07-15 09:05:50.197115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.786 [2024-07-15 09:05:50.197141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.786 [2024-07-15 09:05:50.197157] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.786 [2024-07-15 09:05:50.197326] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.786 [2024-07-15 09:05:50.197451] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.786 [2024-07-15 09:05:50.197473] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.786 [2024-07-15 09:05:50.197488] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.786 [2024-07-15 09:05:50.199709] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.786 [2024-07-15 09:05:50.209055] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.786 [2024-07-15 09:05:50.209379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.786 [2024-07-15 09:05:50.209530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.786 [2024-07-15 09:05:50.209557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.786 [2024-07-15 09:05:50.209573] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.786 [2024-07-15 09:05:50.209710] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.786 [2024-07-15 09:05:50.209868] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.786 [2024-07-15 09:05:50.209900] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.786 [2024-07-15 09:05:50.209916] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.786 [2024-07-15 09:05:50.212133] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.786 [2024-07-15 09:05:50.221338] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.786 [2024-07-15 09:05:50.221617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.786 [2024-07-15 09:05:50.221773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.786 [2024-07-15 09:05:50.221800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.786 [2024-07-15 09:05:50.221816] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.786 [2024-07-15 09:05:50.221977] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.786 [2024-07-15 09:05:50.222136] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.786 [2024-07-15 09:05:50.222159] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.786 [2024-07-15 09:05:50.222174] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.786 [2024-07-15 09:05:50.224275] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.786 [2024-07-15 09:05:50.233558] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.786 [2024-07-15 09:05:50.233932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.786 [2024-07-15 09:05:50.234098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.786 [2024-07-15 09:05:50.234124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.786 [2024-07-15 09:05:50.234140] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.786 [2024-07-15 09:05:50.234288] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.786 [2024-07-15 09:05:50.234430] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.786 [2024-07-15 09:05:50.234453] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.786 [2024-07-15 09:05:50.234468] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.786 [2024-07-15 09:05:50.236520] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.786 [2024-07-15 09:05:50.245954] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.786 [2024-07-15 09:05:50.246277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.786 [2024-07-15 09:05:50.246441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.786 [2024-07-15 09:05:50.246481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.786 [2024-07-15 09:05:50.246497] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.786 [2024-07-15 09:05:50.246621] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.786 [2024-07-15 09:05:50.246778] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.786 [2024-07-15 09:05:50.246801] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.786 [2024-07-15 09:05:50.246816] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.786 [2024-07-15 09:05:50.249158] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.786 [2024-07-15 09:05:50.258514] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.786 [2024-07-15 09:05:50.258844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.786 [2024-07-15 09:05:50.259046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.786 [2024-07-15 09:05:50.259073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.786 [2024-07-15 09:05:50.259089] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.786 [2024-07-15 09:05:50.259255] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.786 [2024-07-15 09:05:50.259396] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.786 [2024-07-15 09:05:50.259419] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.786 [2024-07-15 09:05:50.259434] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.786 [2024-07-15 09:05:50.261554] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.786 [2024-07-15 09:05:50.270959] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.786 [2024-07-15 09:05:50.271335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.786 [2024-07-15 09:05:50.271524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.786 [2024-07-15 09:05:50.271551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.786 [2024-07-15 09:05:50.271568] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.786 [2024-07-15 09:05:50.271723] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.786 [2024-07-15 09:05:50.271892] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.786 [2024-07-15 09:05:50.271914] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.786 [2024-07-15 09:05:50.271930] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.786 [2024-07-15 09:05:50.274081] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.786 [2024-07-15 09:05:50.283571] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.786 [2024-07-15 09:05:50.283910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.786 [2024-07-15 09:05:50.284066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.786 [2024-07-15 09:05:50.284093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.786 [2024-07-15 09:05:50.284110] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.786 [2024-07-15 09:05:50.284281] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.786 [2024-07-15 09:05:50.284422] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.786 [2024-07-15 09:05:50.284444] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.786 [2024-07-15 09:05:50.284460] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.786 [2024-07-15 09:05:50.286601] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.786 [2024-07-15 09:05:50.296097] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.786 [2024-07-15 09:05:50.296528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.786 [2024-07-15 09:05:50.296748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.786 [2024-07-15 09:05:50.296779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.786 [2024-07-15 09:05:50.296811] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.786 [2024-07-15 09:05:50.296981] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.786 [2024-07-15 09:05:50.297095] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.786 [2024-07-15 09:05:50.297116] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.786 [2024-07-15 09:05:50.297130] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.786 [2024-07-15 09:05:50.299369] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.786 [2024-07-15 09:05:50.308618] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.786 [2024-07-15 09:05:50.308983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.786 [2024-07-15 09:05:50.309109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.786 [2024-07-15 09:05:50.309135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.786 [2024-07-15 09:05:50.309166] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.786 [2024-07-15 09:05:50.309335] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.786 [2024-07-15 09:05:50.309506] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.786 [2024-07-15 09:05:50.309541] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.786 [2024-07-15 09:05:50.309557] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.786 [2024-07-15 09:05:50.311840] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:01.786 [2024-07-15 09:05:50.321120] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:01.786 [2024-07-15 09:05:50.321520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.786 [2024-07-15 09:05:50.321694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:01.787 [2024-07-15 09:05:50.321736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:01.787 [2024-07-15 09:05:50.321752] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:01.787 [2024-07-15 09:05:50.321926] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:01.787 [2024-07-15 09:05:50.322105] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:01.787 [2024-07-15 09:05:50.322127] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:01.787 [2024-07-15 09:05:50.322141] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:01.787 [2024-07-15 09:05:50.324522] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.045 [2024-07-15 09:05:50.333622] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.045 [2024-07-15 09:05:50.334001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.045 [2024-07-15 09:05:50.334206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.045 [2024-07-15 09:05:50.334239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.045 [2024-07-15 09:05:50.334282] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.045 [2024-07-15 09:05:50.334431] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.045 [2024-07-15 09:05:50.334638] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.045 [2024-07-15 09:05:50.334662] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.045 [2024-07-15 09:05:50.334677] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.045 [2024-07-15 09:05:50.336938] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.046 [2024-07-15 09:05:50.346259] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.046 [2024-07-15 09:05:50.346671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.046 [2024-07-15 09:05:50.347656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.046 [2024-07-15 09:05:50.347691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.046 [2024-07-15 09:05:50.347718] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.046 [2024-07-15 09:05:50.347869] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.046 [2024-07-15 09:05:50.348042] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.046 [2024-07-15 09:05:50.348065] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.046 [2024-07-15 09:05:50.348079] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.046 [2024-07-15 09:05:50.350551] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.046 [2024-07-15 09:05:50.358908] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.046 [2024-07-15 09:05:50.359260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.046 [2024-07-15 09:05:50.359505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.046 [2024-07-15 09:05:50.359545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.046 [2024-07-15 09:05:50.359561] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.046 [2024-07-15 09:05:50.359761] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.046 [2024-07-15 09:05:50.359972] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.046 [2024-07-15 09:05:50.359995] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.046 [2024-07-15 09:05:50.360009] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.046 [2024-07-15 09:05:50.362065] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.046 [2024-07-15 09:05:50.371442] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.046 [2024-07-15 09:05:50.371780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.046 [2024-07-15 09:05:50.371929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.046 [2024-07-15 09:05:50.371955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.046 [2024-07-15 09:05:50.371971] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.046 [2024-07-15 09:05:50.372125] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.046 [2024-07-15 09:05:50.372283] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.046 [2024-07-15 09:05:50.372308] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.046 [2024-07-15 09:05:50.372324] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.046 [2024-07-15 09:05:50.374674] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.046 [2024-07-15 09:05:50.384060] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.046 [2024-07-15 09:05:50.384439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.046 [2024-07-15 09:05:50.384648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.046 [2024-07-15 09:05:50.384674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.046 [2024-07-15 09:05:50.384690] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.046 [2024-07-15 09:05:50.384840] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.046 [2024-07-15 09:05:50.385013] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.046 [2024-07-15 09:05:50.385035] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.046 [2024-07-15 09:05:50.385050] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.046 [2024-07-15 09:05:50.387315] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.046 [2024-07-15 09:05:50.396521] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.046 [2024-07-15 09:05:50.396940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.046 [2024-07-15 09:05:50.397082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.046 [2024-07-15 09:05:50.397108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.046 [2024-07-15 09:05:50.397125] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.046 [2024-07-15 09:05:50.397338] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.046 [2024-07-15 09:05:50.397490] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.046 [2024-07-15 09:05:50.397524] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.046 [2024-07-15 09:05:50.397540] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.046 [2024-07-15 09:05:50.399801] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.046 [2024-07-15 09:05:50.409293] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.046 [2024-07-15 09:05:50.409707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.046 [2024-07-15 09:05:50.409868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.046 [2024-07-15 09:05:50.409901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.046 [2024-07-15 09:05:50.409918] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.046 [2024-07-15 09:05:50.410083] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.046 [2024-07-15 09:05:50.410257] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.046 [2024-07-15 09:05:50.410282] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.046 [2024-07-15 09:05:50.410298] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.046 [2024-07-15 09:05:50.412611] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.046 [2024-07-15 09:05:50.421827] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.046 [2024-07-15 09:05:50.422182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.046 [2024-07-15 09:05:50.422394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.046 [2024-07-15 09:05:50.422420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.046 [2024-07-15 09:05:50.422451] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.046 [2024-07-15 09:05:50.422593] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.046 [2024-07-15 09:05:50.422771] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.046 [2024-07-15 09:05:50.422796] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.046 [2024-07-15 09:05:50.422811] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.046 [2024-07-15 09:05:50.424965] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.046 [2024-07-15 09:05:50.434351] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.046 [2024-07-15 09:05:50.434770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.046 [2024-07-15 09:05:50.434960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.046 [2024-07-15 09:05:50.434987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.046 [2024-07-15 09:05:50.435003] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.046 [2024-07-15 09:05:50.435152] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.046 [2024-07-15 09:05:50.435366] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.046 [2024-07-15 09:05:50.435390] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.046 [2024-07-15 09:05:50.435407] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.046 [2024-07-15 09:05:50.437602] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.046 [2024-07-15 09:05:50.446929] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.046 [2024-07-15 09:05:50.447391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.046 [2024-07-15 09:05:50.447591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.046 [2024-07-15 09:05:50.447617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.046 [2024-07-15 09:05:50.447632] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.046 [2024-07-15 09:05:50.447810] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.046 [2024-07-15 09:05:50.448032] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.046 [2024-07-15 09:05:50.448058] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.046 [2024-07-15 09:05:50.448073] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.046 [2024-07-15 09:05:50.450353] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.046 [2024-07-15 09:05:50.459470] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.046 [2024-07-15 09:05:50.459797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.046 [2024-07-15 09:05:50.459976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.046 [2024-07-15 09:05:50.460003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.046 [2024-07-15 09:05:50.460020] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.046 [2024-07-15 09:05:50.460201] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.046 [2024-07-15 09:05:50.460353] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.047 [2024-07-15 09:05:50.460378] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.047 [2024-07-15 09:05:50.460393] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.047 [2024-07-15 09:05:50.462774] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.047 [2024-07-15 09:05:50.471959] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.047 [2024-07-15 09:05:50.472296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.047 [2024-07-15 09:05:50.472461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.047 [2024-07-15 09:05:50.472489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.047 [2024-07-15 09:05:50.472507] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.047 [2024-07-15 09:05:50.472727] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.047 [2024-07-15 09:05:50.472843] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.047 [2024-07-15 09:05:50.472873] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.047 [2024-07-15 09:05:50.472951] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.047 [2024-07-15 09:05:50.475374] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.047 [2024-07-15 09:05:50.484502] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.047 [2024-07-15 09:05:50.484841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.047 [2024-07-15 09:05:50.485021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.047 [2024-07-15 09:05:50.485050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.047 [2024-07-15 09:05:50.485069] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.047 [2024-07-15 09:05:50.485253] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.047 [2024-07-15 09:05:50.485404] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.047 [2024-07-15 09:05:50.485428] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.047 [2024-07-15 09:05:50.485450] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.047 [2024-07-15 09:05:50.487752] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.047 [2024-07-15 09:05:50.497152] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.047 [2024-07-15 09:05:50.497482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.047 [2024-07-15 09:05:50.497685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.047 [2024-07-15 09:05:50.497712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.047 [2024-07-15 09:05:50.497728] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.047 [2024-07-15 09:05:50.497915] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.047 [2024-07-15 09:05:50.498072] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.047 [2024-07-15 09:05:50.498096] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.047 [2024-07-15 09:05:50.498112] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.047 [2024-07-15 09:05:50.500532] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.047 [2024-07-15 09:05:50.509864] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.047 [2024-07-15 09:05:50.510178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.047 [2024-07-15 09:05:50.510332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.047 [2024-07-15 09:05:50.510358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.047 [2024-07-15 09:05:50.510390] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.047 [2024-07-15 09:05:50.510547] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.047 [2024-07-15 09:05:50.510699] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.047 [2024-07-15 09:05:50.510723] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.047 [2024-07-15 09:05:50.510739] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.047 [2024-07-15 09:05:50.513077] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.047 [2024-07-15 09:05:50.522407] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.047 [2024-07-15 09:05:50.522734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.047 [2024-07-15 09:05:50.522897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.047 [2024-07-15 09:05:50.522927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.047 [2024-07-15 09:05:50.522945] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.047 [2024-07-15 09:05:50.523128] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.047 [2024-07-15 09:05:50.523280] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.047 [2024-07-15 09:05:50.523304] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.047 [2024-07-15 09:05:50.523319] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.047 [2024-07-15 09:05:50.525850] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.047 [2024-07-15 09:05:50.535010] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.047 [2024-07-15 09:05:50.535418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.047 [2024-07-15 09:05:50.535601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.047 [2024-07-15 09:05:50.535626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.047 [2024-07-15 09:05:50.535642] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.047 [2024-07-15 09:05:50.535840] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.047 [2024-07-15 09:05:50.536030] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.047 [2024-07-15 09:05:50.536055] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.047 [2024-07-15 09:05:50.536071] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.047 [2024-07-15 09:05:50.538564] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.047 [2024-07-15 09:05:50.547555] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.047 [2024-07-15 09:05:50.547895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.047 [2024-07-15 09:05:50.548097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.047 [2024-07-15 09:05:50.548146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.047 [2024-07-15 09:05:50.548165] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.047 [2024-07-15 09:05:50.548349] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.047 [2024-07-15 09:05:50.548518] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.047 [2024-07-15 09:05:50.548543] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.047 [2024-07-15 09:05:50.548559] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.047 [2024-07-15 09:05:50.550970] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.047 [2024-07-15 09:05:50.560008] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.047 [2024-07-15 09:05:50.560343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.047 [2024-07-15 09:05:50.560543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.047 [2024-07-15 09:05:50.560584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.047 [2024-07-15 09:05:50.560600] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.047 [2024-07-15 09:05:50.560728] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.047 [2024-07-15 09:05:50.560925] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.047 [2024-07-15 09:05:50.560950] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.047 [2024-07-15 09:05:50.560966] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.047 [2024-07-15 09:05:50.563456] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.047 [2024-07-15 09:05:50.572571] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.047 [2024-07-15 09:05:50.572918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.047 [2024-07-15 09:05:50.573115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.047 [2024-07-15 09:05:50.573142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.047 [2024-07-15 09:05:50.573158] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.047 [2024-07-15 09:05:50.573275] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.047 [2024-07-15 09:05:50.573439] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.047 [2024-07-15 09:05:50.573463] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.047 [2024-07-15 09:05:50.573479] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.047 [2024-07-15 09:05:50.575647] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.047 [2024-07-15 09:05:50.585128] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.047 [2024-07-15 09:05:50.585504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.047 [2024-07-15 09:05:50.585717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.047 [2024-07-15 09:05:50.585747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.047 [2024-07-15 09:05:50.585764] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.047 [2024-07-15 09:05:50.585979] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.047 [2024-07-15 09:05:50.586167] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.048 [2024-07-15 09:05:50.586192] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.048 [2024-07-15 09:05:50.586208] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.048 [2024-07-15 09:05:50.588572] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.307 [2024-07-15 09:05:50.597590] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.307 [2024-07-15 09:05:50.597958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.307 [2024-07-15 09:05:50.598135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.307 [2024-07-15 09:05:50.598161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.307 [2024-07-15 09:05:50.598178] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.307 [2024-07-15 09:05:50.598405] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.307 [2024-07-15 09:05:50.598593] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.307 [2024-07-15 09:05:50.598617] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.307 [2024-07-15 09:05:50.598633] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.307 [2024-07-15 09:05:50.601005] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.307 [2024-07-15 09:05:50.610167] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.307 [2024-07-15 09:05:50.610476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.307 [2024-07-15 09:05:50.610643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.307 [2024-07-15 09:05:50.610668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.307 [2024-07-15 09:05:50.610684] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.307 [2024-07-15 09:05:50.610867] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.307 [2024-07-15 09:05:50.611061] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.307 [2024-07-15 09:05:50.611086] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.307 [2024-07-15 09:05:50.611102] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.307 [2024-07-15 09:05:50.613485] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.307 [2024-07-15 09:05:50.622571] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.307 [2024-07-15 09:05:50.622975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.307 [2024-07-15 09:05:50.623304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.307 [2024-07-15 09:05:50.623356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.307 [2024-07-15 09:05:50.623374] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.307 [2024-07-15 09:05:50.623504] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.307 [2024-07-15 09:05:50.623691] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.307 [2024-07-15 09:05:50.623715] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.307 [2024-07-15 09:05:50.623731] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.307 [2024-07-15 09:05:50.626139] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.307 [2024-07-15 09:05:50.635286] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.307 [2024-07-15 09:05:50.635593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.307 [2024-07-15 09:05:50.635790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.307 [2024-07-15 09:05:50.635820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.307 [2024-07-15 09:05:50.635837] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.307 [2024-07-15 09:05:50.636018] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.307 [2024-07-15 09:05:50.636207] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.307 [2024-07-15 09:05:50.636237] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.307 [2024-07-15 09:05:50.636254] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.307 [2024-07-15 09:05:50.638422] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.307 [2024-07-15 09:05:50.648061] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.307 [2024-07-15 09:05:50.648382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.307 [2024-07-15 09:05:50.648559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.307 [2024-07-15 09:05:50.648590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.307 [2024-07-15 09:05:50.648609] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.307 [2024-07-15 09:05:50.648769] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.307 [2024-07-15 09:05:50.648986] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.307 [2024-07-15 09:05:50.649013] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.307 [2024-07-15 09:05:50.649029] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.307 [2024-07-15 09:05:50.651303] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.307 [2024-07-15 09:05:50.660584] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.307 [2024-07-15 09:05:50.660943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.307 [2024-07-15 09:05:50.661078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.307 [2024-07-15 09:05:50.661108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.307 [2024-07-15 09:05:50.661126] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.307 [2024-07-15 09:05:50.661292] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.307 [2024-07-15 09:05:50.661462] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.307 [2024-07-15 09:05:50.661487] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.307 [2024-07-15 09:05:50.661503] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.307 [2024-07-15 09:05:50.663741] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.307 [2024-07-15 09:05:50.673129] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.307 [2024-07-15 09:05:50.673497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.307 [2024-07-15 09:05:50.673635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.307 [2024-07-15 09:05:50.673666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.307 [2024-07-15 09:05:50.673684] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.307 [2024-07-15 09:05:50.673831] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.307 [2024-07-15 09:05:50.674032] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.307 [2024-07-15 09:05:50.674059] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.307 [2024-07-15 09:05:50.674075] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.307 [2024-07-15 09:05:50.676569] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.307 [2024-07-15 09:05:50.685787] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.307 [2024-07-15 09:05:50.686120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.307 [2024-07-15 09:05:50.686278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.307 [2024-07-15 09:05:50.686320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.307 [2024-07-15 09:05:50.686341] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.307 [2024-07-15 09:05:50.686521] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.307 [2024-07-15 09:05:50.686672] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.307 [2024-07-15 09:05:50.686697] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.307 [2024-07-15 09:05:50.686714] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.307 [2024-07-15 09:05:50.689039] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.307 [2024-07-15 09:05:50.698299] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.307 [2024-07-15 09:05:50.698673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.307 [2024-07-15 09:05:50.698839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.307 [2024-07-15 09:05:50.698868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.307 [2024-07-15 09:05:50.698899] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.307 [2024-07-15 09:05:50.699049] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.307 [2024-07-15 09:05:50.699236] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.307 [2024-07-15 09:05:50.699262] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.307 [2024-07-15 09:05:50.699278] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.307 [2024-07-15 09:05:50.701611] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.307 [2024-07-15 09:05:50.710761] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.308 [2024-07-15 09:05:50.711103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.308 [2024-07-15 09:05:50.711293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.308 [2024-07-15 09:05:50.711323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.308 [2024-07-15 09:05:50.711341] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.308 [2024-07-15 09:05:50.711507] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.308 [2024-07-15 09:05:50.711676] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.308 [2024-07-15 09:05:50.711701] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.308 [2024-07-15 09:05:50.711717] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.308 [2024-07-15 09:05:50.713932] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.308 [2024-07-15 09:05:50.723246] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.308 [2024-07-15 09:05:50.723556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.308 [2024-07-15 09:05:50.723757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.308 [2024-07-15 09:05:50.723784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.308 [2024-07-15 09:05:50.723815] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.308 [2024-07-15 09:05:50.723978] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.308 [2024-07-15 09:05:50.724131] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.308 [2024-07-15 09:05:50.724156] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.308 [2024-07-15 09:05:50.724173] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.308 [2024-07-15 09:05:50.726613] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.308 [2024-07-15 09:05:50.735901] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.308 [2024-07-15 09:05:50.736216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.308 [2024-07-15 09:05:50.736437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.308 [2024-07-15 09:05:50.736492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.308 [2024-07-15 09:05:50.736510] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.308 [2024-07-15 09:05:50.736712] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.308 [2024-07-15 09:05:50.736913] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.308 [2024-07-15 09:05:50.736940] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.308 [2024-07-15 09:05:50.736957] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.308 [2024-07-15 09:05:50.739341] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.308 [2024-07-15 09:05:50.748326] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.308 [2024-07-15 09:05:50.748681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.308 [2024-07-15 09:05:50.748841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.308 [2024-07-15 09:05:50.748870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.308 [2024-07-15 09:05:50.748901] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.308 [2024-07-15 09:05:50.749087] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.308 [2024-07-15 09:05:50.749256] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.308 [2024-07-15 09:05:50.749281] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.308 [2024-07-15 09:05:50.749298] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.308 [2024-07-15 09:05:50.751590] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.308 [2024-07-15 09:05:50.760906] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.308 [2024-07-15 09:05:50.761270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.308 [2024-07-15 09:05:50.761469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.308 [2024-07-15 09:05:50.761497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.308 [2024-07-15 09:05:50.761514] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.308 [2024-07-15 09:05:50.761680] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.308 [2024-07-15 09:05:50.761818] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.308 [2024-07-15 09:05:50.761844] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.308 [2024-07-15 09:05:50.761860] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.308 [2024-07-15 09:05:50.764095] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.308 [2024-07-15 09:05:50.773603] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.308 [2024-07-15 09:05:50.773967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.308 [2024-07-15 09:05:50.774130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.308 [2024-07-15 09:05:50.774160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.308 [2024-07-15 09:05:50.774178] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.308 [2024-07-15 09:05:50.774327] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.308 [2024-07-15 09:05:50.774514] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.308 [2024-07-15 09:05:50.774539] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.308 [2024-07-15 09:05:50.774555] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.308 [2024-07-15 09:05:50.776762] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.308 [2024-07-15 09:05:50.786319] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.308 [2024-07-15 09:05:50.786715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.308 [2024-07-15 09:05:50.786892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.308 [2024-07-15 09:05:50.786922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.308 [2024-07-15 09:05:50.786940] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.308 [2024-07-15 09:05:50.787160] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.308 [2024-07-15 09:05:50.787329] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.308 [2024-07-15 09:05:50.787354] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.308 [2024-07-15 09:05:50.787370] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.308 [2024-07-15 09:05:50.789708] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.308 [2024-07-15 09:05:50.799004] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.308 [2024-07-15 09:05:50.799334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.308 [2024-07-15 09:05:50.799497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.308 [2024-07-15 09:05:50.799525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.308 [2024-07-15 09:05:50.799542] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.308 [2024-07-15 09:05:50.799690] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.308 [2024-07-15 09:05:50.799841] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.308 [2024-07-15 09:05:50.799871] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.308 [2024-07-15 09:05:50.799903] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.308 [2024-07-15 09:05:50.802310] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.308 [2024-07-15 09:05:50.811578] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.308 [2024-07-15 09:05:50.811891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.308 [2024-07-15 09:05:50.812034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.308 [2024-07-15 09:05:50.812064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.308 [2024-07-15 09:05:50.812083] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.308 [2024-07-15 09:05:50.812213] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.308 [2024-07-15 09:05:50.812400] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.308 [2024-07-15 09:05:50.812427] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.308 [2024-07-15 09:05:50.812443] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.308 [2024-07-15 09:05:50.814845] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.308 [2024-07-15 09:05:50.824162] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.308 [2024-07-15 09:05:50.824488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.308 [2024-07-15 09:05:50.824743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.308 [2024-07-15 09:05:50.824796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.308 [2024-07-15 09:05:50.824815] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.308 [2024-07-15 09:05:50.824994] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.308 [2024-07-15 09:05:50.825146] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.308 [2024-07-15 09:05:50.825170] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.308 [2024-07-15 09:05:50.825185] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.308 [2024-07-15 09:05:50.827408] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.308 [2024-07-15 09:05:50.836692] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.308 [2024-07-15 09:05:50.837042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.309 [2024-07-15 09:05:50.837213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.309 [2024-07-15 09:05:50.837243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.309 [2024-07-15 09:05:50.837261] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.309 [2024-07-15 09:05:50.837463] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.309 [2024-07-15 09:05:50.837650] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.309 [2024-07-15 09:05:50.837676] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.309 [2024-07-15 09:05:50.837697] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.309 [2024-07-15 09:05:50.840026] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.567 [2024-07-15 09:05:50.849584] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.567 [2024-07-15 09:05:50.849928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.567 [2024-07-15 09:05:50.850094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.567 [2024-07-15 09:05:50.850124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.567 [2024-07-15 09:05:50.850142] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.567 [2024-07-15 09:05:50.850326] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.567 [2024-07-15 09:05:50.850513] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.567 [2024-07-15 09:05:50.850539] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.567 [2024-07-15 09:05:50.850555] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.567 [2024-07-15 09:05:50.852895] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.567 [2024-07-15 09:05:50.862256] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.567 [2024-07-15 09:05:50.862675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.567 [2024-07-15 09:05:50.862897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.567 [2024-07-15 09:05:50.862926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.567 [2024-07-15 09:05:50.862944] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.567 [2024-07-15 09:05:50.863093] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.567 [2024-07-15 09:05:50.863263] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.567 [2024-07-15 09:05:50.863287] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.567 [2024-07-15 09:05:50.863303] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.567 [2024-07-15 09:05:50.865573] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.567 [2024-07-15 09:05:50.874964] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.567 [2024-07-15 09:05:50.875351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.567 [2024-07-15 09:05:50.875470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.567 [2024-07-15 09:05:50.875494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.567 [2024-07-15 09:05:50.875510] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.567 [2024-07-15 09:05:50.875700] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.567 [2024-07-15 09:05:50.875852] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.567 [2024-07-15 09:05:50.875890] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.567 [2024-07-15 09:05:50.875910] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.567 [2024-07-15 09:05:50.878265] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.567 [2024-07-15 09:05:50.887439] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.567 [2024-07-15 09:05:50.887869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.567 [2024-07-15 09:05:50.888153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.567 [2024-07-15 09:05:50.888205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.567 [2024-07-15 09:05:50.888223] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.567 [2024-07-15 09:05:50.888407] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.567 [2024-07-15 09:05:50.888594] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.567 [2024-07-15 09:05:50.888620] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.567 [2024-07-15 09:05:50.888636] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.567 [2024-07-15 09:05:50.891151] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.567 [2024-07-15 09:05:50.900037] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.567 [2024-07-15 09:05:50.900408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.567 [2024-07-15 09:05:50.900659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.567 [2024-07-15 09:05:50.900708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.567 [2024-07-15 09:05:50.900727] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.567 [2024-07-15 09:05:50.900857] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.567 [2024-07-15 09:05:50.901022] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.568 [2024-07-15 09:05:50.901046] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.568 [2024-07-15 09:05:50.901062] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.568 [2024-07-15 09:05:50.903160] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.568 [2024-07-15 09:05:50.912449] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.568 [2024-07-15 09:05:50.912907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.568 [2024-07-15 09:05:50.913077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.568 [2024-07-15 09:05:50.913118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.568 [2024-07-15 09:05:50.913134] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.568 [2024-07-15 09:05:50.913335] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.568 [2024-07-15 09:05:50.913509] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.568 [2024-07-15 09:05:50.913536] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.568 [2024-07-15 09:05:50.913552] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.568 [2024-07-15 09:05:50.915948] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.568 [2024-07-15 09:05:50.925127] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.568 [2024-07-15 09:05:50.925479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.568 [2024-07-15 09:05:50.925640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.568 [2024-07-15 09:05:50.925671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.568 [2024-07-15 09:05:50.925689] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.568 [2024-07-15 09:05:50.925837] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.568 [2024-07-15 09:05:50.926023] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.568 [2024-07-15 09:05:50.926050] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.568 [2024-07-15 09:05:50.926066] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.568 [2024-07-15 09:05:50.928594] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.568 [2024-07-15 09:05:50.937773] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.568 [2024-07-15 09:05:50.938062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.568 [2024-07-15 09:05:50.938244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.568 [2024-07-15 09:05:50.938289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.568 [2024-07-15 09:05:50.938307] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.568 [2024-07-15 09:05:50.938473] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.568 [2024-07-15 09:05:50.938660] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.568 [2024-07-15 09:05:50.938686] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.568 [2024-07-15 09:05:50.938701] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.568 [2024-07-15 09:05:50.940730] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.568 [2024-07-15 09:05:50.950478] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.568 [2024-07-15 09:05:50.950800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.568 [2024-07-15 09:05:50.950983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.568 [2024-07-15 09:05:50.951026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.568 [2024-07-15 09:05:50.951044] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.568 [2024-07-15 09:05:50.951192] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.568 [2024-07-15 09:05:50.951344] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.568 [2024-07-15 09:05:50.951368] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.568 [2024-07-15 09:05:50.951383] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.568 [2024-07-15 09:05:50.953662] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.568 [2024-07-15 09:05:50.962892] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.568 [2024-07-15 09:05:50.963244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.568 [2024-07-15 09:05:50.963404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.568 [2024-07-15 09:05:50.963432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.568 [2024-07-15 09:05:50.963449] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.568 [2024-07-15 09:05:50.963670] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.568 [2024-07-15 09:05:50.963860] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.568 [2024-07-15 09:05:50.963898] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.568 [2024-07-15 09:05:50.963915] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.568 [2024-07-15 09:05:50.966391] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.568 [2024-07-15 09:05:50.975504] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.568 [2024-07-15 09:05:50.975854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.568 [2024-07-15 09:05:50.976023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.568 [2024-07-15 09:05:50.976052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.568 [2024-07-15 09:05:50.976069] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.568 [2024-07-15 09:05:50.976216] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.568 [2024-07-15 09:05:50.976422] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.568 [2024-07-15 09:05:50.976447] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.568 [2024-07-15 09:05:50.976463] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.568 [2024-07-15 09:05:50.978743] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.568 [2024-07-15 09:05:50.987999] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.568 [2024-07-15 09:05:50.988348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.568 [2024-07-15 09:05:50.988487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.568 [2024-07-15 09:05:50.988517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.568 [2024-07-15 09:05:50.988535] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.568 [2024-07-15 09:05:50.988665] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.568 [2024-07-15 09:05:50.988902] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.568 [2024-07-15 09:05:50.988928] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.568 [2024-07-15 09:05:50.988945] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.568 [2024-07-15 09:05:50.991113] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.568 [2024-07-15 09:05:51.000319] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.568 [2024-07-15 09:05:51.000629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.568 [2024-07-15 09:05:51.000794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.568 [2024-07-15 09:05:51.000828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.568 [2024-07-15 09:05:51.000848] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.568 [2024-07-15 09:05:51.001025] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.568 [2024-07-15 09:05:51.001213] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.568 [2024-07-15 09:05:51.001238] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.568 [2024-07-15 09:05:51.001254] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.568 [2024-07-15 09:05:51.003514] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.568 [2024-07-15 09:05:51.012860] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.568 [2024-07-15 09:05:51.013236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.568 [2024-07-15 09:05:51.013395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.568 [2024-07-15 09:05:51.013423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.568 [2024-07-15 09:05:51.013440] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.568 [2024-07-15 09:05:51.013605] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.568 [2024-07-15 09:05:51.013774] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.568 [2024-07-15 09:05:51.013797] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.568 [2024-07-15 09:05:51.013813] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.568 [2024-07-15 09:05:51.016273] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.568 [2024-07-15 09:05:51.025593] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.568 [2024-07-15 09:05:51.025892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.568 [2024-07-15 09:05:51.026054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.568 [2024-07-15 09:05:51.026082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.568 [2024-07-15 09:05:51.026100] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.568 [2024-07-15 09:05:51.026247] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.568 [2024-07-15 09:05:51.026470] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.569 [2024-07-15 09:05:51.026494] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.569 [2024-07-15 09:05:51.026509] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.569 [2024-07-15 09:05:51.028721] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.569 [2024-07-15 09:05:51.038024] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.569 [2024-07-15 09:05:51.038380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.569 [2024-07-15 09:05:51.038579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.569 [2024-07-15 09:05:51.038604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.569 [2024-07-15 09:05:51.038625] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.569 [2024-07-15 09:05:51.038739] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.569 [2024-07-15 09:05:51.038931] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.569 [2024-07-15 09:05:51.038956] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.569 [2024-07-15 09:05:51.038971] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.569 [2024-07-15 09:05:51.041484] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.569 [2024-07-15 09:05:51.050423] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.569 [2024-07-15 09:05:51.050746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.569 [2024-07-15 09:05:51.050887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.569 [2024-07-15 09:05:51.050917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.569 [2024-07-15 09:05:51.050935] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.569 [2024-07-15 09:05:51.051154] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.569 [2024-07-15 09:05:51.051306] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.569 [2024-07-15 09:05:51.051329] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.569 [2024-07-15 09:05:51.051344] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.569 [2024-07-15 09:05:51.053900] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.569 [2024-07-15 09:05:51.063000] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.569 [2024-07-15 09:05:51.063347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.569 [2024-07-15 09:05:51.063530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.569 [2024-07-15 09:05:51.063559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.569 [2024-07-15 09:05:51.063576] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.569 [2024-07-15 09:05:51.063723] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.569 [2024-07-15 09:05:51.063923] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.569 [2024-07-15 09:05:51.063947] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.569 [2024-07-15 09:05:51.063962] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.569 [2024-07-15 09:05:51.066239] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.569 [2024-07-15 09:05:51.075631] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.569 [2024-07-15 09:05:51.076051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.569 [2024-07-15 09:05:51.076215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.569 [2024-07-15 09:05:51.076244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.569 [2024-07-15 09:05:51.076261] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.569 [2024-07-15 09:05:51.076413] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.569 [2024-07-15 09:05:51.076600] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.569 [2024-07-15 09:05:51.076624] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.569 [2024-07-15 09:05:51.076638] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.569 [2024-07-15 09:05:51.078794] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.569 [2024-07-15 09:05:51.088150] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.569 [2024-07-15 09:05:51.088549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.569 [2024-07-15 09:05:51.088738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.569 [2024-07-15 09:05:51.088766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.569 [2024-07-15 09:05:51.088783] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.569 [2024-07-15 09:05:51.088941] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.569 [2024-07-15 09:05:51.089113] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.569 [2024-07-15 09:05:51.089132] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.569 [2024-07-15 09:05:51.089145] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.569 [2024-07-15 09:05:51.091685] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.569 [2024-07-15 09:05:51.100623] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.569 [2024-07-15 09:05:51.101018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.569 [2024-07-15 09:05:51.101180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.569 [2024-07-15 09:05:51.101208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.569 [2024-07-15 09:05:51.101225] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.569 [2024-07-15 09:05:51.101409] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.569 [2024-07-15 09:05:51.101596] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.569 [2024-07-15 09:05:51.101620] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.569 [2024-07-15 09:05:51.101635] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.569 [2024-07-15 09:05:51.103956] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.827 [2024-07-15 09:05:51.113288] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.827 [2024-07-15 09:05:51.113615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.827 [2024-07-15 09:05:51.113780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.827 [2024-07-15 09:05:51.113809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.827 [2024-07-15 09:05:51.113825] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.827 [2024-07-15 09:05:51.114001] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.827 [2024-07-15 09:05:51.114194] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.827 [2024-07-15 09:05:51.114219] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.827 [2024-07-15 09:05:51.114234] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.827 [2024-07-15 09:05:51.116690] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.827 [2024-07-15 09:05:51.125812] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.827 [2024-07-15 09:05:51.126186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.827 [2024-07-15 09:05:51.126385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.827 [2024-07-15 09:05:51.126413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.827 [2024-07-15 09:05:51.126430] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.827 [2024-07-15 09:05:51.126577] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.827 [2024-07-15 09:05:51.126781] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.827 [2024-07-15 09:05:51.126805] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.827 [2024-07-15 09:05:51.126820] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.827 [2024-07-15 09:05:51.129173] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.827 [2024-07-15 09:05:51.138347] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.827 [2024-07-15 09:05:51.138691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.827 [2024-07-15 09:05:51.138856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.827 [2024-07-15 09:05:51.138891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.827 [2024-07-15 09:05:51.138910] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.827 [2024-07-15 09:05:51.139057] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.827 [2024-07-15 09:05:51.139208] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.827 [2024-07-15 09:05:51.139231] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.827 [2024-07-15 09:05:51.139246] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.827 [2024-07-15 09:05:51.141685] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.827 [2024-07-15 09:05:51.151001] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.827 [2024-07-15 09:05:51.151345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.827 [2024-07-15 09:05:51.151504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.827 [2024-07-15 09:05:51.151532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.827 [2024-07-15 09:05:51.151549] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.827 [2024-07-15 09:05:51.151731] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.827 [2024-07-15 09:05:51.151934] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.827 [2024-07-15 09:05:51.151964] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.827 [2024-07-15 09:05:51.151980] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.827 [2024-07-15 09:05:51.154332] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.827 [2024-07-15 09:05:51.163508] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.827 [2024-07-15 09:05:51.163847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.827 [2024-07-15 09:05:51.164037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.827 [2024-07-15 09:05:51.164063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.827 [2024-07-15 09:05:51.164078] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.827 [2024-07-15 09:05:51.164285] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.827 [2024-07-15 09:05:51.164437] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.827 [2024-07-15 09:05:51.164460] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.827 [2024-07-15 09:05:51.164475] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.827 [2024-07-15 09:05:51.166735] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.827 [2024-07-15 09:05:51.176180] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.827 [2024-07-15 09:05:51.176535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.828 [2024-07-15 09:05:51.176677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.828 [2024-07-15 09:05:51.176707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.828 [2024-07-15 09:05:51.176725] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.828 [2024-07-15 09:05:51.176872] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.828 [2024-07-15 09:05:51.177102] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.828 [2024-07-15 09:05:51.177126] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.828 [2024-07-15 09:05:51.177141] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.828 [2024-07-15 09:05:51.179561] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.828 [2024-07-15 09:05:51.188698] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.828 [2024-07-15 09:05:51.189098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.828 [2024-07-15 09:05:51.189262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.828 [2024-07-15 09:05:51.189290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.828 [2024-07-15 09:05:51.189307] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.828 [2024-07-15 09:05:51.189490] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.828 [2024-07-15 09:05:51.189677] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.828 [2024-07-15 09:05:51.189701] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.828 [2024-07-15 09:05:51.189722] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.828 [2024-07-15 09:05:51.191972] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.828 [2024-07-15 09:05:51.201285] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.828 [2024-07-15 09:05:51.201626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.828 [2024-07-15 09:05:51.201786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.828 [2024-07-15 09:05:51.201814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.828 [2024-07-15 09:05:51.201831] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.828 [2024-07-15 09:05:51.202088] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.828 [2024-07-15 09:05:51.202277] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.828 [2024-07-15 09:05:51.202301] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.828 [2024-07-15 09:05:51.202316] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.828 [2024-07-15 09:05:51.204866] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.828 [2024-07-15 09:05:51.213771] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.828 [2024-07-15 09:05:51.214244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.828 [2024-07-15 09:05:51.214427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.828 [2024-07-15 09:05:51.214457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.828 [2024-07-15 09:05:51.214474] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.828 [2024-07-15 09:05:51.214621] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.828 [2024-07-15 09:05:51.214791] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.828 [2024-07-15 09:05:51.214814] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.828 [2024-07-15 09:05:51.214829] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.828 [2024-07-15 09:05:51.216917] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.828 [2024-07-15 09:05:51.226335] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.828 [2024-07-15 09:05:51.226697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.828 [2024-07-15 09:05:51.226860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.828 [2024-07-15 09:05:51.226899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.828 [2024-07-15 09:05:51.226919] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.828 [2024-07-15 09:05:51.227066] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.828 [2024-07-15 09:05:51.227235] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.828 [2024-07-15 09:05:51.227258] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.828 [2024-07-15 09:05:51.227273] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.828 [2024-07-15 09:05:51.229559] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.828 [2024-07-15 09:05:51.238974] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.828 [2024-07-15 09:05:51.239286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.828 [2024-07-15 09:05:51.239476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.828 [2024-07-15 09:05:51.239503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.828 [2024-07-15 09:05:51.239520] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.828 [2024-07-15 09:05:51.239667] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.828 [2024-07-15 09:05:51.239818] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.828 [2024-07-15 09:05:51.239841] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.828 [2024-07-15 09:05:51.239856] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.828 [2024-07-15 09:05:51.242213] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.828 [2024-07-15 09:05:51.251465] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.828 [2024-07-15 09:05:51.251892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.828 [2024-07-15 09:05:51.252096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.828 [2024-07-15 09:05:51.252121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.828 [2024-07-15 09:05:51.252137] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.828 [2024-07-15 09:05:51.252262] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.828 [2024-07-15 09:05:51.252429] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.828 [2024-07-15 09:05:51.252452] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.828 [2024-07-15 09:05:51.252467] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.828 [2024-07-15 09:05:51.254836] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.828 [2024-07-15 09:05:51.264172] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.828 [2024-07-15 09:05:51.264519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.828 [2024-07-15 09:05:51.264676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.828 [2024-07-15 09:05:51.264701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.828 [2024-07-15 09:05:51.264717] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.828 [2024-07-15 09:05:51.264859] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.828 [2024-07-15 09:05:51.265056] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.828 [2024-07-15 09:05:51.265080] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.828 [2024-07-15 09:05:51.265095] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.828 [2024-07-15 09:05:51.267477] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.828 [2024-07-15 09:05:51.276679] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.828 [2024-07-15 09:05:51.276986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.828 [2024-07-15 09:05:51.277171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.828 [2024-07-15 09:05:51.277199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.828 [2024-07-15 09:05:51.277216] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.828 [2024-07-15 09:05:51.277416] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.828 [2024-07-15 09:05:51.277567] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.828 [2024-07-15 09:05:51.277591] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.828 [2024-07-15 09:05:51.277606] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.828 [2024-07-15 09:05:51.279892] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.828 [2024-07-15 09:05:51.289207] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.828 [2024-07-15 09:05:51.289539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.828 [2024-07-15 09:05:51.289728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.828 [2024-07-15 09:05:51.289756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.828 [2024-07-15 09:05:51.289773] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.828 [2024-07-15 09:05:51.289949] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.828 [2024-07-15 09:05:51.290101] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.828 [2024-07-15 09:05:51.290124] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.828 [2024-07-15 09:05:51.290139] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.828 [2024-07-15 09:05:51.292541] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.828 [2024-07-15 09:05:51.301704] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.828 [2024-07-15 09:05:51.302052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.829 [2024-07-15 09:05:51.302214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.829 [2024-07-15 09:05:51.302241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.829 [2024-07-15 09:05:51.302258] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.829 [2024-07-15 09:05:51.302440] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.829 [2024-07-15 09:05:51.302609] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.829 [2024-07-15 09:05:51.302632] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.829 [2024-07-15 09:05:51.302647] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.829 [2024-07-15 09:05:51.304835] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.829 [2024-07-15 09:05:51.314235] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.829 [2024-07-15 09:05:51.314591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.829 [2024-07-15 09:05:51.314747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.829 [2024-07-15 09:05:51.314772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.829 [2024-07-15 09:05:51.314788] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.829 [2024-07-15 09:05:51.315012] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.829 [2024-07-15 09:05:51.315227] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.829 [2024-07-15 09:05:51.315251] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.829 [2024-07-15 09:05:51.315266] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.829 [2024-07-15 09:05:51.317559] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.829 [2024-07-15 09:05:51.326625] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.829 [2024-07-15 09:05:51.326949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.829 [2024-07-15 09:05:51.327113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.829 [2024-07-15 09:05:51.327141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.829 [2024-07-15 09:05:51.327159] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.829 [2024-07-15 09:05:51.327323] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.829 [2024-07-15 09:05:51.327510] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.829 [2024-07-15 09:05:51.327534] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.829 [2024-07-15 09:05:51.327549] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.829 [2024-07-15 09:05:51.329928] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.829 [2024-07-15 09:05:51.339168] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.829 [2024-07-15 09:05:51.339513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.829 [2024-07-15 09:05:51.339653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.829 [2024-07-15 09:05:51.339681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.829 [2024-07-15 09:05:51.339698] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.829 [2024-07-15 09:05:51.339845] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.829 [2024-07-15 09:05:51.340009] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.829 [2024-07-15 09:05:51.340029] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.829 [2024-07-15 09:05:51.340041] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.829 [2024-07-15 09:05:51.342527] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.829 [2024-07-15 09:05:51.351698] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.829 [2024-07-15 09:05:51.352073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.829 [2024-07-15 09:05:51.352205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.829 [2024-07-15 09:05:51.352233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.829 [2024-07-15 09:05:51.352250] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.829 [2024-07-15 09:05:51.352433] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.829 [2024-07-15 09:05:51.352620] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.829 [2024-07-15 09:05:51.352643] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.829 [2024-07-15 09:05:51.352658] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.829 [2024-07-15 09:05:51.355071] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.829 [2024-07-15 09:05:51.364336] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.829 [2024-07-15 09:05:51.364686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.829 [2024-07-15 09:05:51.364874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.829 [2024-07-15 09:05:51.364910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:02.829 [2024-07-15 09:05:51.364928] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:02.829 [2024-07-15 09:05:51.365056] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:02.829 [2024-07-15 09:05:51.365207] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.829 [2024-07-15 09:05:51.365230] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.829 [2024-07-15 09:05:51.365245] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.829 [2024-07-15 09:05:51.367540] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.088 [2024-07-15 09:05:51.376966] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.088 [2024-07-15 09:05:51.377331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.088 [2024-07-15 09:05:51.377492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.088 [2024-07-15 09:05:51.377520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.088 [2024-07-15 09:05:51.377537] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.088 [2024-07-15 09:05:51.377683] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.088 [2024-07-15 09:05:51.377834] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.088 [2024-07-15 09:05:51.377857] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.088 [2024-07-15 09:05:51.377871] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.088 [2024-07-15 09:05:51.380167] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.088 [2024-07-15 09:05:51.389693] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.088 [2024-07-15 09:05:51.390003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.088 [2024-07-15 09:05:51.390134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.088 [2024-07-15 09:05:51.390162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.089 [2024-07-15 09:05:51.390184] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.089 [2024-07-15 09:05:51.390386] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.089 [2024-07-15 09:05:51.390556] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.089 [2024-07-15 09:05:51.390579] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.089 [2024-07-15 09:05:51.390594] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.089 [2024-07-15 09:05:51.392868] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.089 [2024-07-15 09:05:51.402251] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.089 [2024-07-15 09:05:51.402585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.089 [2024-07-15 09:05:51.402770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.089 [2024-07-15 09:05:51.402797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.089 [2024-07-15 09:05:51.402814] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.089 [2024-07-15 09:05:51.403029] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.089 [2024-07-15 09:05:51.403192] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.089 [2024-07-15 09:05:51.403215] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.089 [2024-07-15 09:05:51.403230] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.089 [2024-07-15 09:05:51.405685] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.089 [2024-07-15 09:05:51.414724] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.089 [2024-07-15 09:05:51.415052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.089 [2024-07-15 09:05:51.415223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.089 [2024-07-15 09:05:51.415252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.089 [2024-07-15 09:05:51.415269] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.089 [2024-07-15 09:05:51.415415] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.089 [2024-07-15 09:05:51.415620] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.089 [2024-07-15 09:05:51.415644] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.089 [2024-07-15 09:05:51.415659] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.089 [2024-07-15 09:05:51.418127] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.089 [2024-07-15 09:05:51.427411] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.089 [2024-07-15 09:05:51.427722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.089 [2024-07-15 09:05:51.427886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.089 [2024-07-15 09:05:51.427911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.089 [2024-07-15 09:05:51.427927] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.089 [2024-07-15 09:05:51.428113] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.089 [2024-07-15 09:05:51.428282] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.089 [2024-07-15 09:05:51.428305] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.089 [2024-07-15 09:05:51.428321] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.089 [2024-07-15 09:05:51.430473] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.089 [2024-07-15 09:05:51.439810] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.089 [2024-07-15 09:05:51.440132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.089 [2024-07-15 09:05:51.440332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.089 [2024-07-15 09:05:51.440361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.089 [2024-07-15 09:05:51.440378] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.089 [2024-07-15 09:05:51.440542] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.089 [2024-07-15 09:05:51.440748] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.089 [2024-07-15 09:05:51.440771] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.089 [2024-07-15 09:05:51.440786] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.089 [2024-07-15 09:05:51.443111] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.089 [2024-07-15 09:05:51.452411] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.089 [2024-07-15 09:05:51.452772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.089 [2024-07-15 09:05:51.452964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.089 [2024-07-15 09:05:51.452990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.089 [2024-07-15 09:05:51.453006] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.089 [2024-07-15 09:05:51.453187] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.089 [2024-07-15 09:05:51.453338] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.089 [2024-07-15 09:05:51.453362] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.089 [2024-07-15 09:05:51.453377] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.089 [2024-07-15 09:05:51.455724] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.089 [2024-07-15 09:05:51.464961] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.089 [2024-07-15 09:05:51.465263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.089 [2024-07-15 09:05:51.465429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.089 [2024-07-15 09:05:51.465456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.089 [2024-07-15 09:05:51.465473] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.089 [2024-07-15 09:05:51.465674] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.089 [2024-07-15 09:05:51.465859] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.089 [2024-07-15 09:05:51.465895] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.089 [2024-07-15 09:05:51.465912] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.089 [2024-07-15 09:05:51.468269] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.089 [2024-07-15 09:05:51.477435] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.089 [2024-07-15 09:05:51.477784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.089 [2024-07-15 09:05:51.477984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.089 [2024-07-15 09:05:51.478014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.089 [2024-07-15 09:05:51.478031] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.089 [2024-07-15 09:05:51.478215] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.089 [2024-07-15 09:05:51.478329] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.089 [2024-07-15 09:05:51.478352] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.089 [2024-07-15 09:05:51.478368] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.089 [2024-07-15 09:05:51.480912] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.089 [2024-07-15 09:05:51.490011] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.089 [2024-07-15 09:05:51.490321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.089 [2024-07-15 09:05:51.490507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.089 [2024-07-15 09:05:51.490535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.089 [2024-07-15 09:05:51.490552] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.089 [2024-07-15 09:05:51.490717] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.089 [2024-07-15 09:05:51.490868] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.089 [2024-07-15 09:05:51.490902] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.089 [2024-07-15 09:05:51.490918] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.089 [2024-07-15 09:05:51.493336] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.089 [2024-07-15 09:05:51.502732] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.089 [2024-07-15 09:05:51.503050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.089 [2024-07-15 09:05:51.503215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.089 [2024-07-15 09:05:51.503243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.089 [2024-07-15 09:05:51.503260] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.089 [2024-07-15 09:05:51.503424] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.089 [2024-07-15 09:05:51.503557] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.089 [2024-07-15 09:05:51.503589] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.089 [2024-07-15 09:05:51.503605] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.089 [2024-07-15 09:05:51.505965] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.089 [2024-07-15 09:05:51.515418] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.089 [2024-07-15 09:05:51.515751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.089 [2024-07-15 09:05:51.515918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.089 [2024-07-15 09:05:51.515947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.090 [2024-07-15 09:05:51.515965] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.090 [2024-07-15 09:05:51.516057] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.090 [2024-07-15 09:05:51.516209] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.090 [2024-07-15 09:05:51.516232] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.090 [2024-07-15 09:05:51.516247] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.090 [2024-07-15 09:05:51.518670] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.090 [2024-07-15 09:05:51.527970] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.090 [2024-07-15 09:05:51.528308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.090 [2024-07-15 09:05:51.528443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.090 [2024-07-15 09:05:51.528471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.090 [2024-07-15 09:05:51.528488] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.090 [2024-07-15 09:05:51.528635] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.090 [2024-07-15 09:05:51.528804] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.090 [2024-07-15 09:05:51.528827] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.090 [2024-07-15 09:05:51.528842] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.090 [2024-07-15 09:05:51.531007] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.090 [2024-07-15 09:05:51.540593] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.090 [2024-07-15 09:05:51.540954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.090 [2024-07-15 09:05:51.541117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.090 [2024-07-15 09:05:51.541145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.090 [2024-07-15 09:05:51.541162] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.090 [2024-07-15 09:05:51.541327] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.090 [2024-07-15 09:05:51.541479] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.090 [2024-07-15 09:05:51.541502] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.090 [2024-07-15 09:05:51.541523] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.090 [2024-07-15 09:05:51.543873] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.090 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 1616306 Killed "${NVMF_APP[@]}" "$@" 00:27:03.090 09:05:51 -- host/bdevperf.sh@36 -- # tgt_init 00:27:03.090 09:05:51 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:27:03.090 09:05:51 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:03.090 09:05:51 -- common/autotest_common.sh@712 -- # xtrace_disable 00:27:03.090 09:05:51 -- common/autotest_common.sh@10 -- # set +x 00:27:03.090 09:05:51 -- nvmf/common.sh@469 -- # nvmfpid=1617412 00:27:03.090 09:05:51 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:03.090 09:05:51 -- nvmf/common.sh@470 -- # waitforlisten 1617412 00:27:03.090 09:05:51 -- common/autotest_common.sh@819 -- # '[' -z 1617412 ']' 00:27:03.090 09:05:51 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:03.090 09:05:51 -- common/autotest_common.sh@824 -- # local max_retries=100 00:27:03.090 09:05:51 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:03.090 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:03.090 09:05:51 -- common/autotest_common.sh@828 -- # xtrace_disable 00:27:03.090 09:05:51 -- common/autotest_common.sh@10 -- # set +x 00:27:03.090 [2024-07-15 09:05:51.553156] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.090 [2024-07-15 09:05:51.553479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.090 [2024-07-15 09:05:51.553623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.090 [2024-07-15 09:05:51.553649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.090 [2024-07-15 09:05:51.553664] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.090 [2024-07-15 09:05:51.553836] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.090 [2024-07-15 09:05:51.554017] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.090 [2024-07-15 09:05:51.554041] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.090 [2024-07-15 09:05:51.554056] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.090 [2024-07-15 09:05:51.556405] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.090 [2024-07-15 09:05:51.565771] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.090 [2024-07-15 09:05:51.566085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.090 [2024-07-15 09:05:51.566223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.090 [2024-07-15 09:05:51.566250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.090 [2024-07-15 09:05:51.566267] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.090 [2024-07-15 09:05:51.566374] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.090 [2024-07-15 09:05:51.566554] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.090 [2024-07-15 09:05:51.566577] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.090 [2024-07-15 09:05:51.566591] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.090 [2024-07-15 09:05:51.568811] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.090 [2024-07-15 09:05:51.578341] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.090 [2024-07-15 09:05:51.578689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.090 [2024-07-15 09:05:51.578820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.090 [2024-07-15 09:05:51.578847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.090 [2024-07-15 09:05:51.578863] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.090 [2024-07-15 09:05:51.579068] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.090 [2024-07-15 09:05:51.579247] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.090 [2024-07-15 09:05:51.579267] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.090 [2024-07-15 09:05:51.579279] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.090 [2024-07-15 09:05:51.581429] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.090 [2024-07-15 09:05:51.590617] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.090 [2024-07-15 09:05:51.590908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.090 [2024-07-15 09:05:51.591035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.090 [2024-07-15 09:05:51.591060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.090 [2024-07-15 09:05:51.591076] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.090 [2024-07-15 09:05:51.591132] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:27:03.090 [2024-07-15 09:05:51.591193] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:03.090 [2024-07-15 09:05:51.591255] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.090 [2024-07-15 09:05:51.591411] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.090 [2024-07-15 09:05:51.591429] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.090 [2024-07-15 09:05:51.591441] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.090 [2024-07-15 09:05:51.593528] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.090 [2024-07-15 09:05:51.602744] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.090 [2024-07-15 09:05:51.603145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.090 [2024-07-15 09:05:51.603328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.090 [2024-07-15 09:05:51.603353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.090 [2024-07-15 09:05:51.603368] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.090 [2024-07-15 09:05:51.603531] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.090 [2024-07-15 09:05:51.603732] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.090 [2024-07-15 09:05:51.603751] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.090 [2024-07-15 09:05:51.603770] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.090 [2024-07-15 09:05:51.605652] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.090 [2024-07-15 09:05:51.614754] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.090 [2024-07-15 09:05:51.615124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.090 [2024-07-15 09:05:51.615277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.090 [2024-07-15 09:05:51.615303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.090 [2024-07-15 09:05:51.615319] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.090 [2024-07-15 09:05:51.615480] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.090 [2024-07-15 09:05:51.615636] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.090 [2024-07-15 09:05:51.615656] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.090 [2024-07-15 09:05:51.615668] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.090 [2024-07-15 09:05:51.617508] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.091 EAL: No free 2048 kB hugepages reported on node 1 00:27:03.091 [2024-07-15 09:05:51.627139] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.091 [2024-07-15 09:05:51.627493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.091 [2024-07-15 09:05:51.627646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.091 [2024-07-15 09:05:51.627671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.091 [2024-07-15 09:05:51.627687] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.091 [2024-07-15 09:05:51.627818] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.091 [2024-07-15 09:05:51.628007] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.091 [2024-07-15 09:05:51.628029] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.091 [2024-07-15 09:05:51.628042] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.091 [2024-07-15 09:05:51.630322] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.350 [2024-07-15 09:05:51.639726] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.350 [2024-07-15 09:05:51.640138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.350 [2024-07-15 09:05:51.640262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.350 [2024-07-15 09:05:51.640288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.350 [2024-07-15 09:05:51.640304] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.350 [2024-07-15 09:05:51.640483] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.350 [2024-07-15 09:05:51.640629] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.350 [2024-07-15 09:05:51.640649] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.350 [2024-07-15 09:05:51.640667] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.350 [2024-07-15 09:05:51.642979] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.350 [2024-07-15 09:05:51.652342] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.350 [2024-07-15 09:05:51.652689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.350 [2024-07-15 09:05:51.652840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.350 [2024-07-15 09:05:51.652865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.350 [2024-07-15 09:05:51.652895] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.350 [2024-07-15 09:05:51.653061] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.350 [2024-07-15 09:05:51.653281] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.350 [2024-07-15 09:05:51.653301] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.350 [2024-07-15 09:05:51.653313] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.350 [2024-07-15 09:05:51.655707] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.350 [2024-07-15 09:05:51.660236] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:03.350 [2024-07-15 09:05:51.665005] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.350 [2024-07-15 09:05:51.665397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.350 [2024-07-15 09:05:51.665576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.350 [2024-07-15 09:05:51.665601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.350 [2024-07-15 09:05:51.665618] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.350 [2024-07-15 09:05:51.665752] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.350 [2024-07-15 09:05:51.665924] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.350 [2024-07-15 09:05:51.665945] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.350 [2024-07-15 09:05:51.665959] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.350 [2024-07-15 09:05:51.668358] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.350 [2024-07-15 09:05:51.677633] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.350 [2024-07-15 09:05:51.678106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.350 [2024-07-15 09:05:51.678277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.350 [2024-07-15 09:05:51.678303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.350 [2024-07-15 09:05:51.678321] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.350 [2024-07-15 09:05:51.678492] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.350 [2024-07-15 09:05:51.678638] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.350 [2024-07-15 09:05:51.678658] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.350 [2024-07-15 09:05:51.678672] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.350 [2024-07-15 09:05:51.681094] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.350 [2024-07-15 09:05:51.690206] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.350 [2024-07-15 09:05:51.690479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.350 [2024-07-15 09:05:51.690666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.350 [2024-07-15 09:05:51.690692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.350 [2024-07-15 09:05:51.690707] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.350 [2024-07-15 09:05:51.690896] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.350 [2024-07-15 09:05:51.691054] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.350 [2024-07-15 09:05:51.691074] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.350 [2024-07-15 09:05:51.691086] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.350 [2024-07-15 09:05:51.693448] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.350 [2024-07-15 09:05:51.702777] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.350 [2024-07-15 09:05:51.703096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.350 [2024-07-15 09:05:51.703249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.350 [2024-07-15 09:05:51.703275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.350 [2024-07-15 09:05:51.703292] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.350 [2024-07-15 09:05:51.703456] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.350 [2024-07-15 09:05:51.703654] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.350 [2024-07-15 09:05:51.703674] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.350 [2024-07-15 09:05:51.703686] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.350 [2024-07-15 09:05:51.705902] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.350 [2024-07-15 09:05:51.715322] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.350 [2024-07-15 09:05:51.715701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.350 [2024-07-15 09:05:51.715882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.350 [2024-07-15 09:05:51.715909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.350 [2024-07-15 09:05:51.715925] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.350 [2024-07-15 09:05:51.716088] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.350 [2024-07-15 09:05:51.716247] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.350 [2024-07-15 09:05:51.716267] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.350 [2024-07-15 09:05:51.716280] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.350 [2024-07-15 09:05:51.718442] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.350 [2024-07-15 09:05:51.727998] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.350 [2024-07-15 09:05:51.728603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.350 [2024-07-15 09:05:51.728795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.350 [2024-07-15 09:05:51.728821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.350 [2024-07-15 09:05:51.728840] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.350 [2024-07-15 09:05:51.728991] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.350 [2024-07-15 09:05:51.729132] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.350 [2024-07-15 09:05:51.729168] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.350 [2024-07-15 09:05:51.729194] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.350 [2024-07-15 09:05:51.731434] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.350 [2024-07-15 09:05:51.740636] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.350 [2024-07-15 09:05:51.741061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.350 [2024-07-15 09:05:51.741218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.350 [2024-07-15 09:05:51.741244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.350 [2024-07-15 09:05:51.741260] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.350 [2024-07-15 09:05:51.741426] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.350 [2024-07-15 09:05:51.741590] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.350 [2024-07-15 09:05:51.741614] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.350 [2024-07-15 09:05:51.741629] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.350 [2024-07-15 09:05:51.744048] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.350 [2024-07-15 09:05:51.753068] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.350 [2024-07-15 09:05:51.753431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.350 [2024-07-15 09:05:51.753598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.350 [2024-07-15 09:05:51.753624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.350 [2024-07-15 09:05:51.753639] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.351 [2024-07-15 09:05:51.753788] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.351 [2024-07-15 09:05:51.754004] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.351 [2024-07-15 09:05:51.754026] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.351 [2024-07-15 09:05:51.754039] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.351 [2024-07-15 09:05:51.756271] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.351 [2024-07-15 09:05:51.765620] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.351 [2024-07-15 09:05:51.765968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.351 [2024-07-15 09:05:51.766122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.351 [2024-07-15 09:05:51.766148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.351 [2024-07-15 09:05:51.766163] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.351 [2024-07-15 09:05:51.766328] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.351 [2024-07-15 09:05:51.766489] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.351 [2024-07-15 09:05:51.766520] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.351 [2024-07-15 09:05:51.766532] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.351 [2024-07-15 09:05:51.768703] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.351 [2024-07-15 09:05:51.775355] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:03.351 [2024-07-15 09:05:51.775467] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:03.351 [2024-07-15 09:05:51.775483] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:03.351 [2024-07-15 09:05:51.775496] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:03.351 [2024-07-15 09:05:51.775599] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:03.351 [2024-07-15 09:05:51.775657] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:03.351 [2024-07-15 09:05:51.775661] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:03.351 [2024-07-15 09:05:51.777974] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.351 [2024-07-15 09:05:51.778267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.351 [2024-07-15 09:05:51.778421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.351 [2024-07-15 09:05:51.778446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.351 [2024-07-15 09:05:51.778462] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.351 [2024-07-15 09:05:51.778594] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.351 [2024-07-15 09:05:51.778778] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.351 [2024-07-15 09:05:51.778799] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.351 [2024-07-15 09:05:51.778813] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.351 [2024-07-15 09:05:51.781053] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.351 [2024-07-15 09:05:51.790102] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.351 [2024-07-15 09:05:51.790572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.351 [2024-07-15 09:05:51.790747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.351 [2024-07-15 09:05:51.790773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.351 [2024-07-15 09:05:51.790792] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.351 [2024-07-15 09:05:51.790959] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.351 [2024-07-15 09:05:51.791110] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.351 [2024-07-15 09:05:51.791132] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.351 [2024-07-15 09:05:51.791148] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.351 [2024-07-15 09:05:51.793109] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.351 [2024-07-15 09:05:51.802496] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.351 [2024-07-15 09:05:51.803018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.351 [2024-07-15 09:05:51.803199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.351 [2024-07-15 09:05:51.803225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.351 [2024-07-15 09:05:51.803243] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.351 [2024-07-15 09:05:51.803384] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.351 [2024-07-15 09:05:51.803504] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.351 [2024-07-15 09:05:51.803525] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.351 [2024-07-15 09:05:51.803540] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.351 [2024-07-15 09:05:51.805553] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.351 [2024-07-15 09:05:51.814849] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.351 [2024-07-15 09:05:51.815332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.351 [2024-07-15 09:05:51.815505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.351 [2024-07-15 09:05:51.815530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.351 [2024-07-15 09:05:51.815549] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.351 [2024-07-15 09:05:51.815658] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.351 [2024-07-15 09:05:51.815894] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.351 [2024-07-15 09:05:51.815917] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.351 [2024-07-15 09:05:51.815934] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.351 [2024-07-15 09:05:51.818110] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.351 [2024-07-15 09:05:51.827264] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.351 [2024-07-15 09:05:51.827708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.351 [2024-07-15 09:05:51.827888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.351 [2024-07-15 09:05:51.827915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.351 [2024-07-15 09:05:51.827934] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.351 [2024-07-15 09:05:51.828056] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.351 [2024-07-15 09:05:51.828226] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.351 [2024-07-15 09:05:51.828255] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.351 [2024-07-15 09:05:51.828271] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.351 [2024-07-15 09:05:51.830468] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.351 [2024-07-15 09:05:51.839695] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.351 [2024-07-15 09:05:51.840183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.351 [2024-07-15 09:05:51.840373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.351 [2024-07-15 09:05:51.840399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.351 [2024-07-15 09:05:51.840417] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.351 [2024-07-15 09:05:51.840606] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.351 [2024-07-15 09:05:51.840835] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.351 [2024-07-15 09:05:51.840867] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.351 [2024-07-15 09:05:51.840908] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.351 [2024-07-15 09:05:51.842779] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.351 [2024-07-15 09:05:51.852075] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.351 [2024-07-15 09:05:51.852523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.351 [2024-07-15 09:05:51.852680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.351 [2024-07-15 09:05:51.852705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.351 [2024-07-15 09:05:51.852723] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.351 [2024-07-15 09:05:51.852920] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.351 [2024-07-15 09:05:51.853040] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.351 [2024-07-15 09:05:51.853061] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.351 [2024-07-15 09:05:51.853076] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.351 [2024-07-15 09:05:51.855009] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.351 [2024-07-15 09:05:51.864506] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.351 [2024-07-15 09:05:51.864816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.351 [2024-07-15 09:05:51.864985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.351 [2024-07-15 09:05:51.865012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.351 [2024-07-15 09:05:51.865028] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.351 [2024-07-15 09:05:51.865129] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.351 [2024-07-15 09:05:51.865265] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.351 [2024-07-15 09:05:51.865286] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.351 [2024-07-15 09:05:51.865307] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.352 [2024-07-15 09:05:51.867272] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.352 [2024-07-15 09:05:51.876705] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.352 [2024-07-15 09:05:51.877056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.352 [2024-07-15 09:05:51.877213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.352 [2024-07-15 09:05:51.877238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.352 [2024-07-15 09:05:51.877253] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.352 [2024-07-15 09:05:51.877418] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.352 [2024-07-15 09:05:51.877596] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.352 [2024-07-15 09:05:51.877617] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.352 [2024-07-15 09:05:51.877630] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.352 [2024-07-15 09:05:51.879501] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.352 [2024-07-15 09:05:51.888985] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.352 [2024-07-15 09:05:51.889245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.352 [2024-07-15 09:05:51.889385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.352 [2024-07-15 09:05:51.889411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.352 [2024-07-15 09:05:51.889426] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.352 [2024-07-15 09:05:51.889543] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.352 [2024-07-15 09:05:51.889723] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.352 [2024-07-15 09:05:51.889744] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.352 [2024-07-15 09:05:51.889757] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.352 [2024-07-15 09:05:51.891840] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.610 [2024-07-15 09:05:51.901361] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.610 [2024-07-15 09:05:51.901692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.610 [2024-07-15 09:05:51.901814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.610 [2024-07-15 09:05:51.901839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.610 [2024-07-15 09:05:51.901854] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.610 [2024-07-15 09:05:51.902027] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.610 [2024-07-15 09:05:51.902194] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.610 [2024-07-15 09:05:51.902215] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.610 [2024-07-15 09:05:51.902228] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.610 [2024-07-15 09:05:51.904335] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.610 [2024-07-15 09:05:51.913899] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.610 [2024-07-15 09:05:51.914210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.610 [2024-07-15 09:05:51.914361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.610 [2024-07-15 09:05:51.914386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.610 [2024-07-15 09:05:51.914401] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.610 [2024-07-15 09:05:51.914549] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.610 [2024-07-15 09:05:51.914715] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.610 [2024-07-15 09:05:51.914735] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.610 [2024-07-15 09:05:51.914749] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.610 [2024-07-15 09:05:51.916815] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.610 [2024-07-15 09:05:51.926094] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.610 [2024-07-15 09:05:51.926424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.610 [2024-07-15 09:05:51.926573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.610 [2024-07-15 09:05:51.926599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.610 [2024-07-15 09:05:51.926614] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.610 [2024-07-15 09:05:51.926779] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.610 [2024-07-15 09:05:51.926922] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.610 [2024-07-15 09:05:51.926943] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.610 [2024-07-15 09:05:51.926956] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.610 [2024-07-15 09:05:51.929227] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.610 [2024-07-15 09:05:51.938494] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.610 [2024-07-15 09:05:51.938803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.610 [2024-07-15 09:05:51.938983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.610 [2024-07-15 09:05:51.939011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.610 [2024-07-15 09:05:51.939027] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.610 [2024-07-15 09:05:51.939208] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.610 [2024-07-15 09:05:51.939372] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.610 [2024-07-15 09:05:51.939393] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.610 [2024-07-15 09:05:51.939406] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.610 [2024-07-15 09:05:51.941458] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.610 [2024-07-15 09:05:51.950786] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.610 [2024-07-15 09:05:51.951104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.610 [2024-07-15 09:05:51.951287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.610 [2024-07-15 09:05:51.951313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.610 [2024-07-15 09:05:51.951328] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.611 [2024-07-15 09:05:51.951476] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.611 [2024-07-15 09:05:51.951625] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.611 [2024-07-15 09:05:51.951646] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.611 [2024-07-15 09:05:51.951659] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.611 [2024-07-15 09:05:51.953662] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.611 [2024-07-15 09:05:51.963044] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.611 [2024-07-15 09:05:51.963396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.611 [2024-07-15 09:05:51.963546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.611 [2024-07-15 09:05:51.963571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.611 [2024-07-15 09:05:51.963586] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.611 [2024-07-15 09:05:51.963701] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.611 [2024-07-15 09:05:51.963893] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.611 [2024-07-15 09:05:51.963914] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.611 [2024-07-15 09:05:51.963928] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.611 [2024-07-15 09:05:51.965786] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.611 [2024-07-15 09:05:51.975354] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.611 [2024-07-15 09:05:51.975701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.611 [2024-07-15 09:05:51.975823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.611 [2024-07-15 09:05:51.975848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.611 [2024-07-15 09:05:51.975864] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.611 [2024-07-15 09:05:51.976018] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.611 [2024-07-15 09:05:51.976155] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.611 [2024-07-15 09:05:51.976191] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.611 [2024-07-15 09:05:51.976204] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.611 [2024-07-15 09:05:51.978280] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.611 [2024-07-15 09:05:51.987620] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.611 [2024-07-15 09:05:51.987914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.611 [2024-07-15 09:05:51.988069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.611 [2024-07-15 09:05:51.988095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.611 [2024-07-15 09:05:51.988110] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.611 [2024-07-15 09:05:51.988226] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.611 [2024-07-15 09:05:51.988393] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.611 [2024-07-15 09:05:51.988413] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.611 [2024-07-15 09:05:51.988426] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.611 [2024-07-15 09:05:51.990425] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.611 [2024-07-15 09:05:51.999797] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.611 [2024-07-15 09:05:52.000131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.611 [2024-07-15 09:05:52.000307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.611 [2024-07-15 09:05:52.000332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.611 [2024-07-15 09:05:52.000348] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.611 [2024-07-15 09:05:52.000528] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.611 [2024-07-15 09:05:52.000709] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.611 [2024-07-15 09:05:52.000729] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.611 [2024-07-15 09:05:52.000742] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.611 [2024-07-15 09:05:52.002716] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.611 [2024-07-15 09:05:52.012101] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.611 [2024-07-15 09:05:52.012370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.611 [2024-07-15 09:05:52.012499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.611 [2024-07-15 09:05:52.012525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.611 [2024-07-15 09:05:52.012540] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.611 [2024-07-15 09:05:52.012672] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.611 [2024-07-15 09:05:52.012869] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.611 [2024-07-15 09:05:52.012899] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.611 [2024-07-15 09:05:52.012912] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.611 [2024-07-15 09:05:52.014901] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.611 [2024-07-15 09:05:52.024343] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.611 [2024-07-15 09:05:52.024654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.611 [2024-07-15 09:05:52.024780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.611 [2024-07-15 09:05:52.024810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.611 [2024-07-15 09:05:52.024826] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.611 [2024-07-15 09:05:52.024967] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.611 [2024-07-15 09:05:52.025135] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.611 [2024-07-15 09:05:52.025157] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.611 [2024-07-15 09:05:52.025170] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.611 [2024-07-15 09:05:52.027428] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.611 [2024-07-15 09:05:52.036516] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.611 [2024-07-15 09:05:52.036880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.611 [2024-07-15 09:05:52.037005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.611 [2024-07-15 09:05:52.037031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.611 [2024-07-15 09:05:52.037046] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.611 [2024-07-15 09:05:52.037194] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.611 [2024-07-15 09:05:52.037345] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.611 [2024-07-15 09:05:52.037366] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.611 [2024-07-15 09:05:52.037379] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.611 [2024-07-15 09:05:52.039366] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.611 [2024-07-15 09:05:52.048703] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.611 [2024-07-15 09:05:52.049064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.611 [2024-07-15 09:05:52.049191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.611 [2024-07-15 09:05:52.049217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.611 [2024-07-15 09:05:52.049232] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.611 [2024-07-15 09:05:52.049411] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.611 [2024-07-15 09:05:52.049544] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.611 [2024-07-15 09:05:52.049565] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.611 [2024-07-15 09:05:52.049578] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.611 [2024-07-15 09:05:52.051609] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.611 [2024-07-15 09:05:52.060976] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.611 [2024-07-15 09:05:52.061320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.611 [2024-07-15 09:05:52.061436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.611 [2024-07-15 09:05:52.061461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.611 [2024-07-15 09:05:52.061484] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.611 [2024-07-15 09:05:52.061632] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.611 [2024-07-15 09:05:52.061811] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.611 [2024-07-15 09:05:52.061832] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.611 [2024-07-15 09:05:52.061845] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.611 [2024-07-15 09:05:52.063930] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.611 [2024-07-15 09:05:52.073346] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.611 [2024-07-15 09:05:52.073666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.611 [2024-07-15 09:05:52.073777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.611 [2024-07-15 09:05:52.073802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.611 [2024-07-15 09:05:52.073818] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.612 [2024-07-15 09:05:52.073991] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.612 [2024-07-15 09:05:52.074143] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.612 [2024-07-15 09:05:52.074164] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.612 [2024-07-15 09:05:52.074192] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.612 [2024-07-15 09:05:52.076257] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.612 [2024-07-15 09:05:52.085594] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.612 [2024-07-15 09:05:52.085860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.612 [2024-07-15 09:05:52.086008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.612 [2024-07-15 09:05:52.086034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.612 [2024-07-15 09:05:52.086050] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.612 [2024-07-15 09:05:52.086198] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.612 [2024-07-15 09:05:52.086361] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.612 [2024-07-15 09:05:52.086381] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.612 [2024-07-15 09:05:52.086395] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.612 [2024-07-15 09:05:52.088648] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.612 [2024-07-15 09:05:52.098010] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.612 [2024-07-15 09:05:52.098376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.612 [2024-07-15 09:05:52.098549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.612 [2024-07-15 09:05:52.098575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.612 [2024-07-15 09:05:52.098591] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.612 [2024-07-15 09:05:52.098727] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.612 [2024-07-15 09:05:52.098862] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.612 [2024-07-15 09:05:52.098891] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.612 [2024-07-15 09:05:52.098905] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.612 [2024-07-15 09:05:52.100853] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.612 [2024-07-15 09:05:52.110209] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.612 [2024-07-15 09:05:52.110529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.612 [2024-07-15 09:05:52.110657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.612 [2024-07-15 09:05:52.110682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.612 [2024-07-15 09:05:52.110697] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.612 [2024-07-15 09:05:52.110846] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.612 [2024-07-15 09:05:52.111021] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.612 [2024-07-15 09:05:52.111043] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.612 [2024-07-15 09:05:52.111057] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.612 [2024-07-15 09:05:52.113334] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.612 [2024-07-15 09:05:52.122486] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.612 [2024-07-15 09:05:52.122784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.612 [2024-07-15 09:05:52.122958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.612 [2024-07-15 09:05:52.122984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.612 [2024-07-15 09:05:52.123000] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.612 [2024-07-15 09:05:52.123132] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.612 [2024-07-15 09:05:52.123282] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.612 [2024-07-15 09:05:52.123302] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.612 [2024-07-15 09:05:52.123316] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.612 [2024-07-15 09:05:52.125448] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.612 [2024-07-15 09:05:52.134787] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.612 [2024-07-15 09:05:52.135158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.612 [2024-07-15 09:05:52.135302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.612 [2024-07-15 09:05:52.135327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.612 [2024-07-15 09:05:52.135342] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.612 [2024-07-15 09:05:52.135490] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.612 [2024-07-15 09:05:52.135660] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.612 [2024-07-15 09:05:52.135681] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.612 [2024-07-15 09:05:52.135695] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.612 [2024-07-15 09:05:52.137785] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.612 [2024-07-15 09:05:52.147357] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.612 [2024-07-15 09:05:52.147665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.612 [2024-07-15 09:05:52.147807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.612 [2024-07-15 09:05:52.147833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.612 [2024-07-15 09:05:52.147848] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.612 [2024-07-15 09:05:52.147989] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.612 [2024-07-15 09:05:52.148156] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.612 [2024-07-15 09:05:52.148176] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.612 [2024-07-15 09:05:52.148190] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.612 [2024-07-15 09:05:52.150462] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.871 [2024-07-15 09:05:52.159672] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.871 [2024-07-15 09:05:52.159995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.871 [2024-07-15 09:05:52.160114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.871 [2024-07-15 09:05:52.160139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.871 [2024-07-15 09:05:52.160155] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.871 [2024-07-15 09:05:52.160367] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.871 [2024-07-15 09:05:52.160499] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.871 [2024-07-15 09:05:52.160519] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.871 [2024-07-15 09:05:52.160533] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.871 [2024-07-15 09:05:52.162607] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.871 [2024-07-15 09:05:52.172035] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.871 [2024-07-15 09:05:52.172348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.871 [2024-07-15 09:05:52.172469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.871 [2024-07-15 09:05:52.172494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.871 [2024-07-15 09:05:52.172510] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.871 [2024-07-15 09:05:52.172674] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.871 [2024-07-15 09:05:52.172871] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.871 [2024-07-15 09:05:52.172904] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.871 [2024-07-15 09:05:52.172918] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.871 [2024-07-15 09:05:52.174996] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.871 [2024-07-15 09:05:52.184215] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.871 [2024-07-15 09:05:52.184529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.871 [2024-07-15 09:05:52.184659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.871 [2024-07-15 09:05:52.184683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.871 [2024-07-15 09:05:52.184699] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.871 [2024-07-15 09:05:52.184830] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.871 [2024-07-15 09:05:52.185021] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.871 [2024-07-15 09:05:52.185043] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.871 [2024-07-15 09:05:52.185057] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.871 [2024-07-15 09:05:52.187254] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.871 [2024-07-15 09:05:52.196342] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.871 [2024-07-15 09:05:52.196654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.871 [2024-07-15 09:05:52.196803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.871 [2024-07-15 09:05:52.196828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.871 [2024-07-15 09:05:52.196843] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.871 [2024-07-15 09:05:52.196998] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.871 [2024-07-15 09:05:52.197230] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.871 [2024-07-15 09:05:52.197250] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.871 [2024-07-15 09:05:52.197264] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.871 [2024-07-15 09:05:52.199385] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.871 [2024-07-15 09:05:52.208780] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.871 [2024-07-15 09:05:52.209113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.871 [2024-07-15 09:05:52.209249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.871 [2024-07-15 09:05:52.209274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.871 [2024-07-15 09:05:52.209289] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.871 [2024-07-15 09:05:52.209437] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.871 [2024-07-15 09:05:52.209585] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.871 [2024-07-15 09:05:52.209606] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.871 [2024-07-15 09:05:52.209624] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.871 [2024-07-15 09:05:52.211791] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.871 [2024-07-15 09:05:52.221243] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.871 [2024-07-15 09:05:52.221536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.871 [2024-07-15 09:05:52.221664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.871 [2024-07-15 09:05:52.221691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.871 [2024-07-15 09:05:52.221706] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.871 [2024-07-15 09:05:52.221838] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.871 [2024-07-15 09:05:52.221989] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.871 [2024-07-15 09:05:52.222012] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.871 [2024-07-15 09:05:52.222026] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.871 [2024-07-15 09:05:52.224100] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.871 [2024-07-15 09:05:52.233575] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.871 [2024-07-15 09:05:52.233899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.871 [2024-07-15 09:05:52.234051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.871 [2024-07-15 09:05:52.234077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.871 [2024-07-15 09:05:52.234092] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.871 [2024-07-15 09:05:52.234257] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.871 [2024-07-15 09:05:52.234374] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.871 [2024-07-15 09:05:52.234395] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.871 [2024-07-15 09:05:52.234408] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.871 [2024-07-15 09:05:52.236296] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.871 [2024-07-15 09:05:52.245963] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.871 [2024-07-15 09:05:52.246222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.871 [2024-07-15 09:05:52.246393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.871 [2024-07-15 09:05:52.246420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.871 [2024-07-15 09:05:52.246435] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.871 [2024-07-15 09:05:52.246567] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.871 [2024-07-15 09:05:52.246764] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.871 [2024-07-15 09:05:52.246784] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.871 [2024-07-15 09:05:52.246798] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.871 [2024-07-15 09:05:52.248975] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.871 [2024-07-15 09:05:52.258366] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.871 [2024-07-15 09:05:52.258682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.871 [2024-07-15 09:05:52.258832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.871 [2024-07-15 09:05:52.258857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.871 [2024-07-15 09:05:52.258890] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.871 [2024-07-15 09:05:52.259041] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.871 [2024-07-15 09:05:52.259208] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.871 [2024-07-15 09:05:52.259229] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.871 [2024-07-15 09:05:52.259242] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.871 [2024-07-15 09:05:52.261286] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.871 [2024-07-15 09:05:52.270669] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.871 [2024-07-15 09:05:52.270997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.871 [2024-07-15 09:05:52.271173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.871 [2024-07-15 09:05:52.271199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.871 [2024-07-15 09:05:52.271214] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.872 [2024-07-15 09:05:52.271363] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.872 [2024-07-15 09:05:52.271513] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.872 [2024-07-15 09:05:52.271533] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.872 [2024-07-15 09:05:52.271547] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.872 [2024-07-15 09:05:52.273637] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.872 [2024-07-15 09:05:52.282936] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.872 [2024-07-15 09:05:52.283253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.872 [2024-07-15 09:05:52.283403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.872 [2024-07-15 09:05:52.283427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.872 [2024-07-15 09:05:52.283443] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.872 [2024-07-15 09:05:52.283623] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.872 [2024-07-15 09:05:52.283788] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.872 [2024-07-15 09:05:52.283810] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.872 [2024-07-15 09:05:52.283823] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.872 [2024-07-15 09:05:52.285934] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.872 [2024-07-15 09:05:52.295250] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.872 [2024-07-15 09:05:52.295580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.872 [2024-07-15 09:05:52.295724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.872 [2024-07-15 09:05:52.295749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.872 [2024-07-15 09:05:52.295764] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.872 [2024-07-15 09:05:52.295908] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.872 [2024-07-15 09:05:52.296062] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.872 [2024-07-15 09:05:52.296084] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.872 [2024-07-15 09:05:52.296097] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.872 [2024-07-15 09:05:52.298394] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.872 [2024-07-15 09:05:52.307515] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.872 [2024-07-15 09:05:52.307861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.872 [2024-07-15 09:05:52.307995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.872 [2024-07-15 09:05:52.308020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.872 [2024-07-15 09:05:52.308035] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.872 [2024-07-15 09:05:52.308184] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.872 [2024-07-15 09:05:52.308365] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.872 [2024-07-15 09:05:52.308386] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.872 [2024-07-15 09:05:52.308399] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.872 [2024-07-15 09:05:52.310517] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.872 [2024-07-15 09:05:52.319816] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.872 [2024-07-15 09:05:52.320123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.872 [2024-07-15 09:05:52.320264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.872 [2024-07-15 09:05:52.320290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.872 [2024-07-15 09:05:52.320305] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.872 [2024-07-15 09:05:52.320500] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.872 [2024-07-15 09:05:52.320617] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.872 [2024-07-15 09:05:52.320639] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.872 [2024-07-15 09:05:52.320652] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.872 [2024-07-15 09:05:52.322723] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.872 [2024-07-15 09:05:52.332015] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.872 [2024-07-15 09:05:52.332338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.872 [2024-07-15 09:05:52.332486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.872 [2024-07-15 09:05:52.332511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.872 [2024-07-15 09:05:52.332527] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.872 [2024-07-15 09:05:52.332675] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.872 [2024-07-15 09:05:52.332826] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.872 [2024-07-15 09:05:52.332848] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.872 [2024-07-15 09:05:52.332861] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.872 [2024-07-15 09:05:52.335163] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.872 [2024-07-15 09:05:52.344232] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.872 [2024-07-15 09:05:52.344576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.872 [2024-07-15 09:05:52.344694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.872 [2024-07-15 09:05:52.344719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.872 [2024-07-15 09:05:52.344735] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.872 [2024-07-15 09:05:52.344953] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.872 [2024-07-15 09:05:52.345104] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.872 [2024-07-15 09:05:52.345125] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.872 [2024-07-15 09:05:52.345139] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.872 [2024-07-15 09:05:52.347554] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.872 [2024-07-15 09:05:52.356473] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.872 [2024-07-15 09:05:52.356816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.872 [2024-07-15 09:05:52.356992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.872 [2024-07-15 09:05:52.357019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.872 [2024-07-15 09:05:52.357034] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.872 [2024-07-15 09:05:52.357167] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.872 [2024-07-15 09:05:52.357383] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.872 [2024-07-15 09:05:52.357404] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.872 [2024-07-15 09:05:52.357417] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.872 [2024-07-15 09:05:52.359497] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.872 [2024-07-15 09:05:52.368810] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.872 [2024-07-15 09:05:52.369129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.872 [2024-07-15 09:05:52.369288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.872 [2024-07-15 09:05:52.369326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.872 [2024-07-15 09:05:52.369342] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.872 [2024-07-15 09:05:52.369506] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.872 [2024-07-15 09:05:52.369733] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.872 [2024-07-15 09:05:52.369753] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.872 [2024-07-15 09:05:52.369766] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.872 [2024-07-15 09:05:52.371870] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.872 [2024-07-15 09:05:52.381060] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.872 [2024-07-15 09:05:52.381351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.872 [2024-07-15 09:05:52.381493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.872 [2024-07-15 09:05:52.381518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.872 [2024-07-15 09:05:52.381534] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.872 [2024-07-15 09:05:52.381666] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.872 [2024-07-15 09:05:52.381847] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.872 [2024-07-15 09:05:52.381868] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.872 [2024-07-15 09:05:52.381907] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.872 [2024-07-15 09:05:52.383963] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.872 [2024-07-15 09:05:52.393404] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.872 [2024-07-15 09:05:52.393736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.872 [2024-07-15 09:05:52.393907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.872 [2024-07-15 09:05:52.393934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.872 [2024-07-15 09:05:52.393949] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.873 [2024-07-15 09:05:52.394098] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.873 [2024-07-15 09:05:52.394295] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.873 [2024-07-15 09:05:52.394315] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.873 [2024-07-15 09:05:52.394329] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.873 [2024-07-15 09:05:52.396624] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.873 [2024-07-15 09:05:52.405635] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.873 [2024-07-15 09:05:52.405940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.873 [2024-07-15 09:05:52.406071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.873 [2024-07-15 09:05:52.406096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:03.873 [2024-07-15 09:05:52.406117] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:03.873 [2024-07-15 09:05:52.406266] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:03.873 [2024-07-15 09:05:52.406446] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.873 [2024-07-15 09:05:52.406467] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.873 [2024-07-15 09:05:52.406481] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.873 [2024-07-15 09:05:52.408627] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.131 [2024-07-15 09:05:52.417930] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.131 [2024-07-15 09:05:52.418261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.131 [2024-07-15 09:05:52.418407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.131 [2024-07-15 09:05:52.418433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:04.131 [2024-07-15 09:05:52.418448] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:04.131 [2024-07-15 09:05:52.418581] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:04.131 [2024-07-15 09:05:52.418717] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.131 [2024-07-15 09:05:52.418739] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.131 [2024-07-15 09:05:52.418752] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.131 [2024-07-15 09:05:52.420949] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.131 [2024-07-15 09:05:52.430341] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.131 [2024-07-15 09:05:52.430655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.131 [2024-07-15 09:05:52.430782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.132 [2024-07-15 09:05:52.430808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:04.132 [2024-07-15 09:05:52.430824] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:04.132 [2024-07-15 09:05:52.430965] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:04.132 [2024-07-15 09:05:52.431118] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.132 [2024-07-15 09:05:52.431140] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.132 [2024-07-15 09:05:52.431153] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.132 [2024-07-15 09:05:52.433342] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.132 [2024-07-15 09:05:52.442650] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.132 [2024-07-15 09:05:52.442966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.132 [2024-07-15 09:05:52.443091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.132 [2024-07-15 09:05:52.443117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:04.132 [2024-07-15 09:05:52.443132] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:04.132 [2024-07-15 09:05:52.443269] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:04.132 [2024-07-15 09:05:52.443437] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.132 [2024-07-15 09:05:52.443458] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.132 [2024-07-15 09:05:52.443472] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.132 [2024-07-15 09:05:52.445606] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.132 [2024-07-15 09:05:52.454951] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.132 [2024-07-15 09:05:52.455245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.132 [2024-07-15 09:05:52.455369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.132 [2024-07-15 09:05:52.455395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:04.132 [2024-07-15 09:05:52.455410] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:04.132 [2024-07-15 09:05:52.455526] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:04.132 [2024-07-15 09:05:52.455723] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.132 [2024-07-15 09:05:52.455744] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.132 [2024-07-15 09:05:52.455758] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.132 [2024-07-15 09:05:52.457858] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.132 [2024-07-15 09:05:52.467050] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.132 [2024-07-15 09:05:52.467320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.132 [2024-07-15 09:05:52.467495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.132 [2024-07-15 09:05:52.467521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:04.132 [2024-07-15 09:05:52.467536] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:04.132 [2024-07-15 09:05:52.467669] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:04.132 [2024-07-15 09:05:52.467819] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.132 [2024-07-15 09:05:52.467840] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.132 [2024-07-15 09:05:52.467853] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.132 [2024-07-15 09:05:52.470092] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.132 [2024-07-15 09:05:52.479381] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.132 [2024-07-15 09:05:52.479668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.132 [2024-07-15 09:05:52.479812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.132 [2024-07-15 09:05:52.479837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:04.132 [2024-07-15 09:05:52.479854] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:04.132 [2024-07-15 09:05:52.479976] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:04.132 [2024-07-15 09:05:52.480103] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.132 [2024-07-15 09:05:52.480125] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.132 [2024-07-15 09:05:52.480139] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.132 [2024-07-15 09:05:52.482305] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.132 [2024-07-15 09:05:52.491605] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.132 [2024-07-15 09:05:52.491918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.132 [2024-07-15 09:05:52.492050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.132 [2024-07-15 09:05:52.492076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:04.132 [2024-07-15 09:05:52.492091] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:04.132 [2024-07-15 09:05:52.492223] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:04.132 [2024-07-15 09:05:52.492389] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.132 [2024-07-15 09:05:52.492411] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.132 [2024-07-15 09:05:52.492424] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.132 [2024-07-15 09:05:52.494559] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.132 [2024-07-15 09:05:52.503672] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.132 [2024-07-15 09:05:52.503996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.132 [2024-07-15 09:05:52.504124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.132 [2024-07-15 09:05:52.504149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:04.132 [2024-07-15 09:05:52.504165] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:04.132 [2024-07-15 09:05:52.504297] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:04.132 [2024-07-15 09:05:52.504464] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.132 [2024-07-15 09:05:52.504486] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.132 [2024-07-15 09:05:52.504499] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.132 [2024-07-15 09:05:52.506710] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.132 [2024-07-15 09:05:52.516041] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.132 [2024-07-15 09:05:52.516393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.132 [2024-07-15 09:05:52.516542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.132 [2024-07-15 09:05:52.516568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:04.132 [2024-07-15 09:05:52.516583] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:04.132 [2024-07-15 09:05:52.516748] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:04.132 [2024-07-15 09:05:52.516975] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.132 [2024-07-15 09:05:52.517002] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.132 [2024-07-15 09:05:52.517016] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.132 [2024-07-15 09:05:52.519026] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.132 [2024-07-15 09:05:52.528451] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.132 [2024-07-15 09:05:52.528745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.132 [2024-07-15 09:05:52.528872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.132 [2024-07-15 09:05:52.528903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:04.132 [2024-07-15 09:05:52.528919] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:04.132 [2024-07-15 09:05:52.529051] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:04.132 [2024-07-15 09:05:52.529203] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.132 [2024-07-15 09:05:52.529224] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.132 [2024-07-15 09:05:52.529238] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.132 [2024-07-15 09:05:52.531344] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.132 09:05:52 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:27:04.132 09:05:52 -- common/autotest_common.sh@852 -- # return 0 00:27:04.132 09:05:52 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:04.132 09:05:52 -- common/autotest_common.sh@718 -- # xtrace_disable 00:27:04.132 09:05:52 -- common/autotest_common.sh@10 -- # set +x 00:27:04.132 [2024-07-15 09:05:52.540957] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.132 [2024-07-15 09:05:52.541280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.132 [2024-07-15 09:05:52.541404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.132 [2024-07-15 09:05:52.541429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:04.132 [2024-07-15 09:05:52.541444] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:04.132 [2024-07-15 09:05:52.541593] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:04.132 [2024-07-15 09:05:52.541773] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.132 [2024-07-15 09:05:52.541794] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.132 [2024-07-15 09:05:52.541807] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.132 [2024-07-15 09:05:52.543911] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.132 [2024-07-15 09:05:52.553433] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.133 [2024-07-15 09:05:52.553758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.133 [2024-07-15 09:05:52.553909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.133 [2024-07-15 09:05:52.553935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:04.133 [2024-07-15 09:05:52.553950] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:04.133 [2024-07-15 09:05:52.554131] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:04.133 [2024-07-15 09:05:52.554286] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.133 [2024-07-15 09:05:52.554307] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.133 [2024-07-15 09:05:52.554321] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.133 [2024-07-15 09:05:52.556728] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.133 09:05:52 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:04.133 09:05:52 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:04.133 09:05:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:04.133 09:05:52 -- common/autotest_common.sh@10 -- # set +x 00:27:04.133 [2024-07-15 09:05:52.565706] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.133 [2024-07-15 09:05:52.566016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.133 [2024-07-15 09:05:52.566165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.133 [2024-07-15 09:05:52.566190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:04.133 [2024-07-15 09:05:52.566205] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:04.133 [2024-07-15 09:05:52.566322] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:04.133 [2024-07-15 09:05:52.566454] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.133 [2024-07-15 09:05:52.566475] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.133 [2024-07-15 09:05:52.566488] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.133 [2024-07-15 09:05:52.568388] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.133 [2024-07-15 09:05:52.569708] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:04.133 09:05:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:04.133 09:05:52 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:04.133 09:05:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:04.133 09:05:52 -- common/autotest_common.sh@10 -- # set +x 00:27:04.133 [2024-07-15 09:05:52.578206] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.133 [2024-07-15 09:05:52.578529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.133 [2024-07-15 09:05:52.578655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.133 [2024-07-15 09:05:52.578681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:04.133 [2024-07-15 09:05:52.578696] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:04.133 [2024-07-15 09:05:52.578844] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:04.133 [2024-07-15 09:05:52.579004] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.133 [2024-07-15 09:05:52.579026] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.133 [2024-07-15 09:05:52.579040] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.133 [2024-07-15 09:05:52.580922] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.133 [2024-07-15 09:05:52.590655] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.133 [2024-07-15 09:05:52.590950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.133 [2024-07-15 09:05:52.591108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.133 [2024-07-15 09:05:52.591134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:04.133 [2024-07-15 09:05:52.591150] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:04.133 [2024-07-15 09:05:52.591284] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:04.133 [2024-07-15 09:05:52.591464] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.133 [2024-07-15 09:05:52.591485] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.133 [2024-07-15 09:05:52.591499] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.133 [2024-07-15 09:05:52.593594] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.133 [2024-07-15 09:05:52.603233] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.133 [2024-07-15 09:05:52.603718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.133 [2024-07-15 09:05:52.603850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.133 [2024-07-15 09:05:52.603885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:04.133 [2024-07-15 09:05:52.603905] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:04.133 [2024-07-15 09:05:52.604032] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:04.133 [2024-07-15 09:05:52.604237] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.133 [2024-07-15 09:05:52.604259] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.133 [2024-07-15 09:05:52.604275] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.133 [2024-07-15 09:05:52.606334] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.133 Malloc0 00:27:04.133 09:05:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:04.133 09:05:52 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:04.133 09:05:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:04.133 09:05:52 -- common/autotest_common.sh@10 -- # set +x 00:27:04.133 [2024-07-15 09:05:52.615673] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.133 [2024-07-15 09:05:52.616020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.133 [2024-07-15 09:05:52.616180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.133 [2024-07-15 09:05:52.616205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:04.133 [2024-07-15 09:05:52.616221] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:04.133 [2024-07-15 09:05:52.616372] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:04.133 [2024-07-15 09:05:52.616538] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.133 [2024-07-15 09:05:52.616559] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.133 [2024-07-15 09:05:52.616573] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.133 [2024-07-15 09:05:52.618653] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.133 09:05:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:04.133 09:05:52 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:04.133 09:05:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:04.133 09:05:52 -- common/autotest_common.sh@10 -- # set +x 00:27:04.133 09:05:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:04.133 09:05:52 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:04.133 09:05:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:04.133 09:05:52 -- common/autotest_common.sh@10 -- # set +x 00:27:04.133 [2024-07-15 09:05:52.627992] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.133 [2024-07-15 09:05:52.628315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.133 [2024-07-15 09:05:52.628432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.133 [2024-07-15 09:05:52.628457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c4f400 with addr=10.0.0.2, port=4420 00:27:04.133 [2024-07-15 09:05:52.628472] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f400 is same with the state(5) to be set 00:27:04.133 [2024-07-15 09:05:52.628605] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f400 (9): Bad file descriptor 00:27:04.133 [2024-07-15 09:05:52.628757] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.133 [2024-07-15 09:05:52.628778] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.133 [2024-07-15 09:05:52.628792] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.133 [2024-07-15 09:05:52.631100] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.133 [2024-07-15 09:05:52.631264] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:04.133 09:05:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:04.133 09:05:52 -- host/bdevperf.sh@38 -- # wait 1616615 00:27:04.133 [2024-07-15 09:05:52.640138] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.391 [2024-07-15 09:05:52.788213] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:27:12.499 00:27:12.499 Latency(us) 00:27:12.499 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:12.499 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:27:12.499 Verification LBA range: start 0x0 length 0x4000 00:27:12.499 Nvme1n1 : 15.05 9311.01 36.37 16096.70 0.00 5010.50 952.70 41554.68 00:27:12.499 =================================================================================================================== 00:27:12.499 Total : 9311.01 36.37 16096.70 0.00 5010.50 952.70 41554.68 00:27:12.758 09:06:01 -- host/bdevperf.sh@39 -- # sync 00:27:12.758 09:06:01 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:12.758 09:06:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:12.758 09:06:01 -- common/autotest_common.sh@10 -- # set +x 00:27:12.758 09:06:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:12.758 09:06:01 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:27:12.758 09:06:01 -- host/bdevperf.sh@44 -- # nvmftestfini 00:27:12.758 09:06:01 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:12.758 09:06:01 -- nvmf/common.sh@116 -- # sync 00:27:12.758 09:06:01 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:12.758 09:06:01 -- nvmf/common.sh@119 -- # set +e 00:27:12.758 09:06:01 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:12.758 09:06:01 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:12.758 rmmod nvme_tcp 00:27:12.758 rmmod nvme_fabrics 00:27:12.758 rmmod nvme_keyring 00:27:13.016 09:06:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:13.016 09:06:01 -- nvmf/common.sh@123 -- # set -e 00:27:13.016 09:06:01 -- nvmf/common.sh@124 -- # return 0 00:27:13.016 09:06:01 -- nvmf/common.sh@477 -- # '[' -n 1617412 ']' 00:27:13.016 09:06:01 -- nvmf/common.sh@478 -- # killprocess 1617412 00:27:13.016 09:06:01 -- common/autotest_common.sh@926 -- # '[' -z 1617412 ']' 00:27:13.016 09:06:01 -- common/autotest_common.sh@930 -- # kill -0 1617412 00:27:13.016 09:06:01 -- common/autotest_common.sh@931 -- # uname 00:27:13.016 09:06:01 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:27:13.016 09:06:01 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1617412 00:27:13.016 09:06:01 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:27:13.016 09:06:01 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:27:13.016 09:06:01 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1617412' 00:27:13.016 killing process with pid 1617412 00:27:13.016 09:06:01 -- common/autotest_common.sh@945 -- # kill 1617412 00:27:13.016 09:06:01 -- common/autotest_common.sh@950 -- # wait 1617412 00:27:13.276 09:06:01 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:13.276 09:06:01 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:13.276 09:06:01 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:13.276 09:06:01 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:13.276 09:06:01 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:13.276 09:06:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:13.276 09:06:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:13.276 09:06:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:15.180 09:06:03 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:15.180 00:27:15.180 real 0m23.297s 00:27:15.180 user 1m2.986s 00:27:15.180 sys 0m4.316s 00:27:15.180 09:06:03 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:27:15.180 09:06:03 -- common/autotest_common.sh@10 -- # set +x 00:27:15.180 ************************************ 00:27:15.180 END TEST nvmf_bdevperf 00:27:15.180 ************************************ 00:27:15.180 09:06:03 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:27:15.180 09:06:03 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:27:15.180 09:06:03 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:27:15.180 09:06:03 -- common/autotest_common.sh@10 -- # set +x 00:27:15.180 ************************************ 00:27:15.180 START TEST nvmf_target_disconnect 00:27:15.180 ************************************ 00:27:15.180 09:06:03 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:27:15.437 * Looking for test storage... 00:27:15.437 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:15.437 09:06:03 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:15.437 09:06:03 -- nvmf/common.sh@7 -- # uname -s 00:27:15.437 09:06:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:15.437 09:06:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:15.437 09:06:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:15.437 09:06:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:15.437 09:06:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:15.437 09:06:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:15.437 09:06:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:15.437 09:06:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:15.437 09:06:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:15.437 09:06:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:15.437 09:06:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:15.437 09:06:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:15.437 09:06:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:15.437 09:06:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:15.437 09:06:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:15.437 09:06:03 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:15.437 09:06:03 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:15.437 09:06:03 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:15.437 09:06:03 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:15.437 09:06:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:15.437 09:06:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:15.437 09:06:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:15.437 09:06:03 -- paths/export.sh@5 -- # export PATH 00:27:15.437 09:06:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:15.437 09:06:03 -- nvmf/common.sh@46 -- # : 0 00:27:15.437 09:06:03 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:15.437 09:06:03 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:15.437 09:06:03 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:15.437 09:06:03 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:15.437 09:06:03 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:15.437 09:06:03 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:15.437 09:06:03 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:15.437 09:06:03 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:15.437 09:06:03 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:27:15.437 09:06:03 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:27:15.437 09:06:03 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:27:15.437 09:06:03 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:27:15.437 09:06:03 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:15.437 09:06:03 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:15.437 09:06:03 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:15.437 09:06:03 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:15.437 09:06:03 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:15.437 09:06:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:15.437 09:06:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:15.437 09:06:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:15.437 09:06:03 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:15.437 09:06:03 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:15.437 09:06:03 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:15.437 09:06:03 -- common/autotest_common.sh@10 -- # set +x 00:27:17.335 09:06:05 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:17.335 09:06:05 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:17.335 09:06:05 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:17.335 09:06:05 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:17.335 09:06:05 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:17.335 09:06:05 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:17.335 09:06:05 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:17.335 09:06:05 -- nvmf/common.sh@294 -- # net_devs=() 00:27:17.335 09:06:05 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:17.335 09:06:05 -- nvmf/common.sh@295 -- # e810=() 00:27:17.335 09:06:05 -- nvmf/common.sh@295 -- # local -ga e810 00:27:17.335 09:06:05 -- nvmf/common.sh@296 -- # x722=() 00:27:17.335 09:06:05 -- nvmf/common.sh@296 -- # local -ga x722 00:27:17.335 09:06:05 -- nvmf/common.sh@297 -- # mlx=() 00:27:17.335 09:06:05 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:17.335 09:06:05 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:17.335 09:06:05 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:17.335 09:06:05 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:17.335 09:06:05 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:17.335 09:06:05 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:17.335 09:06:05 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:17.335 09:06:05 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:17.335 09:06:05 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:17.335 09:06:05 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:17.335 09:06:05 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:17.335 09:06:05 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:17.335 09:06:05 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:17.335 09:06:05 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:17.335 09:06:05 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:17.335 09:06:05 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:17.335 09:06:05 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:17.335 09:06:05 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:17.336 09:06:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:17.336 09:06:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:17.336 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:17.336 09:06:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:17.336 09:06:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:17.336 09:06:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:17.336 09:06:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:17.336 09:06:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:17.336 09:06:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:17.336 09:06:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:17.336 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:17.336 09:06:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:17.336 09:06:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:17.336 09:06:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:17.336 09:06:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:17.336 09:06:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:17.336 09:06:05 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:17.336 09:06:05 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:17.336 09:06:05 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:17.336 09:06:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:17.336 09:06:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:17.336 09:06:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:17.336 09:06:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:17.336 09:06:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:17.336 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:17.336 09:06:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:17.336 09:06:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:17.336 09:06:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:17.336 09:06:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:17.336 09:06:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:17.336 09:06:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:17.336 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:17.336 09:06:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:17.336 09:06:05 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:17.336 09:06:05 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:17.336 09:06:05 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:17.336 09:06:05 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:17.336 09:06:05 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:17.336 09:06:05 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:17.336 09:06:05 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:17.336 09:06:05 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:17.336 09:06:05 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:17.336 09:06:05 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:17.336 09:06:05 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:17.336 09:06:05 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:17.336 09:06:05 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:17.336 09:06:05 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:17.336 09:06:05 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:17.336 09:06:05 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:17.336 09:06:05 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:17.336 09:06:05 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:17.336 09:06:05 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:17.336 09:06:05 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:17.336 09:06:05 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:17.336 09:06:05 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:17.336 09:06:05 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:17.336 09:06:05 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:17.336 09:06:05 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:17.336 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:17.336 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.216 ms 00:27:17.336 00:27:17.336 --- 10.0.0.2 ping statistics --- 00:27:17.336 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:17.336 rtt min/avg/max/mdev = 0.216/0.216/0.216/0.000 ms 00:27:17.336 09:06:05 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:17.336 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:17.336 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.139 ms 00:27:17.336 00:27:17.336 --- 10.0.0.1 ping statistics --- 00:27:17.336 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:17.336 rtt min/avg/max/mdev = 0.139/0.139/0.139/0.000 ms 00:27:17.336 09:06:05 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:17.336 09:06:05 -- nvmf/common.sh@410 -- # return 0 00:27:17.336 09:06:05 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:17.336 09:06:05 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:17.336 09:06:05 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:17.336 09:06:05 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:17.336 09:06:05 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:17.336 09:06:05 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:17.336 09:06:05 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:17.336 09:06:05 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:27:17.336 09:06:05 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:27:17.336 09:06:05 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:27:17.336 09:06:05 -- common/autotest_common.sh@10 -- # set +x 00:27:17.336 ************************************ 00:27:17.336 START TEST nvmf_target_disconnect_tc1 00:27:17.336 ************************************ 00:27:17.336 09:06:05 -- common/autotest_common.sh@1104 -- # nvmf_target_disconnect_tc1 00:27:17.336 09:06:05 -- host/target_disconnect.sh@32 -- # set +e 00:27:17.336 09:06:05 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:17.336 EAL: No free 2048 kB hugepages reported on node 1 00:27:17.599 [2024-07-15 09:06:05.893770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:17.599 [2024-07-15 09:06:05.893998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:17.599 [2024-07-15 09:06:05.894026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141a920 with addr=10.0.0.2, port=4420 00:27:17.599 [2024-07-15 09:06:05.894055] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:27:17.599 [2024-07-15 09:06:05.894074] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:27:17.599 [2024-07-15 09:06:05.894087] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:27:17.599 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:27:17.599 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:27:17.599 Initializing NVMe Controllers 00:27:17.599 09:06:05 -- host/target_disconnect.sh@33 -- # trap - ERR 00:27:17.599 09:06:05 -- host/target_disconnect.sh@33 -- # print_backtrace 00:27:17.599 09:06:05 -- common/autotest_common.sh@1132 -- # [[ hxBET =~ e ]] 00:27:17.599 09:06:05 -- common/autotest_common.sh@1132 -- # return 0 00:27:17.599 09:06:05 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:27:17.599 09:06:05 -- host/target_disconnect.sh@41 -- # set -e 00:27:17.599 00:27:17.599 real 0m0.099s 00:27:17.599 user 0m0.038s 00:27:17.599 sys 0m0.060s 00:27:17.599 09:06:05 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:27:17.599 09:06:05 -- common/autotest_common.sh@10 -- # set +x 00:27:17.599 ************************************ 00:27:17.599 END TEST nvmf_target_disconnect_tc1 00:27:17.599 ************************************ 00:27:17.599 09:06:05 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:27:17.599 09:06:05 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:27:17.599 09:06:05 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:27:17.599 09:06:05 -- common/autotest_common.sh@10 -- # set +x 00:27:17.599 ************************************ 00:27:17.599 START TEST nvmf_target_disconnect_tc2 00:27:17.599 ************************************ 00:27:17.599 09:06:05 -- common/autotest_common.sh@1104 -- # nvmf_target_disconnect_tc2 00:27:17.599 09:06:05 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:27:17.599 09:06:05 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:27:17.599 09:06:05 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:17.599 09:06:05 -- common/autotest_common.sh@712 -- # xtrace_disable 00:27:17.599 09:06:05 -- common/autotest_common.sh@10 -- # set +x 00:27:17.599 09:06:05 -- nvmf/common.sh@469 -- # nvmfpid=1620606 00:27:17.599 09:06:05 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:27:17.599 09:06:05 -- nvmf/common.sh@470 -- # waitforlisten 1620606 00:27:17.599 09:06:05 -- common/autotest_common.sh@819 -- # '[' -z 1620606 ']' 00:27:17.599 09:06:05 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:17.599 09:06:05 -- common/autotest_common.sh@824 -- # local max_retries=100 00:27:17.599 09:06:05 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:17.599 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:17.599 09:06:05 -- common/autotest_common.sh@828 -- # xtrace_disable 00:27:17.599 09:06:05 -- common/autotest_common.sh@10 -- # set +x 00:27:17.599 [2024-07-15 09:06:05.972417] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:27:17.599 [2024-07-15 09:06:05.972507] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:17.599 EAL: No free 2048 kB hugepages reported on node 1 00:27:17.599 [2024-07-15 09:06:06.036149] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:17.857 [2024-07-15 09:06:06.144654] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:17.857 [2024-07-15 09:06:06.144822] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:17.857 [2024-07-15 09:06:06.144840] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:17.857 [2024-07-15 09:06:06.144853] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:17.857 [2024-07-15 09:06:06.145077] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:27:17.857 [2024-07-15 09:06:06.145144] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:27:17.857 [2024-07-15 09:06:06.145206] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:27:17.857 [2024-07-15 09:06:06.145196] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:27:18.423 09:06:06 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:27:18.423 09:06:06 -- common/autotest_common.sh@852 -- # return 0 00:27:18.423 09:06:06 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:18.423 09:06:06 -- common/autotest_common.sh@718 -- # xtrace_disable 00:27:18.423 09:06:06 -- common/autotest_common.sh@10 -- # set +x 00:27:18.423 09:06:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:18.423 09:06:06 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:18.423 09:06:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:18.423 09:06:06 -- common/autotest_common.sh@10 -- # set +x 00:27:18.423 Malloc0 00:27:18.423 09:06:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:18.423 09:06:06 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:27:18.423 09:06:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:18.423 09:06:06 -- common/autotest_common.sh@10 -- # set +x 00:27:18.423 [2024-07-15 09:06:06.950461] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:18.423 09:06:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:18.423 09:06:06 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:18.423 09:06:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:18.423 09:06:06 -- common/autotest_common.sh@10 -- # set +x 00:27:18.423 09:06:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:18.681 09:06:06 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:18.681 09:06:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:18.681 09:06:06 -- common/autotest_common.sh@10 -- # set +x 00:27:18.681 09:06:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:18.681 09:06:06 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:18.681 09:06:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:18.681 09:06:06 -- common/autotest_common.sh@10 -- # set +x 00:27:18.681 [2024-07-15 09:06:06.978727] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:18.681 09:06:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:18.681 09:06:06 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:18.681 09:06:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:18.681 09:06:06 -- common/autotest_common.sh@10 -- # set +x 00:27:18.681 09:06:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:18.681 09:06:06 -- host/target_disconnect.sh@50 -- # reconnectpid=1620766 00:27:18.681 09:06:06 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:18.681 09:06:06 -- host/target_disconnect.sh@52 -- # sleep 2 00:27:18.681 EAL: No free 2048 kB hugepages reported on node 1 00:27:20.587 09:06:08 -- host/target_disconnect.sh@53 -- # kill -9 1620606 00:27:20.587 09:06:08 -- host/target_disconnect.sh@55 -- # sleep 2 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Write completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Write completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Write completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Write completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Write completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Write completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Write completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Write completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Write completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Write completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Write completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 [2024-07-15 09:06:09.002231] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Write completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Write completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Write completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Write completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Write completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Write completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Write completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Write completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Write completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Write completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Write completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 [2024-07-15 09:06:09.002541] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Write completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Write completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Write completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Write completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Write completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Write completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Write completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.587 Read completed with error (sct=0, sc=8) 00:27:20.587 starting I/O failed 00:27:20.588 Read completed with error (sct=0, sc=8) 00:27:20.588 starting I/O failed 00:27:20.588 Write completed with error (sct=0, sc=8) 00:27:20.588 starting I/O failed 00:27:20.588 Read completed with error (sct=0, sc=8) 00:27:20.588 starting I/O failed 00:27:20.588 Write completed with error (sct=0, sc=8) 00:27:20.588 starting I/O failed 00:27:20.588 Read completed with error (sct=0, sc=8) 00:27:20.588 starting I/O failed 00:27:20.588 Read completed with error (sct=0, sc=8) 00:27:20.588 starting I/O failed 00:27:20.588 Read completed with error (sct=0, sc=8) 00:27:20.588 starting I/O failed 00:27:20.588 Write completed with error (sct=0, sc=8) 00:27:20.588 starting I/O failed 00:27:20.588 Write completed with error (sct=0, sc=8) 00:27:20.588 starting I/O failed 00:27:20.588 Write completed with error (sct=0, sc=8) 00:27:20.588 starting I/O failed 00:27:20.588 [2024-07-15 09:06:09.002835] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:20.588 Read completed with error (sct=0, sc=8) 00:27:20.588 starting I/O failed 00:27:20.588 Read completed with error (sct=0, sc=8) 00:27:20.588 starting I/O failed 00:27:20.588 Read completed with error (sct=0, sc=8) 00:27:20.588 starting I/O failed 00:27:20.588 Read completed with error (sct=0, sc=8) 00:27:20.588 starting I/O failed 00:27:20.588 Read completed with error (sct=0, sc=8) 00:27:20.588 starting I/O failed 00:27:20.588 Read completed with error (sct=0, sc=8) 00:27:20.588 starting I/O failed 00:27:20.588 Read completed with error (sct=0, sc=8) 00:27:20.588 starting I/O failed 00:27:20.588 Write completed with error (sct=0, sc=8) 00:27:20.588 starting I/O failed 00:27:20.588 Write completed with error (sct=0, sc=8) 00:27:20.588 starting I/O failed 00:27:20.588 Write completed with error (sct=0, sc=8) 00:27:20.588 starting I/O failed 00:27:20.588 Read completed with error (sct=0, sc=8) 00:27:20.588 starting I/O failed 00:27:20.588 Write completed with error (sct=0, sc=8) 00:27:20.588 starting I/O failed 00:27:20.588 Write completed with error (sct=0, sc=8) 00:27:20.588 starting I/O failed 00:27:20.588 Read completed with error (sct=0, sc=8) 00:27:20.588 starting I/O failed 00:27:20.588 Write completed with error (sct=0, sc=8) 00:27:20.588 starting I/O failed 00:27:20.588 Write completed with error (sct=0, sc=8) 00:27:20.588 starting I/O failed 00:27:20.588 Read completed with error (sct=0, sc=8) 00:27:20.588 starting I/O failed 00:27:20.588 Read completed with error (sct=0, sc=8) 00:27:20.588 starting I/O failed 00:27:20.588 Read completed with error (sct=0, sc=8) 00:27:20.588 starting I/O failed 00:27:20.588 Write completed with error (sct=0, sc=8) 00:27:20.588 starting I/O failed 00:27:20.588 Read completed with error (sct=0, sc=8) 00:27:20.588 starting I/O failed 00:27:20.588 Read completed with error (sct=0, sc=8) 00:27:20.588 starting I/O failed 00:27:20.588 Write completed with error (sct=0, sc=8) 00:27:20.588 starting I/O failed 00:27:20.588 Write completed with error (sct=0, sc=8) 00:27:20.588 starting I/O failed 00:27:20.588 Read completed with error (sct=0, sc=8) 00:27:20.588 starting I/O failed 00:27:20.588 Write completed with error (sct=0, sc=8) 00:27:20.588 starting I/O failed 00:27:20.588 Write completed with error (sct=0, sc=8) 00:27:20.588 starting I/O failed 00:27:20.588 Read completed with error (sct=0, sc=8) 00:27:20.588 starting I/O failed 00:27:20.588 Write completed with error (sct=0, sc=8) 00:27:20.588 starting I/O failed 00:27:20.588 Read completed with error (sct=0, sc=8) 00:27:20.588 starting I/O failed 00:27:20.588 Write completed with error (sct=0, sc=8) 00:27:20.588 starting I/O failed 00:27:20.588 Write completed with error (sct=0, sc=8) 00:27:20.588 starting I/O failed 00:27:20.588 [2024-07-15 09:06:09.003178] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.588 [2024-07-15 09:06:09.003381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.588 [2024-07-15 09:06:09.003544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.588 [2024-07-15 09:06:09.003572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.588 qpair failed and we were unable to recover it. 00:27:20.588 [2024-07-15 09:06:09.003721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.588 [2024-07-15 09:06:09.003869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.588 [2024-07-15 09:06:09.003920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.588 qpair failed and we were unable to recover it. 00:27:20.588 [2024-07-15 09:06:09.004048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.588 [2024-07-15 09:06:09.004183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.588 [2024-07-15 09:06:09.004207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.588 qpair failed and we were unable to recover it. 00:27:20.588 [2024-07-15 09:06:09.004333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.588 [2024-07-15 09:06:09.004484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.588 [2024-07-15 09:06:09.004508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.588 qpair failed and we were unable to recover it. 00:27:20.588 [2024-07-15 09:06:09.004714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.588 [2024-07-15 09:06:09.004828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.588 [2024-07-15 09:06:09.004852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.588 qpair failed and we were unable to recover it. 00:27:20.588 [2024-07-15 09:06:09.005012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.588 [2024-07-15 09:06:09.005132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.588 [2024-07-15 09:06:09.005157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.588 qpair failed and we were unable to recover it. 00:27:20.588 [2024-07-15 09:06:09.005278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.588 [2024-07-15 09:06:09.005420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.588 [2024-07-15 09:06:09.005444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.588 qpair failed and we were unable to recover it. 00:27:20.588 [2024-07-15 09:06:09.005578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.588 [2024-07-15 09:06:09.005711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.588 [2024-07-15 09:06:09.005737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.588 qpair failed and we were unable to recover it. 00:27:20.588 [2024-07-15 09:06:09.005908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.588 [2024-07-15 09:06:09.006026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.588 [2024-07-15 09:06:09.006051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.588 qpair failed and we were unable to recover it. 00:27:20.588 [2024-07-15 09:06:09.006176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.588 [2024-07-15 09:06:09.006317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.588 [2024-07-15 09:06:09.006342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.588 qpair failed and we were unable to recover it. 00:27:20.588 [2024-07-15 09:06:09.006521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.588 [2024-07-15 09:06:09.006721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.588 [2024-07-15 09:06:09.006748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.588 qpair failed and we were unable to recover it. 00:27:20.588 [2024-07-15 09:06:09.006886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.588 [2024-07-15 09:06:09.007012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.588 [2024-07-15 09:06:09.007038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.588 qpair failed and we were unable to recover it. 00:27:20.588 [2024-07-15 09:06:09.007153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.588 [2024-07-15 09:06:09.007318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.588 [2024-07-15 09:06:09.007345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.588 qpair failed and we were unable to recover it. 00:27:20.588 [2024-07-15 09:06:09.007515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.588 [2024-07-15 09:06:09.007661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.588 [2024-07-15 09:06:09.007689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.588 qpair failed and we were unable to recover it. 00:27:20.588 [2024-07-15 09:06:09.007853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.588 [2024-07-15 09:06:09.007981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.588 [2024-07-15 09:06:09.008007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.588 qpair failed and we were unable to recover it. 00:27:20.588 [2024-07-15 09:06:09.008130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.588 [2024-07-15 09:06:09.008323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.588 [2024-07-15 09:06:09.008347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.588 qpair failed and we were unable to recover it. 00:27:20.588 [2024-07-15 09:06:09.008509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.588 [2024-07-15 09:06:09.008651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.588 [2024-07-15 09:06:09.008692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.588 qpair failed and we were unable to recover it. 00:27:20.588 [2024-07-15 09:06:09.008844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.588 [2024-07-15 09:06:09.008997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.588 [2024-07-15 09:06:09.009022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.588 qpair failed and we were unable to recover it. 00:27:20.588 [2024-07-15 09:06:09.009145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.588 [2024-07-15 09:06:09.009274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.588 [2024-07-15 09:06:09.009299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.588 qpair failed and we were unable to recover it. 00:27:20.588 [2024-07-15 09:06:09.009442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.009572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.009599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.589 qpair failed and we were unable to recover it. 00:27:20.589 [2024-07-15 09:06:09.009786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.009945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.009970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.589 qpair failed and we were unable to recover it. 00:27:20.589 [2024-07-15 09:06:09.010087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.010210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.010233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.589 qpair failed and we were unable to recover it. 00:27:20.589 [2024-07-15 09:06:09.010376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.010533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.010560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.589 qpair failed and we were unable to recover it. 00:27:20.589 [2024-07-15 09:06:09.010697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.010884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.010909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.589 qpair failed and we were unable to recover it. 00:27:20.589 [2024-07-15 09:06:09.011027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.011150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.011175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.589 qpair failed and we were unable to recover it. 00:27:20.589 [2024-07-15 09:06:09.011320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.011506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.011547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.589 qpair failed and we were unable to recover it. 00:27:20.589 [2024-07-15 09:06:09.011712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.011884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.011909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.589 qpair failed and we were unable to recover it. 00:27:20.589 [2024-07-15 09:06:09.012034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.012148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.012173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.589 qpair failed and we were unable to recover it. 00:27:20.589 [2024-07-15 09:06:09.012323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.012499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.012524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.589 qpair failed and we were unable to recover it. 00:27:20.589 [2024-07-15 09:06:09.012692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.012824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.012849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.589 qpair failed and we were unable to recover it. 00:27:20.589 [2024-07-15 09:06:09.012967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.013088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.013112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.589 qpair failed and we were unable to recover it. 00:27:20.589 [2024-07-15 09:06:09.013262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.013376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.013400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.589 qpair failed and we were unable to recover it. 00:27:20.589 [2024-07-15 09:06:09.013577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.013758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.013782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.589 qpair failed and we were unable to recover it. 00:27:20.589 [2024-07-15 09:06:09.013916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.014032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.014056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.589 qpair failed and we were unable to recover it. 00:27:20.589 [2024-07-15 09:06:09.014179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.014339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.014367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.589 qpair failed and we were unable to recover it. 00:27:20.589 [2024-07-15 09:06:09.014535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.014684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.014713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.589 qpair failed and we were unable to recover it. 00:27:20.589 [2024-07-15 09:06:09.014908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.015034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.015058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.589 qpair failed and we were unable to recover it. 00:27:20.589 [2024-07-15 09:06:09.015185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.015331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.015355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.589 qpair failed and we were unable to recover it. 00:27:20.589 [2024-07-15 09:06:09.015526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.015636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.015661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.589 qpair failed and we were unable to recover it. 00:27:20.589 [2024-07-15 09:06:09.015776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.015937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.015962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.589 qpair failed and we were unable to recover it. 00:27:20.589 [2024-07-15 09:06:09.016107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.016262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.016286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.589 qpair failed and we were unable to recover it. 00:27:20.589 [2024-07-15 09:06:09.016438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.016577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.016601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.589 qpair failed and we were unable to recover it. 00:27:20.589 [2024-07-15 09:06:09.016798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.016933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.016958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.589 qpair failed and we were unable to recover it. 00:27:20.589 [2024-07-15 09:06:09.017110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.017281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.017312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.589 qpair failed and we were unable to recover it. 00:27:20.589 [2024-07-15 09:06:09.017510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.017677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.017704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.589 qpair failed and we were unable to recover it. 00:27:20.589 [2024-07-15 09:06:09.017885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.018025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.018050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.589 qpair failed and we were unable to recover it. 00:27:20.589 [2024-07-15 09:06:09.018229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.018369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.018393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.589 qpair failed and we were unable to recover it. 00:27:20.589 [2024-07-15 09:06:09.018542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.018663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.018690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.589 qpair failed and we were unable to recover it. 00:27:20.589 [2024-07-15 09:06:09.018898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.019040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.019064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.589 qpair failed and we were unable to recover it. 00:27:20.589 [2024-07-15 09:06:09.019177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.019310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.589 [2024-07-15 09:06:09.019334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.589 qpair failed and we were unable to recover it. 00:27:20.590 [2024-07-15 09:06:09.019482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.019622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.019646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.590 qpair failed and we were unable to recover it. 00:27:20.590 [2024-07-15 09:06:09.019815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.019963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.019989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.590 qpair failed and we were unable to recover it. 00:27:20.590 [2024-07-15 09:06:09.020105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.020253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.020277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.590 qpair failed and we were unable to recover it. 00:27:20.590 [2024-07-15 09:06:09.020414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.020553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.020576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.590 qpair failed and we were unable to recover it. 00:27:20.590 [2024-07-15 09:06:09.020762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.020908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.020933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.590 qpair failed and we were unable to recover it. 00:27:20.590 [2024-07-15 09:06:09.021063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.021209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.021234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.590 qpair failed and we were unable to recover it. 00:27:20.590 [2024-07-15 09:06:09.021401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.021553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.021577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.590 qpair failed and we were unable to recover it. 00:27:20.590 [2024-07-15 09:06:09.021748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.021924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.021949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.590 qpair failed and we were unable to recover it. 00:27:20.590 [2024-07-15 09:06:09.022095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.022224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.022249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.590 qpair failed and we were unable to recover it. 00:27:20.590 [2024-07-15 09:06:09.022415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.022533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.022558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.590 qpair failed and we were unable to recover it. 00:27:20.590 [2024-07-15 09:06:09.022732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.022930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.022955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.590 qpair failed and we were unable to recover it. 00:27:20.590 [2024-07-15 09:06:09.023077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.023197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.023222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.590 qpair failed and we were unable to recover it. 00:27:20.590 [2024-07-15 09:06:09.023370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.023483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.023508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.590 qpair failed and we were unable to recover it. 00:27:20.590 [2024-07-15 09:06:09.023627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.023795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.023819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.590 qpair failed and we were unable to recover it. 00:27:20.590 [2024-07-15 09:06:09.023971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.024115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.024139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.590 qpair failed and we were unable to recover it. 00:27:20.590 [2024-07-15 09:06:09.024259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.024402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.024425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.590 qpair failed and we were unable to recover it. 00:27:20.590 [2024-07-15 09:06:09.024582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.024748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.024772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.590 qpair failed and we were unable to recover it. 00:27:20.590 [2024-07-15 09:06:09.024895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.025009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.025034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.590 qpair failed and we were unable to recover it. 00:27:20.590 [2024-07-15 09:06:09.025175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.025350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.025375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.590 qpair failed and we were unable to recover it. 00:27:20.590 [2024-07-15 09:06:09.025537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.025699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.025723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.590 qpair failed and we were unable to recover it. 00:27:20.590 [2024-07-15 09:06:09.025874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.026008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.026034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.590 qpair failed and we were unable to recover it. 00:27:20.590 [2024-07-15 09:06:09.026180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.026356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.026380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.590 qpair failed and we were unable to recover it. 00:27:20.590 [2024-07-15 09:06:09.026512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.026626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.026652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.590 qpair failed and we were unable to recover it. 00:27:20.590 [2024-07-15 09:06:09.026768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.026906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.026931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.590 qpair failed and we were unable to recover it. 00:27:20.590 [2024-07-15 09:06:09.027100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.027226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.027249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.590 qpair failed and we were unable to recover it. 00:27:20.590 [2024-07-15 09:06:09.027414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.027542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.027568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.590 qpair failed and we were unable to recover it. 00:27:20.590 [2024-07-15 09:06:09.027738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.027907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.027933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.590 qpair failed and we were unable to recover it. 00:27:20.590 [2024-07-15 09:06:09.028078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.028224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.028248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.590 qpair failed and we were unable to recover it. 00:27:20.590 [2024-07-15 09:06:09.028415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.029050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.029084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.590 qpair failed and we were unable to recover it. 00:27:20.590 [2024-07-15 09:06:09.029265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.029457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.029485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.590 qpair failed and we were unable to recover it. 00:27:20.590 [2024-07-15 09:06:09.029620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.029793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.590 [2024-07-15 09:06:09.029818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.590 qpair failed and we were unable to recover it. 00:27:20.590 [2024-07-15 09:06:09.029971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.030116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.030141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.591 qpair failed and we were unable to recover it. 00:27:20.591 [2024-07-15 09:06:09.030355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.030522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.030547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.591 qpair failed and we were unable to recover it. 00:27:20.591 [2024-07-15 09:06:09.030689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.030870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.030902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.591 qpair failed and we were unable to recover it. 00:27:20.591 [2024-07-15 09:06:09.031049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.031166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.031191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.591 qpair failed and we were unable to recover it. 00:27:20.591 [2024-07-15 09:06:09.031300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.031467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.031495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.591 qpair failed and we were unable to recover it. 00:27:20.591 [2024-07-15 09:06:09.031633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.031778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.031803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.591 qpair failed and we were unable to recover it. 00:27:20.591 [2024-07-15 09:06:09.031946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.032053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.032078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.591 qpair failed and we were unable to recover it. 00:27:20.591 [2024-07-15 09:06:09.032214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.032372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.032400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.591 qpair failed and we were unable to recover it. 00:27:20.591 [2024-07-15 09:06:09.032522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.032653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.032680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.591 qpair failed and we were unable to recover it. 00:27:20.591 [2024-07-15 09:06:09.032801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.032993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.033018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.591 qpair failed and we were unable to recover it. 00:27:20.591 [2024-07-15 09:06:09.033157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.033303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.033329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.591 qpair failed and we were unable to recover it. 00:27:20.591 [2024-07-15 09:06:09.033449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.033565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.033589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.591 qpair failed and we were unable to recover it. 00:27:20.591 [2024-07-15 09:06:09.033736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.033885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.033914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.591 qpair failed and we were unable to recover it. 00:27:20.591 [2024-07-15 09:06:09.034083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.034228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.034252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.591 qpair failed and we were unable to recover it. 00:27:20.591 [2024-07-15 09:06:09.034395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.034540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.034563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.591 qpair failed and we were unable to recover it. 00:27:20.591 [2024-07-15 09:06:09.034754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.034899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.034925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.591 qpair failed and we were unable to recover it. 00:27:20.591 [2024-07-15 09:06:09.035046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.035185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.035209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.591 qpair failed and we were unable to recover it. 00:27:20.591 [2024-07-15 09:06:09.035331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.035469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.035493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.591 qpair failed and we were unable to recover it. 00:27:20.591 [2024-07-15 09:06:09.035688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.035813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.035836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.591 qpair failed and we were unable to recover it. 00:27:20.591 [2024-07-15 09:06:09.036000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.036136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.036161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.591 qpair failed and we were unable to recover it. 00:27:20.591 [2024-07-15 09:06:09.036312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.036456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.036480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.591 qpair failed and we were unable to recover it. 00:27:20.591 [2024-07-15 09:06:09.036598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.036720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.591 [2024-07-15 09:06:09.036746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.591 qpair failed and we were unable to recover it. 00:27:20.592 [2024-07-15 09:06:09.036891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.037040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.037064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.592 qpair failed and we were unable to recover it. 00:27:20.592 [2024-07-15 09:06:09.037177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.037320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.037344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.592 qpair failed and we were unable to recover it. 00:27:20.592 [2024-07-15 09:06:09.037531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.037701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.037725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.592 qpair failed and we were unable to recover it. 00:27:20.592 [2024-07-15 09:06:09.037868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.038015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.038040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.592 qpair failed and we were unable to recover it. 00:27:20.592 [2024-07-15 09:06:09.038179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.038301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.038326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.592 qpair failed and we were unable to recover it. 00:27:20.592 [2024-07-15 09:06:09.038499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.038644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.038667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.592 qpair failed and we were unable to recover it. 00:27:20.592 [2024-07-15 09:06:09.038826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.039004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.039029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.592 qpair failed and we were unable to recover it. 00:27:20.592 [2024-07-15 09:06:09.039150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.039276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.039301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.592 qpair failed and we were unable to recover it. 00:27:20.592 [2024-07-15 09:06:09.039443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.039581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.039610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.592 qpair failed and we were unable to recover it. 00:27:20.592 [2024-07-15 09:06:09.039768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.039923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.039962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.592 qpair failed and we were unable to recover it. 00:27:20.592 [2024-07-15 09:06:09.040075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.040254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.040279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.592 qpair failed and we were unable to recover it. 00:27:20.592 [2024-07-15 09:06:09.040455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.040619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.040648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.592 qpair failed and we were unable to recover it. 00:27:20.592 [2024-07-15 09:06:09.040781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.040919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.040960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.592 qpair failed and we were unable to recover it. 00:27:20.592 [2024-07-15 09:06:09.041088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.041225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.041248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.592 qpair failed and we were unable to recover it. 00:27:20.592 [2024-07-15 09:06:09.041397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.041552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.041576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.592 qpair failed and we were unable to recover it. 00:27:20.592 [2024-07-15 09:06:09.041723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.041871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.041901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.592 qpair failed and we were unable to recover it. 00:27:20.592 [2024-07-15 09:06:09.042012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.042145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.042170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.592 qpair failed and we were unable to recover it. 00:27:20.592 [2024-07-15 09:06:09.042314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.042455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.042480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.592 qpair failed and we were unable to recover it. 00:27:20.592 [2024-07-15 09:06:09.042595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.042759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.042783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.592 qpair failed and we were unable to recover it. 00:27:20.592 [2024-07-15 09:06:09.042935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.043110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.043134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.592 qpair failed and we were unable to recover it. 00:27:20.592 [2024-07-15 09:06:09.043278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.043481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.043505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.592 qpair failed and we were unable to recover it. 00:27:20.592 [2024-07-15 09:06:09.043651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.043766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.043790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.592 qpair failed and we were unable to recover it. 00:27:20.592 [2024-07-15 09:06:09.043941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.044110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.044134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.592 qpair failed and we were unable to recover it. 00:27:20.592 [2024-07-15 09:06:09.044284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.044480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.044509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.592 qpair failed and we were unable to recover it. 00:27:20.592 [2024-07-15 09:06:09.044656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.044772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.044796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.592 qpair failed and we were unable to recover it. 00:27:20.592 [2024-07-15 09:06:09.044928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.045067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.045091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.592 qpair failed and we were unable to recover it. 00:27:20.592 [2024-07-15 09:06:09.045223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.045423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.045447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.592 qpair failed and we were unable to recover it. 00:27:20.592 [2024-07-15 09:06:09.045587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.045729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.045752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.592 qpair failed and we were unable to recover it. 00:27:20.592 [2024-07-15 09:06:09.045896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.046066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.046090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.592 qpair failed and we were unable to recover it. 00:27:20.592 [2024-07-15 09:06:09.046264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.046416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.046442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.592 qpair failed and we were unable to recover it. 00:27:20.592 [2024-07-15 09:06:09.046649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.046769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.592 [2024-07-15 09:06:09.046792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.592 qpair failed and we were unable to recover it. 00:27:20.593 [2024-07-15 09:06:09.046933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.047055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.047079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.593 qpair failed and we were unable to recover it. 00:27:20.593 [2024-07-15 09:06:09.047241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.047420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.047444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.593 qpair failed and we were unable to recover it. 00:27:20.593 [2024-07-15 09:06:09.047588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.047724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.047748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.593 qpair failed and we were unable to recover it. 00:27:20.593 [2024-07-15 09:06:09.047894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.048036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.048059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.593 qpair failed and we were unable to recover it. 00:27:20.593 [2024-07-15 09:06:09.048243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.048420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.048445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.593 qpair failed and we were unable to recover it. 00:27:20.593 [2024-07-15 09:06:09.048593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.048732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.048757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.593 qpair failed and we were unable to recover it. 00:27:20.593 [2024-07-15 09:06:09.048903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.049060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.049083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.593 qpair failed and we were unable to recover it. 00:27:20.593 [2024-07-15 09:06:09.049205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.049323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.049347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.593 qpair failed and we were unable to recover it. 00:27:20.593 [2024-07-15 09:06:09.049496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.049606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.049629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.593 qpair failed and we were unable to recover it. 00:27:20.593 [2024-07-15 09:06:09.049785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.049962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.049987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.593 qpair failed and we were unable to recover it. 00:27:20.593 [2024-07-15 09:06:09.050108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.050231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.050256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.593 qpair failed and we were unable to recover it. 00:27:20.593 [2024-07-15 09:06:09.050414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.050571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.050598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.593 qpair failed and we were unable to recover it. 00:27:20.593 [2024-07-15 09:06:09.050759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.050873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.050904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.593 qpair failed and we were unable to recover it. 00:27:20.593 [2024-07-15 09:06:09.051059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.051198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.051225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.593 qpair failed and we were unable to recover it. 00:27:20.593 [2024-07-15 09:06:09.051400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.051574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.051598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.593 qpair failed and we were unable to recover it. 00:27:20.593 [2024-07-15 09:06:09.051771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.051922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.051948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.593 qpair failed and we were unable to recover it. 00:27:20.593 [2024-07-15 09:06:09.052098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.052250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.052274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.593 qpair failed and we were unable to recover it. 00:27:20.593 [2024-07-15 09:06:09.052440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.052594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.052620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.593 qpair failed and we were unable to recover it. 00:27:20.593 [2024-07-15 09:06:09.052785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.052934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.052958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.593 qpair failed and we were unable to recover it. 00:27:20.593 [2024-07-15 09:06:09.053105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.053273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.053299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.593 qpair failed and we were unable to recover it. 00:27:20.593 [2024-07-15 09:06:09.053428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.053579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.053606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.593 qpair failed and we were unable to recover it. 00:27:20.593 [2024-07-15 09:06:09.053745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.053902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.053927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.593 qpair failed and we were unable to recover it. 00:27:20.593 [2024-07-15 09:06:09.054058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.054198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.054222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.593 qpair failed and we were unable to recover it. 00:27:20.593 [2024-07-15 09:06:09.054402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.054564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.054591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.593 qpair failed and we were unable to recover it. 00:27:20.593 [2024-07-15 09:06:09.054754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.054901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.054927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.593 qpair failed and we were unable to recover it. 00:27:20.593 [2024-07-15 09:06:09.055072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.055255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.055279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.593 qpair failed and we were unable to recover it. 00:27:20.593 [2024-07-15 09:06:09.055425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.055535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.055559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.593 qpair failed and we were unable to recover it. 00:27:20.593 [2024-07-15 09:06:09.055701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.055848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.055873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.593 qpair failed and we were unable to recover it. 00:27:20.593 [2024-07-15 09:06:09.055998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.056108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.056133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.593 qpair failed and we were unable to recover it. 00:27:20.593 [2024-07-15 09:06:09.056275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.056405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.056434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.593 qpair failed and we were unable to recover it. 00:27:20.593 [2024-07-15 09:06:09.056596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.056790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.593 [2024-07-15 09:06:09.056817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.593 qpair failed and we were unable to recover it. 00:27:20.593 [2024-07-15 09:06:09.056967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.057137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.057161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.594 qpair failed and we were unable to recover it. 00:27:20.594 [2024-07-15 09:06:09.057332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.057508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.057550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.594 qpair failed and we were unable to recover it. 00:27:20.594 [2024-07-15 09:06:09.057685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.057880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.057908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.594 qpair failed and we were unable to recover it. 00:27:20.594 [2024-07-15 09:06:09.058067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.058236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.058263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.594 qpair failed and we were unable to recover it. 00:27:20.594 [2024-07-15 09:06:09.058414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.058554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.058578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.594 qpair failed and we were unable to recover it. 00:27:20.594 [2024-07-15 09:06:09.058729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.058842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.058866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.594 qpair failed and we were unable to recover it. 00:27:20.594 [2024-07-15 09:06:09.059000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.059146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.059171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.594 qpair failed and we were unable to recover it. 00:27:20.594 [2024-07-15 09:06:09.059313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.059471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.059497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.594 qpair failed and we were unable to recover it. 00:27:20.594 [2024-07-15 09:06:09.059622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.059763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.059787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.594 qpair failed and we were unable to recover it. 00:27:20.594 [2024-07-15 09:06:09.059933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.060043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.060068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.594 qpair failed and we were unable to recover it. 00:27:20.594 [2024-07-15 09:06:09.060239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.060388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.060413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.594 qpair failed and we were unable to recover it. 00:27:20.594 [2024-07-15 09:06:09.060526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.060674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.060699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.594 qpair failed and we were unable to recover it. 00:27:20.594 [2024-07-15 09:06:09.060868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.061026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.061054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.594 qpair failed and we were unable to recover it. 00:27:20.594 [2024-07-15 09:06:09.061223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.061329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.061353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.594 qpair failed and we were unable to recover it. 00:27:20.594 [2024-07-15 09:06:09.061474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.061586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.061610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.594 qpair failed and we were unable to recover it. 00:27:20.594 [2024-07-15 09:06:09.061780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.061932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.061957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.594 qpair failed and we were unable to recover it. 00:27:20.594 [2024-07-15 09:06:09.062115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.062319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.062344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.594 qpair failed and we were unable to recover it. 00:27:20.594 [2024-07-15 09:06:09.062500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.062677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.062701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.594 qpair failed and we were unable to recover it. 00:27:20.594 [2024-07-15 09:06:09.062852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.063044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.063069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.594 qpair failed and we were unable to recover it. 00:27:20.594 [2024-07-15 09:06:09.063185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.063339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.063366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.594 qpair failed and we were unable to recover it. 00:27:20.594 [2024-07-15 09:06:09.063507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.063648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.063673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.594 qpair failed and we were unable to recover it. 00:27:20.594 [2024-07-15 09:06:09.063847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.064032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.064056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.594 qpair failed and we were unable to recover it. 00:27:20.594 [2024-07-15 09:06:09.064167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.064374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.064399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.594 qpair failed and we were unable to recover it. 00:27:20.594 [2024-07-15 09:06:09.064525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.064643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.064667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.594 qpair failed and we were unable to recover it. 00:27:20.594 [2024-07-15 09:06:09.064838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.064994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.065019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.594 qpair failed and we were unable to recover it. 00:27:20.594 [2024-07-15 09:06:09.065159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.065324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.065350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.594 qpair failed and we were unable to recover it. 00:27:20.594 [2024-07-15 09:06:09.065513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.065680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.065704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.594 qpair failed and we were unable to recover it. 00:27:20.594 [2024-07-15 09:06:09.065845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.066016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.066041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.594 qpair failed and we were unable to recover it. 00:27:20.594 [2024-07-15 09:06:09.066152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.066270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.066312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.594 qpair failed and we were unable to recover it. 00:27:20.594 [2024-07-15 09:06:09.066480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.066624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.066648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.594 qpair failed and we were unable to recover it. 00:27:20.594 [2024-07-15 09:06:09.066793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.066945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.594 [2024-07-15 09:06:09.066970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.594 qpair failed and we were unable to recover it. 00:27:20.595 [2024-07-15 09:06:09.067107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.067251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.067276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.595 qpair failed and we were unable to recover it. 00:27:20.595 [2024-07-15 09:06:09.067423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.067540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.067564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.595 qpair failed and we were unable to recover it. 00:27:20.595 [2024-07-15 09:06:09.067719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.067836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.067859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.595 qpair failed and we were unable to recover it. 00:27:20.595 [2024-07-15 09:06:09.068027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.068169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.068192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.595 qpair failed and we were unable to recover it. 00:27:20.595 [2024-07-15 09:06:09.068341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.068458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.068482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.595 qpair failed and we were unable to recover it. 00:27:20.595 [2024-07-15 09:06:09.068593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.068745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.068772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.595 qpair failed and we were unable to recover it. 00:27:20.595 [2024-07-15 09:06:09.068940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.069062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.069087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.595 qpair failed and we were unable to recover it. 00:27:20.595 [2024-07-15 09:06:09.069214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.069400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.069426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.595 qpair failed and we were unable to recover it. 00:27:20.595 [2024-07-15 09:06:09.069569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.069703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.069730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.595 qpair failed and we were unable to recover it. 00:27:20.595 [2024-07-15 09:06:09.069936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.070075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.070099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.595 qpair failed and we were unable to recover it. 00:27:20.595 [2024-07-15 09:06:09.070230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.070351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.070376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.595 qpair failed and we were unable to recover it. 00:27:20.595 [2024-07-15 09:06:09.070554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.070698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.070721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.595 qpair failed and we were unable to recover it. 00:27:20.595 [2024-07-15 09:06:09.070840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.070969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.070994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.595 qpair failed and we were unable to recover it. 00:27:20.595 [2024-07-15 09:06:09.071109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.071279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.071303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.595 qpair failed and we were unable to recover it. 00:27:20.595 [2024-07-15 09:06:09.071446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.071585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.071610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.595 qpair failed and we were unable to recover it. 00:27:20.595 [2024-07-15 09:06:09.071738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.071898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.071924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.595 qpair failed and we were unable to recover it. 00:27:20.595 [2024-07-15 09:06:09.072042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.072160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.072195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.595 qpair failed and we were unable to recover it. 00:27:20.595 [2024-07-15 09:06:09.072339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.072477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.072503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.595 qpair failed and we were unable to recover it. 00:27:20.595 [2024-07-15 09:06:09.072696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.072840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.072864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.595 qpair failed and we were unable to recover it. 00:27:20.595 [2024-07-15 09:06:09.073090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.073226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.073250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.595 qpair failed and we were unable to recover it. 00:27:20.595 [2024-07-15 09:06:09.073419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.073604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.073628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.595 qpair failed and we were unable to recover it. 00:27:20.595 [2024-07-15 09:06:09.073797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.073943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.073968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.595 qpair failed and we were unable to recover it. 00:27:20.595 [2024-07-15 09:06:09.074115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.074237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.074265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.595 qpair failed and we were unable to recover it. 00:27:20.595 [2024-07-15 09:06:09.074404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.074622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.074649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.595 qpair failed and we were unable to recover it. 00:27:20.595 [2024-07-15 09:06:09.074798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.074964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.074989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.595 qpair failed and we were unable to recover it. 00:27:20.595 [2024-07-15 09:06:09.075113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.075281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.075323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.595 qpair failed and we were unable to recover it. 00:27:20.595 [2024-07-15 09:06:09.075528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.075698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.075738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.595 qpair failed and we were unable to recover it. 00:27:20.595 [2024-07-15 09:06:09.075868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.076040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.076065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.595 qpair failed and we were unable to recover it. 00:27:20.595 [2024-07-15 09:06:09.076204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.076344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.076369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.595 qpair failed and we were unable to recover it. 00:27:20.595 [2024-07-15 09:06:09.076511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.076648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.076674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.595 qpair failed and we were unable to recover it. 00:27:20.595 [2024-07-15 09:06:09.076805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.076950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.595 [2024-07-15 09:06:09.076975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.596 qpair failed and we were unable to recover it. 00:27:20.596 [2024-07-15 09:06:09.077101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.596 [2024-07-15 09:06:09.077268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.596 [2024-07-15 09:06:09.077291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.596 qpair failed and we were unable to recover it. 00:27:20.596 [2024-07-15 09:06:09.077410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.596 [2024-07-15 09:06:09.077574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.596 [2024-07-15 09:06:09.077606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.596 qpair failed and we were unable to recover it. 00:27:20.596 [2024-07-15 09:06:09.077763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.596 [2024-07-15 09:06:09.077916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.077958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.597 qpair failed and we were unable to recover it. 00:27:20.597 [2024-07-15 09:06:09.078081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.078198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.078224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.597 qpair failed and we were unable to recover it. 00:27:20.597 [2024-07-15 09:06:09.078382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.078533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.078560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.597 qpair failed and we were unable to recover it. 00:27:20.597 [2024-07-15 09:06:09.078717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.078901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.078942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.597 qpair failed and we were unable to recover it. 00:27:20.597 [2024-07-15 09:06:09.079065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.079192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.079216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.597 qpair failed and we were unable to recover it. 00:27:20.597 [2024-07-15 09:06:09.079423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.079563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.079587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.597 qpair failed and we were unable to recover it. 00:27:20.597 [2024-07-15 09:06:09.079709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.079889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.079917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.597 qpair failed and we were unable to recover it. 00:27:20.597 [2024-07-15 09:06:09.080108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.080304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.080348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.597 qpair failed and we were unable to recover it. 00:27:20.597 [2024-07-15 09:06:09.080567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.080754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.080780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.597 qpair failed and we were unable to recover it. 00:27:20.597 [2024-07-15 09:06:09.080913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.081076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.081101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.597 qpair failed and we were unable to recover it. 00:27:20.597 [2024-07-15 09:06:09.081274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.081437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.081464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.597 qpair failed and we were unable to recover it. 00:27:20.597 [2024-07-15 09:06:09.081620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.081782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.081808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.597 qpair failed and we were unable to recover it. 00:27:20.597 [2024-07-15 09:06:09.081954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.082123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.082147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.597 qpair failed and we were unable to recover it. 00:27:20.597 [2024-07-15 09:06:09.082332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.082473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.082513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.597 qpair failed and we were unable to recover it. 00:27:20.597 [2024-07-15 09:06:09.082671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.082836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.082860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.597 qpair failed and we were unable to recover it. 00:27:20.597 [2024-07-15 09:06:09.083007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.083120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.083144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.597 qpair failed and we were unable to recover it. 00:27:20.597 [2024-07-15 09:06:09.083271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.083388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.083413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.597 qpair failed and we were unable to recover it. 00:27:20.597 [2024-07-15 09:06:09.083556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.083707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.083734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.597 qpair failed and we were unable to recover it. 00:27:20.597 [2024-07-15 09:06:09.083862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.084011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.084035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.597 qpair failed and we were unable to recover it. 00:27:20.597 [2024-07-15 09:06:09.084186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.084327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.084351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.597 qpair failed and we were unable to recover it. 00:27:20.597 [2024-07-15 09:06:09.084520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.084660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.084689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.597 qpair failed and we were unable to recover it. 00:27:20.597 [2024-07-15 09:06:09.084852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.085017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.085041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.597 qpair failed and we were unable to recover it. 00:27:20.597 [2024-07-15 09:06:09.085190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.085304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.085329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.597 qpair failed and we were unable to recover it. 00:27:20.597 [2024-07-15 09:06:09.085496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.085654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.085681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.597 qpair failed and we were unable to recover it. 00:27:20.597 [2024-07-15 09:06:09.085834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.086014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.086038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.597 qpair failed and we were unable to recover it. 00:27:20.597 [2024-07-15 09:06:09.086160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.086324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.086370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.597 qpair failed and we were unable to recover it. 00:27:20.597 [2024-07-15 09:06:09.086538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.086748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.086775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.597 qpair failed and we were unable to recover it. 00:27:20.597 [2024-07-15 09:06:09.086967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.087108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.087134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.597 qpair failed and we were unable to recover it. 00:27:20.597 [2024-07-15 09:06:09.087318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.087462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.087486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.597 qpair failed and we were unable to recover it. 00:27:20.597 [2024-07-15 09:06:09.087649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.087800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.087827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.597 qpair failed and we were unable to recover it. 00:27:20.597 [2024-07-15 09:06:09.088000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.088120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.597 [2024-07-15 09:06:09.088161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.597 qpair failed and we were unable to recover it. 00:27:20.598 [2024-07-15 09:06:09.088349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.088463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.088487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.598 qpair failed and we were unable to recover it. 00:27:20.598 [2024-07-15 09:06:09.088598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.088757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.088784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.598 qpair failed and we were unable to recover it. 00:27:20.598 [2024-07-15 09:06:09.088962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.089119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.089144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.598 qpair failed and we were unable to recover it. 00:27:20.598 [2024-07-15 09:06:09.089319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.089500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.089527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.598 qpair failed and we were unable to recover it. 00:27:20.598 [2024-07-15 09:06:09.089684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.089834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.089861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.598 qpair failed and we were unable to recover it. 00:27:20.598 [2024-07-15 09:06:09.090004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.090161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.090188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.598 qpair failed and we were unable to recover it. 00:27:20.598 [2024-07-15 09:06:09.090345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.090506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.090530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.598 qpair failed and we were unable to recover it. 00:27:20.598 [2024-07-15 09:06:09.090708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.090874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.090911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.598 qpair failed and we were unable to recover it. 00:27:20.598 [2024-07-15 09:06:09.091033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.091204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.091228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.598 qpair failed and we were unable to recover it. 00:27:20.598 [2024-07-15 09:06:09.091399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.091514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.091559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.598 qpair failed and we were unable to recover it. 00:27:20.598 [2024-07-15 09:06:09.091746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.091901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.091929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.598 qpair failed and we were unable to recover it. 00:27:20.598 [2024-07-15 09:06:09.092087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.092259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.092283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.598 qpair failed and we were unable to recover it. 00:27:20.598 [2024-07-15 09:06:09.092426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.092619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.092676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.598 qpair failed and we were unable to recover it. 00:27:20.598 [2024-07-15 09:06:09.092811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.092944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.092973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.598 qpair failed and we were unable to recover it. 00:27:20.598 [2024-07-15 09:06:09.093137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.093268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.093291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.598 qpair failed and we were unable to recover it. 00:27:20.598 [2024-07-15 09:06:09.093426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.093568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.093591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.598 qpair failed and we were unable to recover it. 00:27:20.598 [2024-07-15 09:06:09.093759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.093918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.093946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.598 qpair failed and we were unable to recover it. 00:27:20.598 [2024-07-15 09:06:09.094078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.094229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.094256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.598 qpair failed and we were unable to recover it. 00:27:20.598 [2024-07-15 09:06:09.094429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.094547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.094570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.598 qpair failed and we were unable to recover it. 00:27:20.598 [2024-07-15 09:06:09.094733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.094865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.094897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.598 qpair failed and we were unable to recover it. 00:27:20.598 [2024-07-15 09:06:09.095085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.095268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.095326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.598 qpair failed and we were unable to recover it. 00:27:20.598 [2024-07-15 09:06:09.095473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.095612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.095636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.598 qpair failed and we were unable to recover it. 00:27:20.598 [2024-07-15 09:06:09.095836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.096019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.096047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.598 qpair failed and we were unable to recover it. 00:27:20.598 [2024-07-15 09:06:09.096218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.096337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.096361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.598 qpair failed and we were unable to recover it. 00:27:20.598 [2024-07-15 09:06:09.096534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.096651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.096691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.598 qpair failed and we were unable to recover it. 00:27:20.598 [2024-07-15 09:06:09.096897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.097080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.097106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.598 qpair failed and we were unable to recover it. 00:27:20.598 [2024-07-15 09:06:09.097260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.097428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.097452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.598 qpair failed and we were unable to recover it. 00:27:20.598 [2024-07-15 09:06:09.097628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.097764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.097789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.598 qpair failed and we were unable to recover it. 00:27:20.598 [2024-07-15 09:06:09.097980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.098103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.098127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.598 qpair failed and we were unable to recover it. 00:27:20.598 [2024-07-15 09:06:09.098286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.098436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.098463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.598 qpair failed and we were unable to recover it. 00:27:20.598 [2024-07-15 09:06:09.098625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.098741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.598 [2024-07-15 09:06:09.098767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.598 qpair failed and we were unable to recover it. 00:27:20.599 [2024-07-15 09:06:09.098961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.099080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.099107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.599 qpair failed and we were unable to recover it. 00:27:20.599 [2024-07-15 09:06:09.099270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.099384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.099411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.599 qpair failed and we were unable to recover it. 00:27:20.599 [2024-07-15 09:06:09.099567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.099677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.099701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.599 qpair failed and we were unable to recover it. 00:27:20.599 [2024-07-15 09:06:09.099866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.100043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.100068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.599 qpair failed and we were unable to recover it. 00:27:20.599 [2024-07-15 09:06:09.100219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.100362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.100389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.599 qpair failed and we were unable to recover it. 00:27:20.599 [2024-07-15 09:06:09.100544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.100697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.100724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.599 qpair failed and we were unable to recover it. 00:27:20.599 [2024-07-15 09:06:09.100902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.101059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.101086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.599 qpair failed and we were unable to recover it. 00:27:20.599 [2024-07-15 09:06:09.101258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.101373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.101397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.599 qpair failed and we were unable to recover it. 00:27:20.599 [2024-07-15 09:06:09.101540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.101704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.101731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.599 qpair failed and we were unable to recover it. 00:27:20.599 [2024-07-15 09:06:09.101891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.102035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.102059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.599 qpair failed and we were unable to recover it. 00:27:20.599 [2024-07-15 09:06:09.102195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.102307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.102333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.599 qpair failed and we were unable to recover it. 00:27:20.599 [2024-07-15 09:06:09.102482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.102628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.102654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.599 qpair failed and we were unable to recover it. 00:27:20.599 [2024-07-15 09:06:09.102864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.103038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.103078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.599 qpair failed and we were unable to recover it. 00:27:20.599 [2024-07-15 09:06:09.103258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.103379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.103403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.599 qpair failed and we were unable to recover it. 00:27:20.599 [2024-07-15 09:06:09.103522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.103679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.103707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.599 qpair failed and we were unable to recover it. 00:27:20.599 [2024-07-15 09:06:09.103865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.104033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.104060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.599 qpair failed and we were unable to recover it. 00:27:20.599 [2024-07-15 09:06:09.104218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.104365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.104390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.599 qpair failed and we were unable to recover it. 00:27:20.599 [2024-07-15 09:06:09.104562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.104717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.104741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.599 qpair failed and we were unable to recover it. 00:27:20.599 [2024-07-15 09:06:09.104959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.105121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.105149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.599 qpair failed and we were unable to recover it. 00:27:20.599 [2024-07-15 09:06:09.105305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.105467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.105492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.599 qpair failed and we were unable to recover it. 00:27:20.599 [2024-07-15 09:06:09.105674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.105796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.105823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.599 qpair failed and we were unable to recover it. 00:27:20.599 [2024-07-15 09:06:09.105989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.106138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.106172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.599 qpair failed and we were unable to recover it. 00:27:20.599 [2024-07-15 09:06:09.106355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.106472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.106496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.599 qpair failed and we were unable to recover it. 00:27:20.599 [2024-07-15 09:06:09.106644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.106804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.106831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.599 qpair failed and we were unable to recover it. 00:27:20.599 [2024-07-15 09:06:09.107006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.107140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.107168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.599 qpair failed and we were unable to recover it. 00:27:20.599 [2024-07-15 09:06:09.107358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.107492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.107516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.599 qpair failed and we were unable to recover it. 00:27:20.599 [2024-07-15 09:06:09.107687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.107872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.107907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.599 qpair failed and we were unable to recover it. 00:27:20.599 [2024-07-15 09:06:09.108036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.108204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.108231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.599 qpair failed and we were unable to recover it. 00:27:20.599 [2024-07-15 09:06:09.108391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.108532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.108556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.599 qpair failed and we were unable to recover it. 00:27:20.599 [2024-07-15 09:06:09.108732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.108872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.108906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.599 qpair failed and we were unable to recover it. 00:27:20.599 [2024-07-15 09:06:09.109028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.109161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.599 [2024-07-15 09:06:09.109187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.599 qpair failed and we were unable to recover it. 00:27:20.600 [2024-07-15 09:06:09.109348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.109487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.109527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.600 qpair failed and we were unable to recover it. 00:27:20.600 [2024-07-15 09:06:09.109677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.109799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.109827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.600 qpair failed and we were unable to recover it. 00:27:20.600 [2024-07-15 09:06:09.109986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.110145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.110171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.600 qpair failed and we were unable to recover it. 00:27:20.600 [2024-07-15 09:06:09.110360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.110539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.110565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.600 qpair failed and we were unable to recover it. 00:27:20.600 [2024-07-15 09:06:09.110689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.110843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.110869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.600 qpair failed and we were unable to recover it. 00:27:20.600 [2024-07-15 09:06:09.111062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.111192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.111218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.600 qpair failed and we were unable to recover it. 00:27:20.600 [2024-07-15 09:06:09.111344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.111487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.111511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.600 qpair failed and we were unable to recover it. 00:27:20.600 [2024-07-15 09:06:09.111658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.111772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.111797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.600 qpair failed and we were unable to recover it. 00:27:20.600 [2024-07-15 09:06:09.111969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.112082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.112107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.600 qpair failed and we were unable to recover it. 00:27:20.600 [2024-07-15 09:06:09.112235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.112341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.112366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.600 qpair failed and we were unable to recover it. 00:27:20.600 [2024-07-15 09:06:09.112539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.112704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.112730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.600 qpair failed and we were unable to recover it. 00:27:20.600 [2024-07-15 09:06:09.112883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.113014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.113041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.600 qpair failed and we were unable to recover it. 00:27:20.600 [2024-07-15 09:06:09.113179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.113323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.113347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.600 qpair failed and we were unable to recover it. 00:27:20.600 [2024-07-15 09:06:09.113513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.113638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.113666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.600 qpair failed and we were unable to recover it. 00:27:20.600 [2024-07-15 09:06:09.113817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.113972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.113998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.600 qpair failed and we were unable to recover it. 00:27:20.600 [2024-07-15 09:06:09.114129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.114273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.114297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.600 qpair failed and we were unable to recover it. 00:27:20.600 [2024-07-15 09:06:09.114447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.114606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.114631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.600 qpair failed and we were unable to recover it. 00:27:20.600 [2024-07-15 09:06:09.114740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.114868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.114902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.600 qpair failed and we were unable to recover it. 00:27:20.600 [2024-07-15 09:06:09.115086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.115237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.115262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.600 qpair failed and we were unable to recover it. 00:27:20.600 [2024-07-15 09:06:09.115403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.115541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.115566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.600 qpair failed and we were unable to recover it. 00:27:20.600 [2024-07-15 09:06:09.115714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.115826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.115851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.600 qpair failed and we were unable to recover it. 00:27:20.600 [2024-07-15 09:06:09.116021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.116145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.116169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.600 qpair failed and we were unable to recover it. 00:27:20.600 [2024-07-15 09:06:09.116298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.116439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.116465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.600 qpair failed and we were unable to recover it. 00:27:20.600 [2024-07-15 09:06:09.116580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.116723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.116748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.600 qpair failed and we were unable to recover it. 00:27:20.600 [2024-07-15 09:06:09.116916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.117059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.117083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.600 qpair failed and we were unable to recover it. 00:27:20.600 [2024-07-15 09:06:09.117234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.117377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.117402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.600 qpair failed and we were unable to recover it. 00:27:20.600 [2024-07-15 09:06:09.117526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.117675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.117700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.600 qpair failed and we were unable to recover it. 00:27:20.600 [2024-07-15 09:06:09.117854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.118005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.118030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.600 qpair failed and we were unable to recover it. 00:27:20.600 [2024-07-15 09:06:09.118152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.118269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.118295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.600 qpair failed and we were unable to recover it. 00:27:20.600 [2024-07-15 09:06:09.118430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.118572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.118596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.600 qpair failed and we were unable to recover it. 00:27:20.600 [2024-07-15 09:06:09.118737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.118855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.600 [2024-07-15 09:06:09.118888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.600 qpair failed and we were unable to recover it. 00:27:20.601 [2024-07-15 09:06:09.119036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.601 [2024-07-15 09:06:09.119149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.601 [2024-07-15 09:06:09.119174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.601 qpair failed and we were unable to recover it. 00:27:20.601 [2024-07-15 09:06:09.119322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.601 [2024-07-15 09:06:09.119439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.601 [2024-07-15 09:06:09.119463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.601 qpair failed and we were unable to recover it. 00:27:20.601 [2024-07-15 09:06:09.119580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.601 [2024-07-15 09:06:09.119722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.601 [2024-07-15 09:06:09.119746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.601 qpair failed and we were unable to recover it. 00:27:20.601 [2024-07-15 09:06:09.119869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.601 [2024-07-15 09:06:09.119997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.601 [2024-07-15 09:06:09.120021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.601 qpair failed and we were unable to recover it. 00:27:20.601 [2024-07-15 09:06:09.120166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.601 [2024-07-15 09:06:09.120279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.601 [2024-07-15 09:06:09.120303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.601 qpair failed and we were unable to recover it. 00:27:20.601 [2024-07-15 09:06:09.120451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.601 [2024-07-15 09:06:09.120591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.601 [2024-07-15 09:06:09.120615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.601 qpair failed and we were unable to recover it. 00:27:20.601 [2024-07-15 09:06:09.120733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.601 [2024-07-15 09:06:09.120849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.601 [2024-07-15 09:06:09.120874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.601 qpair failed and we were unable to recover it. 00:27:20.601 [2024-07-15 09:06:09.121000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.601 [2024-07-15 09:06:09.121106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.601 [2024-07-15 09:06:09.121130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.601 qpair failed and we were unable to recover it. 00:27:20.601 [2024-07-15 09:06:09.121240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.601 [2024-07-15 09:06:09.121381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.601 [2024-07-15 09:06:09.121410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.601 qpair failed and we were unable to recover it. 00:27:20.601 [2024-07-15 09:06:09.121559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.601 [2024-07-15 09:06:09.121677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.601 [2024-07-15 09:06:09.121702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.601 qpair failed and we were unable to recover it. 00:27:20.601 [2024-07-15 09:06:09.121819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.601 [2024-07-15 09:06:09.121981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.601 [2024-07-15 09:06:09.122006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.601 qpair failed and we were unable to recover it. 00:27:20.601 [2024-07-15 09:06:09.122148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.601 [2024-07-15 09:06:09.122288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.601 [2024-07-15 09:06:09.122312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.601 qpair failed and we were unable to recover it. 00:27:20.601 [2024-07-15 09:06:09.122433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.601 [2024-07-15 09:06:09.122599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.601 [2024-07-15 09:06:09.122623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.601 qpair failed and we were unable to recover it. 00:27:20.601 [2024-07-15 09:06:09.122791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.601 [2024-07-15 09:06:09.122931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.601 [2024-07-15 09:06:09.122957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.601 qpair failed and we were unable to recover it. 00:27:20.601 [2024-07-15 09:06:09.123106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.601 [2024-07-15 09:06:09.123270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.123294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.876 qpair failed and we were unable to recover it. 00:27:20.876 [2024-07-15 09:06:09.123441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.123560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.123585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.876 qpair failed and we were unable to recover it. 00:27:20.876 [2024-07-15 09:06:09.123735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.123884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.123908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.876 qpair failed and we were unable to recover it. 00:27:20.876 [2024-07-15 09:06:09.124068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.124187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.124211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.876 qpair failed and we were unable to recover it. 00:27:20.876 [2024-07-15 09:06:09.124330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.124441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.124469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.876 qpair failed and we were unable to recover it. 00:27:20.876 [2024-07-15 09:06:09.124637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.124749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.124773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.876 qpair failed and we were unable to recover it. 00:27:20.876 [2024-07-15 09:06:09.124938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.125082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.125107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.876 qpair failed and we were unable to recover it. 00:27:20.876 [2024-07-15 09:06:09.125259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.125376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.125399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.876 qpair failed and we were unable to recover it. 00:27:20.876 [2024-07-15 09:06:09.125539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.125681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.125706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.876 qpair failed and we were unable to recover it. 00:27:20.876 [2024-07-15 09:06:09.125854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.126021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.126046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.876 qpair failed and we were unable to recover it. 00:27:20.876 [2024-07-15 09:06:09.126189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.126333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.126357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.876 qpair failed and we were unable to recover it. 00:27:20.876 [2024-07-15 09:06:09.126481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.126632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.126655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.876 qpair failed and we were unable to recover it. 00:27:20.876 [2024-07-15 09:06:09.126797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.126940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.126965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.876 qpair failed and we were unable to recover it. 00:27:20.876 [2024-07-15 09:06:09.127108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.127225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.127248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.876 qpair failed and we were unable to recover it. 00:27:20.876 [2024-07-15 09:06:09.127420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.127537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.127560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.876 qpair failed and we were unable to recover it. 00:27:20.876 [2024-07-15 09:06:09.127711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.127824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.127849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.876 qpair failed and we were unable to recover it. 00:27:20.876 [2024-07-15 09:06:09.127971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.128103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.128128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.876 qpair failed and we were unable to recover it. 00:27:20.876 [2024-07-15 09:06:09.128278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.128419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.128443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.876 qpair failed and we were unable to recover it. 00:27:20.876 [2024-07-15 09:06:09.128587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.128702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.128725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.876 qpair failed and we were unable to recover it. 00:27:20.876 [2024-07-15 09:06:09.128841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.128960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.128985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.876 qpair failed and we were unable to recover it. 00:27:20.876 [2024-07-15 09:06:09.129126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.129274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.129298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.876 qpair failed and we were unable to recover it. 00:27:20.876 [2024-07-15 09:06:09.129440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.129552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.129576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.876 qpair failed and we were unable to recover it. 00:27:20.876 [2024-07-15 09:06:09.129709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.129851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.129895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.876 qpair failed and we were unable to recover it. 00:27:20.876 [2024-07-15 09:06:09.130019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.130162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.130186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.876 qpair failed and we were unable to recover it. 00:27:20.876 [2024-07-15 09:06:09.130326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.130465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.130488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.876 qpair failed and we were unable to recover it. 00:27:20.876 [2024-07-15 09:06:09.130633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.130760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.130786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.876 qpair failed and we were unable to recover it. 00:27:20.876 [2024-07-15 09:06:09.130969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.131080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.131104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.876 qpair failed and we were unable to recover it. 00:27:20.876 [2024-07-15 09:06:09.131278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.131390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.131414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.876 qpair failed and we were unable to recover it. 00:27:20.876 [2024-07-15 09:06:09.131554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.131668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.131693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.876 qpair failed and we were unable to recover it. 00:27:20.876 [2024-07-15 09:06:09.131874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.132020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.876 [2024-07-15 09:06:09.132045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.876 qpair failed and we were unable to recover it. 00:27:20.877 [2024-07-15 09:06:09.132157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.132297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.132321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.877 qpair failed and we were unable to recover it. 00:27:20.877 [2024-07-15 09:06:09.132443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.132567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.132591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.877 qpair failed and we were unable to recover it. 00:27:20.877 [2024-07-15 09:06:09.132712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.132855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.132884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.877 qpair failed and we were unable to recover it. 00:27:20.877 [2024-07-15 09:06:09.132997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.133116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.133140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.877 qpair failed and we were unable to recover it. 00:27:20.877 [2024-07-15 09:06:09.133270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.133421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.133445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.877 qpair failed and we were unable to recover it. 00:27:20.877 [2024-07-15 09:06:09.133585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.133729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.133753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.877 qpair failed and we were unable to recover it. 00:27:20.877 [2024-07-15 09:06:09.133894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.134037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.134061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.877 qpair failed and we were unable to recover it. 00:27:20.877 [2024-07-15 09:06:09.134195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.134337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.134361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.877 qpair failed and we were unable to recover it. 00:27:20.877 [2024-07-15 09:06:09.134531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.134641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.134665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.877 qpair failed and we were unable to recover it. 00:27:20.877 [2024-07-15 09:06:09.134832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.134977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.135002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.877 qpair failed and we were unable to recover it. 00:27:20.877 [2024-07-15 09:06:09.135121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.135263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.135288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.877 qpair failed and we were unable to recover it. 00:27:20.877 [2024-07-15 09:06:09.135402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.135513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.135538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.877 qpair failed and we were unable to recover it. 00:27:20.877 [2024-07-15 09:06:09.135660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.135796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.135820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.877 qpair failed and we were unable to recover it. 00:27:20.877 [2024-07-15 09:06:09.135972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.136114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.136139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.877 qpair failed and we were unable to recover it. 00:27:20.877 [2024-07-15 09:06:09.136284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.136448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.136472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.877 qpair failed and we were unable to recover it. 00:27:20.877 [2024-07-15 09:06:09.136615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.136758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.136787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.877 qpair failed and we were unable to recover it. 00:27:20.877 [2024-07-15 09:06:09.136956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.137100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.137124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.877 qpair failed and we were unable to recover it. 00:27:20.877 [2024-07-15 09:06:09.137290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.137404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.137428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.877 qpair failed and we were unable to recover it. 00:27:20.877 [2024-07-15 09:06:09.137574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.137743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.137767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.877 qpair failed and we were unable to recover it. 00:27:20.877 [2024-07-15 09:06:09.137939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.138084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.138109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.877 qpair failed and we were unable to recover it. 00:27:20.877 [2024-07-15 09:06:09.138263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.138413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.138437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.877 qpair failed and we were unable to recover it. 00:27:20.877 [2024-07-15 09:06:09.138577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.138718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.138742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.877 qpair failed and we were unable to recover it. 00:27:20.877 [2024-07-15 09:06:09.138887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.139058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.139082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.877 qpair failed and we were unable to recover it. 00:27:20.877 [2024-07-15 09:06:09.139219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.139330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.139354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.877 qpair failed and we were unable to recover it. 00:27:20.877 [2024-07-15 09:06:09.139494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.139630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.139654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.877 qpair failed and we were unable to recover it. 00:27:20.877 [2024-07-15 09:06:09.139778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.139921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.139946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.877 qpair failed and we were unable to recover it. 00:27:20.877 [2024-07-15 09:06:09.140100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.140230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.140253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.877 qpair failed and we were unable to recover it. 00:27:20.877 [2024-07-15 09:06:09.140392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.140562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.140585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.877 qpair failed and we were unable to recover it. 00:27:20.877 [2024-07-15 09:06:09.140729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.140873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.140904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.877 qpair failed and we were unable to recover it. 00:27:20.877 [2024-07-15 09:06:09.141044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.141184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.877 [2024-07-15 09:06:09.141208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.877 qpair failed and we were unable to recover it. 00:27:20.877 [2024-07-15 09:06:09.141348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.141486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.141511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.878 qpair failed and we were unable to recover it. 00:27:20.878 [2024-07-15 09:06:09.141657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.141777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.141802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.878 qpair failed and we were unable to recover it. 00:27:20.878 [2024-07-15 09:06:09.141914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.142061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.142084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.878 qpair failed and we were unable to recover it. 00:27:20.878 [2024-07-15 09:06:09.142227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.142344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.142367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.878 qpair failed and we were unable to recover it. 00:27:20.878 [2024-07-15 09:06:09.142511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.142627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.142651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.878 qpair failed and we were unable to recover it. 00:27:20.878 [2024-07-15 09:06:09.142797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.142961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.142986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.878 qpair failed and we were unable to recover it. 00:27:20.878 [2024-07-15 09:06:09.143158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.143301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.143324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.878 qpair failed and we were unable to recover it. 00:27:20.878 [2024-07-15 09:06:09.143471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.143590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.143632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.878 qpair failed and we were unable to recover it. 00:27:20.878 [2024-07-15 09:06:09.143793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.143993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.144018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.878 qpair failed and we were unable to recover it. 00:27:20.878 [2024-07-15 09:06:09.144160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.144346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.144369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.878 qpair failed and we were unable to recover it. 00:27:20.878 [2024-07-15 09:06:09.144526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.144670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.144709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.878 qpair failed and we were unable to recover it. 00:27:20.878 [2024-07-15 09:06:09.144886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.145005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.145029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.878 qpair failed and we were unable to recover it. 00:27:20.878 [2024-07-15 09:06:09.145184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.145308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.145335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.878 qpair failed and we were unable to recover it. 00:27:20.878 [2024-07-15 09:06:09.145525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.145737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.145763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.878 qpair failed and we were unable to recover it. 00:27:20.878 [2024-07-15 09:06:09.145909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.146051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.146076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.878 qpair failed and we were unable to recover it. 00:27:20.878 [2024-07-15 09:06:09.146269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.146453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.146479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.878 qpair failed and we were unable to recover it. 00:27:20.878 [2024-07-15 09:06:09.146621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.146787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.146813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.878 qpair failed and we were unable to recover it. 00:27:20.878 [2024-07-15 09:06:09.146959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.147080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.147105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.878 qpair failed and we were unable to recover it. 00:27:20.878 [2024-07-15 09:06:09.147253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.147427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.147469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.878 qpair failed and we were unable to recover it. 00:27:20.878 [2024-07-15 09:06:09.147629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.147787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.147813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.878 qpair failed and we were unable to recover it. 00:27:20.878 [2024-07-15 09:06:09.147979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.148098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.148122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.878 qpair failed and we were unable to recover it. 00:27:20.878 [2024-07-15 09:06:09.148268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.148415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.148440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.878 qpair failed and we were unable to recover it. 00:27:20.878 [2024-07-15 09:06:09.148576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.148741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.148782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.878 qpair failed and we were unable to recover it. 00:27:20.878 [2024-07-15 09:06:09.148907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.149067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.149091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.878 qpair failed and we were unable to recover it. 00:27:20.878 [2024-07-15 09:06:09.149267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.149436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.149460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.878 qpair failed and we were unable to recover it. 00:27:20.878 [2024-07-15 09:06:09.149624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.149757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.149783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.878 qpair failed and we were unable to recover it. 00:27:20.878 [2024-07-15 09:06:09.149940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.150085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.150109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.878 qpair failed and we were unable to recover it. 00:27:20.878 [2024-07-15 09:06:09.150295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.150461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.150512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.878 qpair failed and we were unable to recover it. 00:27:20.878 [2024-07-15 09:06:09.150671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.150805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.150831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.878 qpair failed and we were unable to recover it. 00:27:20.878 [2024-07-15 09:06:09.151064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.151187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.151212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.878 qpair failed and we were unable to recover it. 00:27:20.878 [2024-07-15 09:06:09.151355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.151534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.878 [2024-07-15 09:06:09.151575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.878 qpair failed and we were unable to recover it. 00:27:20.878 [2024-07-15 09:06:09.151712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.151891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.151916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.879 qpair failed and we were unable to recover it. 00:27:20.879 [2024-07-15 09:06:09.152026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.152139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.152180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.879 qpair failed and we were unable to recover it. 00:27:20.879 [2024-07-15 09:06:09.152361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.152532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.152572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.879 qpair failed and we were unable to recover it. 00:27:20.879 [2024-07-15 09:06:09.152744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.152921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.152946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.879 qpair failed and we were unable to recover it. 00:27:20.879 [2024-07-15 09:06:09.153067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.153235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.153259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.879 qpair failed and we were unable to recover it. 00:27:20.879 [2024-07-15 09:06:09.153425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.153556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.153587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.879 qpair failed and we were unable to recover it. 00:27:20.879 [2024-07-15 09:06:09.153746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.153912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.153952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.879 qpair failed and we were unable to recover it. 00:27:20.879 [2024-07-15 09:06:09.154080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.154204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.154227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.879 qpair failed and we were unable to recover it. 00:27:20.879 [2024-07-15 09:06:09.154406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.154543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.154567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.879 qpair failed and we were unable to recover it. 00:27:20.879 [2024-07-15 09:06:09.154709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.154889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.154917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.879 qpair failed and we were unable to recover it. 00:27:20.879 [2024-07-15 09:06:09.155051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.155159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.155183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.879 qpair failed and we were unable to recover it. 00:27:20.879 [2024-07-15 09:06:09.155331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.155443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.155467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.879 qpair failed and we were unable to recover it. 00:27:20.879 [2024-07-15 09:06:09.155628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.155809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.155836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.879 qpair failed and we were unable to recover it. 00:27:20.879 [2024-07-15 09:06:09.155987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.156151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.156176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.879 qpair failed and we were unable to recover it. 00:27:20.879 [2024-07-15 09:06:09.156320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.156491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.156517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.879 qpair failed and we were unable to recover it. 00:27:20.879 [2024-07-15 09:06:09.156681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.156823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.156847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.879 qpair failed and we were unable to recover it. 00:27:20.879 [2024-07-15 09:06:09.156983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.157127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.157151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.879 qpair failed and we were unable to recover it. 00:27:20.879 [2024-07-15 09:06:09.157325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.157509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.157532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.879 qpair failed and we were unable to recover it. 00:27:20.879 [2024-07-15 09:06:09.157678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.157843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.157869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.879 qpair failed and we were unable to recover it. 00:27:20.879 [2024-07-15 09:06:09.158053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.158194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.158218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.879 qpair failed and we were unable to recover it. 00:27:20.879 [2024-07-15 09:06:09.158363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.158510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.158533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.879 qpair failed and we were unable to recover it. 00:27:20.879 [2024-07-15 09:06:09.158650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.158817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.158840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.879 qpair failed and we were unable to recover it. 00:27:20.879 [2024-07-15 09:06:09.159019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.159150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.159177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.879 qpair failed and we were unable to recover it. 00:27:20.879 [2024-07-15 09:06:09.159328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.159486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.159511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.879 qpair failed and we were unable to recover it. 00:27:20.879 [2024-07-15 09:06:09.159682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.159823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.159846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.879 qpair failed and we were unable to recover it. 00:27:20.879 [2024-07-15 09:06:09.160013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.160131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.160155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.879 qpair failed and we were unable to recover it. 00:27:20.879 [2024-07-15 09:06:09.160278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.160474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.160502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.879 qpair failed and we were unable to recover it. 00:27:20.879 [2024-07-15 09:06:09.160647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.160819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.160843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.879 qpair failed and we were unable to recover it. 00:27:20.879 [2024-07-15 09:06:09.160998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.161170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.161194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.879 qpair failed and we were unable to recover it. 00:27:20.879 [2024-07-15 09:06:09.161313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.161456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.161480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.879 qpair failed and we were unable to recover it. 00:27:20.879 [2024-07-15 09:06:09.161596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.879 [2024-07-15 09:06:09.161735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.161758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.880 qpair failed and we were unable to recover it. 00:27:20.880 [2024-07-15 09:06:09.161896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.162041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.162064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.880 qpair failed and we were unable to recover it. 00:27:20.880 [2024-07-15 09:06:09.162187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.162356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.162379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.880 qpair failed and we were unable to recover it. 00:27:20.880 [2024-07-15 09:06:09.162553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.162721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.162748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.880 qpair failed and we were unable to recover it. 00:27:20.880 [2024-07-15 09:06:09.162887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.163013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.163039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.880 qpair failed and we were unable to recover it. 00:27:20.880 [2024-07-15 09:06:09.163179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.163298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.163321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.880 qpair failed and we were unable to recover it. 00:27:20.880 [2024-07-15 09:06:09.163434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.163603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.163627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.880 qpair failed and we were unable to recover it. 00:27:20.880 [2024-07-15 09:06:09.163754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.163888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.163916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.880 qpair failed and we were unable to recover it. 00:27:20.880 [2024-07-15 09:06:09.164047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.164176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.164201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.880 qpair failed and we were unable to recover it. 00:27:20.880 [2024-07-15 09:06:09.164396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.164563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.164587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.880 qpair failed and we were unable to recover it. 00:27:20.880 [2024-07-15 09:06:09.164754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.164887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.164915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.880 qpair failed and we were unable to recover it. 00:27:20.880 [2024-07-15 09:06:09.165049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.165206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.165233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.880 qpair failed and we were unable to recover it. 00:27:20.880 [2024-07-15 09:06:09.165492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.165634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.165660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.880 qpair failed and we were unable to recover it. 00:27:20.880 [2024-07-15 09:06:09.165823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.165969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.165994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.880 qpair failed and we were unable to recover it. 00:27:20.880 [2024-07-15 09:06:09.166138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.166278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.166302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.880 qpair failed and we were unable to recover it. 00:27:20.880 [2024-07-15 09:06:09.166457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.166580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.166606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.880 qpair failed and we were unable to recover it. 00:27:20.880 [2024-07-15 09:06:09.166737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.166936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.166965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.880 qpair failed and we were unable to recover it. 00:27:20.880 [2024-07-15 09:06:09.167112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.167261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.167285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.880 qpair failed and we were unable to recover it. 00:27:20.880 [2024-07-15 09:06:09.167425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.167606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.167632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.880 qpair failed and we were unable to recover it. 00:27:20.880 [2024-07-15 09:06:09.167774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.167935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.167962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.880 qpair failed and we were unable to recover it. 00:27:20.880 [2024-07-15 09:06:09.168134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.168251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.168275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.880 qpair failed and we were unable to recover it. 00:27:20.880 [2024-07-15 09:06:09.168451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.168629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.168653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.880 qpair failed and we were unable to recover it. 00:27:20.880 [2024-07-15 09:06:09.168819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.169036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.169061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.880 qpair failed and we were unable to recover it. 00:27:20.880 [2024-07-15 09:06:09.169205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.169394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.169421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.880 qpair failed and we were unable to recover it. 00:27:20.880 [2024-07-15 09:06:09.169603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.880 [2024-07-15 09:06:09.169823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.169847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.881 qpair failed and we were unable to recover it. 00:27:20.881 [2024-07-15 09:06:09.169977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.170122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.170146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.881 qpair failed and we were unable to recover it. 00:27:20.881 [2024-07-15 09:06:09.170266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.170446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.170474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.881 qpair failed and we were unable to recover it. 00:27:20.881 [2024-07-15 09:06:09.170644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.170782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.170808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.881 qpair failed and we were unable to recover it. 00:27:20.881 [2024-07-15 09:06:09.170944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.171132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.171156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.881 qpair failed and we were unable to recover it. 00:27:20.881 [2024-07-15 09:06:09.171299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.171415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.171439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.881 qpair failed and we were unable to recover it. 00:27:20.881 [2024-07-15 09:06:09.171580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.171773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.171797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.881 qpair failed and we were unable to recover it. 00:27:20.881 [2024-07-15 09:06:09.171917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.172084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.172108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.881 qpair failed and we were unable to recover it. 00:27:20.881 [2024-07-15 09:06:09.172322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.172466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.172490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.881 qpair failed and we were unable to recover it. 00:27:20.881 [2024-07-15 09:06:09.172636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.172759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.172783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.881 qpair failed and we were unable to recover it. 00:27:20.881 [2024-07-15 09:06:09.172895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.173031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.173060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.881 qpair failed and we were unable to recover it. 00:27:20.881 [2024-07-15 09:06:09.173181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.173363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.173390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.881 qpair failed and we were unable to recover it. 00:27:20.881 [2024-07-15 09:06:09.173521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.173665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.173689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.881 qpair failed and we were unable to recover it. 00:27:20.881 [2024-07-15 09:06:09.173805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.173926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.173951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.881 qpair failed and we were unable to recover it. 00:27:20.881 [2024-07-15 09:06:09.174081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.174202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.174229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.881 qpair failed and we were unable to recover it. 00:27:20.881 [2024-07-15 09:06:09.174391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.174533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.174557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.881 qpair failed and we were unable to recover it. 00:27:20.881 [2024-07-15 09:06:09.174746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.174895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.174923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.881 qpair failed and we were unable to recover it. 00:27:20.881 [2024-07-15 09:06:09.175088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.175236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.175278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.881 qpair failed and we were unable to recover it. 00:27:20.881 [2024-07-15 09:06:09.175429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.175590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.175617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.881 qpair failed and we were unable to recover it. 00:27:20.881 [2024-07-15 09:06:09.175744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.175873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.175907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.881 qpair failed and we were unable to recover it. 00:27:20.881 [2024-07-15 09:06:09.176098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.176282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.176328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.881 qpair failed and we were unable to recover it. 00:27:20.881 [2024-07-15 09:06:09.176457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.176627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.176652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.881 qpair failed and we were unable to recover it. 00:27:20.881 [2024-07-15 09:06:09.176797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.176999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.177027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.881 qpair failed and we were unable to recover it. 00:27:20.881 [2024-07-15 09:06:09.177226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.177366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.177390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.881 qpair failed and we were unable to recover it. 00:27:20.881 [2024-07-15 09:06:09.177536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.177740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.177767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.881 qpair failed and we were unable to recover it. 00:27:20.881 [2024-07-15 09:06:09.177909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.178025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.178049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.881 qpair failed and we were unable to recover it. 00:27:20.881 [2024-07-15 09:06:09.178201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.178386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.178412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.881 qpair failed and we were unable to recover it. 00:27:20.881 [2024-07-15 09:06:09.178583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.178748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.178775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.881 qpair failed and we were unable to recover it. 00:27:20.881 [2024-07-15 09:06:09.178935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.179145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.179169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.881 qpair failed and we were unable to recover it. 00:27:20.881 [2024-07-15 09:06:09.179307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.179494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.179520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.881 qpair failed and we were unable to recover it. 00:27:20.881 [2024-07-15 09:06:09.179707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.179864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.179898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.881 qpair failed and we were unable to recover it. 00:27:20.881 [2024-07-15 09:06:09.180034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.881 [2024-07-15 09:06:09.180189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.180216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.882 qpair failed and we were unable to recover it. 00:27:20.882 [2024-07-15 09:06:09.180367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.180626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.180675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.882 qpair failed and we were unable to recover it. 00:27:20.882 [2024-07-15 09:06:09.180820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.180946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.180971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.882 qpair failed and we were unable to recover it. 00:27:20.882 [2024-07-15 09:06:09.181139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.181331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.181355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.882 qpair failed and we were unable to recover it. 00:27:20.882 [2024-07-15 09:06:09.181491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.181622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.181648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.882 qpair failed and we were unable to recover it. 00:27:20.882 [2024-07-15 09:06:09.181803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.181936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.181964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.882 qpair failed and we were unable to recover it. 00:27:20.882 [2024-07-15 09:06:09.182132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.182276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.182318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.882 qpair failed and we were unable to recover it. 00:27:20.882 [2024-07-15 09:06:09.182511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.182651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.182674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.882 qpair failed and we were unable to recover it. 00:27:20.882 [2024-07-15 09:06:09.182871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.183039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.183066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.882 qpair failed and we were unable to recover it. 00:27:20.882 [2024-07-15 09:06:09.183289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.183541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.183592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.882 qpair failed and we were unable to recover it. 00:27:20.882 [2024-07-15 09:06:09.183730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.183845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.183869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.882 qpair failed and we were unable to recover it. 00:27:20.882 [2024-07-15 09:06:09.184073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.184274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.184324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.882 qpair failed and we were unable to recover it. 00:27:20.882 [2024-07-15 09:06:09.184509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.184640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.184670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.882 qpair failed and we were unable to recover it. 00:27:20.882 [2024-07-15 09:06:09.184830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.184997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.185027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.882 qpair failed and we were unable to recover it. 00:27:20.882 [2024-07-15 09:06:09.185226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.185382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.185408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.882 qpair failed and we were unable to recover it. 00:27:20.882 [2024-07-15 09:06:09.185590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.185771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.185798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.882 qpair failed and we were unable to recover it. 00:27:20.882 [2024-07-15 09:06:09.185952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.186084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.186110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.882 qpair failed and we were unable to recover it. 00:27:20.882 [2024-07-15 09:06:09.186270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.186506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.186568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.882 qpair failed and we were unable to recover it. 00:27:20.882 [2024-07-15 09:06:09.186757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.186891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.186932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.882 qpair failed and we were unable to recover it. 00:27:20.882 [2024-07-15 09:06:09.187065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.187200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.187226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.882 qpair failed and we were unable to recover it. 00:27:20.882 [2024-07-15 09:06:09.187409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.187560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.187587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.882 qpair failed and we were unable to recover it. 00:27:20.882 [2024-07-15 09:06:09.187771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.187908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.187935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.882 qpair failed and we were unable to recover it. 00:27:20.882 [2024-07-15 09:06:09.188131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.188238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.188277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.882 qpair failed and we were unable to recover it. 00:27:20.882 [2024-07-15 09:06:09.188420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.188544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.188570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.882 qpair failed and we were unable to recover it. 00:27:20.882 [2024-07-15 09:06:09.188706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.188859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.188891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.882 qpair failed and we were unable to recover it. 00:27:20.882 [2024-07-15 09:06:09.189057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.189198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.189223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.882 qpair failed and we were unable to recover it. 00:27:20.882 [2024-07-15 09:06:09.189365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.189474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.189498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.882 qpair failed and we were unable to recover it. 00:27:20.882 [2024-07-15 09:06:09.189639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.189779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.189803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.882 qpair failed and we were unable to recover it. 00:27:20.882 [2024-07-15 09:06:09.189983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.190122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.190149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.882 qpair failed and we were unable to recover it. 00:27:20.882 [2024-07-15 09:06:09.190302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.190489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.190516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.882 qpair failed and we were unable to recover it. 00:27:20.882 [2024-07-15 09:06:09.190678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.190863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.190897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.882 qpair failed and we were unable to recover it. 00:27:20.882 [2024-07-15 09:06:09.191058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.882 [2024-07-15 09:06:09.191185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.191211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.883 qpair failed and we were unable to recover it. 00:27:20.883 [2024-07-15 09:06:09.191388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.191553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.191583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.883 qpair failed and we were unable to recover it. 00:27:20.883 [2024-07-15 09:06:09.191759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.191909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.191935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.883 qpair failed and we were unable to recover it. 00:27:20.883 [2024-07-15 09:06:09.192091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.192245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.192285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.883 qpair failed and we were unable to recover it. 00:27:20.883 [2024-07-15 09:06:09.192422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.192569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.192595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.883 qpair failed and we were unable to recover it. 00:27:20.883 [2024-07-15 09:06:09.192750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.192951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.192981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.883 qpair failed and we were unable to recover it. 00:27:20.883 [2024-07-15 09:06:09.193123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.193265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.193310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.883 qpair failed and we were unable to recover it. 00:27:20.883 [2024-07-15 09:06:09.193502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.193617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.193656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.883 qpair failed and we were unable to recover it. 00:27:20.883 [2024-07-15 09:06:09.193816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.194007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.194034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.883 qpair failed and we were unable to recover it. 00:27:20.883 [2024-07-15 09:06:09.194199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.194325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.194352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.883 qpair failed and we were unable to recover it. 00:27:20.883 [2024-07-15 09:06:09.194515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.194658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.194681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.883 qpair failed and we were unable to recover it. 00:27:20.883 [2024-07-15 09:06:09.194828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.195013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.195040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.883 qpair failed and we were unable to recover it. 00:27:20.883 [2024-07-15 09:06:09.195178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.195331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.195358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.883 qpair failed and we were unable to recover it. 00:27:20.883 [2024-07-15 09:06:09.195494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.195649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.195675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.883 qpair failed and we were unable to recover it. 00:27:20.883 [2024-07-15 09:06:09.195872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.196021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.196045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.883 qpair failed and we were unable to recover it. 00:27:20.883 [2024-07-15 09:06:09.196164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.196306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.196329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.883 qpair failed and we were unable to recover it. 00:27:20.883 [2024-07-15 09:06:09.196497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.196688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.196712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.883 qpair failed and we were unable to recover it. 00:27:20.883 [2024-07-15 09:06:09.196858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.197002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.197029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.883 qpair failed and we were unable to recover it. 00:27:20.883 [2024-07-15 09:06:09.197164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.197325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.197353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.883 qpair failed and we were unable to recover it. 00:27:20.883 [2024-07-15 09:06:09.197531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.197668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.197708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.883 qpair failed and we were unable to recover it. 00:27:20.883 [2024-07-15 09:06:09.197840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.198017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.198045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.883 qpair failed and we were unable to recover it. 00:27:20.883 [2024-07-15 09:06:09.198228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.198458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.198510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.883 qpair failed and we were unable to recover it. 00:27:20.883 [2024-07-15 09:06:09.198674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.198794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.198818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.883 qpair failed and we were unable to recover it. 00:27:20.883 [2024-07-15 09:06:09.198987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.199099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.199139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.883 qpair failed and we were unable to recover it. 00:27:20.883 [2024-07-15 09:06:09.199300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.199456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.199482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.883 qpair failed and we were unable to recover it. 00:27:20.883 [2024-07-15 09:06:09.199645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.199828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.199855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.883 qpair failed and we were unable to recover it. 00:27:20.883 [2024-07-15 09:06:09.200023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.200164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.200191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.883 qpair failed and we were unable to recover it. 00:27:20.883 [2024-07-15 09:06:09.200388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.200501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.200540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.883 qpair failed and we were unable to recover it. 00:27:20.883 [2024-07-15 09:06:09.200697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.200849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.200883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.883 qpair failed and we were unable to recover it. 00:27:20.883 [2024-07-15 09:06:09.201051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.201203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.201229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.883 qpair failed and we were unable to recover it. 00:27:20.883 [2024-07-15 09:06:09.201413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.201570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.201597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.883 qpair failed and we were unable to recover it. 00:27:20.883 [2024-07-15 09:06:09.201779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.883 [2024-07-15 09:06:09.201960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.201988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.884 qpair failed and we were unable to recover it. 00:27:20.884 [2024-07-15 09:06:09.202149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.202284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.202316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.884 qpair failed and we were unable to recover it. 00:27:20.884 [2024-07-15 09:06:09.202480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.202610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.202637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.884 qpair failed and we were unable to recover it. 00:27:20.884 [2024-07-15 09:06:09.202778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.202931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.202961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.884 qpair failed and we were unable to recover it. 00:27:20.884 [2024-07-15 09:06:09.203127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.203282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.203323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.884 qpair failed and we were unable to recover it. 00:27:20.884 [2024-07-15 09:06:09.203487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.203642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.203670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.884 qpair failed and we were unable to recover it. 00:27:20.884 [2024-07-15 09:06:09.203822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.204001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.204028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.884 qpair failed and we were unable to recover it. 00:27:20.884 [2024-07-15 09:06:09.204211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.204411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.204460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.884 qpair failed and we were unable to recover it. 00:27:20.884 [2024-07-15 09:06:09.204630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.204782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.204807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.884 qpair failed and we were unable to recover it. 00:27:20.884 [2024-07-15 09:06:09.204935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.205075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.205100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.884 qpair failed and we were unable to recover it. 00:27:20.884 [2024-07-15 09:06:09.205234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.205359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.205384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.884 qpair failed and we were unable to recover it. 00:27:20.884 [2024-07-15 09:06:09.205580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.205769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.205795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.884 qpair failed and we were unable to recover it. 00:27:20.884 [2024-07-15 09:06:09.205978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.206123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.206147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.884 qpair failed and we were unable to recover it. 00:27:20.884 [2024-07-15 09:06:09.206319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.206481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.206513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.884 qpair failed and we were unable to recover it. 00:27:20.884 [2024-07-15 09:06:09.206708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.207171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.207206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.884 qpair failed and we were unable to recover it. 00:27:20.884 [2024-07-15 09:06:09.207399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.207523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.207548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.884 qpair failed and we were unable to recover it. 00:27:20.884 [2024-07-15 09:06:09.207693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.207887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.207916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.884 qpair failed and we were unable to recover it. 00:27:20.884 [2024-07-15 09:06:09.208098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.208299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.208355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.884 qpair failed and we were unable to recover it. 00:27:20.884 [2024-07-15 09:06:09.208529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.208672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.208695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.884 qpair failed and we were unable to recover it. 00:27:20.884 [2024-07-15 09:06:09.208870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.209018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.209042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.884 qpair failed and we were unable to recover it. 00:27:20.884 [2024-07-15 09:06:09.209178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.209373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.209401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.884 qpair failed and we were unable to recover it. 00:27:20.884 [2024-07-15 09:06:09.209599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.209755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.209782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.884 qpair failed and we were unable to recover it. 00:27:20.884 [2024-07-15 09:06:09.209969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.210156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.210194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.884 qpair failed and we were unable to recover it. 00:27:20.884 [2024-07-15 09:06:09.210453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.210732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.210787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.884 qpair failed and we were unable to recover it. 00:27:20.884 [2024-07-15 09:06:09.210941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.211086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.211111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.884 qpair failed and we were unable to recover it. 00:27:20.884 [2024-07-15 09:06:09.211298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.211477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.211505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.884 qpair failed and we were unable to recover it. 00:27:20.884 [2024-07-15 09:06:09.211687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.884 [2024-07-15 09:06:09.211841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.211868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.885 qpair failed and we were unable to recover it. 00:27:20.885 [2024-07-15 09:06:09.212046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.212202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.212229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.885 qpair failed and we were unable to recover it. 00:27:20.885 [2024-07-15 09:06:09.212364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.212507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.212531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.885 qpair failed and we were unable to recover it. 00:27:20.885 [2024-07-15 09:06:09.212673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.212821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.212848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.885 qpair failed and we were unable to recover it. 00:27:20.885 [2024-07-15 09:06:09.213032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.213179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.213204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.885 qpair failed and we were unable to recover it. 00:27:20.885 [2024-07-15 09:06:09.213416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.213617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.213644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.885 qpair failed and we were unable to recover it. 00:27:20.885 [2024-07-15 09:06:09.213808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.213977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.214003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.885 qpair failed and we were unable to recover it. 00:27:20.885 [2024-07-15 09:06:09.214149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.214298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.214325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.885 qpair failed and we were unable to recover it. 00:27:20.885 [2024-07-15 09:06:09.214481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.214638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.214664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.885 qpair failed and we were unable to recover it. 00:27:20.885 [2024-07-15 09:06:09.214799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.214996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.215024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.885 qpair failed and we were unable to recover it. 00:27:20.885 [2024-07-15 09:06:09.215217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.215383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.215409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.885 qpair failed and we were unable to recover it. 00:27:20.885 [2024-07-15 09:06:09.215565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.215715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.215742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.885 qpair failed and we were unable to recover it. 00:27:20.885 [2024-07-15 09:06:09.215898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.216061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.216087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.885 qpair failed and we were unable to recover it. 00:27:20.885 [2024-07-15 09:06:09.216253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.216444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.216472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.885 qpair failed and we were unable to recover it. 00:27:20.885 [2024-07-15 09:06:09.216614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.216737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.216761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.885 qpair failed and we were unable to recover it. 00:27:20.885 [2024-07-15 09:06:09.216899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.217073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.217097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.885 qpair failed and we were unable to recover it. 00:27:20.885 [2024-07-15 09:06:09.217213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.217408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.217445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.885 qpair failed and we were unable to recover it. 00:27:20.885 [2024-07-15 09:06:09.217571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.217728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.217756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.885 qpair failed and we were unable to recover it. 00:27:20.885 [2024-07-15 09:06:09.217916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.218045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.218069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.885 qpair failed and we were unable to recover it. 00:27:20.885 [2024-07-15 09:06:09.218216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.218430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.218472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.885 qpair failed and we were unable to recover it. 00:27:20.885 [2024-07-15 09:06:09.218627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.218774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.218801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.885 qpair failed and we were unable to recover it. 00:27:20.885 [2024-07-15 09:06:09.218963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.219127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.219154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.885 qpair failed and we were unable to recover it. 00:27:20.885 [2024-07-15 09:06:09.219355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.219471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.219510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.885 qpair failed and we were unable to recover it. 00:27:20.885 [2024-07-15 09:06:09.219667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.219837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.219862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.885 qpair failed and we were unable to recover it. 00:27:20.885 [2024-07-15 09:06:09.220062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.220208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.220235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.885 qpair failed and we were unable to recover it. 00:27:20.885 [2024-07-15 09:06:09.220367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.220499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.220525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.885 qpair failed and we were unable to recover it. 00:27:20.885 [2024-07-15 09:06:09.220692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.220831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.220859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.885 qpair failed and we were unable to recover it. 00:27:20.885 [2024-07-15 09:06:09.221067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.221188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.221212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.885 qpair failed and we were unable to recover it. 00:27:20.885 [2024-07-15 09:06:09.221379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.221535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.221564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.885 qpair failed and we were unable to recover it. 00:27:20.885 [2024-07-15 09:06:09.221740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.221892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.221920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.885 qpair failed and we were unable to recover it. 00:27:20.885 [2024-07-15 09:06:09.222074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.222226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.222249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.885 qpair failed and we were unable to recover it. 00:27:20.885 [2024-07-15 09:06:09.222417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.885 [2024-07-15 09:06:09.222574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.222601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.886 qpair failed and we were unable to recover it. 00:27:20.886 [2024-07-15 09:06:09.222753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.222907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.222936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.886 qpair failed and we were unable to recover it. 00:27:20.886 [2024-07-15 09:06:09.223100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.223261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.223287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.886 qpair failed and we were unable to recover it. 00:27:20.886 [2024-07-15 09:06:09.223450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.223590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.223614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.886 qpair failed and we were unable to recover it. 00:27:20.886 [2024-07-15 09:06:09.223789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.223951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.223979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.886 qpair failed and we were unable to recover it. 00:27:20.886 [2024-07-15 09:06:09.224104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.224229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.224256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.886 qpair failed and we were unable to recover it. 00:27:20.886 [2024-07-15 09:06:09.224459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.224627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.224651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.886 qpair failed and we were unable to recover it. 00:27:20.886 [2024-07-15 09:06:09.224766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.224911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.224937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.886 qpair failed and we were unable to recover it. 00:27:20.886 [2024-07-15 09:06:09.225077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.225213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.225240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.886 qpair failed and we were unable to recover it. 00:27:20.886 [2024-07-15 09:06:09.225395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.225558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.225583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.886 qpair failed and we were unable to recover it. 00:27:20.886 [2024-07-15 09:06:09.225755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.225907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.225960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.886 qpair failed and we were unable to recover it. 00:27:20.886 [2024-07-15 09:06:09.226094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.226214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.226238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.886 qpair failed and we were unable to recover it. 00:27:20.886 [2024-07-15 09:06:09.226391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.226510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.226536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.886 qpair failed and we were unable to recover it. 00:27:20.886 [2024-07-15 09:06:09.226690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.226852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.226884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.886 qpair failed and we were unable to recover it. 00:27:20.886 [2024-07-15 09:06:09.227020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.227184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.227207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.886 qpair failed and we were unable to recover it. 00:27:20.886 [2024-07-15 09:06:09.227346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.227464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.227488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.886 qpair failed and we were unable to recover it. 00:27:20.886 [2024-07-15 09:06:09.227630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.227819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.227844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.886 qpair failed and we were unable to recover it. 00:27:20.886 [2024-07-15 09:06:09.227997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.228116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.228140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.886 qpair failed and we were unable to recover it. 00:27:20.886 [2024-07-15 09:06:09.228306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.228484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.228510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.886 qpair failed and we were unable to recover it. 00:27:20.886 [2024-07-15 09:06:09.228702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.228882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.228924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.886 qpair failed and we were unable to recover it. 00:27:20.886 [2024-07-15 09:06:09.229079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.229200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.229225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.886 qpair failed and we were unable to recover it. 00:27:20.886 [2024-07-15 09:06:09.229356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.229482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.229506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.886 qpair failed and we were unable to recover it. 00:27:20.886 [2024-07-15 09:06:09.229655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.229832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.229858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.886 qpair failed and we were unable to recover it. 00:27:20.886 [2024-07-15 09:06:09.230047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.230206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.230230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.886 qpair failed and we were unable to recover it. 00:27:20.886 [2024-07-15 09:06:09.230351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.230497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.230521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.886 qpair failed and we were unable to recover it. 00:27:20.886 [2024-07-15 09:06:09.230639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.230813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.230838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.886 qpair failed and we were unable to recover it. 00:27:20.886 [2024-07-15 09:06:09.231002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.231130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.231155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.886 qpair failed and we were unable to recover it. 00:27:20.886 [2024-07-15 09:06:09.231338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.231463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.231487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.886 qpair failed and we were unable to recover it. 00:27:20.886 [2024-07-15 09:06:09.231626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.231782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.231807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.886 qpair failed and we were unable to recover it. 00:27:20.886 [2024-07-15 09:06:09.231992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.232106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.232130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.886 qpair failed and we were unable to recover it. 00:27:20.886 [2024-07-15 09:06:09.232307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.232447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.232471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.886 qpair failed and we were unable to recover it. 00:27:20.886 [2024-07-15 09:06:09.232597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.886 [2024-07-15 09:06:09.232769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.232793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.887 qpair failed and we were unable to recover it. 00:27:20.887 [2024-07-15 09:06:09.232945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.233065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.233088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.887 qpair failed and we were unable to recover it. 00:27:20.887 [2024-07-15 09:06:09.233243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.233363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.233387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.887 qpair failed and we were unable to recover it. 00:27:20.887 [2024-07-15 09:06:09.233538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.233672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.233696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.887 qpair failed and we were unable to recover it. 00:27:20.887 [2024-07-15 09:06:09.233818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.234000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.234026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.887 qpair failed and we were unable to recover it. 00:27:20.887 [2024-07-15 09:06:09.234194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.234320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.234347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.887 qpair failed and we were unable to recover it. 00:27:20.887 [2024-07-15 09:06:09.234470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.234591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.234614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.887 qpair failed and we were unable to recover it. 00:27:20.887 [2024-07-15 09:06:09.234733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.234901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.234926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.887 qpair failed and we were unable to recover it. 00:27:20.887 [2024-07-15 09:06:09.235051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.235200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.235224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.887 qpair failed and we were unable to recover it. 00:27:20.887 [2024-07-15 09:06:09.235365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.235528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.235552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.887 qpair failed and we were unable to recover it. 00:27:20.887 [2024-07-15 09:06:09.235674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.235787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.235811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.887 qpair failed and we were unable to recover it. 00:27:20.887 [2024-07-15 09:06:09.235930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.236071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.236094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.887 qpair failed and we were unable to recover it. 00:27:20.887 [2024-07-15 09:06:09.236212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.236377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.236401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.887 qpair failed and we were unable to recover it. 00:27:20.887 [2024-07-15 09:06:09.236519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.236660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.236685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.887 qpair failed and we were unable to recover it. 00:27:20.887 [2024-07-15 09:06:09.236801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.236960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.236985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.887 qpair failed and we were unable to recover it. 00:27:20.887 [2024-07-15 09:06:09.237133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.237273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.237297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.887 qpair failed and we were unable to recover it. 00:27:20.887 [2024-07-15 09:06:09.237447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.237590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.237614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.887 qpair failed and we were unable to recover it. 00:27:20.887 [2024-07-15 09:06:09.237760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.237910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.237935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.887 qpair failed and we were unable to recover it. 00:27:20.887 [2024-07-15 09:06:09.238110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.238238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.238262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.887 qpair failed and we were unable to recover it. 00:27:20.887 [2024-07-15 09:06:09.238399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.238521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.238546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.887 qpair failed and we were unable to recover it. 00:27:20.887 [2024-07-15 09:06:09.238661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.238800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.238824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.887 qpair failed and we were unable to recover it. 00:27:20.887 [2024-07-15 09:06:09.238970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.239116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.239140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.887 qpair failed and we were unable to recover it. 00:27:20.887 [2024-07-15 09:06:09.239290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.239404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.239428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.887 qpair failed and we were unable to recover it. 00:27:20.887 [2024-07-15 09:06:09.239599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.239764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.239789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.887 qpair failed and we were unable to recover it. 00:27:20.887 [2024-07-15 09:06:09.239954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.240081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.240106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.887 qpair failed and we were unable to recover it. 00:27:20.887 [2024-07-15 09:06:09.240260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.240399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.240423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.887 qpair failed and we were unable to recover it. 00:27:20.887 [2024-07-15 09:06:09.240576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.240712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.240736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.887 qpair failed and we were unable to recover it. 00:27:20.887 [2024-07-15 09:06:09.240917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.241071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.241096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.887 qpair failed and we were unable to recover it. 00:27:20.887 [2024-07-15 09:06:09.241272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.241441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.241464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.887 qpair failed and we were unable to recover it. 00:27:20.887 [2024-07-15 09:06:09.241635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.241798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.241823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.887 qpair failed and we were unable to recover it. 00:27:20.887 [2024-07-15 09:06:09.241954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.242104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.242129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.887 qpair failed and we were unable to recover it. 00:27:20.887 [2024-07-15 09:06:09.242245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.887 [2024-07-15 09:06:09.242396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.242420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.888 qpair failed and we were unable to recover it. 00:27:20.888 [2024-07-15 09:06:09.242565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.242708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.242732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.888 qpair failed and we were unable to recover it. 00:27:20.888 [2024-07-15 09:06:09.242847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.242988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.243012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.888 qpair failed and we were unable to recover it. 00:27:20.888 [2024-07-15 09:06:09.243131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.243255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.243279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.888 qpair failed and we were unable to recover it. 00:27:20.888 [2024-07-15 09:06:09.243421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.243541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.243565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.888 qpair failed and we were unable to recover it. 00:27:20.888 [2024-07-15 09:06:09.243709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.243864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.243896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.888 qpair failed and we were unable to recover it. 00:27:20.888 [2024-07-15 09:06:09.244049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.244225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.244248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.888 qpair failed and we were unable to recover it. 00:27:20.888 [2024-07-15 09:06:09.244392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.244533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.244556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.888 qpair failed and we were unable to recover it. 00:27:20.888 [2024-07-15 09:06:09.244696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.244852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.244883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.888 qpair failed and we were unable to recover it. 00:27:20.888 [2024-07-15 09:06:09.245013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.245165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.245189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.888 qpair failed and we were unable to recover it. 00:27:20.888 [2024-07-15 09:06:09.245307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.245475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.245498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.888 qpair failed and we were unable to recover it. 00:27:20.888 [2024-07-15 09:06:09.245653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.245795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.245819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.888 qpair failed and we were unable to recover it. 00:27:20.888 [2024-07-15 09:06:09.245959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.246096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.246120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.888 qpair failed and we were unable to recover it. 00:27:20.888 [2024-07-15 09:06:09.246250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.246416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.246440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.888 qpair failed and we were unable to recover it. 00:27:20.888 [2024-07-15 09:06:09.246558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.246681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.246705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.888 qpair failed and we were unable to recover it. 00:27:20.888 [2024-07-15 09:06:09.246824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.247001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.247026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.888 qpair failed and we were unable to recover it. 00:27:20.888 [2024-07-15 09:06:09.247195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.247339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.247363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.888 qpair failed and we were unable to recover it. 00:27:20.888 [2024-07-15 09:06:09.247482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.247646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.247670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.888 qpair failed and we were unable to recover it. 00:27:20.888 [2024-07-15 09:06:09.247839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.247989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.248014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.888 qpair failed and we were unable to recover it. 00:27:20.888 [2024-07-15 09:06:09.248167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.248285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.248309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.888 qpair failed and we were unable to recover it. 00:27:20.888 [2024-07-15 09:06:09.248467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.248589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.248613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.888 qpair failed and we were unable to recover it. 00:27:20.888 [2024-07-15 09:06:09.248782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.248929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.248954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.888 qpair failed and we were unable to recover it. 00:27:20.888 [2024-07-15 09:06:09.249071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.249234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.249258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.888 qpair failed and we were unable to recover it. 00:27:20.888 [2024-07-15 09:06:09.249377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.249543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.249567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.888 qpair failed and we were unable to recover it. 00:27:20.888 [2024-07-15 09:06:09.249711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.249850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.249895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.888 qpair failed and we were unable to recover it. 00:27:20.888 [2024-07-15 09:06:09.250032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.250153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.250181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.888 qpair failed and we were unable to recover it. 00:27:20.888 [2024-07-15 09:06:09.250323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.250437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.250462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.888 qpair failed and we were unable to recover it. 00:27:20.888 [2024-07-15 09:06:09.250601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.250771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.250796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.888 qpair failed and we were unable to recover it. 00:27:20.888 [2024-07-15 09:06:09.250946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.251065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.251089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.888 qpair failed and we were unable to recover it. 00:27:20.888 [2024-07-15 09:06:09.251256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.251373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.888 [2024-07-15 09:06:09.251399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.889 qpair failed and we were unable to recover it. 00:27:20.889 [2024-07-15 09:06:09.251573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.251714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.251738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.889 qpair failed and we were unable to recover it. 00:27:20.889 [2024-07-15 09:06:09.251900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.252021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.252046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.889 qpair failed and we were unable to recover it. 00:27:20.889 [2024-07-15 09:06:09.252191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.252334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.252359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.889 qpair failed and we were unable to recover it. 00:27:20.889 [2024-07-15 09:06:09.252508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.252647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.252672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.889 qpair failed and we were unable to recover it. 00:27:20.889 [2024-07-15 09:06:09.252831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.252944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.252969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.889 qpair failed and we were unable to recover it. 00:27:20.889 [2024-07-15 09:06:09.253115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.253232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.253257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.889 qpair failed and we were unable to recover it. 00:27:20.889 [2024-07-15 09:06:09.253381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.253502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.253526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.889 qpair failed and we were unable to recover it. 00:27:20.889 [2024-07-15 09:06:09.253652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.253789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.253813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.889 qpair failed and we were unable to recover it. 00:27:20.889 [2024-07-15 09:06:09.253956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.254101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.254126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.889 qpair failed and we were unable to recover it. 00:27:20.889 [2024-07-15 09:06:09.254251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.254367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.254392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.889 qpair failed and we were unable to recover it. 00:27:20.889 [2024-07-15 09:06:09.254563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.254678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.254720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.889 qpair failed and we were unable to recover it. 00:27:20.889 [2024-07-15 09:06:09.254906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.255054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.255078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.889 qpair failed and we were unable to recover it. 00:27:20.889 [2024-07-15 09:06:09.255220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.255386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.255410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.889 qpair failed and we were unable to recover it. 00:27:20.889 [2024-07-15 09:06:09.255520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.255652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.255676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.889 qpair failed and we were unable to recover it. 00:27:20.889 [2024-07-15 09:06:09.255824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.255980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.256004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.889 qpair failed and we were unable to recover it. 00:27:20.889 [2024-07-15 09:06:09.256119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.256269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.256293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.889 qpair failed and we were unable to recover it. 00:27:20.889 [2024-07-15 09:06:09.256436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.256566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.256593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.889 qpair failed and we were unable to recover it. 00:27:20.889 [2024-07-15 09:06:09.256762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.256993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.257017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.889 qpair failed and we were unable to recover it. 00:27:20.889 [2024-07-15 09:06:09.257163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.257317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.257344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.889 qpair failed and we were unable to recover it. 00:27:20.889 [2024-07-15 09:06:09.257491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.257635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.257659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.889 qpair failed and we were unable to recover it. 00:27:20.889 [2024-07-15 09:06:09.257830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.257978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.258002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.889 qpair failed and we were unable to recover it. 00:27:20.889 [2024-07-15 09:06:09.258124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.258268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.258292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.889 qpair failed and we were unable to recover it. 00:27:20.889 [2024-07-15 09:06:09.258474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.258617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.258644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.889 qpair failed and we were unable to recover it. 00:27:20.889 [2024-07-15 09:06:09.258785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.258943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.258968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.889 qpair failed and we were unable to recover it. 00:27:20.889 [2024-07-15 09:06:09.259086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.259231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.259254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.889 qpair failed and we were unable to recover it. 00:27:20.889 [2024-07-15 09:06:09.259371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.259518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.259545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.889 qpair failed and we were unable to recover it. 00:27:20.889 [2024-07-15 09:06:09.259719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.259847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.889 [2024-07-15 09:06:09.259874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.889 qpair failed and we were unable to recover it. 00:27:20.889 [2024-07-15 09:06:09.260059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.260201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.260226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.890 qpair failed and we were unable to recover it. 00:27:20.890 [2024-07-15 09:06:09.260337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.260480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.260507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.890 qpair failed and we were unable to recover it. 00:27:20.890 [2024-07-15 09:06:09.260667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.260800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.260826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.890 qpair failed and we were unable to recover it. 00:27:20.890 [2024-07-15 09:06:09.260977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.261117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.261142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.890 qpair failed and we were unable to recover it. 00:27:20.890 [2024-07-15 09:06:09.261299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.261441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.261464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.890 qpair failed and we were unable to recover it. 00:27:20.890 [2024-07-15 09:06:09.261617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.261760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.261783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.890 qpair failed and we were unable to recover it. 00:27:20.890 [2024-07-15 09:06:09.261961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.262106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.262131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.890 qpair failed and we were unable to recover it. 00:27:20.890 [2024-07-15 09:06:09.262247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.262416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.262443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.890 qpair failed and we were unable to recover it. 00:27:20.890 [2024-07-15 09:06:09.262587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.262724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.262748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.890 qpair failed and we were unable to recover it. 00:27:20.890 [2024-07-15 09:06:09.262874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.263018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.263046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.890 qpair failed and we were unable to recover it. 00:27:20.890 [2024-07-15 09:06:09.263163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.263306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.263330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.890 qpair failed and we were unable to recover it. 00:27:20.890 [2024-07-15 09:06:09.263477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.263609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.263638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.890 qpair failed and we were unable to recover it. 00:27:20.890 [2024-07-15 09:06:09.263797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.263919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.263944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.890 qpair failed and we were unable to recover it. 00:27:20.890 [2024-07-15 09:06:09.264057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.264199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.264223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.890 qpair failed and we were unable to recover it. 00:27:20.890 [2024-07-15 09:06:09.264367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.264509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.264533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.890 qpair failed and we were unable to recover it. 00:27:20.890 [2024-07-15 09:06:09.264652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.264762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.264786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.890 qpair failed and we were unable to recover it. 00:27:20.890 [2024-07-15 09:06:09.264931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.265073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.265098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.890 qpair failed and we were unable to recover it. 00:27:20.890 [2024-07-15 09:06:09.265243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.265418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.265443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.890 qpair failed and we were unable to recover it. 00:27:20.890 [2024-07-15 09:06:09.265629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.265786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.265813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.890 qpair failed and we were unable to recover it. 00:27:20.890 [2024-07-15 09:06:09.266004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.266114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.266143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.890 qpair failed and we were unable to recover it. 00:27:20.890 [2024-07-15 09:06:09.266262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.266401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.266424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.890 qpair failed and we were unable to recover it. 00:27:20.890 [2024-07-15 09:06:09.266614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.266759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.266784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.890 qpair failed and we were unable to recover it. 00:27:20.890 [2024-07-15 09:06:09.266962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.267082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.267107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.890 qpair failed and we were unable to recover it. 00:27:20.890 [2024-07-15 09:06:09.267224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.267362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.267387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.890 qpair failed and we were unable to recover it. 00:27:20.890 [2024-07-15 09:06:09.267532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.267674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.267698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.890 qpair failed and we were unable to recover it. 00:27:20.890 [2024-07-15 09:06:09.267841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.268019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.268045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.890 qpair failed and we were unable to recover it. 00:27:20.890 [2024-07-15 09:06:09.268197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.268339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.268364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.890 qpair failed and we were unable to recover it. 00:27:20.890 [2024-07-15 09:06:09.268512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.268647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.268672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.890 qpair failed and we were unable to recover it. 00:27:20.890 [2024-07-15 09:06:09.268825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.268938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.268963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.890 qpair failed and we were unable to recover it. 00:27:20.890 [2024-07-15 09:06:09.269128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.269298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.269323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.890 qpair failed and we were unable to recover it. 00:27:20.890 [2024-07-15 09:06:09.269456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.269582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.890 [2024-07-15 09:06:09.269606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.890 qpair failed and we were unable to recover it. 00:27:20.890 [2024-07-15 09:06:09.269755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.269937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.269963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.891 qpair failed and we were unable to recover it. 00:27:20.891 [2024-07-15 09:06:09.270130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.270276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.270300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.891 qpair failed and we were unable to recover it. 00:27:20.891 [2024-07-15 09:06:09.270446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.270566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.270590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.891 qpair failed and we were unable to recover it. 00:27:20.891 [2024-07-15 09:06:09.270734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.270843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.270867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.891 qpair failed and we were unable to recover it. 00:27:20.891 [2024-07-15 09:06:09.271003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.271145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.271169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.891 qpair failed and we were unable to recover it. 00:27:20.891 [2024-07-15 09:06:09.271312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.271422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.271446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.891 qpair failed and we were unable to recover it. 00:27:20.891 [2024-07-15 09:06:09.271591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.271709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.271734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.891 qpair failed and we were unable to recover it. 00:27:20.891 [2024-07-15 09:06:09.271881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.272026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.272050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.891 qpair failed and we were unable to recover it. 00:27:20.891 [2024-07-15 09:06:09.272194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.272316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.272341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.891 qpair failed and we were unable to recover it. 00:27:20.891 [2024-07-15 09:06:09.272464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.272603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.272628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.891 qpair failed and we were unable to recover it. 00:27:20.891 [2024-07-15 09:06:09.272778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.272922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.272946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.891 qpair failed and we were unable to recover it. 00:27:20.891 [2024-07-15 09:06:09.273059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.273186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.273210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.891 qpair failed and we were unable to recover it. 00:27:20.891 [2024-07-15 09:06:09.273337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.273483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.273508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.891 qpair failed and we were unable to recover it. 00:27:20.891 [2024-07-15 09:06:09.273618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.273733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.273758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.891 qpair failed and we were unable to recover it. 00:27:20.891 [2024-07-15 09:06:09.273929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.274042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.274067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.891 qpair failed and we were unable to recover it. 00:27:20.891 [2024-07-15 09:06:09.274186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.274324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.274348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.891 qpair failed and we were unable to recover it. 00:27:20.891 [2024-07-15 09:06:09.274462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.274588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.274612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.891 qpair failed and we were unable to recover it. 00:27:20.891 [2024-07-15 09:06:09.274753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.274884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.274908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.891 qpair failed and we were unable to recover it. 00:27:20.891 [2024-07-15 09:06:09.275043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.275189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.275213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.891 qpair failed and we were unable to recover it. 00:27:20.891 [2024-07-15 09:06:09.275330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.275451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.275475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.891 qpair failed and we were unable to recover it. 00:27:20.891 [2024-07-15 09:06:09.275601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.275739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.275763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.891 qpair failed and we were unable to recover it. 00:27:20.891 [2024-07-15 09:06:09.275912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.276032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.276056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.891 qpair failed and we were unable to recover it. 00:27:20.891 [2024-07-15 09:06:09.276223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.276341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.276365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.891 qpair failed and we were unable to recover it. 00:27:20.891 [2024-07-15 09:06:09.276505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.276661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.276685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.891 qpair failed and we were unable to recover it. 00:27:20.891 [2024-07-15 09:06:09.276806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.276948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.276973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.891 qpair failed and we were unable to recover it. 00:27:20.891 [2024-07-15 09:06:09.277091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.277233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.277257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.891 qpair failed and we were unable to recover it. 00:27:20.891 [2024-07-15 09:06:09.277374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.277494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.277518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.891 qpair failed and we were unable to recover it. 00:27:20.891 [2024-07-15 09:06:09.277644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.277764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.277789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.891 qpair failed and we were unable to recover it. 00:27:20.891 [2024-07-15 09:06:09.277935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.278047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.278071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.891 qpair failed and we were unable to recover it. 00:27:20.891 [2024-07-15 09:06:09.278196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.278316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.278345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.891 qpair failed and we were unable to recover it. 00:27:20.891 [2024-07-15 09:06:09.278516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.278657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.891 [2024-07-15 09:06:09.278682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.891 qpair failed and we were unable to recover it. 00:27:20.891 [2024-07-15 09:06:09.278801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.278943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.278968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.892 qpair failed and we were unable to recover it. 00:27:20.892 [2024-07-15 09:06:09.279089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.279227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.279252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.892 qpair failed and we were unable to recover it. 00:27:20.892 [2024-07-15 09:06:09.279392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.279528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.279553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.892 qpair failed and we were unable to recover it. 00:27:20.892 [2024-07-15 09:06:09.279695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.279833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.279857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.892 qpair failed and we were unable to recover it. 00:27:20.892 [2024-07-15 09:06:09.279979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.280089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.280113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.892 qpair failed and we were unable to recover it. 00:27:20.892 [2024-07-15 09:06:09.280254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.280423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.280447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.892 qpair failed and we were unable to recover it. 00:27:20.892 [2024-07-15 09:06:09.280568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.280711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.280735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.892 qpair failed and we were unable to recover it. 00:27:20.892 [2024-07-15 09:06:09.280855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.280978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.281003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.892 qpair failed and we were unable to recover it. 00:27:20.892 [2024-07-15 09:06:09.281115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.281258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.281283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.892 qpair failed and we were unable to recover it. 00:27:20.892 [2024-07-15 09:06:09.281428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.281572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.281598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.892 qpair failed and we were unable to recover it. 00:27:20.892 [2024-07-15 09:06:09.281771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.281921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.281946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.892 qpair failed and we were unable to recover it. 00:27:20.892 [2024-07-15 09:06:09.282120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.282261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.282286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.892 qpair failed and we were unable to recover it. 00:27:20.892 [2024-07-15 09:06:09.282398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.282538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.282563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.892 qpair failed and we were unable to recover it. 00:27:20.892 [2024-07-15 09:06:09.282683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.282798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.282822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.892 qpair failed and we were unable to recover it. 00:27:20.892 [2024-07-15 09:06:09.282945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.283091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.283116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.892 qpair failed and we were unable to recover it. 00:27:20.892 [2024-07-15 09:06:09.283224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.283341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.283365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.892 qpair failed and we were unable to recover it. 00:27:20.892 [2024-07-15 09:06:09.283507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.283618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.283643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.892 qpair failed and we were unable to recover it. 00:27:20.892 [2024-07-15 09:06:09.283767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.283912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.283937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.892 qpair failed and we were unable to recover it. 00:27:20.892 [2024-07-15 09:06:09.284063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.284184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.284209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.892 qpair failed and we were unable to recover it. 00:27:20.892 [2024-07-15 09:06:09.284342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.284483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.284507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.892 qpair failed and we were unable to recover it. 00:27:20.892 [2024-07-15 09:06:09.284653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.284797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.284821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.892 qpair failed and we were unable to recover it. 00:27:20.892 [2024-07-15 09:06:09.284965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.285085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.285109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.892 qpair failed and we were unable to recover it. 00:27:20.892 [2024-07-15 09:06:09.285229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.285372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.285396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.892 qpair failed and we were unable to recover it. 00:27:20.892 [2024-07-15 09:06:09.285536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.285679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.285703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.892 qpair failed and we were unable to recover it. 00:27:20.892 [2024-07-15 09:06:09.285849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.285976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.286000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.892 qpair failed and we were unable to recover it. 00:27:20.892 [2024-07-15 09:06:09.286125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.286292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.286317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.892 qpair failed and we were unable to recover it. 00:27:20.892 [2024-07-15 09:06:09.286482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.286647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.286672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.892 qpair failed and we were unable to recover it. 00:27:20.892 [2024-07-15 09:06:09.286814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.286941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.286967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.892 qpair failed and we were unable to recover it. 00:27:20.892 [2024-07-15 09:06:09.287108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.287244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.287269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.892 qpair failed and we were unable to recover it. 00:27:20.892 [2024-07-15 09:06:09.287380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.287489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.287514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.892 qpair failed and we were unable to recover it. 00:27:20.892 [2024-07-15 09:06:09.287631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.287750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.287776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.892 qpair failed and we were unable to recover it. 00:27:20.892 [2024-07-15 09:06:09.287921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.892 [2024-07-15 09:06:09.288053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.288078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.893 qpair failed and we were unable to recover it. 00:27:20.893 [2024-07-15 09:06:09.288217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.288357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.288381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.893 qpair failed and we were unable to recover it. 00:27:20.893 [2024-07-15 09:06:09.288507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.288651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.288675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.893 qpair failed and we were unable to recover it. 00:27:20.893 [2024-07-15 09:06:09.288793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.288912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.288938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.893 qpair failed and we were unable to recover it. 00:27:20.893 [2024-07-15 09:06:09.289063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.289207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.289231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.893 qpair failed and we were unable to recover it. 00:27:20.893 [2024-07-15 09:06:09.289378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.289499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.289523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.893 qpair failed and we were unable to recover it. 00:27:20.893 [2024-07-15 09:06:09.289641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.289759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.289783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.893 qpair failed and we were unable to recover it. 00:27:20.893 [2024-07-15 09:06:09.289902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.290036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.290059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.893 qpair failed and we were unable to recover it. 00:27:20.893 [2024-07-15 09:06:09.290208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.290350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.290374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.893 qpair failed and we were unable to recover it. 00:27:20.893 [2024-07-15 09:06:09.290497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.290655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.290683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.893 qpair failed and we were unable to recover it. 00:27:20.893 [2024-07-15 09:06:09.290853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.290981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.291005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.893 qpair failed and we were unable to recover it. 00:27:20.893 [2024-07-15 09:06:09.291153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.291262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.291287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.893 qpair failed and we were unable to recover it. 00:27:20.893 [2024-07-15 09:06:09.291432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.291599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.291623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.893 qpair failed and we were unable to recover it. 00:27:20.893 [2024-07-15 09:06:09.291763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.291953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.291977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.893 qpair failed and we were unable to recover it. 00:27:20.893 [2024-07-15 09:06:09.292102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.292220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.292244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.893 qpair failed and we were unable to recover it. 00:27:20.893 [2024-07-15 09:06:09.292386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.292537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.292577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.893 qpair failed and we were unable to recover it. 00:27:20.893 [2024-07-15 09:06:09.292734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.292905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.292930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.893 qpair failed and we were unable to recover it. 00:27:20.893 [2024-07-15 09:06:09.293106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.293225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.293249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.893 qpair failed and we were unable to recover it. 00:27:20.893 [2024-07-15 09:06:09.293396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.293507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.293535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.893 qpair failed and we were unable to recover it. 00:27:20.893 [2024-07-15 09:06:09.293678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.293826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.293850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.893 qpair failed and we were unable to recover it. 00:27:20.893 [2024-07-15 09:06:09.293982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.294096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.294120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.893 qpair failed and we were unable to recover it. 00:27:20.893 [2024-07-15 09:06:09.294261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.294401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.294425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.893 qpair failed and we were unable to recover it. 00:27:20.893 [2024-07-15 09:06:09.294636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.294768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.294795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.893 qpair failed and we were unable to recover it. 00:27:20.893 [2024-07-15 09:06:09.294968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.295084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.295108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.893 qpair failed and we were unable to recover it. 00:27:20.893 [2024-07-15 09:06:09.295247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.295398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.295425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.893 qpair failed and we were unable to recover it. 00:27:20.893 [2024-07-15 09:06:09.295584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.295717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.295742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.893 qpair failed and we were unable to recover it. 00:27:20.893 [2024-07-15 09:06:09.295889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.296046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.893 [2024-07-15 09:06:09.296070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.894 qpair failed and we were unable to recover it. 00:27:20.894 [2024-07-15 09:06:09.296213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.296357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.296381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.894 qpair failed and we were unable to recover it. 00:27:20.894 [2024-07-15 09:06:09.296550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.296719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.296743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.894 qpair failed and we were unable to recover it. 00:27:20.894 [2024-07-15 09:06:09.296926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.297057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.297082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.894 qpair failed and we were unable to recover it. 00:27:20.894 [2024-07-15 09:06:09.297243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.297371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.297398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.894 qpair failed and we were unable to recover it. 00:27:20.894 [2024-07-15 09:06:09.297526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.297645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.297669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.894 qpair failed and we were unable to recover it. 00:27:20.894 [2024-07-15 09:06:09.297814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.297930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.297954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.894 qpair failed and we were unable to recover it. 00:27:20.894 [2024-07-15 09:06:09.298087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.298249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.298275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.894 qpair failed and we were unable to recover it. 00:27:20.894 [2024-07-15 09:06:09.298455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.298583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.298612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.894 qpair failed and we were unable to recover it. 00:27:20.894 [2024-07-15 09:06:09.298800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.298947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.298972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.894 qpair failed and we were unable to recover it. 00:27:20.894 [2024-07-15 09:06:09.299139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.299304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.299331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.894 qpair failed and we were unable to recover it. 00:27:20.894 [2024-07-15 09:06:09.299498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.299643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.299673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.894 qpair failed and we were unable to recover it. 00:27:20.894 [2024-07-15 09:06:09.299832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.299972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.299996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.894 qpair failed and we were unable to recover it. 00:27:20.894 [2024-07-15 09:06:09.300174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.300381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.300408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.894 qpair failed and we were unable to recover it. 00:27:20.894 [2024-07-15 09:06:09.300547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.300700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.300727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.894 qpair failed and we were unable to recover it. 00:27:20.894 [2024-07-15 09:06:09.300892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.301048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.301072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.894 qpair failed and we were unable to recover it. 00:27:20.894 [2024-07-15 09:06:09.301188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.301304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.301328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.894 qpair failed and we were unable to recover it. 00:27:20.894 [2024-07-15 09:06:09.301465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.301620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.301644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.894 qpair failed and we were unable to recover it. 00:27:20.894 [2024-07-15 09:06:09.301831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.301975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.302000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.894 qpair failed and we were unable to recover it. 00:27:20.894 [2024-07-15 09:06:09.302124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.302269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.302293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.894 qpair failed and we were unable to recover it. 00:27:20.894 [2024-07-15 09:06:09.302406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.302519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.302543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.894 qpair failed and we were unable to recover it. 00:27:20.894 [2024-07-15 09:06:09.302696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.302867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.302897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.894 qpair failed and we were unable to recover it. 00:27:20.894 [2024-07-15 09:06:09.303018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.303162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.303187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.894 qpair failed and we were unable to recover it. 00:27:20.894 [2024-07-15 09:06:09.303305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.303466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.303493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.894 qpair failed and we were unable to recover it. 00:27:20.894 [2024-07-15 09:06:09.303625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.303791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.303815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.894 qpair failed and we were unable to recover it. 00:27:20.894 [2024-07-15 09:06:09.303931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.304100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.304124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.894 qpair failed and we were unable to recover it. 00:27:20.894 [2024-07-15 09:06:09.304240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.304354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.304379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.894 qpair failed and we were unable to recover it. 00:27:20.894 [2024-07-15 09:06:09.304528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.304639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.304663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.894 qpair failed and we were unable to recover it. 00:27:20.894 [2024-07-15 09:06:09.304772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.304938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.304963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.894 qpair failed and we were unable to recover it. 00:27:20.894 [2024-07-15 09:06:09.305085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.305198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.305221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.894 qpair failed and we were unable to recover it. 00:27:20.894 [2024-07-15 09:06:09.305360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.305505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.305529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.894 qpair failed and we were unable to recover it. 00:27:20.894 [2024-07-15 09:06:09.305684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.894 [2024-07-15 09:06:09.305797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.305822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.895 qpair failed and we were unable to recover it. 00:27:20.895 [2024-07-15 09:06:09.305968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.306088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.306112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.895 qpair failed and we were unable to recover it. 00:27:20.895 [2024-07-15 09:06:09.306255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.306401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.306429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.895 qpair failed and we were unable to recover it. 00:27:20.895 [2024-07-15 09:06:09.306568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.306711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.306737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.895 qpair failed and we were unable to recover it. 00:27:20.895 [2024-07-15 09:06:09.306902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.307027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.307052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.895 qpair failed and we were unable to recover it. 00:27:20.895 [2024-07-15 09:06:09.307207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.307327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.307351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.895 qpair failed and we were unable to recover it. 00:27:20.895 [2024-07-15 09:06:09.307491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.307613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.307637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.895 qpair failed and we were unable to recover it. 00:27:20.895 [2024-07-15 09:06:09.307837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.307966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.307991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.895 qpair failed and we were unable to recover it. 00:27:20.895 [2024-07-15 09:06:09.308110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.308261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.308286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.895 qpair failed and we were unable to recover it. 00:27:20.895 [2024-07-15 09:06:09.308454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.308567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.308590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.895 qpair failed and we were unable to recover it. 00:27:20.895 [2024-07-15 09:06:09.308698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.308810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.308833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.895 qpair failed and we were unable to recover it. 00:27:20.895 [2024-07-15 09:06:09.308984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.309091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.309115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.895 qpair failed and we were unable to recover it. 00:27:20.895 [2024-07-15 09:06:09.309257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.309376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.309404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.895 qpair failed and we were unable to recover it. 00:27:20.895 [2024-07-15 09:06:09.309559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.309674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.309697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.895 qpair failed and we were unable to recover it. 00:27:20.895 [2024-07-15 09:06:09.309856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.309984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.310009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.895 qpair failed and we were unable to recover it. 00:27:20.895 [2024-07-15 09:06:09.310119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.310285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.310310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.895 qpair failed and we were unable to recover it. 00:27:20.895 [2024-07-15 09:06:09.310484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.310621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.310645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.895 qpair failed and we were unable to recover it. 00:27:20.895 [2024-07-15 09:06:09.310793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.310930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.310955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.895 qpair failed and we were unable to recover it. 00:27:20.895 [2024-07-15 09:06:09.311108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.311250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.311274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.895 qpair failed and we were unable to recover it. 00:27:20.895 [2024-07-15 09:06:09.311392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.311532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.311556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.895 qpair failed and we were unable to recover it. 00:27:20.895 [2024-07-15 09:06:09.311674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.311788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.311813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.895 qpair failed and we were unable to recover it. 00:27:20.895 [2024-07-15 09:06:09.311978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.312090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.312115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.895 qpair failed and we were unable to recover it. 00:27:20.895 [2024-07-15 09:06:09.312223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.312326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.312350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.895 qpair failed and we were unable to recover it. 00:27:20.895 [2024-07-15 09:06:09.312475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.312591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.312615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.895 qpair failed and we were unable to recover it. 00:27:20.895 [2024-07-15 09:06:09.312733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.312881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.312907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.895 qpair failed and we were unable to recover it. 00:27:20.895 [2024-07-15 09:06:09.313026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.313170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.313193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.895 qpair failed and we were unable to recover it. 00:27:20.895 [2024-07-15 09:06:09.313329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.313476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.313499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.895 qpair failed and we were unable to recover it. 00:27:20.895 [2024-07-15 09:06:09.313614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.313724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.313748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.895 qpair failed and we were unable to recover it. 00:27:20.895 [2024-07-15 09:06:09.313870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.313998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.314022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.895 qpair failed and we were unable to recover it. 00:27:20.895 [2024-07-15 09:06:09.314171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.314312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.314335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.895 qpair failed and we were unable to recover it. 00:27:20.895 [2024-07-15 09:06:09.314482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.314623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.314648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.895 qpair failed and we were unable to recover it. 00:27:20.895 [2024-07-15 09:06:09.314818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.895 [2024-07-15 09:06:09.314937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.314962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.896 qpair failed and we were unable to recover it. 00:27:20.896 [2024-07-15 09:06:09.315084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.315228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.315251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.896 qpair failed and we were unable to recover it. 00:27:20.896 [2024-07-15 09:06:09.315399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.315519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.315545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.896 qpair failed and we were unable to recover it. 00:27:20.896 [2024-07-15 09:06:09.315687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.315857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.315888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.896 qpair failed and we were unable to recover it. 00:27:20.896 [2024-07-15 09:06:09.316036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.316152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.316176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.896 qpair failed and we were unable to recover it. 00:27:20.896 [2024-07-15 09:06:09.316329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.316473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.316497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.896 qpair failed and we were unable to recover it. 00:27:20.896 [2024-07-15 09:06:09.316639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.316754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.316777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.896 qpair failed and we were unable to recover it. 00:27:20.896 [2024-07-15 09:06:09.316898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.317004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.317028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.896 qpair failed and we were unable to recover it. 00:27:20.896 [2024-07-15 09:06:09.317143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.317283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.317307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.896 qpair failed and we were unable to recover it. 00:27:20.896 [2024-07-15 09:06:09.317428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.317576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.317599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.896 qpair failed and we were unable to recover it. 00:27:20.896 [2024-07-15 09:06:09.317752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.317861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.317892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.896 qpair failed and we were unable to recover it. 00:27:20.896 [2024-07-15 09:06:09.318016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.318155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.318179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.896 qpair failed and we were unable to recover it. 00:27:20.896 [2024-07-15 09:06:09.318297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.318421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.318447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.896 qpair failed and we were unable to recover it. 00:27:20.896 [2024-07-15 09:06:09.318600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.318722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.318748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.896 qpair failed and we were unable to recover it. 00:27:20.896 [2024-07-15 09:06:09.318920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.319068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.319093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.896 qpair failed and we were unable to recover it. 00:27:20.896 [2024-07-15 09:06:09.319216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.319332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.319357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.896 qpair failed and we were unable to recover it. 00:27:20.896 [2024-07-15 09:06:09.319511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.319676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.319700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.896 qpair failed and we were unable to recover it. 00:27:20.896 [2024-07-15 09:06:09.319813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.319926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.319951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.896 qpair failed and we were unable to recover it. 00:27:20.896 [2024-07-15 09:06:09.320097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.320240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.320264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.896 qpair failed and we were unable to recover it. 00:27:20.896 [2024-07-15 09:06:09.320408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.320530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.320554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.896 qpair failed and we were unable to recover it. 00:27:20.896 [2024-07-15 09:06:09.320694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.320810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.320834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.896 qpair failed and we were unable to recover it. 00:27:20.896 [2024-07-15 09:06:09.320954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.321112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.321136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.896 qpair failed and we were unable to recover it. 00:27:20.896 [2024-07-15 09:06:09.321255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.321424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.321453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.896 qpair failed and we were unable to recover it. 00:27:20.896 [2024-07-15 09:06:09.321568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.321709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.321733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.896 qpair failed and we were unable to recover it. 00:27:20.896 [2024-07-15 09:06:09.321887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.322032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.322057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.896 qpair failed and we were unable to recover it. 00:27:20.896 [2024-07-15 09:06:09.322243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.322367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.322393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.896 qpair failed and we were unable to recover it. 00:27:20.896 [2024-07-15 09:06:09.322519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.322634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.322658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.896 qpair failed and we were unable to recover it. 00:27:20.896 [2024-07-15 09:06:09.322796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.322934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.322959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.896 qpair failed and we were unable to recover it. 00:27:20.896 [2024-07-15 09:06:09.323100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.323241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.323266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.896 qpair failed and we were unable to recover it. 00:27:20.896 [2024-07-15 09:06:09.323409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.323529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.323553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.896 qpair failed and we were unable to recover it. 00:27:20.896 [2024-07-15 09:06:09.323727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.323872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.323904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.896 qpair failed and we were unable to recover it. 00:27:20.896 [2024-07-15 09:06:09.324037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.324176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.896 [2024-07-15 09:06:09.324200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.897 qpair failed and we were unable to recover it. 00:27:20.897 [2024-07-15 09:06:09.324370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.324481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.324504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.897 qpair failed and we were unable to recover it. 00:27:20.897 [2024-07-15 09:06:09.324650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.324793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.324817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.897 qpair failed and we were unable to recover it. 00:27:20.897 [2024-07-15 09:06:09.324933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.325074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.325098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.897 qpair failed and we were unable to recover it. 00:27:20.897 [2024-07-15 09:06:09.325221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.325330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.325355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.897 qpair failed and we were unable to recover it. 00:27:20.897 [2024-07-15 09:06:09.325485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.325625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.325649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.897 qpair failed and we were unable to recover it. 00:27:20.897 [2024-07-15 09:06:09.325798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.325936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.325961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.897 qpair failed and we were unable to recover it. 00:27:20.897 [2024-07-15 09:06:09.326097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.326227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.326252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.897 qpair failed and we were unable to recover it. 00:27:20.897 [2024-07-15 09:06:09.326393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.326513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.326537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.897 qpair failed and we were unable to recover it. 00:27:20.897 [2024-07-15 09:06:09.326681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.326824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.326848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.897 qpair failed and we were unable to recover it. 00:27:20.897 [2024-07-15 09:06:09.327014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.327138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.327164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.897 qpair failed and we were unable to recover it. 00:27:20.897 [2024-07-15 09:06:09.327311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.327430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.327455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.897 qpair failed and we were unable to recover it. 00:27:20.897 [2024-07-15 09:06:09.327672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.327814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.327839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.897 qpair failed and we were unable to recover it. 00:27:20.897 [2024-07-15 09:06:09.327969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.328102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.328127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.897 qpair failed and we were unable to recover it. 00:27:20.897 [2024-07-15 09:06:09.328268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.328416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.328440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.897 qpair failed and we were unable to recover it. 00:27:20.897 [2024-07-15 09:06:09.328561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.328706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.328730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.897 qpair failed and we were unable to recover it. 00:27:20.897 [2024-07-15 09:06:09.328854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.329013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.329038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.897 qpair failed and we were unable to recover it. 00:27:20.897 [2024-07-15 09:06:09.329179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.329296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.329320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.897 qpair failed and we were unable to recover it. 00:27:20.897 [2024-07-15 09:06:09.329441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.329582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.329606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.897 qpair failed and we were unable to recover it. 00:27:20.897 [2024-07-15 09:06:09.329734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.329854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.329886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.897 qpair failed and we were unable to recover it. 00:27:20.897 [2024-07-15 09:06:09.330011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.330127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.330151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.897 qpair failed and we were unable to recover it. 00:27:20.897 [2024-07-15 09:06:09.330298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.330440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.330465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.897 qpair failed and we were unable to recover it. 00:27:20.897 [2024-07-15 09:06:09.330596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.330760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.330784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.897 qpair failed and we were unable to recover it. 00:27:20.897 [2024-07-15 09:06:09.330956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.331103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.331127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.897 qpair failed and we were unable to recover it. 00:27:20.897 [2024-07-15 09:06:09.331250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.331395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.331419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.897 qpair failed and we were unable to recover it. 00:27:20.897 [2024-07-15 09:06:09.331554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.331675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.331700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.897 qpair failed and we were unable to recover it. 00:27:20.897 [2024-07-15 09:06:09.331826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.331959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.331984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.897 qpair failed and we were unable to recover it. 00:27:20.897 [2024-07-15 09:06:09.332105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.897 [2024-07-15 09:06:09.332220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.332244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.898 qpair failed and we were unable to recover it. 00:27:20.898 [2024-07-15 09:06:09.332383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.332516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.332540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.898 qpair failed and we were unable to recover it. 00:27:20.898 [2024-07-15 09:06:09.332691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.332850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.332883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.898 qpair failed and we were unable to recover it. 00:27:20.898 [2024-07-15 09:06:09.333031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.333149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.333173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.898 qpair failed and we were unable to recover it. 00:27:20.898 [2024-07-15 09:06:09.333338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.333477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.333501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.898 qpair failed and we were unable to recover it. 00:27:20.898 [2024-07-15 09:06:09.333642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.333761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.333785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.898 qpair failed and we were unable to recover it. 00:27:20.898 [2024-07-15 09:06:09.333924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.334047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.334072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.898 qpair failed and we were unable to recover it. 00:27:20.898 [2024-07-15 09:06:09.334211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.334355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.334379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.898 qpair failed and we were unable to recover it. 00:27:20.898 [2024-07-15 09:06:09.334489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.334633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.334657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.898 qpair failed and we were unable to recover it. 00:27:20.898 [2024-07-15 09:06:09.334824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.334978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.335004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.898 qpair failed and we were unable to recover it. 00:27:20.898 [2024-07-15 09:06:09.335115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.335253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.335278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.898 qpair failed and we were unable to recover it. 00:27:20.898 [2024-07-15 09:06:09.335445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.335615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.335639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.898 qpair failed and we were unable to recover it. 00:27:20.898 [2024-07-15 09:06:09.335773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.335892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.335917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.898 qpair failed and we were unable to recover it. 00:27:20.898 [2024-07-15 09:06:09.336071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.336184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.336208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.898 qpair failed and we were unable to recover it. 00:27:20.898 [2024-07-15 09:06:09.336350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.336494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.336519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.898 qpair failed and we were unable to recover it. 00:27:20.898 [2024-07-15 09:06:09.336685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.336821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.336850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.898 qpair failed and we were unable to recover it. 00:27:20.898 [2024-07-15 09:06:09.337006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.337129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.337152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.898 qpair failed and we were unable to recover it. 00:27:20.898 [2024-07-15 09:06:09.337278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.337396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.337419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.898 qpair failed and we were unable to recover it. 00:27:20.898 [2024-07-15 09:06:09.337566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.337682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.337707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.898 qpair failed and we were unable to recover it. 00:27:20.898 [2024-07-15 09:06:09.337854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.338030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.338054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.898 qpair failed and we were unable to recover it. 00:27:20.898 [2024-07-15 09:06:09.338175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.338337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.338361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.898 qpair failed and we were unable to recover it. 00:27:20.898 [2024-07-15 09:06:09.338505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.338626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.338652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.898 qpair failed and we were unable to recover it. 00:27:20.898 [2024-07-15 09:06:09.338773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.338889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.338914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.898 qpair failed and we were unable to recover it. 00:27:20.898 [2024-07-15 09:06:09.339041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.339159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.339183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.898 qpair failed and we were unable to recover it. 00:27:20.898 [2024-07-15 09:06:09.339312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.339425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.339449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.898 qpair failed and we were unable to recover it. 00:27:20.898 [2024-07-15 09:06:09.339562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.339705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.339729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.898 qpair failed and we were unable to recover it. 00:27:20.898 [2024-07-15 09:06:09.339874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.340042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.340067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.898 qpair failed and we were unable to recover it. 00:27:20.898 [2024-07-15 09:06:09.340181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.340327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.340351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.898 qpair failed and we were unable to recover it. 00:27:20.898 [2024-07-15 09:06:09.340480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.340622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.340646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.898 qpair failed and we were unable to recover it. 00:27:20.898 [2024-07-15 09:06:09.340818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.340936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.340962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.898 qpair failed and we were unable to recover it. 00:27:20.898 [2024-07-15 09:06:09.341092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.341230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.341255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.898 qpair failed and we were unable to recover it. 00:27:20.898 [2024-07-15 09:06:09.341392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.898 [2024-07-15 09:06:09.341533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.341557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.899 qpair failed and we were unable to recover it. 00:27:20.899 [2024-07-15 09:06:09.341711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.341855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.341887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.899 qpair failed and we were unable to recover it. 00:27:20.899 [2024-07-15 09:06:09.342002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.342144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.342169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.899 qpair failed and we were unable to recover it. 00:27:20.899 [2024-07-15 09:06:09.342344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.342491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.342515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.899 qpair failed and we were unable to recover it. 00:27:20.899 [2024-07-15 09:06:09.342631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.342770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.342794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.899 qpair failed and we were unable to recover it. 00:27:20.899 [2024-07-15 09:06:09.342916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.343039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.343063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.899 qpair failed and we were unable to recover it. 00:27:20.899 [2024-07-15 09:06:09.343182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.343324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.343348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.899 qpair failed and we were unable to recover it. 00:27:20.899 [2024-07-15 09:06:09.343494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.343618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.343642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.899 qpair failed and we were unable to recover it. 00:27:20.899 [2024-07-15 09:06:09.343807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.343972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.343998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.899 qpair failed and we were unable to recover it. 00:27:20.899 [2024-07-15 09:06:09.344120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.344233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.344258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.899 qpair failed and we were unable to recover it. 00:27:20.899 [2024-07-15 09:06:09.344398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.344547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.344571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.899 qpair failed and we were unable to recover it. 00:27:20.899 [2024-07-15 09:06:09.344683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.344802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.344827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.899 qpair failed and we were unable to recover it. 00:27:20.899 [2024-07-15 09:06:09.344991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.345136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.345160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.899 qpair failed and we were unable to recover it. 00:27:20.899 [2024-07-15 09:06:09.345307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.345419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.345443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.899 qpair failed and we were unable to recover it. 00:27:20.899 [2024-07-15 09:06:09.345593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.345717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.345741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.899 qpair failed and we were unable to recover it. 00:27:20.899 [2024-07-15 09:06:09.345909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.346035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.346060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.899 qpair failed and we were unable to recover it. 00:27:20.899 [2024-07-15 09:06:09.346201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.346339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.346364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.899 qpair failed and we were unable to recover it. 00:27:20.899 [2024-07-15 09:06:09.346506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.346647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.346671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.899 qpair failed and we were unable to recover it. 00:27:20.899 [2024-07-15 09:06:09.346819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.346938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.346963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.899 qpair failed and we were unable to recover it. 00:27:20.899 [2024-07-15 09:06:09.347080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.347224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.347249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.899 qpair failed and we were unable to recover it. 00:27:20.899 [2024-07-15 09:06:09.347396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.347564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.347588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.899 qpair failed and we were unable to recover it. 00:27:20.899 [2024-07-15 09:06:09.347761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.347905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.347930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.899 qpair failed and we were unable to recover it. 00:27:20.899 [2024-07-15 09:06:09.348074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.348195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.348220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.899 qpair failed and we were unable to recover it. 00:27:20.899 [2024-07-15 09:06:09.348379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.348515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.348539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.899 qpair failed and we were unable to recover it. 00:27:20.899 [2024-07-15 09:06:09.348656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.348771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.348796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.899 qpair failed and we were unable to recover it. 00:27:20.899 [2024-07-15 09:06:09.348935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.349057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.349085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.899 qpair failed and we were unable to recover it. 00:27:20.899 [2024-07-15 09:06:09.349230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.349371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.349395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.899 qpair failed and we were unable to recover it. 00:27:20.899 [2024-07-15 09:06:09.349560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.349740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.349764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.899 qpair failed and we were unable to recover it. 00:27:20.899 [2024-07-15 09:06:09.349883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.350030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.350055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.899 qpair failed and we were unable to recover it. 00:27:20.899 [2024-07-15 09:06:09.350195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.350332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.350356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.899 qpair failed and we were unable to recover it. 00:27:20.899 [2024-07-15 09:06:09.350481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.350600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.899 [2024-07-15 09:06:09.350624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.899 qpair failed and we were unable to recover it. 00:27:20.900 [2024-07-15 09:06:09.350773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.350915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.350940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.900 qpair failed and we were unable to recover it. 00:27:20.900 [2024-07-15 09:06:09.351063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.351209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.351233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.900 qpair failed and we were unable to recover it. 00:27:20.900 [2024-07-15 09:06:09.351354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.351478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.351502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.900 qpair failed and we were unable to recover it. 00:27:20.900 [2024-07-15 09:06:09.351627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.351750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.351773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.900 qpair failed and we were unable to recover it. 00:27:20.900 [2024-07-15 09:06:09.351917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.352062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.352090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.900 qpair failed and we were unable to recover it. 00:27:20.900 [2024-07-15 09:06:09.352225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.352341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.352366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.900 qpair failed and we were unable to recover it. 00:27:20.900 [2024-07-15 09:06:09.352529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.352664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.352688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.900 qpair failed and we were unable to recover it. 00:27:20.900 [2024-07-15 09:06:09.352816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.352940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.352965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.900 qpair failed and we were unable to recover it. 00:27:20.900 [2024-07-15 09:06:09.353112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.353278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.353302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.900 qpair failed and we were unable to recover it. 00:27:20.900 [2024-07-15 09:06:09.353485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.353624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.353647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.900 qpair failed and we were unable to recover it. 00:27:20.900 [2024-07-15 09:06:09.353791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.353936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.353962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.900 qpair failed and we were unable to recover it. 00:27:20.900 [2024-07-15 09:06:09.354135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.354302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.354326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.900 qpair failed and we were unable to recover it. 00:27:20.900 [2024-07-15 09:06:09.354471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.354641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.354664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.900 qpair failed and we were unable to recover it. 00:27:20.900 [2024-07-15 09:06:09.354803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.354950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.354975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.900 qpair failed and we were unable to recover it. 00:27:20.900 [2024-07-15 09:06:09.355113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.355253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.355277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.900 qpair failed and we were unable to recover it. 00:27:20.900 [2024-07-15 09:06:09.355405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.355559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.355584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.900 qpair failed and we were unable to recover it. 00:27:20.900 [2024-07-15 09:06:09.355701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.355846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.355870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.900 qpair failed and we were unable to recover it. 00:27:20.900 [2024-07-15 09:06:09.356047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.356191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.356217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.900 qpair failed and we were unable to recover it. 00:27:20.900 [2024-07-15 09:06:09.356363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.356503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.356527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.900 qpair failed and we were unable to recover it. 00:27:20.900 [2024-07-15 09:06:09.356661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.356816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.356841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.900 qpair failed and we were unable to recover it. 00:27:20.900 [2024-07-15 09:06:09.356961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.357075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.357100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.900 qpair failed and we were unable to recover it. 00:27:20.900 [2024-07-15 09:06:09.357246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.357382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.357406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.900 qpair failed and we were unable to recover it. 00:27:20.900 [2024-07-15 09:06:09.357575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.357719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.357744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.900 qpair failed and we were unable to recover it. 00:27:20.900 [2024-07-15 09:06:09.357905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.358046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.358071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.900 qpair failed and we were unable to recover it. 00:27:20.900 [2024-07-15 09:06:09.358192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.358330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.358354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.900 qpair failed and we were unable to recover it. 00:27:20.900 [2024-07-15 09:06:09.358524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.358630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.358654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.900 qpair failed and we were unable to recover it. 00:27:20.900 [2024-07-15 09:06:09.358825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.358965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.358991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.900 qpair failed and we were unable to recover it. 00:27:20.900 [2024-07-15 09:06:09.359131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.359253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.359278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.900 qpair failed and we were unable to recover it. 00:27:20.900 [2024-07-15 09:06:09.359444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.359610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.359634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.900 qpair failed and we were unable to recover it. 00:27:20.900 [2024-07-15 09:06:09.359743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.359857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.359886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.900 qpair failed and we were unable to recover it. 00:27:20.900 [2024-07-15 09:06:09.360053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.360189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.900 [2024-07-15 09:06:09.360213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.900 qpair failed and we were unable to recover it. 00:27:20.900 [2024-07-15 09:06:09.360357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.360503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.360528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.901 qpair failed and we were unable to recover it. 00:27:20.901 [2024-07-15 09:06:09.360641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.360788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.360813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.901 qpair failed and we were unable to recover it. 00:27:20.901 [2024-07-15 09:06:09.360934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.361056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.361080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.901 qpair failed and we were unable to recover it. 00:27:20.901 [2024-07-15 09:06:09.361198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.361347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.361372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.901 qpair failed and we were unable to recover it. 00:27:20.901 [2024-07-15 09:06:09.361517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.361661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.361686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.901 qpair failed and we were unable to recover it. 00:27:20.901 [2024-07-15 09:06:09.361804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.361952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.361978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.901 qpair failed and we were unable to recover it. 00:27:20.901 [2024-07-15 09:06:09.362093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.362262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.362287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.901 qpair failed and we were unable to recover it. 00:27:20.901 [2024-07-15 09:06:09.362432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.362578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.362602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.901 qpair failed and we were unable to recover it. 00:27:20.901 [2024-07-15 09:06:09.362752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.362868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.362901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.901 qpair failed and we were unable to recover it. 00:27:20.901 [2024-07-15 09:06:09.363068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.363187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.363212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.901 qpair failed and we were unable to recover it. 00:27:20.901 [2024-07-15 09:06:09.363343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.363462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.363487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.901 qpair failed and we were unable to recover it. 00:27:20.901 [2024-07-15 09:06:09.363630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.363773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.363797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.901 qpair failed and we were unable to recover it. 00:27:20.901 [2024-07-15 09:06:09.363967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.364108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.364132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.901 qpair failed and we were unable to recover it. 00:27:20.901 [2024-07-15 09:06:09.364290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.364413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.364438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.901 qpair failed and we were unable to recover it. 00:27:20.901 [2024-07-15 09:06:09.364603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.364745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.364774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.901 qpair failed and we were unable to recover it. 00:27:20.901 [2024-07-15 09:06:09.364931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.365046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.365071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.901 qpair failed and we were unable to recover it. 00:27:20.901 [2024-07-15 09:06:09.365191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.365305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.365329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.901 qpair failed and we were unable to recover it. 00:27:20.901 [2024-07-15 09:06:09.365470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.365606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.365630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.901 qpair failed and we were unable to recover it. 00:27:20.901 [2024-07-15 09:06:09.365773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.365893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.365917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.901 qpair failed and we were unable to recover it. 00:27:20.901 [2024-07-15 09:06:09.366040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.366204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.366228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.901 qpair failed and we were unable to recover it. 00:27:20.901 [2024-07-15 09:06:09.366402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.366521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.366547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.901 qpair failed and we were unable to recover it. 00:27:20.901 [2024-07-15 09:06:09.366691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.366803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.366828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.901 qpair failed and we were unable to recover it. 00:27:20.901 [2024-07-15 09:06:09.366974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.367099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.367124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.901 qpair failed and we were unable to recover it. 00:27:20.901 [2024-07-15 09:06:09.367248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.367363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.367387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.901 qpair failed and we were unable to recover it. 00:27:20.901 [2024-07-15 09:06:09.367545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.367716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.367741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.901 qpair failed and we were unable to recover it. 00:27:20.901 [2024-07-15 09:06:09.367891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.368038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.368063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.901 qpair failed and we were unable to recover it. 00:27:20.901 [2024-07-15 09:06:09.368202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.368342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.901 [2024-07-15 09:06:09.368369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.902 qpair failed and we were unable to recover it. 00:27:20.902 [2024-07-15 09:06:09.368534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.368700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.368725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.902 qpair failed and we were unable to recover it. 00:27:20.902 [2024-07-15 09:06:09.368925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.369062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.369103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.902 qpair failed and we were unable to recover it. 00:27:20.902 [2024-07-15 09:06:09.369222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.369358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.369384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.902 qpair failed and we were unable to recover it. 00:27:20.902 [2024-07-15 09:06:09.369516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.369652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.369679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.902 qpair failed and we were unable to recover it. 00:27:20.902 [2024-07-15 09:06:09.369846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.369960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.369985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.902 qpair failed and we were unable to recover it. 00:27:20.902 [2024-07-15 09:06:09.370127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.370281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.370305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.902 qpair failed and we were unable to recover it. 00:27:20.902 [2024-07-15 09:06:09.370446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.370599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.370627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.902 qpair failed and we were unable to recover it. 00:27:20.902 [2024-07-15 09:06:09.370762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.370918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.370947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.902 qpair failed and we were unable to recover it. 00:27:20.902 [2024-07-15 09:06:09.371076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.371236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.371264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.902 qpair failed and we were unable to recover it. 00:27:20.902 [2024-07-15 09:06:09.371397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.371538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.371564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.902 qpair failed and we were unable to recover it. 00:27:20.902 [2024-07-15 09:06:09.371718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.371874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.371907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.902 qpair failed and we were unable to recover it. 00:27:20.902 [2024-07-15 09:06:09.372047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.372181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.372205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.902 qpair failed and we were unable to recover it. 00:27:20.902 [2024-07-15 09:06:09.372349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.372532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.372556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.902 qpair failed and we were unable to recover it. 00:27:20.902 [2024-07-15 09:06:09.372726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.372893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.372919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.902 qpair failed and we were unable to recover it. 00:27:20.902 [2024-07-15 09:06:09.373041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.373202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.373229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.902 qpair failed and we were unable to recover it. 00:27:20.902 [2024-07-15 09:06:09.373359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.373528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.373555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.902 qpair failed and we were unable to recover it. 00:27:20.902 [2024-07-15 09:06:09.373693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.373826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.373850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.902 qpair failed and we were unable to recover it. 00:27:20.902 [2024-07-15 09:06:09.373975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.374084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.374108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.902 qpair failed and we were unable to recover it. 00:27:20.902 [2024-07-15 09:06:09.374278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.374410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.374437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.902 qpair failed and we were unable to recover it. 00:27:20.902 [2024-07-15 09:06:09.374589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.374734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.374758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.902 qpair failed and we were unable to recover it. 00:27:20.902 [2024-07-15 09:06:09.374900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.375018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.375041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.902 qpair failed and we were unable to recover it. 00:27:20.902 [2024-07-15 09:06:09.375160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.375273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.375297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.902 qpair failed and we were unable to recover it. 00:27:20.902 [2024-07-15 09:06:09.375480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.375642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.375668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.902 qpair failed and we were unable to recover it. 00:27:20.902 [2024-07-15 09:06:09.375833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.375957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.375981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.902 qpair failed and we were unable to recover it. 00:27:20.902 [2024-07-15 09:06:09.376122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.376289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.376315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.902 qpair failed and we were unable to recover it. 00:27:20.902 [2024-07-15 09:06:09.376475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.376599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.376623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.902 qpair failed and we were unable to recover it. 00:27:20.902 [2024-07-15 09:06:09.376758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.376925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.376951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.902 qpair failed and we were unable to recover it. 00:27:20.902 [2024-07-15 09:06:09.377084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.377242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.377268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.902 qpair failed and we were unable to recover it. 00:27:20.902 [2024-07-15 09:06:09.377424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.377608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.377635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.902 qpair failed and we were unable to recover it. 00:27:20.902 [2024-07-15 09:06:09.377788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.377903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.902 [2024-07-15 09:06:09.377928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.902 qpair failed and we were unable to recover it. 00:27:20.902 [2024-07-15 09:06:09.378074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.378213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.378240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.903 qpair failed and we were unable to recover it. 00:27:20.903 [2024-07-15 09:06:09.378403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.378556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.378582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.903 qpair failed and we were unable to recover it. 00:27:20.903 [2024-07-15 09:06:09.378745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.378859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.378889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.903 qpair failed and we were unable to recover it. 00:27:20.903 [2024-07-15 09:06:09.379035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.379157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.379180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.903 qpair failed and we were unable to recover it. 00:27:20.903 [2024-07-15 09:06:09.379360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.379518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.379545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.903 qpair failed and we were unable to recover it. 00:27:20.903 [2024-07-15 09:06:09.379706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.379867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.379917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.903 qpair failed and we were unable to recover it. 00:27:20.903 [2024-07-15 09:06:09.380036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.380151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.380175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.903 qpair failed and we were unable to recover it. 00:27:20.903 [2024-07-15 09:06:09.380358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.380505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.380530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.903 qpair failed and we were unable to recover it. 00:27:20.903 [2024-07-15 09:06:09.380650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.380773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.380801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.903 qpair failed and we were unable to recover it. 00:27:20.903 [2024-07-15 09:06:09.380970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.381121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.381145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.903 qpair failed and we were unable to recover it. 00:27:20.903 [2024-07-15 09:06:09.381316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.381436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.381460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.903 qpair failed and we were unable to recover it. 00:27:20.903 [2024-07-15 09:06:09.381606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.381724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.381747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.903 qpair failed and we were unable to recover it. 00:27:20.903 [2024-07-15 09:06:09.381870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.382026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.382050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.903 qpair failed and we were unable to recover it. 00:27:20.903 [2024-07-15 09:06:09.382166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.382287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.382313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.903 qpair failed and we were unable to recover it. 00:27:20.903 [2024-07-15 09:06:09.382457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.382615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.382638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.903 qpair failed and we were unable to recover it. 00:27:20.903 [2024-07-15 09:06:09.382811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.382972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.382997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.903 qpair failed and we were unable to recover it. 00:27:20.903 [2024-07-15 09:06:09.383106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.383251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.383276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.903 qpair failed and we were unable to recover it. 00:27:20.903 [2024-07-15 09:06:09.383417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.383560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.383585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.903 qpair failed and we were unable to recover it. 00:27:20.903 [2024-07-15 09:06:09.383728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.383874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.383905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.903 qpair failed and we were unable to recover it. 00:27:20.903 [2024-07-15 09:06:09.384026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.384142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.384165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.903 qpair failed and we were unable to recover it. 00:27:20.903 [2024-07-15 09:06:09.384283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.384399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.384423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.903 qpair failed and we were unable to recover it. 00:27:20.903 [2024-07-15 09:06:09.384539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.384681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.384704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.903 qpair failed and we were unable to recover it. 00:27:20.903 [2024-07-15 09:06:09.384848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.384966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.384991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.903 qpair failed and we were unable to recover it. 00:27:20.903 [2024-07-15 09:06:09.385128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.385274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.385299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.903 qpair failed and we were unable to recover it. 00:27:20.903 [2024-07-15 09:06:09.385414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.385584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.385609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.903 qpair failed and we were unable to recover it. 00:27:20.903 [2024-07-15 09:06:09.385753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.385938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.385964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.903 qpair failed and we were unable to recover it. 00:27:20.903 [2024-07-15 09:06:09.386076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.386212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.386237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.903 qpair failed and we were unable to recover it. 00:27:20.903 [2024-07-15 09:06:09.386375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.386516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.386540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.903 qpair failed and we were unable to recover it. 00:27:20.903 [2024-07-15 09:06:09.386682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.386838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.386863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.903 qpair failed and we were unable to recover it. 00:27:20.903 [2024-07-15 09:06:09.387020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.387140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.387164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.903 qpair failed and we were unable to recover it. 00:27:20.903 [2024-07-15 09:06:09.387280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.387413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.903 [2024-07-15 09:06:09.387437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.903 qpair failed and we were unable to recover it. 00:27:20.903 [2024-07-15 09:06:09.387579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.387702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.387726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.904 qpair failed and we were unable to recover it. 00:27:20.904 [2024-07-15 09:06:09.387862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.388012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.388037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.904 qpair failed and we were unable to recover it. 00:27:20.904 [2024-07-15 09:06:09.388185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.388303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.388328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.904 qpair failed and we were unable to recover it. 00:27:20.904 [2024-07-15 09:06:09.388454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.388610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.388634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.904 qpair failed and we were unable to recover it. 00:27:20.904 [2024-07-15 09:06:09.388757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.388888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.388913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.904 qpair failed and we were unable to recover it. 00:27:20.904 [2024-07-15 09:06:09.389028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.389150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.389174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.904 qpair failed and we were unable to recover it. 00:27:20.904 [2024-07-15 09:06:09.389319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.389431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.389456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.904 qpair failed and we were unable to recover it. 00:27:20.904 [2024-07-15 09:06:09.389599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.389748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.389772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.904 qpair failed and we were unable to recover it. 00:27:20.904 [2024-07-15 09:06:09.389897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.390043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.390067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.904 qpair failed and we were unable to recover it. 00:27:20.904 [2024-07-15 09:06:09.390189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.390328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.390352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.904 qpair failed and we were unable to recover it. 00:27:20.904 [2024-07-15 09:06:09.390493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.390611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.390634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.904 qpair failed and we were unable to recover it. 00:27:20.904 [2024-07-15 09:06:09.390807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.390944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.390970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.904 qpair failed and we were unable to recover it. 00:27:20.904 [2024-07-15 09:06:09.391081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.391217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.391242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.904 qpair failed and we were unable to recover it. 00:27:20.904 [2024-07-15 09:06:09.391381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.391497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.391521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.904 qpair failed and we were unable to recover it. 00:27:20.904 [2024-07-15 09:06:09.391644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.391799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.391823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.904 qpair failed and we were unable to recover it. 00:27:20.904 [2024-07-15 09:06:09.391998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.392116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.392140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.904 qpair failed and we were unable to recover it. 00:27:20.904 [2024-07-15 09:06:09.392285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.392426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.392450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.904 qpair failed and we were unable to recover it. 00:27:20.904 [2024-07-15 09:06:09.392591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.392704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.392727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.904 qpair failed and we were unable to recover it. 00:27:20.904 [2024-07-15 09:06:09.392849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.392992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.393021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.904 qpair failed and we were unable to recover it. 00:27:20.904 [2024-07-15 09:06:09.393138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.393308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.393332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.904 qpair failed and we were unable to recover it. 00:27:20.904 [2024-07-15 09:06:09.393482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.393641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.393665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.904 qpair failed and we were unable to recover it. 00:27:20.904 [2024-07-15 09:06:09.393783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.393899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.393923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.904 qpair failed and we were unable to recover it. 00:27:20.904 [2024-07-15 09:06:09.394049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.394191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.394215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.904 qpair failed and we were unable to recover it. 00:27:20.904 [2024-07-15 09:06:09.394338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.394454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.394477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.904 qpair failed and we were unable to recover it. 00:27:20.904 [2024-07-15 09:06:09.394596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.394740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.394764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.904 qpair failed and we were unable to recover it. 00:27:20.904 [2024-07-15 09:06:09.394887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.395028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.395053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.904 qpair failed and we were unable to recover it. 00:27:20.904 [2024-07-15 09:06:09.395167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.395305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.395330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.904 qpair failed and we were unable to recover it. 00:27:20.904 [2024-07-15 09:06:09.395444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.395589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.395613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.904 qpair failed and we were unable to recover it. 00:27:20.904 [2024-07-15 09:06:09.395787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.395921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.395949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.904 qpair failed and we were unable to recover it. 00:27:20.904 [2024-07-15 09:06:09.396069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.396191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.396215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.904 qpair failed and we were unable to recover it. 00:27:20.904 [2024-07-15 09:06:09.396328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.396449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.904 [2024-07-15 09:06:09.396472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.904 qpair failed and we were unable to recover it. 00:27:20.904 [2024-07-15 09:06:09.396594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.905 [2024-07-15 09:06:09.396713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.905 [2024-07-15 09:06:09.396737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.905 qpair failed and we were unable to recover it. 00:27:20.905 [2024-07-15 09:06:09.396899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.905 [2024-07-15 09:06:09.397041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.905 [2024-07-15 09:06:09.397065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.905 qpair failed and we were unable to recover it. 00:27:20.905 [2024-07-15 09:06:09.397207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.905 [2024-07-15 09:06:09.397353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.905 [2024-07-15 09:06:09.397378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.905 qpair failed and we were unable to recover it. 00:27:20.905 [2024-07-15 09:06:09.397525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.905 [2024-07-15 09:06:09.397642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.905 [2024-07-15 09:06:09.397666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.905 qpair failed and we were unable to recover it. 00:27:20.905 [2024-07-15 09:06:09.397790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.905 [2024-07-15 09:06:09.397908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.905 [2024-07-15 09:06:09.397934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.905 qpair failed and we were unable to recover it. 00:27:20.905 [2024-07-15 09:06:09.398108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.905 [2024-07-15 09:06:09.398251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.905 [2024-07-15 09:06:09.398274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.905 qpair failed and we were unable to recover it. 00:27:20.905 [2024-07-15 09:06:09.398394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.905 [2024-07-15 09:06:09.398540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.905 [2024-07-15 09:06:09.398563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.905 qpair failed and we were unable to recover it. 00:27:20.905 [2024-07-15 09:06:09.398690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.905 [2024-07-15 09:06:09.398813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.905 [2024-07-15 09:06:09.398837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.905 qpair failed and we were unable to recover it. 00:27:20.905 [2024-07-15 09:06:09.398972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.905 [2024-07-15 09:06:09.399102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.905 [2024-07-15 09:06:09.399125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.905 qpair failed and we were unable to recover it. 00:27:20.905 [2024-07-15 09:06:09.399303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.905 [2024-07-15 09:06:09.399427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.905 [2024-07-15 09:06:09.399451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.905 qpair failed and we were unable to recover it. 00:27:20.905 [2024-07-15 09:06:09.399568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.905 [2024-07-15 09:06:09.399681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.905 [2024-07-15 09:06:09.399704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.905 qpair failed and we were unable to recover it. 00:27:20.905 [2024-07-15 09:06:09.399873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.905 [2024-07-15 09:06:09.400001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.905 [2024-07-15 09:06:09.400024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.905 qpair failed and we were unable to recover it. 00:27:20.905 [2024-07-15 09:06:09.400170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.905 [2024-07-15 09:06:09.400293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.905 [2024-07-15 09:06:09.400316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.905 qpair failed and we were unable to recover it. 00:27:20.905 [2024-07-15 09:06:09.400459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.905 [2024-07-15 09:06:09.400597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.905 [2024-07-15 09:06:09.400620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.905 qpair failed and we were unable to recover it. 00:27:20.905 [2024-07-15 09:06:09.400736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.905 [2024-07-15 09:06:09.400887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.905 [2024-07-15 09:06:09.400911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.905 qpair failed and we were unable to recover it. 00:27:20.905 [2024-07-15 09:06:09.401072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.905 [2024-07-15 09:06:09.401198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.905 [2024-07-15 09:06:09.401223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.905 qpair failed and we were unable to recover it. 00:27:20.905 [2024-07-15 09:06:09.401370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.905 [2024-07-15 09:06:09.401514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.905 [2024-07-15 09:06:09.401537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.905 qpair failed and we were unable to recover it. 00:27:20.905 [2024-07-15 09:06:09.401649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.905 [2024-07-15 09:06:09.401817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.905 [2024-07-15 09:06:09.401840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.905 qpair failed and we were unable to recover it. 00:27:20.905 [2024-07-15 09:06:09.402001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.905 [2024-07-15 09:06:09.402113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:20.905 [2024-07-15 09:06:09.402138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:20.905 qpair failed and we were unable to recover it. 00:27:20.905 [2024-07-15 09:06:09.402251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.402393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.402417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.180 qpair failed and we were unable to recover it. 00:27:21.180 [2024-07-15 09:06:09.402565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.402669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.402693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.180 qpair failed and we were unable to recover it. 00:27:21.180 [2024-07-15 09:06:09.402842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.403000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.403025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.180 qpair failed and we were unable to recover it. 00:27:21.180 [2024-07-15 09:06:09.403174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.403286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.403309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.180 qpair failed and we were unable to recover it. 00:27:21.180 [2024-07-15 09:06:09.403423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.403539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.403562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.180 qpair failed and we were unable to recover it. 00:27:21.180 [2024-07-15 09:06:09.403685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.403802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.403825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.180 qpair failed and we were unable to recover it. 00:27:21.180 [2024-07-15 09:06:09.403997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.404137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.404160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.180 qpair failed and we were unable to recover it. 00:27:21.180 [2024-07-15 09:06:09.404332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.404455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.404480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.180 qpair failed and we were unable to recover it. 00:27:21.180 [2024-07-15 09:06:09.404628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.404770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.404795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.180 qpair failed and we were unable to recover it. 00:27:21.180 [2024-07-15 09:06:09.404913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.405036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.405060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.180 qpair failed and we were unable to recover it. 00:27:21.180 [2024-07-15 09:06:09.405174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.405289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.405313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.180 qpair failed and we were unable to recover it. 00:27:21.180 [2024-07-15 09:06:09.405451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.405625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.405652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.180 qpair failed and we were unable to recover it. 00:27:21.180 [2024-07-15 09:06:09.405779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.405915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.405955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.180 qpair failed and we were unable to recover it. 00:27:21.180 [2024-07-15 09:06:09.406124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.406256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.406283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.180 qpair failed and we were unable to recover it. 00:27:21.180 [2024-07-15 09:06:09.406445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.406594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.406618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.180 qpair failed and we were unable to recover it. 00:27:21.180 [2024-07-15 09:06:09.406798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.406946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.406971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.180 qpair failed and we were unable to recover it. 00:27:21.180 [2024-07-15 09:06:09.407094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.407238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.407264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.180 qpair failed and we were unable to recover it. 00:27:21.180 [2024-07-15 09:06:09.407393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.407577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.407603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.180 qpair failed and we were unable to recover it. 00:27:21.180 [2024-07-15 09:06:09.407771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.407914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.407940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.180 qpair failed and we were unable to recover it. 00:27:21.180 [2024-07-15 09:06:09.408050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.408184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.408215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.180 qpair failed and we were unable to recover it. 00:27:21.180 [2024-07-15 09:06:09.408338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.408500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.408527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.180 qpair failed and we were unable to recover it. 00:27:21.180 [2024-07-15 09:06:09.408712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.408855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.408901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.180 qpair failed and we were unable to recover it. 00:27:21.180 [2024-07-15 09:06:09.409052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.409195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.409219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.180 qpair failed and we were unable to recover it. 00:27:21.180 [2024-07-15 09:06:09.409387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.180 [2024-07-15 09:06:09.409573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.409627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.181 qpair failed and we were unable to recover it. 00:27:21.181 [2024-07-15 09:06:09.409755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.409902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.409943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.181 qpair failed and we were unable to recover it. 00:27:21.181 [2024-07-15 09:06:09.410062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.410244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.410271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.181 qpair failed and we were unable to recover it. 00:27:21.181 [2024-07-15 09:06:09.410433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.410580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.410603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.181 qpair failed and we were unable to recover it. 00:27:21.181 [2024-07-15 09:06:09.410746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.410889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.410913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.181 qpair failed and we were unable to recover it. 00:27:21.181 [2024-07-15 09:06:09.411037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.411173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.411200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.181 qpair failed and we were unable to recover it. 00:27:21.181 [2024-07-15 09:06:09.411380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.411537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.411564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.181 qpair failed and we were unable to recover it. 00:27:21.181 [2024-07-15 09:06:09.411730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.411872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.411904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.181 qpair failed and we were unable to recover it. 00:27:21.181 [2024-07-15 09:06:09.412024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.412189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.412216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.181 qpair failed and we were unable to recover it. 00:27:21.181 [2024-07-15 09:06:09.412368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.412497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.412523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.181 qpair failed and we were unable to recover it. 00:27:21.181 [2024-07-15 09:06:09.412682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.412816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.412842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.181 qpair failed and we were unable to recover it. 00:27:21.181 [2024-07-15 09:06:09.413029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.413150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.413174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.181 qpair failed and we were unable to recover it. 00:27:21.181 [2024-07-15 09:06:09.413294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.413466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.413493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.181 qpair failed and we were unable to recover it. 00:27:21.181 [2024-07-15 09:06:09.413656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.413811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.413837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.181 qpair failed and we were unable to recover it. 00:27:21.181 [2024-07-15 09:06:09.413984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.414151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.414192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.181 qpair failed and we were unable to recover it. 00:27:21.181 [2024-07-15 09:06:09.414384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.414551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.414575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.181 qpair failed and we were unable to recover it. 00:27:21.181 [2024-07-15 09:06:09.414711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.414869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.414906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.181 qpair failed and we were unable to recover it. 00:27:21.181 [2024-07-15 09:06:09.415070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.415228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.415254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.181 qpair failed and we were unable to recover it. 00:27:21.181 [2024-07-15 09:06:09.415436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.415658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.415710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.181 qpair failed and we were unable to recover it. 00:27:21.181 [2024-07-15 09:06:09.415842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.415989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.416014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.181 qpair failed and we were unable to recover it. 00:27:21.181 [2024-07-15 09:06:09.416166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.416353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.416380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.181 qpair failed and we were unable to recover it. 00:27:21.181 [2024-07-15 09:06:09.416540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.416669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.416695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.181 qpair failed and we were unable to recover it. 00:27:21.181 [2024-07-15 09:06:09.416824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.416972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.416997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.181 qpair failed and we were unable to recover it. 00:27:21.181 [2024-07-15 09:06:09.417115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.417239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.417263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.181 qpair failed and we were unable to recover it. 00:27:21.181 [2024-07-15 09:06:09.417428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.417594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.417617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.181 qpair failed and we were unable to recover it. 00:27:21.181 [2024-07-15 09:06:09.417757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.417891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.417934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.181 qpair failed and we were unable to recover it. 00:27:21.181 [2024-07-15 09:06:09.418108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.418263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.418311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.181 qpair failed and we were unable to recover it. 00:27:21.181 [2024-07-15 09:06:09.418483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.418678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.418706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.181 qpair failed and we were unable to recover it. 00:27:21.181 [2024-07-15 09:06:09.418836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.419052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.419078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.181 qpair failed and we were unable to recover it. 00:27:21.181 [2024-07-15 09:06:09.419217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.419421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.419445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.181 qpair failed and we were unable to recover it. 00:27:21.181 [2024-07-15 09:06:09.419565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.419708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.181 [2024-07-15 09:06:09.419735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.181 qpair failed and we were unable to recover it. 00:27:21.182 [2024-07-15 09:06:09.419899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.420037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.420061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.182 qpair failed and we were unable to recover it. 00:27:21.182 [2024-07-15 09:06:09.420272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.420466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.420490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.182 qpair failed and we were unable to recover it. 00:27:21.182 [2024-07-15 09:06:09.420610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.420782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.420807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.182 qpair failed and we were unable to recover it. 00:27:21.182 [2024-07-15 09:06:09.420950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.421080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.421107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.182 qpair failed and we were unable to recover it. 00:27:21.182 [2024-07-15 09:06:09.421246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.421386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.421411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.182 qpair failed and we were unable to recover it. 00:27:21.182 [2024-07-15 09:06:09.421571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.421752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.421779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.182 qpair failed and we were unable to recover it. 00:27:21.182 [2024-07-15 09:06:09.421940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.422079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.422106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.182 qpair failed and we were unable to recover it. 00:27:21.182 [2024-07-15 09:06:09.422242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.422402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.422428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.182 qpair failed and we were unable to recover it. 00:27:21.182 [2024-07-15 09:06:09.422614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.422746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.422770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.182 qpair failed and we were unable to recover it. 00:27:21.182 [2024-07-15 09:06:09.422912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.423031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.423058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.182 qpair failed and we were unable to recover it. 00:27:21.182 [2024-07-15 09:06:09.423193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.423330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.423358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.182 qpair failed and we were unable to recover it. 00:27:21.182 [2024-07-15 09:06:09.423515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.423648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.423675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.182 qpair failed and we were unable to recover it. 00:27:21.182 [2024-07-15 09:06:09.423806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.423980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.424005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.182 qpair failed and we were unable to recover it. 00:27:21.182 [2024-07-15 09:06:09.424112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.424271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.424298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.182 qpair failed and we were unable to recover it. 00:27:21.182 [2024-07-15 09:06:09.424431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.424588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.424612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.182 qpair failed and we were unable to recover it. 00:27:21.182 [2024-07-15 09:06:09.424760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.424943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.424971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.182 qpair failed and we were unable to recover it. 00:27:21.182 [2024-07-15 09:06:09.425104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.425242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.425271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.182 qpair failed and we were unable to recover it. 00:27:21.182 [2024-07-15 09:06:09.425435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.425612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.425636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.182 qpair failed and we were unable to recover it. 00:27:21.182 [2024-07-15 09:06:09.425782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.425917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.425946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.182 qpair failed and we were unable to recover it. 00:27:21.182 [2024-07-15 09:06:09.426102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.426301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.426351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.182 qpair failed and we were unable to recover it. 00:27:21.182 [2024-07-15 09:06:09.426546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.426654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.426679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.182 qpair failed and we were unable to recover it. 00:27:21.182 [2024-07-15 09:06:09.426822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.427001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.427026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.182 qpair failed and we were unable to recover it. 00:27:21.182 [2024-07-15 09:06:09.427150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.427287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.427312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.182 qpair failed and we were unable to recover it. 00:27:21.182 [2024-07-15 09:06:09.427452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.427570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.427597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.182 qpair failed and we were unable to recover it. 00:27:21.182 [2024-07-15 09:06:09.427779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.427913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.427938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.182 qpair failed and we were unable to recover it. 00:27:21.182 [2024-07-15 09:06:09.428079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.428208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.428235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.182 qpair failed and we were unable to recover it. 00:27:21.182 [2024-07-15 09:06:09.428364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.428525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.428551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.182 qpair failed and we were unable to recover it. 00:27:21.182 [2024-07-15 09:06:09.428692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.428816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.428842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.182 qpair failed and we were unable to recover it. 00:27:21.182 [2024-07-15 09:06:09.429022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.429142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.429166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.182 qpair failed and we were unable to recover it. 00:27:21.182 [2024-07-15 09:06:09.429332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.429459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.429486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.182 qpair failed and we were unable to recover it. 00:27:21.182 [2024-07-15 09:06:09.429616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.429753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.182 [2024-07-15 09:06:09.429780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.182 qpair failed and we were unable to recover it. 00:27:21.183 [2024-07-15 09:06:09.429938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.430066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.430093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.183 qpair failed and we were unable to recover it. 00:27:21.183 [2024-07-15 09:06:09.430229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.430379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.430403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.183 qpair failed and we were unable to recover it. 00:27:21.183 [2024-07-15 09:06:09.430575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.430721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.430748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.183 qpair failed and we were unable to recover it. 00:27:21.183 [2024-07-15 09:06:09.430909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.431062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.431090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.183 qpair failed and we were unable to recover it. 00:27:21.183 [2024-07-15 09:06:09.431215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.431340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.431366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.183 qpair failed and we were unable to recover it. 00:27:21.183 [2024-07-15 09:06:09.431527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.431693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.431736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.183 qpair failed and we were unable to recover it. 00:27:21.183 [2024-07-15 09:06:09.431872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.432038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.432065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.183 qpair failed and we were unable to recover it. 00:27:21.183 [2024-07-15 09:06:09.432229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.432345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.432371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.183 qpair failed and we were unable to recover it. 00:27:21.183 [2024-07-15 09:06:09.432533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.432714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.432741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.183 qpair failed and we were unable to recover it. 00:27:21.183 [2024-07-15 09:06:09.432872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.432987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.433012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.183 qpair failed and we were unable to recover it. 00:27:21.183 [2024-07-15 09:06:09.433147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.433303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.433330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.183 qpair failed and we were unable to recover it. 00:27:21.183 [2024-07-15 09:06:09.433452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.433609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.433636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.183 qpair failed and we were unable to recover it. 00:27:21.183 [2024-07-15 09:06:09.433836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.433980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.434005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.183 qpair failed and we were unable to recover it. 00:27:21.183 [2024-07-15 09:06:09.434120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.434254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.434279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.183 qpair failed and we were unable to recover it. 00:27:21.183 [2024-07-15 09:06:09.434410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.434568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.434595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.183 qpair failed and we were unable to recover it. 00:27:21.183 [2024-07-15 09:06:09.434718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.434900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.434928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.183 qpair failed and we were unable to recover it. 00:27:21.183 [2024-07-15 09:06:09.435085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.435281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.435305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.183 qpair failed and we were unable to recover it. 00:27:21.183 [2024-07-15 09:06:09.435471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.435635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.435687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.183 qpair failed and we were unable to recover it. 00:27:21.183 [2024-07-15 09:06:09.435845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.436016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.436044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.183 qpair failed and we were unable to recover it. 00:27:21.183 [2024-07-15 09:06:09.436193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.436311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.436335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.183 qpair failed and we were unable to recover it. 00:27:21.183 [2024-07-15 09:06:09.436505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.436620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.436644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.183 qpair failed and we were unable to recover it. 00:27:21.183 [2024-07-15 09:06:09.436760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.436930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.436955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.183 qpair failed and we were unable to recover it. 00:27:21.183 [2024-07-15 09:06:09.437091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.437248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.437277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.183 qpair failed and we were unable to recover it. 00:27:21.183 [2024-07-15 09:06:09.437402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.437521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.437548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.183 qpair failed and we were unable to recover it. 00:27:21.183 [2024-07-15 09:06:09.437713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.437838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.437865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.183 qpair failed and we were unable to recover it. 00:27:21.183 [2024-07-15 09:06:09.438045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.438166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.438190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.183 qpair failed and we were unable to recover it. 00:27:21.183 [2024-07-15 09:06:09.438350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.438546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.438575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.183 qpair failed and we were unable to recover it. 00:27:21.183 [2024-07-15 09:06:09.438721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.438837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.438862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.183 qpair failed and we were unable to recover it. 00:27:21.183 [2024-07-15 09:06:09.439028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.439203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.439230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.183 qpair failed and we were unable to recover it. 00:27:21.183 [2024-07-15 09:06:09.439366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.439486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.183 [2024-07-15 09:06:09.439510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.183 qpair failed and we were unable to recover it. 00:27:21.183 [2024-07-15 09:06:09.439618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.439806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.439833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.184 qpair failed and we were unable to recover it. 00:27:21.184 [2024-07-15 09:06:09.440011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.440167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.440191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.184 qpair failed and we were unable to recover it. 00:27:21.184 [2024-07-15 09:06:09.440325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.440453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.440480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.184 qpair failed and we were unable to recover it. 00:27:21.184 [2024-07-15 09:06:09.440653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.440776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.440801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.184 qpair failed and we were unable to recover it. 00:27:21.184 [2024-07-15 09:06:09.440947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.441078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.441105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.184 qpair failed and we were unable to recover it. 00:27:21.184 [2024-07-15 09:06:09.441235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.441394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.441421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.184 qpair failed and we were unable to recover it. 00:27:21.184 [2024-07-15 09:06:09.441569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.441706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.441734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.184 qpair failed and we were unable to recover it. 00:27:21.184 [2024-07-15 09:06:09.441852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.442000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.442025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.184 qpair failed and we were unable to recover it. 00:27:21.184 [2024-07-15 09:06:09.442138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.442302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.442329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.184 qpair failed and we were unable to recover it. 00:27:21.184 [2024-07-15 09:06:09.442454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.442654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.442679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.184 qpair failed and we were unable to recover it. 00:27:21.184 [2024-07-15 09:06:09.442797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.442952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.442981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.184 qpair failed and we were unable to recover it. 00:27:21.184 [2024-07-15 09:06:09.443109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.443257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.443281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.184 qpair failed and we were unable to recover it. 00:27:21.184 [2024-07-15 09:06:09.443443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.443625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.443652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.184 qpair failed and we were unable to recover it. 00:27:21.184 [2024-07-15 09:06:09.443770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.443928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.443956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.184 qpair failed and we were unable to recover it. 00:27:21.184 [2024-07-15 09:06:09.444090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.444216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.444243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.184 qpair failed and we were unable to recover it. 00:27:21.184 [2024-07-15 09:06:09.444409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.444576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.444600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.184 qpair failed and we were unable to recover it. 00:27:21.184 [2024-07-15 09:06:09.444746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.444926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.444954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.184 qpair failed and we were unable to recover it. 00:27:21.184 [2024-07-15 09:06:09.445119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.445261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.445285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.184 qpair failed and we were unable to recover it. 00:27:21.184 [2024-07-15 09:06:09.445511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.445652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.445677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.184 qpair failed and we were unable to recover it. 00:27:21.184 [2024-07-15 09:06:09.445812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.445934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.445959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.184 qpair failed and we were unable to recover it. 00:27:21.184 [2024-07-15 09:06:09.446106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.446298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.446340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.184 qpair failed and we were unable to recover it. 00:27:21.184 [2024-07-15 09:06:09.446498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.446663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.446687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.184 qpair failed and we were unable to recover it. 00:27:21.184 [2024-07-15 09:06:09.446808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.446945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.446971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.184 qpair failed and we were unable to recover it. 00:27:21.184 [2024-07-15 09:06:09.447091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.447209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.447234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.184 qpair failed and we were unable to recover it. 00:27:21.184 [2024-07-15 09:06:09.447402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.447523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.184 [2024-07-15 09:06:09.447550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.184 qpair failed and we were unable to recover it. 00:27:21.185 [2024-07-15 09:06:09.447710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.447841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.447868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.185 qpair failed and we were unable to recover it. 00:27:21.185 [2024-07-15 09:06:09.448069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.448258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.448285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.185 qpair failed and we were unable to recover it. 00:27:21.185 [2024-07-15 09:06:09.448422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.448570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.448596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.185 qpair failed and we were unable to recover it. 00:27:21.185 [2024-07-15 09:06:09.448755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.448922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.448947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.185 qpair failed and we were unable to recover it. 00:27:21.185 [2024-07-15 09:06:09.449068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.449230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.449257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.185 qpair failed and we were unable to recover it. 00:27:21.185 [2024-07-15 09:06:09.449444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.449587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.449627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.185 qpair failed and we were unable to recover it. 00:27:21.185 [2024-07-15 09:06:09.449757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.449873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.449905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.185 qpair failed and we were unable to recover it. 00:27:21.185 [2024-07-15 09:06:09.450099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.450252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.450301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.185 qpair failed and we were unable to recover it. 00:27:21.185 [2024-07-15 09:06:09.450427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.450586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.450612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.185 qpair failed and we were unable to recover it. 00:27:21.185 [2024-07-15 09:06:09.450752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.450944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.450972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.185 qpair failed and we were unable to recover it. 00:27:21.185 [2024-07-15 09:06:09.451120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.451263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.451287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.185 qpair failed and we were unable to recover it. 00:27:21.185 [2024-07-15 09:06:09.451407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.451555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.451580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.185 qpair failed and we were unable to recover it. 00:27:21.185 [2024-07-15 09:06:09.451726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.451902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.451927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.185 qpair failed and we were unable to recover it. 00:27:21.185 [2024-07-15 09:06:09.452047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.452210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.452237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.185 qpair failed and we were unable to recover it. 00:27:21.185 [2024-07-15 09:06:09.452387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.452507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.452531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.185 qpair failed and we were unable to recover it. 00:27:21.185 [2024-07-15 09:06:09.452653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.452783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.452810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.185 qpair failed and we were unable to recover it. 00:27:21.185 [2024-07-15 09:06:09.452979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.453096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.453120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.185 qpair failed and we were unable to recover it. 00:27:21.185 [2024-07-15 09:06:09.453260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.453427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.453451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.185 qpair failed and we were unable to recover it. 00:27:21.185 [2024-07-15 09:06:09.453594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.453738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.453762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.185 qpair failed and we were unable to recover it. 00:27:21.185 [2024-07-15 09:06:09.453940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.454098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.454125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.185 qpair failed and we were unable to recover it. 00:27:21.185 [2024-07-15 09:06:09.454277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.454441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.454466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.185 qpair failed and we were unable to recover it. 00:27:21.185 [2024-07-15 09:06:09.454583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.454723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.454748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.185 qpair failed and we were unable to recover it. 00:27:21.185 [2024-07-15 09:06:09.454883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.455052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.455083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.185 qpair failed and we were unable to recover it. 00:27:21.185 [2024-07-15 09:06:09.455261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.455434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.455458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.185 qpair failed and we were unable to recover it. 00:27:21.185 [2024-07-15 09:06:09.455611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.455788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.455812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.185 qpair failed and we were unable to recover it. 00:27:21.185 [2024-07-15 09:06:09.455967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.456110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.456138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.185 qpair failed and we were unable to recover it. 00:27:21.185 [2024-07-15 09:06:09.456280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.456418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.456443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.185 qpair failed and we were unable to recover it. 00:27:21.185 [2024-07-15 09:06:09.456559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.456668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.456693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.185 qpair failed and we were unable to recover it. 00:27:21.185 [2024-07-15 09:06:09.456837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.456955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.457000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.185 qpair failed and we were unable to recover it. 00:27:21.185 [2024-07-15 09:06:09.457135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.457285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.457314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.185 qpair failed and we were unable to recover it. 00:27:21.185 [2024-07-15 09:06:09.457505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.457620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.185 [2024-07-15 09:06:09.457645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.185 qpair failed and we were unable to recover it. 00:27:21.185 [2024-07-15 09:06:09.457785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.457948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.457973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.186 qpair failed and we were unable to recover it. 00:27:21.186 [2024-07-15 09:06:09.458091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.458262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.458289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.186 qpair failed and we were unable to recover it. 00:27:21.186 [2024-07-15 09:06:09.458419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.458571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.458597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.186 qpair failed and we were unable to recover it. 00:27:21.186 [2024-07-15 09:06:09.458733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.458842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.458866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.186 qpair failed and we were unable to recover it. 00:27:21.186 [2024-07-15 09:06:09.459040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.459203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.459230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.186 qpair failed and we were unable to recover it. 00:27:21.186 [2024-07-15 09:06:09.459397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.459523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.459550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.186 qpair failed and we were unable to recover it. 00:27:21.186 [2024-07-15 09:06:09.459697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.459850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.459874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.186 qpair failed and we were unable to recover it. 00:27:21.186 [2024-07-15 09:06:09.460075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.460219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.460244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.186 qpair failed and we were unable to recover it. 00:27:21.186 [2024-07-15 09:06:09.460382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.460509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.460538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.186 qpair failed and we were unable to recover it. 00:27:21.186 [2024-07-15 09:06:09.460701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.460888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.460916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.186 qpair failed and we were unable to recover it. 00:27:21.186 [2024-07-15 09:06:09.461062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.461204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.461228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.186 qpair failed and we were unable to recover it. 00:27:21.186 [2024-07-15 09:06:09.461345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.461486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.461511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.186 qpair failed and we were unable to recover it. 00:27:21.186 [2024-07-15 09:06:09.461678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.461856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.461892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.186 qpair failed and we were unable to recover it. 00:27:21.186 [2024-07-15 09:06:09.462022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.462150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.462178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.186 qpair failed and we were unable to recover it. 00:27:21.186 [2024-07-15 09:06:09.462303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.462458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.462485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.186 qpair failed and we were unable to recover it. 00:27:21.186 [2024-07-15 09:06:09.462650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.462764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.462788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.186 qpair failed and we were unable to recover it. 00:27:21.186 [2024-07-15 09:06:09.462912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.463049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.463077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.186 qpair failed and we were unable to recover it. 00:27:21.186 [2024-07-15 09:06:09.463208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.463362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.463389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.186 qpair failed and we were unable to recover it. 00:27:21.186 [2024-07-15 09:06:09.463566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.463708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.463736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.186 qpair failed and we were unable to recover it. 00:27:21.186 [2024-07-15 09:06:09.463896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.464013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.464038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.186 qpair failed and we were unable to recover it. 00:27:21.186 [2024-07-15 09:06:09.464206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.464376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.464401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.186 qpair failed and we were unable to recover it. 00:27:21.186 [2024-07-15 09:06:09.464571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.464737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.464761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.186 qpair failed and we were unable to recover it. 00:27:21.186 [2024-07-15 09:06:09.464908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.465041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.465068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.186 qpair failed and we were unable to recover it. 00:27:21.186 [2024-07-15 09:06:09.465246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.465362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.465386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.186 qpair failed and we were unable to recover it. 00:27:21.186 [2024-07-15 09:06:09.465546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.465670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.465697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.186 qpair failed and we were unable to recover it. 00:27:21.186 [2024-07-15 09:06:09.465855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.466015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.466043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.186 qpair failed and we were unable to recover it. 00:27:21.186 [2024-07-15 09:06:09.466166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.466324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.466351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.186 qpair failed and we were unable to recover it. 00:27:21.186 [2024-07-15 09:06:09.466483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.466621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.466645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.186 qpair failed and we were unable to recover it. 00:27:21.186 [2024-07-15 09:06:09.466816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.466983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.467011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.186 qpair failed and we were unable to recover it. 00:27:21.186 [2024-07-15 09:06:09.467138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.467298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.467325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.186 qpair failed and we were unable to recover it. 00:27:21.186 [2024-07-15 09:06:09.467445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.467568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.186 [2024-07-15 09:06:09.467595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.186 qpair failed and we were unable to recover it. 00:27:21.186 [2024-07-15 09:06:09.467730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.467881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.467906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.187 qpair failed and we were unable to recover it. 00:27:21.187 [2024-07-15 09:06:09.468056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.468186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.468213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.187 qpair failed and we were unable to recover it. 00:27:21.187 [2024-07-15 09:06:09.468336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.468468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.468495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.187 qpair failed and we were unable to recover it. 00:27:21.187 [2024-07-15 09:06:09.468620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.468806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.468830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.187 qpair failed and we were unable to recover it. 00:27:21.187 [2024-07-15 09:06:09.468975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.469090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.469115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.187 qpair failed and we were unable to recover it. 00:27:21.187 [2024-07-15 09:06:09.469289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.469421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.469448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.187 qpair failed and we were unable to recover it. 00:27:21.187 [2024-07-15 09:06:09.469616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.469736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.469763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.187 qpair failed and we were unable to recover it. 00:27:21.187 [2024-07-15 09:06:09.469928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.470082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.470110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.187 qpair failed and we were unable to recover it. 00:27:21.187 [2024-07-15 09:06:09.470283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.470455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.470496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.187 qpair failed and we were unable to recover it. 00:27:21.187 [2024-07-15 09:06:09.470655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.470778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.470805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.187 qpair failed and we were unable to recover it. 00:27:21.187 [2024-07-15 09:06:09.470957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.471116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.471143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.187 qpair failed and we were unable to recover it. 00:27:21.187 [2024-07-15 09:06:09.471303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.471488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.471542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.187 qpair failed and we were unable to recover it. 00:27:21.187 [2024-07-15 09:06:09.471698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.471845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.471869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.187 qpair failed and we were unable to recover it. 00:27:21.187 [2024-07-15 09:06:09.472019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.472144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.472172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.187 qpair failed and we were unable to recover it. 00:27:21.187 [2024-07-15 09:06:09.472343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.472483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.472508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.187 qpair failed and we were unable to recover it. 00:27:21.187 [2024-07-15 09:06:09.472674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.472827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.472854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.187 qpair failed and we were unable to recover it. 00:27:21.187 [2024-07-15 09:06:09.473004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.473115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.473140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.187 qpair failed and we were unable to recover it. 00:27:21.187 [2024-07-15 09:06:09.473311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.473445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.473470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.187 qpair failed and we were unable to recover it. 00:27:21.187 [2024-07-15 09:06:09.473662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.473809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.473837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.187 qpair failed and we were unable to recover it. 00:27:21.187 [2024-07-15 09:06:09.473977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.474148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.474173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.187 qpair failed and we were unable to recover it. 00:27:21.187 [2024-07-15 09:06:09.474325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.474465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.474508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.187 qpair failed and we were unable to recover it. 00:27:21.187 [2024-07-15 09:06:09.474668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.474827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.474854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.187 qpair failed and we were unable to recover it. 00:27:21.187 [2024-07-15 09:06:09.474990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.475109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.475136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.187 qpair failed and we were unable to recover it. 00:27:21.187 [2024-07-15 09:06:09.475252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.475365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.475392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.187 qpair failed and we were unable to recover it. 00:27:21.187 [2024-07-15 09:06:09.475526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.475694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.475718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.187 qpair failed and we were unable to recover it. 00:27:21.187 [2024-07-15 09:06:09.475869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.476031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.476059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.187 qpair failed and we were unable to recover it. 00:27:21.187 [2024-07-15 09:06:09.476214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.476376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.476403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.187 qpair failed and we were unable to recover it. 00:27:21.187 [2024-07-15 09:06:09.476561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.476718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.476745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.187 qpair failed and we were unable to recover it. 00:27:21.187 [2024-07-15 09:06:09.476902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.477024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.477048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.187 qpair failed and we were unable to recover it. 00:27:21.187 [2024-07-15 09:06:09.477185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.477342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.477369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.187 qpair failed and we were unable to recover it. 00:27:21.187 [2024-07-15 09:06:09.477521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.477680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.477707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.187 qpair failed and we were unable to recover it. 00:27:21.187 [2024-07-15 09:06:09.477824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.187 [2024-07-15 09:06:09.478013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.478042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.188 qpair failed and we were unable to recover it. 00:27:21.188 [2024-07-15 09:06:09.478237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.478382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.478423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.188 qpair failed and we were unable to recover it. 00:27:21.188 [2024-07-15 09:06:09.478584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.478735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.478762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.188 qpair failed and we were unable to recover it. 00:27:21.188 [2024-07-15 09:06:09.478913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.479064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.479091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.188 qpair failed and we were unable to recover it. 00:27:21.188 [2024-07-15 09:06:09.479225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.479440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.479491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.188 qpair failed and we were unable to recover it. 00:27:21.188 [2024-07-15 09:06:09.479648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.479766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.479795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.188 qpair failed and we were unable to recover it. 00:27:21.188 [2024-07-15 09:06:09.479970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.480113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.480138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.188 qpair failed and we were unable to recover it. 00:27:21.188 [2024-07-15 09:06:09.480320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.480523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.480574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.188 qpair failed and we were unable to recover it. 00:27:21.188 [2024-07-15 09:06:09.480751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.480871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.480906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.188 qpair failed and we were unable to recover it. 00:27:21.188 [2024-07-15 09:06:09.481108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.481268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.481296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.188 qpair failed and we were unable to recover it. 00:27:21.188 [2024-07-15 09:06:09.481428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.481586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.481613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.188 qpair failed and we were unable to recover it. 00:27:21.188 [2024-07-15 09:06:09.481764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.481902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.481931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.188 qpair failed and we were unable to recover it. 00:27:21.188 [2024-07-15 09:06:09.482099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.482224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.482252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.188 qpair failed and we were unable to recover it. 00:27:21.188 [2024-07-15 09:06:09.482417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.482558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.482583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.188 qpair failed and we were unable to recover it. 00:27:21.188 [2024-07-15 09:06:09.482760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.482932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.482960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.188 qpair failed and we were unable to recover it. 00:27:21.188 [2024-07-15 09:06:09.483094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.483260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.483287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.188 qpair failed and we were unable to recover it. 00:27:21.188 [2024-07-15 09:06:09.483510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.483633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.483660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.188 qpair failed and we were unable to recover it. 00:27:21.188 [2024-07-15 09:06:09.483823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.483935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.483961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.188 qpair failed and we were unable to recover it. 00:27:21.188 [2024-07-15 09:06:09.484094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.484257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.484281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.188 qpair failed and we were unable to recover it. 00:27:21.188 [2024-07-15 09:06:09.484424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.484563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.484588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.188 qpair failed and we were unable to recover it. 00:27:21.188 [2024-07-15 09:06:09.484781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.484913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.484942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.188 qpair failed and we were unable to recover it. 00:27:21.188 [2024-07-15 09:06:09.485087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.485206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.485234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.188 qpair failed and we were unable to recover it. 00:27:21.188 [2024-07-15 09:06:09.485397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.485559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.485584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.188 qpair failed and we were unable to recover it. 00:27:21.188 [2024-07-15 09:06:09.485690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.485819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.485846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.188 qpair failed and we were unable to recover it. 00:27:21.188 [2024-07-15 09:06:09.486019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.486190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.486215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.188 qpair failed and we were unable to recover it. 00:27:21.188 [2024-07-15 09:06:09.486388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.486530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.188 [2024-07-15 09:06:09.486554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.188 qpair failed and we were unable to recover it. 00:27:21.188 [2024-07-15 09:06:09.486691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.486870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.486923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.189 qpair failed and we were unable to recover it. 00:27:21.189 [2024-07-15 09:06:09.487093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.487249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.487273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.189 qpair failed and we were unable to recover it. 00:27:21.189 [2024-07-15 09:06:09.487461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.487660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.487708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.189 qpair failed and we were unable to recover it. 00:27:21.189 [2024-07-15 09:06:09.487867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.488017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.488058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.189 qpair failed and we were unable to recover it. 00:27:21.189 [2024-07-15 09:06:09.488213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.488385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.488425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.189 qpair failed and we were unable to recover it. 00:27:21.189 [2024-07-15 09:06:09.488597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.488752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.488783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.189 qpair failed and we were unable to recover it. 00:27:21.189 [2024-07-15 09:06:09.488983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.489228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.489252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.189 qpair failed and we were unable to recover it. 00:27:21.189 [2024-07-15 09:06:09.489393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.489577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.489604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.189 qpair failed and we were unable to recover it. 00:27:21.189 [2024-07-15 09:06:09.489797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.489923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.489950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.189 qpair failed and we were unable to recover it. 00:27:21.189 [2024-07-15 09:06:09.490112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.490266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.490292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.189 qpair failed and we were unable to recover it. 00:27:21.189 [2024-07-15 09:06:09.490501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.490713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.490741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.189 qpair failed and we were unable to recover it. 00:27:21.189 [2024-07-15 09:06:09.490895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.491014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.491039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.189 qpair failed and we were unable to recover it. 00:27:21.189 [2024-07-15 09:06:09.491232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.491368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.491395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.189 qpair failed and we were unable to recover it. 00:27:21.189 [2024-07-15 09:06:09.491554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.491684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.491712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.189 qpair failed and we were unable to recover it. 00:27:21.189 [2024-07-15 09:06:09.491867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.492023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.492051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.189 qpair failed and we were unable to recover it. 00:27:21.189 [2024-07-15 09:06:09.492237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.492350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.492374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.189 qpair failed and we were unable to recover it. 00:27:21.189 [2024-07-15 09:06:09.492531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.492715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.492743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.189 qpair failed and we were unable to recover it. 00:27:21.189 [2024-07-15 09:06:09.492901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.493029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.493056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.189 qpair failed and we were unable to recover it. 00:27:21.189 [2024-07-15 09:06:09.493194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.493365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.493416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.189 qpair failed and we were unable to recover it. 00:27:21.189 [2024-07-15 09:06:09.493604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.493722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.493760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.189 qpair failed and we were unable to recover it. 00:27:21.189 [2024-07-15 09:06:09.493912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.494050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.494077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.189 qpair failed and we were unable to recover it. 00:27:21.189 [2024-07-15 09:06:09.494241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.494423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.494447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.189 qpair failed and we were unable to recover it. 00:27:21.189 [2024-07-15 09:06:09.494595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.494700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.494725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.189 qpair failed and we were unable to recover it. 00:27:21.189 [2024-07-15 09:06:09.494868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.495016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.495058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.189 qpair failed and we were unable to recover it. 00:27:21.189 [2024-07-15 09:06:09.495203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.495388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.495415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.189 qpair failed and we were unable to recover it. 00:27:21.189 [2024-07-15 09:06:09.495596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.495739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.495767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.189 qpair failed and we were unable to recover it. 00:27:21.189 [2024-07-15 09:06:09.495935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.496091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.496118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.189 qpair failed and we were unable to recover it. 00:27:21.189 [2024-07-15 09:06:09.496329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.496443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.496467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.189 qpair failed and we were unable to recover it. 00:27:21.189 [2024-07-15 09:06:09.496603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.496761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.496787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.189 qpair failed and we were unable to recover it. 00:27:21.189 [2024-07-15 09:06:09.496936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.497084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.189 [2024-07-15 09:06:09.497111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.190 qpair failed and we were unable to recover it. 00:27:21.190 [2024-07-15 09:06:09.497271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.497444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.497469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.190 qpair failed and we were unable to recover it. 00:27:21.190 [2024-07-15 09:06:09.497613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.497805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.497833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.190 qpair failed and we were unable to recover it. 00:27:21.190 [2024-07-15 09:06:09.497981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.498125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.498150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.190 qpair failed and we were unable to recover it. 00:27:21.190 [2024-07-15 09:06:09.498261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.498381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.498405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.190 qpair failed and we were unable to recover it. 00:27:21.190 [2024-07-15 09:06:09.498518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.498726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.498753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.190 qpair failed and we were unable to recover it. 00:27:21.190 [2024-07-15 09:06:09.498944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.499060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.499100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.190 qpair failed and we were unable to recover it. 00:27:21.190 [2024-07-15 09:06:09.499295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.499481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.499505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.190 qpair failed and we were unable to recover it. 00:27:21.190 [2024-07-15 09:06:09.499657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.499831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.499858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.190 qpair failed and we were unable to recover it. 00:27:21.190 [2024-07-15 09:06:09.499998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.500186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.500214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.190 qpair failed and we were unable to recover it. 00:27:21.190 [2024-07-15 09:06:09.500378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.500565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.500623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.190 qpair failed and we were unable to recover it. 00:27:21.190 [2024-07-15 09:06:09.500755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.500927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.500955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.190 qpair failed and we were unable to recover it. 00:27:21.190 [2024-07-15 09:06:09.501111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.501251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.501279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.190 qpair failed and we were unable to recover it. 00:27:21.190 [2024-07-15 09:06:09.501403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.501559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.501586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.190 qpair failed and we were unable to recover it. 00:27:21.190 [2024-07-15 09:06:09.501750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.501897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.501922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.190 qpair failed and we were unable to recover it. 00:27:21.190 [2024-07-15 09:06:09.502076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.502264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.502291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.190 qpair failed and we were unable to recover it. 00:27:21.190 [2024-07-15 09:06:09.502484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.502604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.502630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.190 qpair failed and we were unable to recover it. 00:27:21.190 [2024-07-15 09:06:09.502819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.502981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.503014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.190 qpair failed and we were unable to recover it. 00:27:21.190 [2024-07-15 09:06:09.503155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.503331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.503373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.190 qpair failed and we were unable to recover it. 00:27:21.190 [2024-07-15 09:06:09.503506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.503703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.503730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.190 qpair failed and we were unable to recover it. 00:27:21.190 [2024-07-15 09:06:09.503884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.504035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.504062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.190 qpair failed and we were unable to recover it. 00:27:21.190 [2024-07-15 09:06:09.504178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.504329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.504356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.190 qpair failed and we were unable to recover it. 00:27:21.190 [2024-07-15 09:06:09.504531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.504669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.504693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.190 qpair failed and we were unable to recover it. 00:27:21.190 [2024-07-15 09:06:09.504866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.505023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.505050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.190 qpair failed and we were unable to recover it. 00:27:21.190 [2024-07-15 09:06:09.505182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.505338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.505365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.190 qpair failed and we were unable to recover it. 00:27:21.190 [2024-07-15 09:06:09.505510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.505670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.505698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.190 qpair failed and we were unable to recover it. 00:27:21.190 [2024-07-15 09:06:09.505831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.505975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.506000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.190 qpair failed and we were unable to recover it. 00:27:21.190 [2024-07-15 09:06:09.506122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.506247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.506271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.190 qpair failed and we were unable to recover it. 00:27:21.190 [2024-07-15 09:06:09.506419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.506592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.506618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.190 qpair failed and we were unable to recover it. 00:27:21.190 [2024-07-15 09:06:09.506812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.506937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.506962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.190 qpair failed and we were unable to recover it. 00:27:21.190 [2024-07-15 09:06:09.507156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.507299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.507324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.190 qpair failed and we were unable to recover it. 00:27:21.190 [2024-07-15 09:06:09.507493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.507673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.190 [2024-07-15 09:06:09.507700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.191 qpair failed and we were unable to recover it. 00:27:21.191 [2024-07-15 09:06:09.507827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.508017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.508042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.191 qpair failed and we were unable to recover it. 00:27:21.191 [2024-07-15 09:06:09.508160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.508306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.508331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.191 qpair failed and we were unable to recover it. 00:27:21.191 [2024-07-15 09:06:09.508471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.508583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.508608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.191 qpair failed and we were unable to recover it. 00:27:21.191 [2024-07-15 09:06:09.508757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.508888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.508930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.191 qpair failed and we were unable to recover it. 00:27:21.191 [2024-07-15 09:06:09.509054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.509182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.509210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.191 qpair failed and we were unable to recover it. 00:27:21.191 [2024-07-15 09:06:09.509342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.509476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.509503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.191 qpair failed and we were unable to recover it. 00:27:21.191 [2024-07-15 09:06:09.509653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.509809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.509833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.191 qpair failed and we were unable to recover it. 00:27:21.191 [2024-07-15 09:06:09.509983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.510118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.510143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.191 qpair failed and we were unable to recover it. 00:27:21.191 [2024-07-15 09:06:09.510293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.510457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.510484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.191 qpair failed and we were unable to recover it. 00:27:21.191 [2024-07-15 09:06:09.510669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.510862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.510914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.191 qpair failed and we were unable to recover it. 00:27:21.191 [2024-07-15 09:06:09.511060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.511205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.511230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.191 qpair failed and we were unable to recover it. 00:27:21.191 [2024-07-15 09:06:09.511381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.511541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.511568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.191 qpair failed and we were unable to recover it. 00:27:21.191 [2024-07-15 09:06:09.511711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.511858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.511893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.191 qpair failed and we were unable to recover it. 00:27:21.191 [2024-07-15 09:06:09.512043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.512165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.512190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.191 qpair failed and we were unable to recover it. 00:27:21.191 [2024-07-15 09:06:09.512332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.512510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.512552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.191 qpair failed and we were unable to recover it. 00:27:21.191 [2024-07-15 09:06:09.512739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.512874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.512924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.191 qpair failed and we were unable to recover it. 00:27:21.191 [2024-07-15 09:06:09.513076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.513187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.513212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.191 qpair failed and we were unable to recover it. 00:27:21.191 [2024-07-15 09:06:09.513358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.513496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.513521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.191 qpair failed and we were unable to recover it. 00:27:21.191 [2024-07-15 09:06:09.513686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.513883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.513926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.191 qpair failed and we were unable to recover it. 00:27:21.191 [2024-07-15 09:06:09.514046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.514191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.514216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.191 qpair failed and we were unable to recover it. 00:27:21.191 [2024-07-15 09:06:09.514370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.514549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.514576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.191 qpair failed and we were unable to recover it. 00:27:21.191 [2024-07-15 09:06:09.514756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.514937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.514963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.191 qpair failed and we were unable to recover it. 00:27:21.191 [2024-07-15 09:06:09.515108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.515262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.515286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.191 qpair failed and we were unable to recover it. 00:27:21.191 [2024-07-15 09:06:09.515455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.515614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.515642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.191 qpair failed and we were unable to recover it. 00:27:21.191 [2024-07-15 09:06:09.515802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.515971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.515997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.191 qpair failed and we were unable to recover it. 00:27:21.191 [2024-07-15 09:06:09.516141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.516285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.516309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.191 qpair failed and we were unable to recover it. 00:27:21.191 [2024-07-15 09:06:09.516479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.516630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.516673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.191 qpair failed and we were unable to recover it. 00:27:21.191 [2024-07-15 09:06:09.516868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.517039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.517064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.191 qpair failed and we were unable to recover it. 00:27:21.191 [2024-07-15 09:06:09.517229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.517384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.517410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.191 qpair failed and we were unable to recover it. 00:27:21.191 [2024-07-15 09:06:09.517600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.517779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.191 [2024-07-15 09:06:09.517807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.191 qpair failed and we were unable to recover it. 00:27:21.191 [2024-07-15 09:06:09.517979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.518121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.518145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.192 qpair failed and we were unable to recover it. 00:27:21.192 [2024-07-15 09:06:09.518309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.518457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.518481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.192 qpair failed and we were unable to recover it. 00:27:21.192 [2024-07-15 09:06:09.518627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.518746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.518772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.192 qpair failed and we were unable to recover it. 00:27:21.192 [2024-07-15 09:06:09.518958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.519100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.519125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.192 qpair failed and we were unable to recover it. 00:27:21.192 [2024-07-15 09:06:09.519276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.519393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.519417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.192 qpair failed and we were unable to recover it. 00:27:21.192 [2024-07-15 09:06:09.519584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.519777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.519805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.192 qpair failed and we were unable to recover it. 00:27:21.192 [2024-07-15 09:06:09.519974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.520090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.520120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.192 qpair failed and we were unable to recover it. 00:27:21.192 [2024-07-15 09:06:09.520323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.520534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.520561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.192 qpair failed and we were unable to recover it. 00:27:21.192 [2024-07-15 09:06:09.520728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.520847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.520872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.192 qpair failed and we were unable to recover it. 00:27:21.192 [2024-07-15 09:06:09.521008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.521146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.521187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.192 qpair failed and we were unable to recover it. 00:27:21.192 [2024-07-15 09:06:09.521390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.521533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.521557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.192 qpair failed and we were unable to recover it. 00:27:21.192 [2024-07-15 09:06:09.521701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.521848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.521882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.192 qpair failed and we were unable to recover it. 00:27:21.192 [2024-07-15 09:06:09.522029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.522205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.522229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.192 qpair failed and we were unable to recover it. 00:27:21.192 [2024-07-15 09:06:09.522434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.522621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.522648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.192 qpair failed and we were unable to recover it. 00:27:21.192 [2024-07-15 09:06:09.522776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.522932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.522958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.192 qpair failed and we were unable to recover it. 00:27:21.192 [2024-07-15 09:06:09.523095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.523234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.523267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.192 qpair failed and we were unable to recover it. 00:27:21.192 [2024-07-15 09:06:09.523454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.523599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.523623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.192 qpair failed and we were unable to recover it. 00:27:21.192 [2024-07-15 09:06:09.523800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.523973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.523997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.192 qpair failed and we were unable to recover it. 00:27:21.192 [2024-07-15 09:06:09.524110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.524275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.524304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.192 qpair failed and we were unable to recover it. 00:27:21.192 [2024-07-15 09:06:09.524461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.524589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.524618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.192 qpair failed and we were unable to recover it. 00:27:21.192 [2024-07-15 09:06:09.524783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.524901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.524934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.192 qpair failed and we were unable to recover it. 00:27:21.192 [2024-07-15 09:06:09.525086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.525229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.525255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.192 qpair failed and we were unable to recover it. 00:27:21.192 [2024-07-15 09:06:09.525424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.525559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.525586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.192 qpair failed and we were unable to recover it. 00:27:21.192 [2024-07-15 09:06:09.525746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.525909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.525949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.192 qpair failed and we were unable to recover it. 00:27:21.192 [2024-07-15 09:06:09.526142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.526337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.526364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.192 qpair failed and we were unable to recover it. 00:27:21.192 [2024-07-15 09:06:09.526493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.526677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.526701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.192 qpair failed and we were unable to recover it. 00:27:21.192 [2024-07-15 09:06:09.526847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.527025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.527050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.192 qpair failed and we were unable to recover it. 00:27:21.192 [2024-07-15 09:06:09.527212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.527354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.527379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.192 qpair failed and we were unable to recover it. 00:27:21.192 [2024-07-15 09:06:09.527523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.527643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.527668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.192 qpair failed and we were unable to recover it. 00:27:21.192 [2024-07-15 09:06:09.527797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.527939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.527964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.192 qpair failed and we were unable to recover it. 00:27:21.192 [2024-07-15 09:06:09.528110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.528266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.528291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.192 qpair failed and we were unable to recover it. 00:27:21.192 [2024-07-15 09:06:09.528427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.192 [2024-07-15 09:06:09.528592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.528618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.193 qpair failed and we were unable to recover it. 00:27:21.193 [2024-07-15 09:06:09.528761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.528886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.528911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.193 qpair failed and we were unable to recover it. 00:27:21.193 [2024-07-15 09:06:09.529078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.529282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.529309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.193 qpair failed and we were unable to recover it. 00:27:21.193 [2024-07-15 09:06:09.529495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.529637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.529660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.193 qpair failed and we were unable to recover it. 00:27:21.193 [2024-07-15 09:06:09.529885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.530016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.530041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.193 qpair failed and we were unable to recover it. 00:27:21.193 [2024-07-15 09:06:09.530156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.530298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.530323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.193 qpair failed and we were unable to recover it. 00:27:21.193 [2024-07-15 09:06:09.530491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.530619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.530646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.193 qpair failed and we were unable to recover it. 00:27:21.193 [2024-07-15 09:06:09.530779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.530941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.530966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.193 qpair failed and we were unable to recover it. 00:27:21.193 [2024-07-15 09:06:09.531106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.531225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.531250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.193 qpair failed and we were unable to recover it. 00:27:21.193 [2024-07-15 09:06:09.531457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.531621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.531648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.193 qpair failed and we were unable to recover it. 00:27:21.193 [2024-07-15 09:06:09.531807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.531995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.532020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.193 qpair failed and we were unable to recover it. 00:27:21.193 [2024-07-15 09:06:09.532144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.532264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.532288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.193 qpair failed and we were unable to recover it. 00:27:21.193 [2024-07-15 09:06:09.532407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.532553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.532594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.193 qpair failed and we were unable to recover it. 00:27:21.193 [2024-07-15 09:06:09.532727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.532867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.532899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.193 qpair failed and we were unable to recover it. 00:27:21.193 [2024-07-15 09:06:09.533090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.533235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.533260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.193 qpair failed and we were unable to recover it. 00:27:21.193 [2024-07-15 09:06:09.533434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.533614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.533639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.193 qpair failed and we were unable to recover it. 00:27:21.193 [2024-07-15 09:06:09.533784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.533919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.533951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.193 qpair failed and we were unable to recover it. 00:27:21.193 [2024-07-15 09:06:09.534119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.534273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.534297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.193 qpair failed and we were unable to recover it. 00:27:21.193 [2024-07-15 09:06:09.534442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.534577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.534601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.193 qpair failed and we were unable to recover it. 00:27:21.193 [2024-07-15 09:06:09.534744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.534888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.534914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.193 qpair failed and we were unable to recover it. 00:27:21.193 [2024-07-15 09:06:09.535073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.535199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.535225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.193 qpair failed and we were unable to recover it. 00:27:21.193 [2024-07-15 09:06:09.535395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.535536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.535560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.193 qpair failed and we were unable to recover it. 00:27:21.193 [2024-07-15 09:06:09.535727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.535860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.535897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.193 qpair failed and we were unable to recover it. 00:27:21.193 [2024-07-15 09:06:09.536089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.536219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.536244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.193 qpair failed and we were unable to recover it. 00:27:21.193 [2024-07-15 09:06:09.536430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.536574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.536598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.193 qpair failed and we were unable to recover it. 00:27:21.193 [2024-07-15 09:06:09.536752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.536900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.536933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.193 qpair failed and we were unable to recover it. 00:27:21.193 [2024-07-15 09:06:09.537079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.537289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.193 [2024-07-15 09:06:09.537318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.193 qpair failed and we were unable to recover it. 00:27:21.193 [2024-07-15 09:06:09.537463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.537608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.537632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.194 qpair failed and we were unable to recover it. 00:27:21.194 [2024-07-15 09:06:09.537795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.537949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.537978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.194 qpair failed and we were unable to recover it. 00:27:21.194 [2024-07-15 09:06:09.538142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.538291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.538315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.194 qpair failed and we were unable to recover it. 00:27:21.194 [2024-07-15 09:06:09.538439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.538564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.538588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.194 qpair failed and we were unable to recover it. 00:27:21.194 [2024-07-15 09:06:09.538706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.538816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.538842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.194 qpair failed and we were unable to recover it. 00:27:21.194 [2024-07-15 09:06:09.539035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.539159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.539200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.194 qpair failed and we were unable to recover it. 00:27:21.194 [2024-07-15 09:06:09.539391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.539537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.539562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.194 qpair failed and we were unable to recover it. 00:27:21.194 [2024-07-15 09:06:09.539686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.539840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.539865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.194 qpair failed and we were unable to recover it. 00:27:21.194 [2024-07-15 09:06:09.540070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.540209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.540233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.194 qpair failed and we were unable to recover it. 00:27:21.194 [2024-07-15 09:06:09.540352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.540497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.540523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.194 qpair failed and we were unable to recover it. 00:27:21.194 [2024-07-15 09:06:09.540698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.540825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.540850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.194 qpair failed and we were unable to recover it. 00:27:21.194 [2024-07-15 09:06:09.541022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.541175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.541198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.194 qpair failed and we were unable to recover it. 00:27:21.194 [2024-07-15 09:06:09.541349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.541505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.541532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.194 qpair failed and we were unable to recover it. 00:27:21.194 [2024-07-15 09:06:09.541689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.541839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.541867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.194 qpair failed and we were unable to recover it. 00:27:21.194 [2024-07-15 09:06:09.542045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.542188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.542227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.194 qpair failed and we were unable to recover it. 00:27:21.194 [2024-07-15 09:06:09.542423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.542541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.542565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.194 qpair failed and we were unable to recover it. 00:27:21.194 [2024-07-15 09:06:09.542735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.542914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.542946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.194 qpair failed and we were unable to recover it. 00:27:21.194 [2024-07-15 09:06:09.543089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.543228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.543254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.194 qpair failed and we were unable to recover it. 00:27:21.194 [2024-07-15 09:06:09.543423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.543542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.543565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.194 qpair failed and we were unable to recover it. 00:27:21.194 [2024-07-15 09:06:09.543689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.543881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.543910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.194 qpair failed and we were unable to recover it. 00:27:21.194 [2024-07-15 09:06:09.544067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.544257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.544284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.194 qpair failed and we were unable to recover it. 00:27:21.194 [2024-07-15 09:06:09.544478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.544659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.544685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.194 qpair failed and we were unable to recover it. 00:27:21.194 [2024-07-15 09:06:09.544841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.544999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.545024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.194 qpair failed and we were unable to recover it. 00:27:21.194 [2024-07-15 09:06:09.545191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.545376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.545403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.194 qpair failed and we were unable to recover it. 00:27:21.194 [2024-07-15 09:06:09.545556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.545716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.545743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.194 qpair failed and we were unable to recover it. 00:27:21.194 [2024-07-15 09:06:09.545902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.546032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.546059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.194 qpair failed and we were unable to recover it. 00:27:21.194 [2024-07-15 09:06:09.546221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.546366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.546404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.194 qpair failed and we were unable to recover it. 00:27:21.194 [2024-07-15 09:06:09.546558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.546713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.546740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.194 qpair failed and we were unable to recover it. 00:27:21.194 [2024-07-15 09:06:09.546901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.547064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.547092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.194 qpair failed and we were unable to recover it. 00:27:21.194 [2024-07-15 09:06:09.547251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.547429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.547455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.194 qpair failed and we were unable to recover it. 00:27:21.194 [2024-07-15 09:06:09.547623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.547745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.194 [2024-07-15 09:06:09.547771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.194 qpair failed and we were unable to recover it. 00:27:21.194 [2024-07-15 09:06:09.547923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.548121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.548146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.195 qpair failed and we were unable to recover it. 00:27:21.195 [2024-07-15 09:06:09.548325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.548519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.548545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.195 qpair failed and we were unable to recover it. 00:27:21.195 [2024-07-15 09:06:09.548727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.548888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.548917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.195 qpair failed and we were unable to recover it. 00:27:21.195 [2024-07-15 09:06:09.549087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.549243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.549267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.195 qpair failed and we were unable to recover it. 00:27:21.195 [2024-07-15 09:06:09.549416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.549549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.549576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.195 qpair failed and we were unable to recover it. 00:27:21.195 [2024-07-15 09:06:09.549737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.549897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.549928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.195 qpair failed and we were unable to recover it. 00:27:21.195 [2024-07-15 09:06:09.550081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.550270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.550297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.195 qpair failed and we were unable to recover it. 00:27:21.195 [2024-07-15 09:06:09.550431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.550542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.550567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.195 qpair failed and we were unable to recover it. 00:27:21.195 [2024-07-15 09:06:09.550734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.550886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.550914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.195 qpair failed and we were unable to recover it. 00:27:21.195 [2024-07-15 09:06:09.551099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.551230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.551261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.195 qpair failed and we were unable to recover it. 00:27:21.195 [2024-07-15 09:06:09.551450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.551605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.551632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.195 qpair failed and we were unable to recover it. 00:27:21.195 [2024-07-15 09:06:09.551769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.551924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.551950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.195 qpair failed and we were unable to recover it. 00:27:21.195 [2024-07-15 09:06:09.552135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.552290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.552314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.195 qpair failed and we were unable to recover it. 00:27:21.195 [2024-07-15 09:06:09.552485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.552642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.552669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.195 qpair failed and we were unable to recover it. 00:27:21.195 [2024-07-15 09:06:09.552821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.552993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.553017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.195 qpair failed and we were unable to recover it. 00:27:21.195 [2024-07-15 09:06:09.553126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.553273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.553298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.195 qpair failed and we were unable to recover it. 00:27:21.195 [2024-07-15 09:06:09.553442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.553603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.553630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.195 qpair failed and we were unable to recover it. 00:27:21.195 [2024-07-15 09:06:09.553789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.553970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.553997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.195 qpair failed and we were unable to recover it. 00:27:21.195 [2024-07-15 09:06:09.554164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.554353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.554380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.195 qpair failed and we were unable to recover it. 00:27:21.195 [2024-07-15 09:06:09.554547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.554726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.554753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.195 qpair failed and we were unable to recover it. 00:27:21.195 [2024-07-15 09:06:09.554892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.555082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.555109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.195 qpair failed and we were unable to recover it. 00:27:21.195 [2024-07-15 09:06:09.555269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.555423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.555450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.195 qpair failed and we were unable to recover it. 00:27:21.195 [2024-07-15 09:06:09.555636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.555791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.555817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.195 qpair failed and we were unable to recover it. 00:27:21.195 [2024-07-15 09:06:09.555957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.556107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.556131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.195 qpair failed and we were unable to recover it. 00:27:21.195 [2024-07-15 09:06:09.556318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.556488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.556515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.195 qpair failed and we were unable to recover it. 00:27:21.195 [2024-07-15 09:06:09.556669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.556828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.556855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.195 qpair failed and we were unable to recover it. 00:27:21.195 [2024-07-15 09:06:09.557036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.557204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.557243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.195 qpair failed and we were unable to recover it. 00:27:21.195 [2024-07-15 09:06:09.557382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.557496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.557519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.195 qpair failed and we were unable to recover it. 00:27:21.195 [2024-07-15 09:06:09.557707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.557856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.557890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.195 qpair failed and we were unable to recover it. 00:27:21.195 [2024-07-15 09:06:09.558063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.558249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.558276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.195 qpair failed and we were unable to recover it. 00:27:21.195 [2024-07-15 09:06:09.558417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.558543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.558569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.195 qpair failed and we were unable to recover it. 00:27:21.195 [2024-07-15 09:06:09.558713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.195 [2024-07-15 09:06:09.558855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.558885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.196 qpair failed and we were unable to recover it. 00:27:21.196 [2024-07-15 09:06:09.559010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.559174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.559200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.196 qpair failed and we were unable to recover it. 00:27:21.196 [2024-07-15 09:06:09.559382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.559536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.559563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.196 qpair failed and we were unable to recover it. 00:27:21.196 [2024-07-15 09:06:09.559728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.559894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.559919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.196 qpair failed and we were unable to recover it. 00:27:21.196 [2024-07-15 09:06:09.560119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.560269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.560310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.196 qpair failed and we were unable to recover it. 00:27:21.196 [2024-07-15 09:06:09.560505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.560654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.560680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.196 qpair failed and we were unable to recover it. 00:27:21.196 [2024-07-15 09:06:09.560884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.561024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.561048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.196 qpair failed and we were unable to recover it. 00:27:21.196 [2024-07-15 09:06:09.561186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.561312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.561341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.196 qpair failed and we were unable to recover it. 00:27:21.196 [2024-07-15 09:06:09.561529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.561689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.561716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.196 qpair failed and we were unable to recover it. 00:27:21.196 [2024-07-15 09:06:09.561909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.562040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.562068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.196 qpair failed and we were unable to recover it. 00:27:21.196 [2024-07-15 09:06:09.562229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.562351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.562378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.196 qpair failed and we were unable to recover it. 00:27:21.196 [2024-07-15 09:06:09.562559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.562684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.562710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.196 qpair failed and we were unable to recover it. 00:27:21.196 [2024-07-15 09:06:09.562867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.563057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.563083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.196 qpair failed and we were unable to recover it. 00:27:21.196 [2024-07-15 09:06:09.563212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.563354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.563381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.196 qpair failed and we were unable to recover it. 00:27:21.196 [2024-07-15 09:06:09.563513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.563673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.563701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.196 qpair failed and we were unable to recover it. 00:27:21.196 [2024-07-15 09:06:09.563832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.563987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.564012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.196 qpair failed and we were unable to recover it. 00:27:21.196 [2024-07-15 09:06:09.564169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.564321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.564348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.196 qpair failed and we were unable to recover it. 00:27:21.196 [2024-07-15 09:06:09.564518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.564696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.564724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.196 qpair failed and we were unable to recover it. 00:27:21.196 [2024-07-15 09:06:09.564889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.565736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.565780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.196 qpair failed and we were unable to recover it. 00:27:21.196 [2024-07-15 09:06:09.565993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.566145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.566170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.196 qpair failed and we were unable to recover it. 00:27:21.196 [2024-07-15 09:06:09.566376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.566538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.566565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.196 qpair failed and we were unable to recover it. 00:27:21.196 [2024-07-15 09:06:09.566729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.566988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.567017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.196 qpair failed and we were unable to recover it. 00:27:21.196 [2024-07-15 09:06:09.567179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.567316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.567343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.196 qpair failed and we were unable to recover it. 00:27:21.196 [2024-07-15 09:06:09.567500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.567692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.567717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.196 qpair failed and we were unable to recover it. 00:27:21.196 [2024-07-15 09:06:09.567836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.567986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.568011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.196 qpair failed and we were unable to recover it. 00:27:21.196 [2024-07-15 09:06:09.568188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.568370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.568397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.196 qpair failed and we were unable to recover it. 00:27:21.196 [2024-07-15 09:06:09.568554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.568684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.568712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.196 qpair failed and we were unable to recover it. 00:27:21.196 [2024-07-15 09:06:09.568871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.569033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.569061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.196 qpair failed and we were unable to recover it. 00:27:21.196 [2024-07-15 09:06:09.569230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.569373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.569396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.196 qpair failed and we were unable to recover it. 00:27:21.196 [2024-07-15 09:06:09.569598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.569757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.569788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.196 qpair failed and we were unable to recover it. 00:27:21.196 [2024-07-15 09:06:09.569951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.570142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.570169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.196 qpair failed and we were unable to recover it. 00:27:21.196 [2024-07-15 09:06:09.570328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.196 [2024-07-15 09:06:09.570513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.570540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.197 qpair failed and we were unable to recover it. 00:27:21.197 [2024-07-15 09:06:09.570707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.570851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.570882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.197 qpair failed and we were unable to recover it. 00:27:21.197 [2024-07-15 09:06:09.571002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.571124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.571148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.197 qpair failed and we were unable to recover it. 00:27:21.197 [2024-07-15 09:06:09.571289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.571445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.571472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.197 qpair failed and we were unable to recover it. 00:27:21.197 [2024-07-15 09:06:09.571593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.571778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.571804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.197 qpair failed and we were unable to recover it. 00:27:21.197 [2024-07-15 09:06:09.571942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.572061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.572087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.197 qpair failed and we were unable to recover it. 00:27:21.197 [2024-07-15 09:06:09.572234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.572429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.572456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.197 qpair failed and we were unable to recover it. 00:27:21.197 [2024-07-15 09:06:09.572614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.572797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.572823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.197 qpair failed and we were unable to recover it. 00:27:21.197 [2024-07-15 09:06:09.572996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.573142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.573182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.197 qpair failed and we were unable to recover it. 00:27:21.197 [2024-07-15 09:06:09.573385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.573501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.573541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.197 qpair failed and we were unable to recover it. 00:27:21.197 [2024-07-15 09:06:09.573736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.573867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.573904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.197 qpair failed and we were unable to recover it. 00:27:21.197 [2024-07-15 09:06:09.574046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.574168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.574208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.197 qpair failed and we were unable to recover it. 00:27:21.197 [2024-07-15 09:06:09.574393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.574549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.574575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.197 qpair failed and we were unable to recover it. 00:27:21.197 [2024-07-15 09:06:09.574739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.574851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.574874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.197 qpair failed and we were unable to recover it. 00:27:21.197 [2024-07-15 09:06:09.575032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.575150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.575193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.197 qpair failed and we were unable to recover it. 00:27:21.197 [2024-07-15 09:06:09.575351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.575482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.575509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.197 qpair failed and we were unable to recover it. 00:27:21.197 [2024-07-15 09:06:09.575691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.575845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.575871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.197 qpair failed and we were unable to recover it. 00:27:21.197 [2024-07-15 09:06:09.576050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.576207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.576235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.197 qpair failed and we were unable to recover it. 00:27:21.197 [2024-07-15 09:06:09.576385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.576581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.576606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.197 qpair failed and we were unable to recover it. 00:27:21.197 [2024-07-15 09:06:09.576776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.576948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.576974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.197 qpair failed and we were unable to recover it. 00:27:21.197 [2024-07-15 09:06:09.577109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.577306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.577334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.197 qpair failed and we were unable to recover it. 00:27:21.197 [2024-07-15 09:06:09.577496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.577661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.577715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.197 qpair failed and we were unable to recover it. 00:27:21.197 [2024-07-15 09:06:09.577867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.577999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.578026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.197 qpair failed and we were unable to recover it. 00:27:21.197 [2024-07-15 09:06:09.578210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.578359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.578387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.197 qpair failed and we were unable to recover it. 00:27:21.197 [2024-07-15 09:06:09.578527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.578678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.578705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.197 qpair failed and we were unable to recover it. 00:27:21.197 [2024-07-15 09:06:09.578868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.579000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.579024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.197 qpair failed and we were unable to recover it. 00:27:21.197 [2024-07-15 09:06:09.579169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.579306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.579333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.197 qpair failed and we were unable to recover it. 00:27:21.197 [2024-07-15 09:06:09.579457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.579641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.197 [2024-07-15 09:06:09.579669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.198 qpair failed and we were unable to recover it. 00:27:21.198 [2024-07-15 09:06:09.579857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.580016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.580040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.198 qpair failed and we were unable to recover it. 00:27:21.198 [2024-07-15 09:06:09.580148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.580318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.580343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.198 qpair failed and we were unable to recover it. 00:27:21.198 [2024-07-15 09:06:09.580492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.580680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.580708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.198 qpair failed and we were unable to recover it. 00:27:21.198 [2024-07-15 09:06:09.580870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.581003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.581030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.198 qpair failed and we were unable to recover it. 00:27:21.198 [2024-07-15 09:06:09.581199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.581355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.581383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.198 qpair failed and we were unable to recover it. 00:27:21.198 [2024-07-15 09:06:09.581575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.581724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.581749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.198 qpair failed and we were unable to recover it. 00:27:21.198 [2024-07-15 09:06:09.581924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.582114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.582140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.198 qpair failed and we were unable to recover it. 00:27:21.198 [2024-07-15 09:06:09.582279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.582434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.582461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.198 qpair failed and we were unable to recover it. 00:27:21.198 [2024-07-15 09:06:09.582588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.582739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.582766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.198 qpair failed and we were unable to recover it. 00:27:21.198 [2024-07-15 09:06:09.582933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.583054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.583078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.198 qpair failed and we were unable to recover it. 00:27:21.198 [2024-07-15 09:06:09.583219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.583375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.583402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.198 qpair failed and we were unable to recover it. 00:27:21.198 [2024-07-15 09:06:09.583564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.583724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.583756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.198 qpair failed and we were unable to recover it. 00:27:21.198 [2024-07-15 09:06:09.583917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.584101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.584127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.198 qpair failed and we were unable to recover it. 00:27:21.198 [2024-07-15 09:06:09.584292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.584459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.584483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.198 qpair failed and we were unable to recover it. 00:27:21.198 [2024-07-15 09:06:09.584661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.584860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.584891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.198 qpair failed and we were unable to recover it. 00:27:21.198 [2024-07-15 09:06:09.585083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.585248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.585272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.198 qpair failed and we were unable to recover it. 00:27:21.198 [2024-07-15 09:06:09.585394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.585559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.585586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.198 qpair failed and we were unable to recover it. 00:27:21.198 [2024-07-15 09:06:09.585751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.585897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.585922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.198 qpair failed and we were unable to recover it. 00:27:21.198 [2024-07-15 09:06:09.586098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.586240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.586268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.198 qpair failed and we were unable to recover it. 00:27:21.198 [2024-07-15 09:06:09.586428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.586616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.586643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.198 qpair failed and we were unable to recover it. 00:27:21.198 [2024-07-15 09:06:09.586797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.586956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.586984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.198 qpair failed and we were unable to recover it. 00:27:21.198 [2024-07-15 09:06:09.587123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.587228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.587256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.198 qpair failed and we were unable to recover it. 00:27:21.198 [2024-07-15 09:06:09.587456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.587610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.587638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.198 qpair failed and we were unable to recover it. 00:27:21.198 [2024-07-15 09:06:09.587793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.587947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.587975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.198 qpair failed and we were unable to recover it. 00:27:21.198 [2024-07-15 09:06:09.588107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.588264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.588291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.198 qpair failed and we were unable to recover it. 00:27:21.198 [2024-07-15 09:06:09.588459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.588604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.588628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.198 qpair failed and we were unable to recover it. 00:27:21.198 [2024-07-15 09:06:09.588793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.588936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.588965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.198 qpair failed and we were unable to recover it. 00:27:21.198 [2024-07-15 09:06:09.589132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.589290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.589316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.198 qpair failed and we were unable to recover it. 00:27:21.198 [2024-07-15 09:06:09.589446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.589577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.589604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.198 qpair failed and we were unable to recover it. 00:27:21.198 [2024-07-15 09:06:09.589766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.589904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.589930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.198 qpair failed and we were unable to recover it. 00:27:21.198 [2024-07-15 09:06:09.590104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.590258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.198 [2024-07-15 09:06:09.590285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.199 qpair failed and we were unable to recover it. 00:27:21.199 [2024-07-15 09:06:09.590435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.590615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.590642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.199 qpair failed and we were unable to recover it. 00:27:21.199 [2024-07-15 09:06:09.590775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.590949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.590975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.199 qpair failed and we were unable to recover it. 00:27:21.199 [2024-07-15 09:06:09.591113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.591257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.591281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.199 qpair failed and we were unable to recover it. 00:27:21.199 [2024-07-15 09:06:09.591460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.591614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.591642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.199 qpair failed and we were unable to recover it. 00:27:21.199 [2024-07-15 09:06:09.591823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.592017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.592042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.199 qpair failed and we were unable to recover it. 00:27:21.199 [2024-07-15 09:06:09.592208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.592367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.592395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.199 qpair failed and we were unable to recover it. 00:27:21.199 [2024-07-15 09:06:09.592536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.592679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.592704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.199 qpair failed and we were unable to recover it. 00:27:21.199 [2024-07-15 09:06:09.592888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.593072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.593099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.199 qpair failed and we were unable to recover it. 00:27:21.199 [2024-07-15 09:06:09.593263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.593409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.593438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.199 qpair failed and we were unable to recover it. 00:27:21.199 [2024-07-15 09:06:09.593606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.593755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.593783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.199 qpair failed and we were unable to recover it. 00:27:21.199 [2024-07-15 09:06:09.593917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.594063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.594088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.199 qpair failed and we were unable to recover it. 00:27:21.199 [2024-07-15 09:06:09.594264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.594425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.594452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.199 qpair failed and we were unable to recover it. 00:27:21.199 [2024-07-15 09:06:09.594634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.594791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.594818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.199 qpair failed and we were unable to recover it. 00:27:21.199 [2024-07-15 09:06:09.594988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.595110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.595136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.199 qpair failed and we were unable to recover it. 00:27:21.199 [2024-07-15 09:06:09.595260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.595429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.595470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.199 qpair failed and we were unable to recover it. 00:27:21.199 [2024-07-15 09:06:09.595628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.595789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.595815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.199 qpair failed and we were unable to recover it. 00:27:21.199 [2024-07-15 09:06:09.595955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.596079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.596104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.199 qpair failed and we were unable to recover it. 00:27:21.199 [2024-07-15 09:06:09.596233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.596381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.596407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.199 qpair failed and we were unable to recover it. 00:27:21.199 [2024-07-15 09:06:09.596569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.596745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.596788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.199 qpair failed and we were unable to recover it. 00:27:21.199 [2024-07-15 09:06:09.596967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.597107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.597131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.199 qpair failed and we were unable to recover it. 00:27:21.199 [2024-07-15 09:06:09.597299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.597528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.597584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.199 qpair failed and we were unable to recover it. 00:27:21.199 [2024-07-15 09:06:09.597712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.597849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.597883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.199 qpair failed and we were unable to recover it. 00:27:21.199 [2024-07-15 09:06:09.598050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.598192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.598232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.199 qpair failed and we were unable to recover it. 00:27:21.199 [2024-07-15 09:06:09.598396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.598566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.598591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.199 qpair failed and we were unable to recover it. 00:27:21.199 [2024-07-15 09:06:09.598708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.598841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.598868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.199 qpair failed and we were unable to recover it. 00:27:21.199 [2024-07-15 09:06:09.599040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.599162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.599203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.199 qpair failed and we were unable to recover it. 00:27:21.199 [2024-07-15 09:06:09.599342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.599453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.599479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.199 qpair failed and we were unable to recover it. 00:27:21.199 [2024-07-15 09:06:09.599638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.599787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.599815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.199 qpair failed and we were unable to recover it. 00:27:21.199 [2024-07-15 09:06:09.599988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.600112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.600136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.199 qpair failed and we were unable to recover it. 00:27:21.199 [2024-07-15 09:06:09.600277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.600441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.600491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.199 qpair failed and we were unable to recover it. 00:27:21.199 [2024-07-15 09:06:09.600689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.600847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.199 [2024-07-15 09:06:09.600875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.200 qpair failed and we were unable to recover it. 00:27:21.200 [2024-07-15 09:06:09.601062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.601206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.601235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.200 qpair failed and we were unable to recover it. 00:27:21.200 [2024-07-15 09:06:09.601405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.601613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.601666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.200 qpair failed and we were unable to recover it. 00:27:21.200 [2024-07-15 09:06:09.601858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.601988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.602013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.200 qpair failed and we were unable to recover it. 00:27:21.200 [2024-07-15 09:06:09.602161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.602270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.602294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.200 qpair failed and we were unable to recover it. 00:27:21.200 [2024-07-15 09:06:09.602448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.602575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.602602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.200 qpair failed and we were unable to recover it. 00:27:21.200 [2024-07-15 09:06:09.602756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.602942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.602970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.200 qpair failed and we were unable to recover it. 00:27:21.200 [2024-07-15 09:06:09.603103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.603232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.603258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.200 qpair failed and we were unable to recover it. 00:27:21.200 [2024-07-15 09:06:09.603430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.603574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.603599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.200 qpair failed and we were unable to recover it. 00:27:21.200 [2024-07-15 09:06:09.603777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.603930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.603959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.200 qpair failed and we were unable to recover it. 00:27:21.200 [2024-07-15 09:06:09.604120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.604283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.604311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.200 qpair failed and we were unable to recover it. 00:27:21.200 [2024-07-15 09:06:09.604471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.604639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.604664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.200 qpair failed and we were unable to recover it. 00:27:21.200 [2024-07-15 09:06:09.604827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.604946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.604971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.200 qpair failed and we were unable to recover it. 00:27:21.200 [2024-07-15 09:06:09.605093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.605254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.605282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.200 qpair failed and we were unable to recover it. 00:27:21.200 [2024-07-15 09:06:09.605399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.605525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.605552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.200 qpair failed and we were unable to recover it. 00:27:21.200 [2024-07-15 09:06:09.605702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.605863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.605897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.200 qpair failed and we were unable to recover it. 00:27:21.200 [2024-07-15 09:06:09.606038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.606151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.606175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.200 qpair failed and we were unable to recover it. 00:27:21.200 [2024-07-15 09:06:09.606349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.606541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.606566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.200 qpair failed and we were unable to recover it. 00:27:21.200 [2024-07-15 09:06:09.606679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.606841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.606868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.200 qpair failed and we were unable to recover it. 00:27:21.200 [2024-07-15 09:06:09.607059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.607194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.607221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.200 qpair failed and we were unable to recover it. 00:27:21.200 [2024-07-15 09:06:09.607384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.607493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.607517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.200 qpair failed and we were unable to recover it. 00:27:21.200 [2024-07-15 09:06:09.607689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.607905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.607930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.200 qpair failed and we were unable to recover it. 00:27:21.200 [2024-07-15 09:06:09.608070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.608225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.608252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.200 qpair failed and we were unable to recover it. 00:27:21.200 [2024-07-15 09:06:09.608414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.608544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.608571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.200 qpair failed and we were unable to recover it. 00:27:21.200 [2024-07-15 09:06:09.608762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.608937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.608976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.200 qpair failed and we were unable to recover it. 00:27:21.200 [2024-07-15 09:06:09.609143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.609265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.609292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.200 qpair failed and we were unable to recover it. 00:27:21.200 [2024-07-15 09:06:09.609443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.609597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.609623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.200 qpair failed and we were unable to recover it. 00:27:21.200 [2024-07-15 09:06:09.609818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.609988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.610012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.200 qpair failed and we were unable to recover it. 00:27:21.200 [2024-07-15 09:06:09.610122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.610243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.610269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.200 qpair failed and we were unable to recover it. 00:27:21.200 [2024-07-15 09:06:09.610478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.610660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.610687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.200 qpair failed and we were unable to recover it. 00:27:21.200 [2024-07-15 09:06:09.610820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.610996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.611022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.200 qpair failed and we were unable to recover it. 00:27:21.200 [2024-07-15 09:06:09.611166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.611310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.200 [2024-07-15 09:06:09.611337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.200 qpair failed and we were unable to recover it. 00:27:21.201 [2024-07-15 09:06:09.611504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.611673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.611697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.201 qpair failed and we were unable to recover it. 00:27:21.201 [2024-07-15 09:06:09.611894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.612028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.612056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.201 qpair failed and we were unable to recover it. 00:27:21.201 [2024-07-15 09:06:09.612184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.612344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.612369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.201 qpair failed and we were unable to recover it. 00:27:21.201 [2024-07-15 09:06:09.612539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.612713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.612740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.201 qpair failed and we were unable to recover it. 00:27:21.201 [2024-07-15 09:06:09.612903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.613051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.613075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.201 qpair failed and we were unable to recover it. 00:27:21.201 [2024-07-15 09:06:09.613201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.613348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.613372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.201 qpair failed and we were unable to recover it. 00:27:21.201 [2024-07-15 09:06:09.613528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.613683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.613711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.201 qpair failed and we were unable to recover it. 00:27:21.201 [2024-07-15 09:06:09.613869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.614049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.614076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.201 qpair failed and we were unable to recover it. 00:27:21.201 [2024-07-15 09:06:09.614242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.614362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.614401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.201 qpair failed and we were unable to recover it. 00:27:21.201 [2024-07-15 09:06:09.614571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.614717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.614742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.201 qpair failed and we were unable to recover it. 00:27:21.201 [2024-07-15 09:06:09.614930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.615086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.615111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.201 qpair failed and we were unable to recover it. 00:27:21.201 [2024-07-15 09:06:09.615289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.615448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.615475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.201 qpair failed and we were unable to recover it. 00:27:21.201 [2024-07-15 09:06:09.615662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.615796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.615822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.201 qpair failed and we were unable to recover it. 00:27:21.201 [2024-07-15 09:06:09.615964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.616113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.616137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.201 qpair failed and we were unable to recover it. 00:27:21.201 [2024-07-15 09:06:09.616300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.616420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.616447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.201 qpair failed and we were unable to recover it. 00:27:21.201 [2024-07-15 09:06:09.616597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.616752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.616778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.201 qpair failed and we were unable to recover it. 00:27:21.201 [2024-07-15 09:06:09.616976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.617171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.617198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.201 qpair failed and we were unable to recover it. 00:27:21.201 [2024-07-15 09:06:09.617385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.617518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.617546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.201 qpair failed and we were unable to recover it. 00:27:21.201 [2024-07-15 09:06:09.617706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.617866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.617902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.201 qpair failed and we were unable to recover it. 00:27:21.201 [2024-07-15 09:06:09.618088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.618222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.618249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.201 qpair failed and we were unable to recover it. 00:27:21.201 [2024-07-15 09:06:09.618441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.618590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.618637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.201 qpair failed and we were unable to recover it. 00:27:21.201 [2024-07-15 09:06:09.618795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.618977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.619006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.201 qpair failed and we were unable to recover it. 00:27:21.201 [2024-07-15 09:06:09.619190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.619351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.619378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.201 qpair failed and we were unable to recover it. 00:27:21.201 [2024-07-15 09:06:09.619508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.619667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.619695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.201 qpair failed and we were unable to recover it. 00:27:21.201 [2024-07-15 09:06:09.619861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.620074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.620102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.201 qpair failed and we were unable to recover it. 00:27:21.201 [2024-07-15 09:06:09.620262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.620443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.620470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.201 qpair failed and we were unable to recover it. 00:27:21.201 [2024-07-15 09:06:09.620600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.201 [2024-07-15 09:06:09.620762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.620790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.202 qpair failed and we were unable to recover it. 00:27:21.202 [2024-07-15 09:06:09.620926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.621091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.621118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.202 qpair failed and we were unable to recover it. 00:27:21.202 [2024-07-15 09:06:09.621308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.621453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.621478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.202 qpair failed and we were unable to recover it. 00:27:21.202 [2024-07-15 09:06:09.621623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.621827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.621855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.202 qpair failed and we were unable to recover it. 00:27:21.202 [2024-07-15 09:06:09.622030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.622153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.622178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.202 qpair failed and we were unable to recover it. 00:27:21.202 [2024-07-15 09:06:09.622334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.622506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.622533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.202 qpair failed and we were unable to recover it. 00:27:21.202 [2024-07-15 09:06:09.622695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.622845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.622870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.202 qpair failed and we were unable to recover it. 00:27:21.202 [2024-07-15 09:06:09.623044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.623188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.623212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.202 qpair failed and we were unable to recover it. 00:27:21.202 [2024-07-15 09:06:09.623402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.623526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.623553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.202 qpair failed and we were unable to recover it. 00:27:21.202 [2024-07-15 09:06:09.623692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.623820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.623850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.202 qpair failed and we were unable to recover it. 00:27:21.202 [2024-07-15 09:06:09.624036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.624207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.624248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.202 qpair failed and we were unable to recover it. 00:27:21.202 [2024-07-15 09:06:09.624432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.624595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.624623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.202 qpair failed and we were unable to recover it. 00:27:21.202 [2024-07-15 09:06:09.624753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.624909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.624952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.202 qpair failed and we were unable to recover it. 00:27:21.202 [2024-07-15 09:06:09.625073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.625215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.625241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.202 qpair failed and we were unable to recover it. 00:27:21.202 [2024-07-15 09:06:09.625434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.625555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.625598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.202 qpair failed and we were unable to recover it. 00:27:21.202 [2024-07-15 09:06:09.625731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.625892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.625920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.202 qpair failed and we were unable to recover it. 00:27:21.202 [2024-07-15 09:06:09.626113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.626271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.626298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.202 qpair failed and we were unable to recover it. 00:27:21.202 [2024-07-15 09:06:09.626494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.626638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.626663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.202 qpair failed and we were unable to recover it. 00:27:21.202 [2024-07-15 09:06:09.626805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.626944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.626985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.202 qpair failed and we were unable to recover it. 00:27:21.202 [2024-07-15 09:06:09.627148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.627331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.627358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.202 qpair failed and we were unable to recover it. 00:27:21.202 [2024-07-15 09:06:09.627518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.627675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.627703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.202 qpair failed and we were unable to recover it. 00:27:21.202 [2024-07-15 09:06:09.627842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.628021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.628048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.202 qpair failed and we were unable to recover it. 00:27:21.202 [2024-07-15 09:06:09.628174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.628316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.628340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.202 qpair failed and we were unable to recover it. 00:27:21.202 [2024-07-15 09:06:09.628469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.628650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.628677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.202 qpair failed and we were unable to recover it. 00:27:21.202 [2024-07-15 09:06:09.628822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.629013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.629039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.202 qpair failed and we were unable to recover it. 00:27:21.202 [2024-07-15 09:06:09.629182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.629319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.629346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.202 qpair failed and we were unable to recover it. 00:27:21.202 [2024-07-15 09:06:09.629540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.629697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.629724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.202 qpair failed and we were unable to recover it. 00:27:21.202 [2024-07-15 09:06:09.629900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.630065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.630090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.202 qpair failed and we were unable to recover it. 00:27:21.202 [2024-07-15 09:06:09.630253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.630419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.630447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.202 qpair failed and we were unable to recover it. 00:27:21.202 [2024-07-15 09:06:09.630581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.630740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.630769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.202 qpair failed and we were unable to recover it. 00:27:21.202 [2024-07-15 09:06:09.630932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.631080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.631105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.202 qpair failed and we were unable to recover it. 00:27:21.202 [2024-07-15 09:06:09.631255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.202 [2024-07-15 09:06:09.631438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.631465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.203 qpair failed and we were unable to recover it. 00:27:21.203 [2024-07-15 09:06:09.631624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.631807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.631835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.203 qpair failed and we were unable to recover it. 00:27:21.203 [2024-07-15 09:06:09.631994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.632166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.632210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.203 qpair failed and we were unable to recover it. 00:27:21.203 [2024-07-15 09:06:09.632375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.632493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.632518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.203 qpair failed and we were unable to recover it. 00:27:21.203 [2024-07-15 09:06:09.632727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.632890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.632922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.203 qpair failed and we were unable to recover it. 00:27:21.203 [2024-07-15 09:06:09.633084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.633217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.633243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.203 qpair failed and we were unable to recover it. 00:27:21.203 [2024-07-15 09:06:09.633397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.633579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.633607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.203 qpair failed and we were unable to recover it. 00:27:21.203 [2024-07-15 09:06:09.633767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.633893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.633933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.203 qpair failed and we were unable to recover it. 00:27:21.203 [2024-07-15 09:06:09.634072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.634232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.634258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.203 qpair failed and we were unable to recover it. 00:27:21.203 [2024-07-15 09:06:09.634416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.634588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.634615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.203 qpair failed and we were unable to recover it. 00:27:21.203 [2024-07-15 09:06:09.634793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.634956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.634984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.203 qpair failed and we were unable to recover it. 00:27:21.203 [2024-07-15 09:06:09.635147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.635292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.635316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.203 qpair failed and we were unable to recover it. 00:27:21.203 [2024-07-15 09:06:09.635516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.635683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.635708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.203 qpair failed and we were unable to recover it. 00:27:21.203 [2024-07-15 09:06:09.635884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.636036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.636063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.203 qpair failed and we were unable to recover it. 00:27:21.203 [2024-07-15 09:06:09.636219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.636350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.636381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.203 qpair failed and we were unable to recover it. 00:27:21.203 [2024-07-15 09:06:09.636550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.636703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.636745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.203 qpair failed and we were unable to recover it. 00:27:21.203 [2024-07-15 09:06:09.636873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.637061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.637089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.203 qpair failed and we were unable to recover it. 00:27:21.203 [2024-07-15 09:06:09.637211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.637367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.637394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.203 qpair failed and we were unable to recover it. 00:27:21.203 [2024-07-15 09:06:09.637574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.637710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.637736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.203 qpair failed and we were unable to recover it. 00:27:21.203 [2024-07-15 09:06:09.637898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.638043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.638067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.203 qpair failed and we were unable to recover it. 00:27:21.203 [2024-07-15 09:06:09.638203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.638384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.638410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.203 qpair failed and we were unable to recover it. 00:27:21.203 [2024-07-15 09:06:09.638563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.638744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.638769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.203 qpair failed and we were unable to recover it. 00:27:21.203 [2024-07-15 09:06:09.638967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.639115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.639138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.203 qpair failed and we were unable to recover it. 00:27:21.203 [2024-07-15 09:06:09.639323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.639480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.639506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.203 qpair failed and we were unable to recover it. 00:27:21.203 [2024-07-15 09:06:09.639683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.639847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.639880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.203 qpair failed and we were unable to recover it. 00:27:21.203 [2024-07-15 09:06:09.640027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.640149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.640191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.203 qpair failed and we were unable to recover it. 00:27:21.203 [2024-07-15 09:06:09.640345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.640478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.640505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.203 qpair failed and we were unable to recover it. 00:27:21.203 [2024-07-15 09:06:09.640635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.640779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.640803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.203 qpair failed and we were unable to recover it. 00:27:21.203 [2024-07-15 09:06:09.640976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.641090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.641115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.203 qpair failed and we were unable to recover it. 00:27:21.203 [2024-07-15 09:06:09.641276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.641431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.641458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.203 qpair failed and we were unable to recover it. 00:27:21.203 [2024-07-15 09:06:09.641618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.641745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.641771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.203 qpair failed and we were unable to recover it. 00:27:21.203 [2024-07-15 09:06:09.641911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.642051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.203 [2024-07-15 09:06:09.642075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.204 qpair failed and we were unable to recover it. 00:27:21.204 [2024-07-15 09:06:09.642184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.642324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.642351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.204 qpair failed and we were unable to recover it. 00:27:21.204 [2024-07-15 09:06:09.642496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.642686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.642711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.204 qpair failed and we were unable to recover it. 00:27:21.204 [2024-07-15 09:06:09.642886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.643005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.643029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.204 qpair failed and we were unable to recover it. 00:27:21.204 [2024-07-15 09:06:09.643207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.643339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.643365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.204 qpair failed and we were unable to recover it. 00:27:21.204 [2024-07-15 09:06:09.643550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.643760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.643787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.204 qpair failed and we were unable to recover it. 00:27:21.204 [2024-07-15 09:06:09.643907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.644066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.644089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.204 qpair failed and we were unable to recover it. 00:27:21.204 [2024-07-15 09:06:09.644280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.644437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.644464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.204 qpair failed and we were unable to recover it. 00:27:21.204 [2024-07-15 09:06:09.644606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.644770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.644811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.204 qpair failed and we were unable to recover it. 00:27:21.204 [2024-07-15 09:06:09.644958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.645107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.645131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.204 qpair failed and we were unable to recover it. 00:27:21.204 [2024-07-15 09:06:09.645300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.645500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.645526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.204 qpair failed and we were unable to recover it. 00:27:21.204 [2024-07-15 09:06:09.645647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.645771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.645798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.204 qpair failed and we were unable to recover it. 00:27:21.204 [2024-07-15 09:06:09.645947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.646085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.646108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.204 qpair failed and we were unable to recover it. 00:27:21.204 [2024-07-15 09:06:09.646269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.646422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.646448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.204 qpair failed and we were unable to recover it. 00:27:21.204 [2024-07-15 09:06:09.646577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.646707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.646733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.204 qpair failed and we were unable to recover it. 00:27:21.204 [2024-07-15 09:06:09.646928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.647042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.647067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.204 qpair failed and we were unable to recover it. 00:27:21.204 [2024-07-15 09:06:09.647210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.647355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.647396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.204 qpair failed and we were unable to recover it. 00:27:21.204 [2024-07-15 09:06:09.647554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.647679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.647705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.204 qpair failed and we were unable to recover it. 00:27:21.204 [2024-07-15 09:06:09.647833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.647990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.648014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.204 qpair failed and we were unable to recover it. 00:27:21.204 [2024-07-15 09:06:09.648165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.648324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.648351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.204 qpair failed and we were unable to recover it. 00:27:21.204 [2024-07-15 09:06:09.648515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.648656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.648680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.204 qpair failed and we were unable to recover it. 00:27:21.204 [2024-07-15 09:06:09.648820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.649016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.649041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.204 qpair failed and we were unable to recover it. 00:27:21.204 [2024-07-15 09:06:09.649164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.649361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.649388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.204 qpair failed and we were unable to recover it. 00:27:21.204 [2024-07-15 09:06:09.649603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.649748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.649776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.204 qpair failed and we were unable to recover it. 00:27:21.204 [2024-07-15 09:06:09.649939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.650105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.650134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.204 qpair failed and we were unable to recover it. 00:27:21.204 [2024-07-15 09:06:09.650306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.650521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.650566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.204 qpair failed and we were unable to recover it. 00:27:21.204 [2024-07-15 09:06:09.650722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.650847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.650874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.204 qpair failed and we were unable to recover it. 00:27:21.204 [2024-07-15 09:06:09.651022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.651166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.651191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.204 qpair failed and we were unable to recover it. 00:27:21.204 [2024-07-15 09:06:09.651337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.651484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.651509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.204 qpair failed and we were unable to recover it. 00:27:21.204 [2024-07-15 09:06:09.651651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.651837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.651864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.204 qpair failed and we were unable to recover it. 00:27:21.204 [2024-07-15 09:06:09.652043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.652204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.204 [2024-07-15 09:06:09.652231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.204 qpair failed and we were unable to recover it. 00:27:21.204 [2024-07-15 09:06:09.652446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.652752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.652807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-15 09:06:09.652971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.653092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.653115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-15 09:06:09.653252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.653413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.653439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-15 09:06:09.653596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.653780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.653808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-15 09:06:09.653988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.654114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.654137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-15 09:06:09.654304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.654464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.654492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-15 09:06:09.654616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.654774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.654801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-15 09:06:09.654973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.655119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.655143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-15 09:06:09.655320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.655567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.655629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-15 09:06:09.655787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.655928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.655953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-15 09:06:09.656095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.656261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.656288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-15 09:06:09.656421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.656541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.656567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-15 09:06:09.656723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.656889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.656916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-15 09:06:09.657079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.657261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.657288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-15 09:06:09.657472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.657617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.657641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-15 09:06:09.657834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.657986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.658011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-15 09:06:09.658130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.658287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.658313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-15 09:06:09.658475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.658645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.658686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-15 09:06:09.658817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.658980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.659005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-15 09:06:09.659152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.659322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.659348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-15 09:06:09.659478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.659645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.659672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-15 09:06:09.659811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.659944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.659968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-15 09:06:09.660157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.660287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.660315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-15 09:06:09.660475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.660641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.660667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-15 09:06:09.660831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.660973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.660998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-15 09:06:09.661153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.661304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.661328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-15 09:06:09.661509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.661664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.661690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-15 09:06:09.661814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.661963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.661989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-15 09:06:09.662113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.662312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.662339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-15 09:06:09.662480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.205 [2024-07-15 09:06:09.662618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.662642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.206 qpair failed and we were unable to recover it. 00:27:21.206 [2024-07-15 09:06:09.662782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.662932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.662961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.206 qpair failed and we were unable to recover it. 00:27:21.206 [2024-07-15 09:06:09.663146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.663282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.663310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.206 qpair failed and we were unable to recover it. 00:27:21.206 [2024-07-15 09:06:09.663500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.663642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.663666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.206 qpair failed and we were unable to recover it. 00:27:21.206 [2024-07-15 09:06:09.663812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.663931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.663956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.206 qpair failed and we were unable to recover it. 00:27:21.206 [2024-07-15 09:06:09.664068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.664227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.664254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.206 qpair failed and we were unable to recover it. 00:27:21.206 [2024-07-15 09:06:09.664391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.664509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.664537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.206 qpair failed and we were unable to recover it. 00:27:21.206 [2024-07-15 09:06:09.664668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.664790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.664817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.206 qpair failed and we were unable to recover it. 00:27:21.206 [2024-07-15 09:06:09.664961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.665111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.665137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.206 qpair failed and we were unable to recover it. 00:27:21.206 [2024-07-15 09:06:09.665310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.665459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.665485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.206 qpair failed and we were unable to recover it. 00:27:21.206 [2024-07-15 09:06:09.665641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.665776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.665804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.206 qpair failed and we were unable to recover it. 00:27:21.206 [2024-07-15 09:06:09.665985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.666111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.666138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.206 qpair failed and we were unable to recover it. 00:27:21.206 [2024-07-15 09:06:09.666311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.666458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.666482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.206 qpair failed and we were unable to recover it. 00:27:21.206 [2024-07-15 09:06:09.666627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.666795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.666823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.206 qpair failed and we were unable to recover it. 00:27:21.206 [2024-07-15 09:06:09.666959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.667118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.667145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.206 qpair failed and we were unable to recover it. 00:27:21.206 [2024-07-15 09:06:09.667275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.667431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.667464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.206 qpair failed and we were unable to recover it. 00:27:21.206 [2024-07-15 09:06:09.667627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.667770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.667794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.206 qpair failed and we were unable to recover it. 00:27:21.206 [2024-07-15 09:06:09.667965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.668095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.668122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.206 qpair failed and we were unable to recover it. 00:27:21.206 [2024-07-15 09:06:09.668275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.668442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.668467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.206 qpair failed and we were unable to recover it. 00:27:21.206 [2024-07-15 09:06:09.668624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.668771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.668799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.206 qpair failed and we were unable to recover it. 00:27:21.206 [2024-07-15 09:06:09.668970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.669088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.669112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.206 qpair failed and we were unable to recover it. 00:27:21.206 [2024-07-15 09:06:09.669282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.669453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.669512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.206 qpair failed and we were unable to recover it. 00:27:21.206 [2024-07-15 09:06:09.669661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.669856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.669884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.206 qpair failed and we were unable to recover it. 00:27:21.206 [2024-07-15 09:06:09.670036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.670192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.670220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.206 qpair failed and we were unable to recover it. 00:27:21.206 [2024-07-15 09:06:09.670356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.670471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.670498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.206 qpair failed and we were unable to recover it. 00:27:21.206 [2024-07-15 09:06:09.670643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.206 [2024-07-15 09:06:09.670809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.670834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.207 qpair failed and we were unable to recover it. 00:27:21.207 [2024-07-15 09:06:09.671049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.671273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.671325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.207 qpair failed and we were unable to recover it. 00:27:21.207 [2024-07-15 09:06:09.671602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.671780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.671807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.207 qpair failed and we were unable to recover it. 00:27:21.207 [2024-07-15 09:06:09.671950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.672114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.672155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.207 qpair failed and we were unable to recover it. 00:27:21.207 [2024-07-15 09:06:09.672335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.672472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.672499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.207 qpair failed and we were unable to recover it. 00:27:21.207 [2024-07-15 09:06:09.672657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.672810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.672837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.207 qpair failed and we were unable to recover it. 00:27:21.207 [2024-07-15 09:06:09.672977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.673105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.673132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.207 qpair failed and we were unable to recover it. 00:27:21.207 [2024-07-15 09:06:09.673291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.673410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.673434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.207 qpair failed and we were unable to recover it. 00:27:21.207 [2024-07-15 09:06:09.673605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.673763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.673791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.207 qpair failed and we were unable to recover it. 00:27:21.207 [2024-07-15 09:06:09.673945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.674102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.674129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.207 qpair failed and we were unable to recover it. 00:27:21.207 [2024-07-15 09:06:09.674429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.674577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.674604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.207 qpair failed and we were unable to recover it. 00:27:21.207 [2024-07-15 09:06:09.674790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.674914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.674938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.207 qpair failed and we were unable to recover it. 00:27:21.207 [2024-07-15 09:06:09.675086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.675215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.675241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.207 qpair failed and we were unable to recover it. 00:27:21.207 [2024-07-15 09:06:09.675400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.675548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.675575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.207 qpair failed and we were unable to recover it. 00:27:21.207 [2024-07-15 09:06:09.675702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.675855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.675892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.207 qpair failed and we were unable to recover it. 00:27:21.207 [2024-07-15 09:06:09.676043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.676187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.676211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.207 qpair failed and we were unable to recover it. 00:27:21.207 [2024-07-15 09:06:09.676354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.676506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.676533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.207 qpair failed and we were unable to recover it. 00:27:21.207 [2024-07-15 09:06:09.676664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.676853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.676888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.207 qpair failed and we were unable to recover it. 00:27:21.207 [2024-07-15 09:06:09.677016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.677133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.677160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.207 qpair failed and we were unable to recover it. 00:27:21.207 [2024-07-15 09:06:09.677359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.677473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.677514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.207 qpair failed and we were unable to recover it. 00:27:21.207 [2024-07-15 09:06:09.677671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.677856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.677890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.207 qpair failed and we were unable to recover it. 00:27:21.207 [2024-07-15 09:06:09.678023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.678181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.678208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.207 qpair failed and we were unable to recover it. 00:27:21.207 [2024-07-15 09:06:09.678389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.678615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.678641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.207 qpair failed and we were unable to recover it. 00:27:21.207 [2024-07-15 09:06:09.678805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.678941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.678966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.207 qpair failed and we were unable to recover it. 00:27:21.207 [2024-07-15 09:06:09.679086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.679229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.679255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.207 qpair failed and we were unable to recover it. 00:27:21.207 [2024-07-15 09:06:09.679412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.679627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.679678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.207 qpair failed and we were unable to recover it. 00:27:21.207 [2024-07-15 09:06:09.679818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.679988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.680014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.207 qpair failed and we were unable to recover it. 00:27:21.207 [2024-07-15 09:06:09.680138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.680301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.680341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.207 qpair failed and we were unable to recover it. 00:27:21.207 [2024-07-15 09:06:09.680468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.680650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.680676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.207 qpair failed and we were unable to recover it. 00:27:21.207 [2024-07-15 09:06:09.680800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.680927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.680955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.207 qpair failed and we were unable to recover it. 00:27:21.207 [2024-07-15 09:06:09.681115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.681296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.681346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.207 qpair failed and we were unable to recover it. 00:27:21.207 [2024-07-15 09:06:09.681512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.207 [2024-07-15 09:06:09.681628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.681655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.208 qpair failed and we were unable to recover it. 00:27:21.208 [2024-07-15 09:06:09.681822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.682003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.682031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.208 qpair failed and we were unable to recover it. 00:27:21.208 [2024-07-15 09:06:09.682160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.682326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.682369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.208 qpair failed and we were unable to recover it. 00:27:21.208 [2024-07-15 09:06:09.682501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.682655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.682682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.208 qpair failed and we were unable to recover it. 00:27:21.208 [2024-07-15 09:06:09.682841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.682970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.682995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.208 qpair failed and we were unable to recover it. 00:27:21.208 [2024-07-15 09:06:09.683117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.683280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.683308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.208 qpair failed and we were unable to recover it. 00:27:21.208 [2024-07-15 09:06:09.683469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.683635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.683659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.208 qpair failed and we were unable to recover it. 00:27:21.208 [2024-07-15 09:06:09.683820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.683956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.683985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.208 qpair failed and we were unable to recover it. 00:27:21.208 [2024-07-15 09:06:09.684131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.684278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.684303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.208 qpair failed and we were unable to recover it. 00:27:21.208 [2024-07-15 09:06:09.684440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.684600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.684626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.208 qpair failed and we were unable to recover it. 00:27:21.208 [2024-07-15 09:06:09.684757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.684872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.684911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.208 qpair failed and we were unable to recover it. 00:27:21.208 [2024-07-15 09:06:09.685039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.685209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.685233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.208 qpair failed and we were unable to recover it. 00:27:21.208 [2024-07-15 09:06:09.685347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.685468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.685494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.208 qpair failed and we were unable to recover it. 00:27:21.208 [2024-07-15 09:06:09.685640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.685805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.685833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.208 qpair failed and we were unable to recover it. 00:27:21.208 [2024-07-15 09:06:09.685967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.686095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.686121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.208 qpair failed and we were unable to recover it. 00:27:21.208 [2024-07-15 09:06:09.686282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.686484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.686534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.208 qpair failed and we were unable to recover it. 00:27:21.208 [2024-07-15 09:06:09.686725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.686861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.686895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.208 qpair failed and we were unable to recover it. 00:27:21.208 [2024-07-15 09:06:09.687080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.687211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.687239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.208 qpair failed and we were unable to recover it. 00:27:21.208 [2024-07-15 09:06:09.687401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.687559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.687586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.208 qpair failed and we were unable to recover it. 00:27:21.208 [2024-07-15 09:06:09.687743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.687943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.687968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.208 qpair failed and we were unable to recover it. 00:27:21.208 [2024-07-15 09:06:09.688083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.688201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.688225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.208 qpair failed and we were unable to recover it. 00:27:21.208 [2024-07-15 09:06:09.688394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.688551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.688580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.208 qpair failed and we were unable to recover it. 00:27:21.208 [2024-07-15 09:06:09.688774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.688921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.688945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.208 qpair failed and we were unable to recover it. 00:27:21.208 [2024-07-15 09:06:09.689139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.689288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.689312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.208 qpair failed and we were unable to recover it. 00:27:21.208 [2024-07-15 09:06:09.689449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.689567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.689592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.208 qpair failed and we were unable to recover it. 00:27:21.208 [2024-07-15 09:06:09.689779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.689946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.689971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.208 qpair failed and we were unable to recover it. 00:27:21.208 [2024-07-15 09:06:09.690093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.690289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.690316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.208 qpair failed and we were unable to recover it. 00:27:21.208 [2024-07-15 09:06:09.690486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.690651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.690676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.208 qpair failed and we were unable to recover it. 00:27:21.208 [2024-07-15 09:06:09.690818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.690943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.690968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.208 qpair failed and we were unable to recover it. 00:27:21.208 [2024-07-15 09:06:09.691104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.691263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.691289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.208 qpair failed and we were unable to recover it. 00:27:21.208 [2024-07-15 09:06:09.691441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.691637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.691662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.208 qpair failed and we were unable to recover it. 00:27:21.208 [2024-07-15 09:06:09.691789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.208 [2024-07-15 09:06:09.691976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.692004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.209 qpair failed and we were unable to recover it. 00:27:21.209 [2024-07-15 09:06:09.692174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.692289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.692313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.209 qpair failed and we were unable to recover it. 00:27:21.209 [2024-07-15 09:06:09.692500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.692663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.692690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.209 qpair failed and we were unable to recover it. 00:27:21.209 [2024-07-15 09:06:09.692846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.692979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.693007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.209 qpair failed and we were unable to recover it. 00:27:21.209 [2024-07-15 09:06:09.693164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.693297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.693326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.209 qpair failed and we were unable to recover it. 00:27:21.209 [2024-07-15 09:06:09.693491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.693606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.693630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.209 qpair failed and we were unable to recover it. 00:27:21.209 [2024-07-15 09:06:09.693800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.693982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.694010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.209 qpair failed and we were unable to recover it. 00:27:21.209 [2024-07-15 09:06:09.694168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.694291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.694318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.209 qpair failed and we were unable to recover it. 00:27:21.209 [2024-07-15 09:06:09.694481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.694603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.694631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.209 qpair failed and we were unable to recover it. 00:27:21.209 [2024-07-15 09:06:09.694798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.694944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.694985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.209 qpair failed and we were unable to recover it. 00:27:21.209 [2024-07-15 09:06:09.695115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.695251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.695279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.209 qpair failed and we were unable to recover it. 00:27:21.209 [2024-07-15 09:06:09.695427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.695586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.695614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.209 qpair failed and we were unable to recover it. 00:27:21.209 [2024-07-15 09:06:09.695743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.695892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.695921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.209 qpair failed and we were unable to recover it. 00:27:21.209 [2024-07-15 09:06:09.696081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.696220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.696245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.209 qpair failed and we were unable to recover it. 00:27:21.209 [2024-07-15 09:06:09.696445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.696579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.696606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.209 qpair failed and we were unable to recover it. 00:27:21.209 [2024-07-15 09:06:09.696756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.696888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.696916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.209 qpair failed and we were unable to recover it. 00:27:21.209 [2024-07-15 09:06:09.697052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.697286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.697340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.209 qpair failed and we were unable to recover it. 00:27:21.209 [2024-07-15 09:06:09.697532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.697692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.697719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.209 qpair failed and we were unable to recover it. 00:27:21.209 [2024-07-15 09:06:09.697905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.698076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.698100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.209 qpair failed and we were unable to recover it. 00:27:21.209 [2024-07-15 09:06:09.698297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.698419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.698446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.209 qpair failed and we were unable to recover it. 00:27:21.209 [2024-07-15 09:06:09.698605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.698732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.698763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.209 qpair failed and we were unable to recover it. 00:27:21.209 [2024-07-15 09:06:09.698953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.699096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.699121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.209 qpair failed and we were unable to recover it. 00:27:21.209 [2024-07-15 09:06:09.699286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.699413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.699440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.209 qpair failed and we were unable to recover it. 00:27:21.209 [2024-07-15 09:06:09.699627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.699760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.699787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.209 qpair failed and we were unable to recover it. 00:27:21.209 [2024-07-15 09:06:09.699953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.700108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.700135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.209 qpair failed and we were unable to recover it. 00:27:21.209 [2024-07-15 09:06:09.700307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.700425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.700450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.209 qpair failed and we were unable to recover it. 00:27:21.209 [2024-07-15 09:06:09.700657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.700802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.700828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.209 qpair failed and we were unable to recover it. 00:27:21.209 [2024-07-15 09:06:09.700980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.701130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.701157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.209 qpair failed and we were unable to recover it. 00:27:21.209 [2024-07-15 09:06:09.701316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.701527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.209 [2024-07-15 09:06:09.701578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.210 qpair failed and we were unable to recover it. 00:27:21.210 [2024-07-15 09:06:09.701714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.210 [2024-07-15 09:06:09.701832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.210 [2024-07-15 09:06:09.701856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.210 qpair failed and we were unable to recover it. 00:27:21.210 [2024-07-15 09:06:09.702032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.210 [2024-07-15 09:06:09.702218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.210 [2024-07-15 09:06:09.702251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.210 qpair failed and we were unable to recover it. 00:27:21.210 [2024-07-15 09:06:09.702428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.210 [2024-07-15 09:06:09.702594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.210 [2024-07-15 09:06:09.702623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.210 qpair failed and we were unable to recover it. 00:27:21.210 [2024-07-15 09:06:09.702787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.210 [2024-07-15 09:06:09.702931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.210 [2024-07-15 09:06:09.702960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.210 qpair failed and we were unable to recover it. 00:27:21.210 [2024-07-15 09:06:09.703103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.210 [2024-07-15 09:06:09.703352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.210 [2024-07-15 09:06:09.703381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.210 qpair failed and we were unable to recover it. 00:27:21.210 [2024-07-15 09:06:09.703572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.210 [2024-07-15 09:06:09.703795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.210 [2024-07-15 09:06:09.703823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.210 qpair failed and we were unable to recover it. 00:27:21.210 [2024-07-15 09:06:09.703967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.210 [2024-07-15 09:06:09.704131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.210 [2024-07-15 09:06:09.704161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.210 qpair failed and we were unable to recover it. 00:27:21.210 [2024-07-15 09:06:09.704397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.210 [2024-07-15 09:06:09.704637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.210 [2024-07-15 09:06:09.704686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.210 qpair failed and we were unable to recover it. 00:27:21.210 [2024-07-15 09:06:09.704857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.210 [2024-07-15 09:06:09.705039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.210 [2024-07-15 09:06:09.705065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.210 qpair failed and we were unable to recover it. 00:27:21.210 [2024-07-15 09:06:09.705208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.210 [2024-07-15 09:06:09.705332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.210 [2024-07-15 09:06:09.705359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.210 qpair failed and we were unable to recover it. 00:27:21.210 [2024-07-15 09:06:09.705546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.210 [2024-07-15 09:06:09.705736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.210 [2024-07-15 09:06:09.705765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.210 qpair failed and we were unable to recover it. 00:27:21.210 [2024-07-15 09:06:09.705900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.210 [2024-07-15 09:06:09.706063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.210 [2024-07-15 09:06:09.706098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.210 qpair failed and we were unable to recover it. 00:27:21.210 [2024-07-15 09:06:09.706246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.210 [2024-07-15 09:06:09.706393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.210 [2024-07-15 09:06:09.706434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.210 qpair failed and we were unable to recover it. 00:27:21.483 [2024-07-15 09:06:09.706654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.483 [2024-07-15 09:06:09.706832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.483 [2024-07-15 09:06:09.706861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.483 qpair failed and we were unable to recover it. 00:27:21.483 [2024-07-15 09:06:09.707030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.483 [2024-07-15 09:06:09.707254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.483 [2024-07-15 09:06:09.707323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.483 qpair failed and we were unable to recover it. 00:27:21.483 [2024-07-15 09:06:09.707581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.483 [2024-07-15 09:06:09.707789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.483 [2024-07-15 09:06:09.707817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.483 qpair failed and we were unable to recover it. 00:27:21.483 [2024-07-15 09:06:09.707997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.483 [2024-07-15 09:06:09.708152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.483 [2024-07-15 09:06:09.708197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.483 qpair failed and we were unable to recover it. 00:27:21.483 [2024-07-15 09:06:09.708401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.483 [2024-07-15 09:06:09.708561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.483 [2024-07-15 09:06:09.708586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.483 qpair failed and we were unable to recover it. 00:27:21.483 [2024-07-15 09:06:09.708721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.483 [2024-07-15 09:06:09.708913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.483 [2024-07-15 09:06:09.708957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.483 qpair failed and we were unable to recover it. 00:27:21.483 [2024-07-15 09:06:09.709105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.483 [2024-07-15 09:06:09.709243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.483 [2024-07-15 09:06:09.709270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.483 qpair failed and we were unable to recover it. 00:27:21.483 [2024-07-15 09:06:09.709418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.483 [2024-07-15 09:06:09.709537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.483 [2024-07-15 09:06:09.709563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.483 qpair failed and we were unable to recover it. 00:27:21.483 [2024-07-15 09:06:09.709740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.483 [2024-07-15 09:06:09.709958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.483 [2024-07-15 09:06:09.709984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.483 qpair failed and we were unable to recover it. 00:27:21.483 [2024-07-15 09:06:09.710142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.483 [2024-07-15 09:06:09.710287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.483 [2024-07-15 09:06:09.710315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.483 qpair failed and we were unable to recover it. 00:27:21.483 [2024-07-15 09:06:09.710439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.483 [2024-07-15 09:06:09.710595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.483 [2024-07-15 09:06:09.710622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.483 qpair failed and we were unable to recover it. 00:27:21.483 [2024-07-15 09:06:09.710823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.483 [2024-07-15 09:06:09.710972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.483 [2024-07-15 09:06:09.710998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.483 qpair failed and we were unable to recover it. 00:27:21.483 [2024-07-15 09:06:09.711149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.483 [2024-07-15 09:06:09.711323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.483 [2024-07-15 09:06:09.711367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.483 qpair failed and we were unable to recover it. 00:27:21.483 [2024-07-15 09:06:09.711499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.483 [2024-07-15 09:06:09.711731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.483 [2024-07-15 09:06:09.711758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.483 qpair failed and we were unable to recover it. 00:27:21.483 [2024-07-15 09:06:09.711975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.483 [2024-07-15 09:06:09.712097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.483 [2024-07-15 09:06:09.712122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.483 qpair failed and we were unable to recover it. 00:27:21.483 [2024-07-15 09:06:09.712271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.483 [2024-07-15 09:06:09.712419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.483 [2024-07-15 09:06:09.712465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.483 qpair failed and we were unable to recover it. 00:27:21.483 [2024-07-15 09:06:09.712665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.483 [2024-07-15 09:06:09.712826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.483 [2024-07-15 09:06:09.712853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.483 qpair failed and we were unable to recover it. 00:27:21.483 [2024-07-15 09:06:09.713073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.483 [2024-07-15 09:06:09.713305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.483 [2024-07-15 09:06:09.713334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.483 qpair failed and we were unable to recover it. 00:27:21.484 [2024-07-15 09:06:09.713574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.713761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.713789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.484 qpair failed and we were unable to recover it. 00:27:21.484 [2024-07-15 09:06:09.713956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.714086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.714111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.484 qpair failed and we were unable to recover it. 00:27:21.484 [2024-07-15 09:06:09.714259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.714430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.714488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.484 qpair failed and we were unable to recover it. 00:27:21.484 [2024-07-15 09:06:09.714665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.714794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.714823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.484 qpair failed and we were unable to recover it. 00:27:21.484 [2024-07-15 09:06:09.715051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.715292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.715340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.484 qpair failed and we were unable to recover it. 00:27:21.484 [2024-07-15 09:06:09.715481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.715654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.715694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.484 qpair failed and we were unable to recover it. 00:27:21.484 [2024-07-15 09:06:09.715816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.715980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.716007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.484 qpair failed and we were unable to recover it. 00:27:21.484 [2024-07-15 09:06:09.716150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.716292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.716322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.484 qpair failed and we were unable to recover it. 00:27:21.484 [2024-07-15 09:06:09.716548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.716768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.716793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.484 qpair failed and we were unable to recover it. 00:27:21.484 [2024-07-15 09:06:09.716935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.717120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.717148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.484 qpair failed and we were unable to recover it. 00:27:21.484 [2024-07-15 09:06:09.717321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.717464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.717489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.484 qpair failed and we were unable to recover it. 00:27:21.484 [2024-07-15 09:06:09.717631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.717802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.717826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.484 qpair failed and we were unable to recover it. 00:27:21.484 [2024-07-15 09:06:09.717985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.718104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.718129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.484 qpair failed and we were unable to recover it. 00:27:21.484 [2024-07-15 09:06:09.718351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.718552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.718599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.484 qpair failed and we were unable to recover it. 00:27:21.484 [2024-07-15 09:06:09.718761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.718916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.718944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.484 qpair failed and we were unable to recover it. 00:27:21.484 [2024-07-15 09:06:09.719074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.719202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.719230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.484 qpair failed and we were unable to recover it. 00:27:21.484 [2024-07-15 09:06:09.719420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.719537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.719561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.484 qpair failed and we were unable to recover it. 00:27:21.484 [2024-07-15 09:06:09.719680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.719793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.719818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.484 qpair failed and we were unable to recover it. 00:27:21.484 [2024-07-15 09:06:09.719982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.720175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.720235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.484 qpair failed and we were unable to recover it. 00:27:21.484 [2024-07-15 09:06:09.720405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.720587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.720614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.484 qpair failed and we were unable to recover it. 00:27:21.484 [2024-07-15 09:06:09.720805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.720961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.720988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.484 qpair failed and we were unable to recover it. 00:27:21.484 [2024-07-15 09:06:09.721160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.721329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.721389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.484 qpair failed and we were unable to recover it. 00:27:21.484 [2024-07-15 09:06:09.721591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.721772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.721800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.484 qpair failed and we were unable to recover it. 00:27:21.484 [2024-07-15 09:06:09.721927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.722091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.722119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.484 qpair failed and we were unable to recover it. 00:27:21.484 [2024-07-15 09:06:09.722275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.722441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.722496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.484 qpair failed and we were unable to recover it. 00:27:21.484 [2024-07-15 09:06:09.722664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.722810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.722851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.484 qpair failed and we were unable to recover it. 00:27:21.484 [2024-07-15 09:06:09.723030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.723226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.723281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.484 qpair failed and we were unable to recover it. 00:27:21.484 [2024-07-15 09:06:09.723407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.723538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.723565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.484 qpair failed and we were unable to recover it. 00:27:21.484 [2024-07-15 09:06:09.723689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.723886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.723911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.484 qpair failed and we were unable to recover it. 00:27:21.484 [2024-07-15 09:06:09.724058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.724239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.484 [2024-07-15 09:06:09.724266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.484 qpair failed and we were unable to recover it. 00:27:21.484 [2024-07-15 09:06:09.724422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.724579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.724606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.485 qpair failed and we were unable to recover it. 00:27:21.485 [2024-07-15 09:06:09.724746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.724982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.725031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.485 qpair failed and we were unable to recover it. 00:27:21.485 [2024-07-15 09:06:09.725239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.725449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.725500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.485 qpair failed and we were unable to recover it. 00:27:21.485 [2024-07-15 09:06:09.725641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.725763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.725788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.485 qpair failed and we were unable to recover it. 00:27:21.485 [2024-07-15 09:06:09.725910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.726046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.726074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.485 qpair failed and we were unable to recover it. 00:27:21.485 [2024-07-15 09:06:09.726260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.726407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.726435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.485 qpair failed and we were unable to recover it. 00:27:21.485 [2024-07-15 09:06:09.726592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.726750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.726777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.485 qpair failed and we were unable to recover it. 00:27:21.485 [2024-07-15 09:06:09.726953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.727098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.727140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.485 qpair failed and we were unable to recover it. 00:27:21.485 [2024-07-15 09:06:09.727304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.727441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.727470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.485 qpair failed and we were unable to recover it. 00:27:21.485 [2024-07-15 09:06:09.727641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.727771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.727798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.485 qpair failed and we were unable to recover it. 00:27:21.485 [2024-07-15 09:06:09.727967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.728201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.728250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.485 qpair failed and we were unable to recover it. 00:27:21.485 [2024-07-15 09:06:09.728415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.728565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.728605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.485 qpair failed and we were unable to recover it. 00:27:21.485 [2024-07-15 09:06:09.728761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.728889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.728916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.485 qpair failed and we were unable to recover it. 00:27:21.485 [2024-07-15 09:06:09.729077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.729261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.729288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.485 qpair failed and we were unable to recover it. 00:27:21.485 [2024-07-15 09:06:09.729472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.729641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.729667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.485 qpair failed and we were unable to recover it. 00:27:21.485 [2024-07-15 09:06:09.729823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.729940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.729964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.485 qpair failed and we were unable to recover it. 00:27:21.485 [2024-07-15 09:06:09.730138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.730259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.730286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.485 qpair failed and we were unable to recover it. 00:27:21.485 [2024-07-15 09:06:09.730466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.730587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.730611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.485 qpair failed and we were unable to recover it. 00:27:21.485 [2024-07-15 09:06:09.730748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.730967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.731021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.485 qpair failed and we were unable to recover it. 00:27:21.485 [2024-07-15 09:06:09.731220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.731379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.731406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.485 qpair failed and we were unable to recover it. 00:27:21.485 [2024-07-15 09:06:09.731535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.731673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.731699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.485 qpair failed and we were unable to recover it. 00:27:21.485 [2024-07-15 09:06:09.731853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.731997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.732024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.485 qpair failed and we were unable to recover it. 00:27:21.485 [2024-07-15 09:06:09.732186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.732400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.732449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.485 qpair failed and we were unable to recover it. 00:27:21.485 [2024-07-15 09:06:09.732617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.732764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.732804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.485 qpair failed and we were unable to recover it. 00:27:21.485 [2024-07-15 09:06:09.732990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.733264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.733288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.485 qpair failed and we were unable to recover it. 00:27:21.485 [2024-07-15 09:06:09.733473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.733627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.733654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.485 qpair failed and we were unable to recover it. 00:27:21.485 [2024-07-15 09:06:09.733787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.733950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.733977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.485 qpair failed and we were unable to recover it. 00:27:21.485 [2024-07-15 09:06:09.734144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.734276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.734301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.485 qpair failed and we were unable to recover it. 00:27:21.485 [2024-07-15 09:06:09.734445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.734577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.734604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.485 qpair failed and we were unable to recover it. 00:27:21.485 [2024-07-15 09:06:09.734764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.734951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.734978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.485 qpair failed and we were unable to recover it. 00:27:21.485 [2024-07-15 09:06:09.735139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.485 [2024-07-15 09:06:09.735297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.735324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.486 qpair failed and we were unable to recover it. 00:27:21.486 [2024-07-15 09:06:09.735460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.735579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.735603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.486 qpair failed and we were unable to recover it. 00:27:21.486 [2024-07-15 09:06:09.735748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.735874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.735910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.486 qpair failed and we were unable to recover it. 00:27:21.486 [2024-07-15 09:06:09.736083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.736270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.736294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.486 qpair failed and we were unable to recover it. 00:27:21.486 [2024-07-15 09:06:09.736414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.736578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.736606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.486 qpair failed and we were unable to recover it. 00:27:21.486 [2024-07-15 09:06:09.736773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.736955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.736984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.486 qpair failed and we were unable to recover it. 00:27:21.486 [2024-07-15 09:06:09.737144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.737273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.737299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.486 qpair failed and we were unable to recover it. 00:27:21.486 [2024-07-15 09:06:09.737423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.737546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.737574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.486 qpair failed and we were unable to recover it. 00:27:21.486 [2024-07-15 09:06:09.737740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.737859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.737892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.486 qpair failed and we were unable to recover it. 00:27:21.486 [2024-07-15 09:06:09.738083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.738236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.738262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.486 qpair failed and we were unable to recover it. 00:27:21.486 [2024-07-15 09:06:09.738388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.738551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.738577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.486 qpair failed and we were unable to recover it. 00:27:21.486 [2024-07-15 09:06:09.738756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.738906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.738932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.486 qpair failed and we were unable to recover it. 00:27:21.486 [2024-07-15 09:06:09.739130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.739406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.739453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.486 qpair failed and we were unable to recover it. 00:27:21.486 [2024-07-15 09:06:09.739610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.739727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.739753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.486 qpair failed and we were unable to recover it. 00:27:21.486 [2024-07-15 09:06:09.739925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.740126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.740191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.486 qpair failed and we were unable to recover it. 00:27:21.486 [2024-07-15 09:06:09.740358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.740514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.740538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.486 qpair failed and we were unable to recover it. 00:27:21.486 [2024-07-15 09:06:09.740703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.740891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.740920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.486 qpair failed and we were unable to recover it. 00:27:21.486 [2024-07-15 09:06:09.741081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.741281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.741338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.486 qpair failed and we were unable to recover it. 00:27:21.486 [2024-07-15 09:06:09.741505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.741672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.741696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.486 qpair failed and we were unable to recover it. 00:27:21.486 [2024-07-15 09:06:09.741906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.742040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.742068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.486 qpair failed and we were unable to recover it. 00:27:21.486 [2024-07-15 09:06:09.742237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.742414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.742439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.486 qpair failed and we were unable to recover it. 00:27:21.486 [2024-07-15 09:06:09.742611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.742771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.742804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.486 qpair failed and we were unable to recover it. 00:27:21.486 [2024-07-15 09:06:09.742969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.743127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.743154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.486 qpair failed and we were unable to recover it. 00:27:21.486 [2024-07-15 09:06:09.743287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.743446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.743471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.486 qpair failed and we were unable to recover it. 00:27:21.486 [2024-07-15 09:06:09.743609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.743726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.743750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.486 qpair failed and we were unable to recover it. 00:27:21.486 [2024-07-15 09:06:09.743890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.744037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.744061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.486 qpair failed and we were unable to recover it. 00:27:21.486 [2024-07-15 09:06:09.744224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.744369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.744395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.486 qpair failed and we were unable to recover it. 00:27:21.486 [2024-07-15 09:06:09.744552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.744734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.744761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.486 qpair failed and we were unable to recover it. 00:27:21.486 [2024-07-15 09:06:09.744919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.745067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.745097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.486 qpair failed and we were unable to recover it. 00:27:21.486 [2024-07-15 09:06:09.745278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.745446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.745497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.486 qpair failed and we were unable to recover it. 00:27:21.486 [2024-07-15 09:06:09.745658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.745906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.486 [2024-07-15 09:06:09.745934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.486 qpair failed and we were unable to recover it. 00:27:21.487 [2024-07-15 09:06:09.746128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.746316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.746371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.487 qpair failed and we were unable to recover it. 00:27:21.487 [2024-07-15 09:06:09.746577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.746745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.746769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.487 qpair failed and we were unable to recover it. 00:27:21.487 [2024-07-15 09:06:09.746891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.747061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.747102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.487 qpair failed and we were unable to recover it. 00:27:21.487 [2024-07-15 09:06:09.747323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.747562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.747613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.487 qpair failed and we were unable to recover it. 00:27:21.487 [2024-07-15 09:06:09.747768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.747940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.747968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.487 qpair failed and we were unable to recover it. 00:27:21.487 [2024-07-15 09:06:09.748141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.748371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.748398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.487 qpair failed and we were unable to recover it. 00:27:21.487 [2024-07-15 09:06:09.748601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.748748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.748772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.487 qpair failed and we were unable to recover it. 00:27:21.487 [2024-07-15 09:06:09.748923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.749096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.749124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.487 qpair failed and we were unable to recover it. 00:27:21.487 [2024-07-15 09:06:09.749255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.749410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.749437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.487 qpair failed and we were unable to recover it. 00:27:21.487 [2024-07-15 09:06:09.749599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.749731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.749757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.487 qpair failed and we were unable to recover it. 00:27:21.487 [2024-07-15 09:06:09.749901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.750080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.750125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.487 qpair failed and we were unable to recover it. 00:27:21.487 [2024-07-15 09:06:09.750292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.750445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.750470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.487 qpair failed and we were unable to recover it. 00:27:21.487 [2024-07-15 09:06:09.750673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.750866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.750900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.487 qpair failed and we were unable to recover it. 00:27:21.487 [2024-07-15 09:06:09.751032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.751158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.751186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.487 qpair failed and we were unable to recover it. 00:27:21.487 [2024-07-15 09:06:09.751319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.751488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.751512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.487 qpair failed and we were unable to recover it. 00:27:21.487 [2024-07-15 09:06:09.751713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.751870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.751910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.487 qpair failed and we were unable to recover it. 00:27:21.487 [2024-07-15 09:06:09.752073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.752191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.752219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.487 qpair failed and we were unable to recover it. 00:27:21.487 [2024-07-15 09:06:09.752380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.752537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.752564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.487 qpair failed and we were unable to recover it. 00:27:21.487 [2024-07-15 09:06:09.752723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.752869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.752945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.487 qpair failed and we were unable to recover it. 00:27:21.487 [2024-07-15 09:06:09.753078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.753248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.753276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.487 qpair failed and we were unable to recover it. 00:27:21.487 [2024-07-15 09:06:09.753440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.753576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.753619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.487 qpair failed and we were unable to recover it. 00:27:21.487 [2024-07-15 09:06:09.753787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.753912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.753946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.487 qpair failed and we were unable to recover it. 00:27:21.487 [2024-07-15 09:06:09.754089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.754219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.754245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.487 qpair failed and we were unable to recover it. 00:27:21.487 [2024-07-15 09:06:09.754446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.754575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.754602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.487 qpair failed and we were unable to recover it. 00:27:21.487 [2024-07-15 09:06:09.754796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.754958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.487 [2024-07-15 09:06:09.754986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.487 qpair failed and we were unable to recover it. 00:27:21.488 [2024-07-15 09:06:09.755154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.755355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.755405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.488 qpair failed and we were unable to recover it. 00:27:21.488 [2024-07-15 09:06:09.755547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.755667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.755693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.488 qpair failed and we were unable to recover it. 00:27:21.488 [2024-07-15 09:06:09.755831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.755964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.756001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.488 qpair failed and we were unable to recover it. 00:27:21.488 [2024-07-15 09:06:09.756167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.756382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.756452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.488 qpair failed and we were unable to recover it. 00:27:21.488 [2024-07-15 09:06:09.756635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.756820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.756848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.488 qpair failed and we were unable to recover it. 00:27:21.488 [2024-07-15 09:06:09.757013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.757145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.757171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.488 qpair failed and we were unable to recover it. 00:27:21.488 [2024-07-15 09:06:09.757317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.757513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.757541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.488 qpair failed and we were unable to recover it. 00:27:21.488 [2024-07-15 09:06:09.757697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.757893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.757919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.488 qpair failed and we were unable to recover it. 00:27:21.488 [2024-07-15 09:06:09.758068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.758290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.758337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.488 qpair failed and we were unable to recover it. 00:27:21.488 [2024-07-15 09:06:09.758502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.758651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.758677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.488 qpair failed and we were unable to recover it. 00:27:21.488 [2024-07-15 09:06:09.758821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.758994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.759023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.488 qpair failed and we were unable to recover it. 00:27:21.488 [2024-07-15 09:06:09.759207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.759330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.759357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.488 qpair failed and we were unable to recover it. 00:27:21.488 [2024-07-15 09:06:09.759490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.759645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.759673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.488 qpair failed and we were unable to recover it. 00:27:21.488 [2024-07-15 09:06:09.759813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.759968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.760011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.488 qpair failed and we were unable to recover it. 00:27:21.488 [2024-07-15 09:06:09.760199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.760326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.760355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.488 qpair failed and we were unable to recover it. 00:27:21.488 [2024-07-15 09:06:09.760510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.760646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.760676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.488 qpair failed and we were unable to recover it. 00:27:21.488 [2024-07-15 09:06:09.760864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.761009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.761049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.488 qpair failed and we were unable to recover it. 00:27:21.488 [2024-07-15 09:06:09.761242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.761391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.761417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.488 qpair failed and we were unable to recover it. 00:27:21.488 [2024-07-15 09:06:09.761572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.761753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.761781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.488 qpair failed and we were unable to recover it. 00:27:21.488 [2024-07-15 09:06:09.761950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.762083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.762112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.488 qpair failed and we were unable to recover it. 00:27:21.488 [2024-07-15 09:06:09.762253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.762406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.762434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.488 qpair failed and we were unable to recover it. 00:27:21.488 [2024-07-15 09:06:09.762623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.762740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.762784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.488 qpair failed and we were unable to recover it. 00:27:21.488 [2024-07-15 09:06:09.762969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.763098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.763127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.488 qpair failed and we were unable to recover it. 00:27:21.488 [2024-07-15 09:06:09.763257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.763393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.763422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.488 qpair failed and we were unable to recover it. 00:27:21.488 [2024-07-15 09:06:09.763623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.763755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.763783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.488 qpair failed and we were unable to recover it. 00:27:21.488 [2024-07-15 09:06:09.763948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.764102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.764143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.488 qpair failed and we were unable to recover it. 00:27:21.488 [2024-07-15 09:06:09.764287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.764445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.764472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.488 qpair failed and we were unable to recover it. 00:27:21.488 [2024-07-15 09:06:09.764656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.764790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.764817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.488 qpair failed and we were unable to recover it. 00:27:21.488 [2024-07-15 09:06:09.764952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.765119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.765156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.488 qpair failed and we were unable to recover it. 00:27:21.488 [2024-07-15 09:06:09.765327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.765452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.488 [2024-07-15 09:06:09.765479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.488 qpair failed and we were unable to recover it. 00:27:21.488 [2024-07-15 09:06:09.765653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.765827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.765856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.489 qpair failed and we were unable to recover it. 00:27:21.489 [2024-07-15 09:06:09.766017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.766150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.766185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.489 qpair failed and we were unable to recover it. 00:27:21.489 [2024-07-15 09:06:09.766354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.766490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.766515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.489 qpair failed and we were unable to recover it. 00:27:21.489 [2024-07-15 09:06:09.766634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.766788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.766814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.489 qpair failed and we were unable to recover it. 00:27:21.489 [2024-07-15 09:06:09.766990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.767152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.767178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.489 qpair failed and we were unable to recover it. 00:27:21.489 [2024-07-15 09:06:09.767344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.767504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.767531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.489 qpair failed and we were unable to recover it. 00:27:21.489 [2024-07-15 09:06:09.767665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.767854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.767890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.489 qpair failed and we were unable to recover it. 00:27:21.489 [2024-07-15 09:06:09.768060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.768180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.768205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.489 qpair failed and we were unable to recover it. 00:27:21.489 [2024-07-15 09:06:09.768368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.768510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.768538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.489 qpair failed and we were unable to recover it. 00:27:21.489 [2024-07-15 09:06:09.768668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.768817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.768845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.489 qpair failed and we were unable to recover it. 00:27:21.489 [2024-07-15 09:06:09.768994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.769118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.769146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.489 qpair failed and we were unable to recover it. 00:27:21.489 [2024-07-15 09:06:09.769322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.769474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.769500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.489 qpair failed and we were unable to recover it. 00:27:21.489 [2024-07-15 09:06:09.769645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.769784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.769813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.489 qpair failed and we were unable to recover it. 00:27:21.489 [2024-07-15 09:06:09.769995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.770197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.770242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.489 qpair failed and we were unable to recover it. 00:27:21.489 [2024-07-15 09:06:09.770440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.770641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.770671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.489 qpair failed and we were unable to recover it. 00:27:21.489 [2024-07-15 09:06:09.770827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.770988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.771015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.489 qpair failed and we were unable to recover it. 00:27:21.489 [2024-07-15 09:06:09.771211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.771403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.771452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.489 qpair failed and we were unable to recover it. 00:27:21.489 [2024-07-15 09:06:09.771619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.771801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.771829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.489 qpair failed and we were unable to recover it. 00:27:21.489 [2024-07-15 09:06:09.772004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.772165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.772192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.489 qpair failed and we were unable to recover it. 00:27:21.489 [2024-07-15 09:06:09.772333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.772465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.772491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.489 qpair failed and we were unable to recover it. 00:27:21.489 [2024-07-15 09:06:09.772687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.772842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.772869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.489 qpair failed and we were unable to recover it. 00:27:21.489 [2024-07-15 09:06:09.773024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.773191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.773217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.489 qpair failed and we were unable to recover it. 00:27:21.489 [2024-07-15 09:06:09.773360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.773574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.773623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.489 qpair failed and we were unable to recover it. 00:27:21.489 [2024-07-15 09:06:09.773793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.773936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.773984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.489 qpair failed and we were unable to recover it. 00:27:21.489 [2024-07-15 09:06:09.774131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.774303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.774329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.489 qpair failed and we were unable to recover it. 00:27:21.489 [2024-07-15 09:06:09.774530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.774660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.774687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.489 qpair failed and we were unable to recover it. 00:27:21.489 [2024-07-15 09:06:09.774829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.775000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.775028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.489 qpair failed and we were unable to recover it. 00:27:21.489 [2024-07-15 09:06:09.775169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.775339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.775389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.489 qpair failed and we were unable to recover it. 00:27:21.489 [2024-07-15 09:06:09.775552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.775682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.775712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.489 qpair failed and we were unable to recover it. 00:27:21.489 [2024-07-15 09:06:09.775851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.776023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.776051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.489 qpair failed and we were unable to recover it. 00:27:21.489 [2024-07-15 09:06:09.776196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.489 [2024-07-15 09:06:09.776366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.776392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.490 qpair failed and we were unable to recover it. 00:27:21.490 [2024-07-15 09:06:09.776601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.776808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.776836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.490 qpair failed and we were unable to recover it. 00:27:21.490 [2024-07-15 09:06:09.777013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.777155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.777182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.490 qpair failed and we were unable to recover it. 00:27:21.490 [2024-07-15 09:06:09.777406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.777563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.777630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.490 qpair failed and we were unable to recover it. 00:27:21.490 [2024-07-15 09:06:09.777758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.777890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.777919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.490 qpair failed and we were unable to recover it. 00:27:21.490 [2024-07-15 09:06:09.778081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.778250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.778292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.490 qpair failed and we were unable to recover it. 00:27:21.490 [2024-07-15 09:06:09.778470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.778627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.778657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.490 qpair failed and we were unable to recover it. 00:27:21.490 [2024-07-15 09:06:09.778861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.779032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.779062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.490 qpair failed and we were unable to recover it. 00:27:21.490 [2024-07-15 09:06:09.779187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.779401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.779453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.490 qpair failed and we were unable to recover it. 00:27:21.490 [2024-07-15 09:06:09.779641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.779796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.779823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.490 qpair failed and we were unable to recover it. 00:27:21.490 [2024-07-15 09:06:09.779963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.780132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.780158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.490 qpair failed and we were unable to recover it. 00:27:21.490 [2024-07-15 09:06:09.780312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.780467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.780495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.490 qpair failed and we were unable to recover it. 00:27:21.490 [2024-07-15 09:06:09.780661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.780791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.780820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.490 qpair failed and we were unable to recover it. 00:27:21.490 [2024-07-15 09:06:09.781008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.781175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.781218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.490 qpair failed and we were unable to recover it. 00:27:21.490 [2024-07-15 09:06:09.781372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.781500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.781528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.490 qpair failed and we were unable to recover it. 00:27:21.490 [2024-07-15 09:06:09.781687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.781847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.781884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.490 qpair failed and we were unable to recover it. 00:27:21.490 [2024-07-15 09:06:09.782049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.782214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.782269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.490 qpair failed and we were unable to recover it. 00:27:21.490 [2024-07-15 09:06:09.782410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.782580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.782624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.490 qpair failed and we were unable to recover it. 00:27:21.490 [2024-07-15 09:06:09.782787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.782974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.783003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.490 qpair failed and we were unable to recover it. 00:27:21.490 [2024-07-15 09:06:09.783137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.783292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.783320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.490 qpair failed and we were unable to recover it. 00:27:21.490 [2024-07-15 09:06:09.783538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.783697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.783727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.490 qpair failed and we were unable to recover it. 00:27:21.490 [2024-07-15 09:06:09.783868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.784048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.784074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.490 qpair failed and we were unable to recover it. 00:27:21.490 [2024-07-15 09:06:09.784271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.784430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.784458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.490 qpair failed and we were unable to recover it. 00:27:21.490 [2024-07-15 09:06:09.784582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.784707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.784738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.490 qpair failed and we were unable to recover it. 00:27:21.490 [2024-07-15 09:06:09.784893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.785064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.785095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.490 qpair failed and we were unable to recover it. 00:27:21.490 [2024-07-15 09:06:09.785289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.785467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.785498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.490 qpair failed and we were unable to recover it. 00:27:21.490 [2024-07-15 09:06:09.785650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.785811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.785841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.490 qpair failed and we were unable to recover it. 00:27:21.490 [2024-07-15 09:06:09.786045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.786176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.786201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.490 qpair failed and we were unable to recover it. 00:27:21.490 [2024-07-15 09:06:09.786368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.786561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.786595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.490 qpair failed and we were unable to recover it. 00:27:21.490 [2024-07-15 09:06:09.786737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.786889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.786925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.490 qpair failed and we were unable to recover it. 00:27:21.490 [2024-07-15 09:06:09.787087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.490 [2024-07-15 09:06:09.787222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.787252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.491 qpair failed and we were unable to recover it. 00:27:21.491 [2024-07-15 09:06:09.787443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.787603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.787633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.491 qpair failed and we were unable to recover it. 00:27:21.491 [2024-07-15 09:06:09.787818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.787976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.788009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.491 qpair failed and we were unable to recover it. 00:27:21.491 [2024-07-15 09:06:09.788156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.788327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.788352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.491 qpair failed and we were unable to recover it. 00:27:21.491 [2024-07-15 09:06:09.788504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.788632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.788673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.491 qpair failed and we were unable to recover it. 00:27:21.491 [2024-07-15 09:06:09.788865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.789056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.789091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.491 qpair failed and we were unable to recover it. 00:27:21.491 [2024-07-15 09:06:09.789305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.789553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.789609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.491 qpair failed and we were unable to recover it. 00:27:21.491 [2024-07-15 09:06:09.789770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.789942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.789986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.491 qpair failed and we were unable to recover it. 00:27:21.491 [2024-07-15 09:06:09.790153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.790314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.790346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.491 qpair failed and we were unable to recover it. 00:27:21.491 [2024-07-15 09:06:09.790534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.790724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.790753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.491 qpair failed and we were unable to recover it. 00:27:21.491 [2024-07-15 09:06:09.790918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.791104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.791133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.491 qpair failed and we were unable to recover it. 00:27:21.491 [2024-07-15 09:06:09.791302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.791508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.791570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.491 qpair failed and we were unable to recover it. 00:27:21.491 [2024-07-15 09:06:09.791775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.791951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.791977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.491 qpair failed and we were unable to recover it. 00:27:21.491 [2024-07-15 09:06:09.792103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.792269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.792299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.491 qpair failed and we were unable to recover it. 00:27:21.491 [2024-07-15 09:06:09.792545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.792696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.792725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.491 qpair failed and we were unable to recover it. 00:27:21.491 [2024-07-15 09:06:09.792875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.793051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.793077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.491 qpair failed and we were unable to recover it. 00:27:21.491 [2024-07-15 09:06:09.793238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.793409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.793437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.491 qpair failed and we were unable to recover it. 00:27:21.491 [2024-07-15 09:06:09.793605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.793766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.793795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.491 qpair failed and we were unable to recover it. 00:27:21.491 [2024-07-15 09:06:09.793993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.794137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.794178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.491 qpair failed and we were unable to recover it. 00:27:21.491 [2024-07-15 09:06:09.794348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.794550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.794610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.491 qpair failed and we were unable to recover it. 00:27:21.491 [2024-07-15 09:06:09.794775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.794931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.794959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.491 qpair failed and we were unable to recover it. 00:27:21.491 [2024-07-15 09:06:09.795089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.795239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.795268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.491 qpair failed and we were unable to recover it. 00:27:21.491 [2024-07-15 09:06:09.795573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.795786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.795816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.491 qpair failed and we were unable to recover it. 00:27:21.491 [2024-07-15 09:06:09.795982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.796130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.796155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.491 qpair failed and we were unable to recover it. 00:27:21.491 [2024-07-15 09:06:09.796328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.796572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.796637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.491 qpair failed and we were unable to recover it. 00:27:21.491 [2024-07-15 09:06:09.796833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.797007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.797036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.491 qpair failed and we were unable to recover it. 00:27:21.491 [2024-07-15 09:06:09.797166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.797418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.797471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.491 qpair failed and we were unable to recover it. 00:27:21.491 [2024-07-15 09:06:09.797637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.797792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.797844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.491 qpair failed and we were unable to recover it. 00:27:21.491 [2024-07-15 09:06:09.798024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.798180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.798234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.491 qpair failed and we were unable to recover it. 00:27:21.491 [2024-07-15 09:06:09.798378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.798571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.798599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.491 qpair failed and we were unable to recover it. 00:27:21.491 [2024-07-15 09:06:09.798787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.798980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.491 [2024-07-15 09:06:09.799010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.492 qpair failed and we were unable to recover it. 00:27:21.492 [2024-07-15 09:06:09.799151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.799274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.799303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.492 qpair failed and we were unable to recover it. 00:27:21.492 [2024-07-15 09:06:09.799435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.799617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.799646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.492 qpair failed and we were unable to recover it. 00:27:21.492 [2024-07-15 09:06:09.799804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.799964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.799995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.492 qpair failed and we were unable to recover it. 00:27:21.492 [2024-07-15 09:06:09.800138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.800431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.800484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.492 qpair failed and we were unable to recover it. 00:27:21.492 [2024-07-15 09:06:09.800648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.800789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.800815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.492 qpair failed and we were unable to recover it. 00:27:21.492 [2024-07-15 09:06:09.800994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.801182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.801229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.492 qpair failed and we were unable to recover it. 00:27:21.492 [2024-07-15 09:06:09.801444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.801596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.801621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.492 qpair failed and we were unable to recover it. 00:27:21.492 [2024-07-15 09:06:09.801791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.801944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.801987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.492 qpair failed and we were unable to recover it. 00:27:21.492 [2024-07-15 09:06:09.802131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.802276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.802303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.492 qpair failed and we were unable to recover it. 00:27:21.492 [2024-07-15 09:06:09.802478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.802625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.802654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.492 qpair failed and we were unable to recover it. 00:27:21.492 [2024-07-15 09:06:09.802841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.802996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.803026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.492 qpair failed and we were unable to recover it. 00:27:21.492 [2024-07-15 09:06:09.803195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.803337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.803378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.492 qpair failed and we were unable to recover it. 00:27:21.492 [2024-07-15 09:06:09.803572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.803729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.803758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.492 qpair failed and we were unable to recover it. 00:27:21.492 [2024-07-15 09:06:09.803926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.804110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.804139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.492 qpair failed and we were unable to recover it. 00:27:21.492 [2024-07-15 09:06:09.804270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.804430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.804459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.492 qpair failed and we were unable to recover it. 00:27:21.492 [2024-07-15 09:06:09.804627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.804784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.804817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.492 qpair failed and we were unable to recover it. 00:27:21.492 [2024-07-15 09:06:09.804981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.805110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.805136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.492 qpair failed and we were unable to recover it. 00:27:21.492 [2024-07-15 09:06:09.805322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.805477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.805506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.492 qpair failed and we were unable to recover it. 00:27:21.492 [2024-07-15 09:06:09.805690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.805827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.805854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.492 qpair failed and we were unable to recover it. 00:27:21.492 [2024-07-15 09:06:09.805997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.806147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.806175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.492 qpair failed and we were unable to recover it. 00:27:21.492 [2024-07-15 09:06:09.806316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.806433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.806459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.492 qpair failed and we were unable to recover it. 00:27:21.492 [2024-07-15 09:06:09.806617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.806772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.806801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.492 qpair failed and we were unable to recover it. 00:27:21.492 [2024-07-15 09:06:09.806962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.807122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.807150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.492 qpair failed and we were unable to recover it. 00:27:21.492 [2024-07-15 09:06:09.807361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.807570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.807599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.492 qpair failed and we were unable to recover it. 00:27:21.492 [2024-07-15 09:06:09.807756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.807874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.807909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.492 qpair failed and we were unable to recover it. 00:27:21.492 [2024-07-15 09:06:09.808084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.808353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.808411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.492 qpair failed and we were unable to recover it. 00:27:21.492 [2024-07-15 09:06:09.808553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.808717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.492 [2024-07-15 09:06:09.808747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.493 qpair failed and we were unable to recover it. 00:27:21.493 [2024-07-15 09:06:09.808911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.809060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.809090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.493 qpair failed and we were unable to recover it. 00:27:21.493 [2024-07-15 09:06:09.809280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.809394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.809436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.493 qpair failed and we were unable to recover it. 00:27:21.493 [2024-07-15 09:06:09.809623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.809762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.809790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.493 qpair failed and we were unable to recover it. 00:27:21.493 [2024-07-15 09:06:09.809926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.810084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.810112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.493 qpair failed and we were unable to recover it. 00:27:21.493 [2024-07-15 09:06:09.810287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.810427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.810453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.493 qpair failed and we were unable to recover it. 00:27:21.493 [2024-07-15 09:06:09.810602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.810722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.810748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.493 qpair failed and we were unable to recover it. 00:27:21.493 [2024-07-15 09:06:09.810957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.811117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.811158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.493 qpair failed and we were unable to recover it. 00:27:21.493 [2024-07-15 09:06:09.811318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.811506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.811534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.493 qpair failed and we were unable to recover it. 00:27:21.493 [2024-07-15 09:06:09.811690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.811848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.811888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.493 qpair failed and we were unable to recover it. 00:27:21.493 [2024-07-15 09:06:09.812091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.812210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.812251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.493 qpair failed and we were unable to recover it. 00:27:21.493 [2024-07-15 09:06:09.812418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.812570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.812601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.493 qpair failed and we were unable to recover it. 00:27:21.493 [2024-07-15 09:06:09.812786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.812978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.813006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.493 qpair failed and we were unable to recover it. 00:27:21.493 [2024-07-15 09:06:09.813167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.813376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.813402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.493 qpair failed and we were unable to recover it. 00:27:21.493 [2024-07-15 09:06:09.813569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.813686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.813728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.493 qpair failed and we were unable to recover it. 00:27:21.493 [2024-07-15 09:06:09.813893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.814059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.814084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.493 qpair failed and we were unable to recover it. 00:27:21.493 [2024-07-15 09:06:09.814207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.814354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.814380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.493 qpair failed and we were unable to recover it. 00:27:21.493 [2024-07-15 09:06:09.814571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.814728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.814758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.493 qpair failed and we were unable to recover it. 00:27:21.493 [2024-07-15 09:06:09.814926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.815052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.815078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.493 qpair failed and we were unable to recover it. 00:27:21.493 [2024-07-15 09:06:09.815280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.815430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.815459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.493 qpair failed and we were unable to recover it. 00:27:21.493 [2024-07-15 09:06:09.815621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.815793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.815820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.493 qpair failed and we were unable to recover it. 00:27:21.493 [2024-07-15 09:06:09.816013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.816177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.816206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.493 qpair failed and we were unable to recover it. 00:27:21.493 [2024-07-15 09:06:09.816375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.816494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.816520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.493 qpair failed and we were unable to recover it. 00:27:21.493 [2024-07-15 09:06:09.816668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.816949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.816979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.493 qpair failed and we were unable to recover it. 00:27:21.493 [2024-07-15 09:06:09.817150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.817323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.817349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.493 qpair failed and we were unable to recover it. 00:27:21.493 [2024-07-15 09:06:09.817558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.817763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.817791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.493 qpair failed and we were unable to recover it. 00:27:21.493 [2024-07-15 09:06:09.817963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.818113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.818140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.493 qpair failed and we were unable to recover it. 00:27:21.493 [2024-07-15 09:06:09.818259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.818376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.818403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.493 qpair failed and we were unable to recover it. 00:27:21.493 [2024-07-15 09:06:09.818536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.818722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.818751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.493 qpair failed and we were unable to recover it. 00:27:21.493 [2024-07-15 09:06:09.818914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.819045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.819074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.493 qpair failed and we were unable to recover it. 00:27:21.493 [2024-07-15 09:06:09.819221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.819388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.493 [2024-07-15 09:06:09.819414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.493 qpair failed and we were unable to recover it. 00:27:21.493 [2024-07-15 09:06:09.819571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.819757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.819783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.494 qpair failed and we were unable to recover it. 00:27:21.494 [2024-07-15 09:06:09.819921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.820064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.820093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.494 qpair failed and we were unable to recover it. 00:27:21.494 [2024-07-15 09:06:09.820329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.820510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.820540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.494 qpair failed and we were unable to recover it. 00:27:21.494 [2024-07-15 09:06:09.820704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.820853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.820887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.494 qpair failed and we were unable to recover it. 00:27:21.494 [2024-07-15 09:06:09.821094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.821323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.821352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.494 qpair failed and we were unable to recover it. 00:27:21.494 [2024-07-15 09:06:09.821513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.821681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.821707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.494 qpair failed and we were unable to recover it. 00:27:21.494 [2024-07-15 09:06:09.821853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.822030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.822057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.494 qpair failed and we were unable to recover it. 00:27:21.494 [2024-07-15 09:06:09.822231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.822412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.822469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.494 qpair failed and we were unable to recover it. 00:27:21.494 [2024-07-15 09:06:09.822626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.822810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.822839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.494 qpair failed and we were unable to recover it. 00:27:21.494 [2024-07-15 09:06:09.823041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.823228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.823285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.494 qpair failed and we were unable to recover it. 00:27:21.494 [2024-07-15 09:06:09.823473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.823629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.823658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.494 qpair failed and we were unable to recover it. 00:27:21.494 [2024-07-15 09:06:09.823789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.823963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.824005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.494 qpair failed and we were unable to recover it. 00:27:21.494 [2024-07-15 09:06:09.824134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.824291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.824321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.494 qpair failed and we were unable to recover it. 00:27:21.494 [2024-07-15 09:06:09.824479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.824664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.824693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.494 qpair failed and we were unable to recover it. 00:27:21.494 [2024-07-15 09:06:09.824852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.825071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.825100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.494 qpair failed and we were unable to recover it. 00:27:21.494 [2024-07-15 09:06:09.825248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.825391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.825418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.494 qpair failed and we were unable to recover it. 00:27:21.494 [2024-07-15 09:06:09.825595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.825750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.825779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.494 qpair failed and we were unable to recover it. 00:27:21.494 [2024-07-15 09:06:09.825970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.826124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.826153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.494 qpair failed and we were unable to recover it. 00:27:21.494 [2024-07-15 09:06:09.826377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.826581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.826609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.494 qpair failed and we were unable to recover it. 00:27:21.494 [2024-07-15 09:06:09.826804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.826993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.827022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.494 qpair failed and we were unable to recover it. 00:27:21.494 [2024-07-15 09:06:09.827201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.827355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.827383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.494 qpair failed and we were unable to recover it. 00:27:21.494 [2024-07-15 09:06:09.827553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.827702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.827727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.494 qpair failed and we were unable to recover it. 00:27:21.494 [2024-07-15 09:06:09.827975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.828160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.828188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.494 qpair failed and we were unable to recover it. 00:27:21.494 [2024-07-15 09:06:09.828376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.828521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.828563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.494 qpair failed and we were unable to recover it. 00:27:21.494 [2024-07-15 09:06:09.828715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.828886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.828915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.494 qpair failed and we were unable to recover it. 00:27:21.494 [2024-07-15 09:06:09.829110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.829238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.829266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.494 qpair failed and we were unable to recover it. 00:27:21.494 [2024-07-15 09:06:09.829432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.829603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.829629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.494 qpair failed and we were unable to recover it. 00:27:21.494 [2024-07-15 09:06:09.829777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.829897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.829923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.494 qpair failed and we were unable to recover it. 00:27:21.494 [2024-07-15 09:06:09.830135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.830273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.830298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.494 qpair failed and we were unable to recover it. 00:27:21.494 [2024-07-15 09:06:09.830488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.830673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.830701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.494 qpair failed and we were unable to recover it. 00:27:21.494 [2024-07-15 09:06:09.830826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.830962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.494 [2024-07-15 09:06:09.830992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.494 qpair failed and we were unable to recover it. 00:27:21.495 [2024-07-15 09:06:09.831184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.831349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.831377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.495 qpair failed and we were unable to recover it. 00:27:21.495 [2024-07-15 09:06:09.831510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.831665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.831694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.495 qpair failed and we were unable to recover it. 00:27:21.495 [2024-07-15 09:06:09.831887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.832047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.832076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.495 qpair failed and we were unable to recover it. 00:27:21.495 [2024-07-15 09:06:09.832233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.832552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.832602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.495 qpair failed and we were unable to recover it. 00:27:21.495 [2024-07-15 09:06:09.832776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.832923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.832950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.495 qpair failed and we were unable to recover it. 00:27:21.495 [2024-07-15 09:06:09.833125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.833317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.833376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.495 qpair failed and we were unable to recover it. 00:27:21.495 [2024-07-15 09:06:09.833559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.833720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.833746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.495 qpair failed and we were unable to recover it. 00:27:21.495 [2024-07-15 09:06:09.833891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.834059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.834089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.495 qpair failed and we were unable to recover it. 00:27:21.495 [2024-07-15 09:06:09.834231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.834396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.834438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.495 qpair failed and we were unable to recover it. 00:27:21.495 [2024-07-15 09:06:09.834621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.834785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.834814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.495 qpair failed and we were unable to recover it. 00:27:21.495 [2024-07-15 09:06:09.835004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.835146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.835174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.495 qpair failed and we were unable to recover it. 00:27:21.495 [2024-07-15 09:06:09.835337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.835491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.835519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.495 qpair failed and we were unable to recover it. 00:27:21.495 [2024-07-15 09:06:09.835680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.835869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.835911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.495 qpair failed and we were unable to recover it. 00:27:21.495 [2024-07-15 09:06:09.836104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.836236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.836264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.495 qpair failed and we were unable to recover it. 00:27:21.495 [2024-07-15 09:06:09.836445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.836620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.836646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.495 qpair failed and we were unable to recover it. 00:27:21.495 [2024-07-15 09:06:09.836768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.836958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.836986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.495 qpair failed and we were unable to recover it. 00:27:21.495 [2024-07-15 09:06:09.837151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.837268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.837293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.495 qpair failed and we were unable to recover it. 00:27:21.495 [2024-07-15 09:06:09.837488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.837643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.837671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.495 qpair failed and we were unable to recover it. 00:27:21.495 [2024-07-15 09:06:09.837827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.838020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.838048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.495 qpair failed and we were unable to recover it. 00:27:21.495 [2024-07-15 09:06:09.838185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.838315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.838343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.495 qpair failed and we were unable to recover it. 00:27:21.495 [2024-07-15 09:06:09.838505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.838675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.838718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.495 qpair failed and we were unable to recover it. 00:27:21.495 [2024-07-15 09:06:09.838885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.839068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.839095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.495 qpair failed and we were unable to recover it. 00:27:21.495 [2024-07-15 09:06:09.839255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.839387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.839416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.495 qpair failed and we were unable to recover it. 00:27:21.495 [2024-07-15 09:06:09.839573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.839739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.839768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.495 qpair failed and we were unable to recover it. 00:27:21.495 [2024-07-15 09:06:09.839964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.840155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.840183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.495 qpair failed and we were unable to recover it. 00:27:21.495 [2024-07-15 09:06:09.840367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.840552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.840581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.495 qpair failed and we were unable to recover it. 00:27:21.495 [2024-07-15 09:06:09.840740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.840895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.840924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.495 qpair failed and we were unable to recover it. 00:27:21.495 [2024-07-15 09:06:09.841078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.841316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.841378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.495 qpair failed and we were unable to recover it. 00:27:21.495 [2024-07-15 09:06:09.841553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.841700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.841742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.495 qpair failed and we were unable to recover it. 00:27:21.495 [2024-07-15 09:06:09.841883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.842042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.495 [2024-07-15 09:06:09.842071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.495 qpair failed and we were unable to recover it. 00:27:21.495 [2024-07-15 09:06:09.842232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.842419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.842476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.496 qpair failed and we were unable to recover it. 00:27:21.496 [2024-07-15 09:06:09.842638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.842824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.842853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.496 qpair failed and we were unable to recover it. 00:27:21.496 [2024-07-15 09:06:09.843017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.843130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.843155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.496 qpair failed and we were unable to recover it. 00:27:21.496 [2024-07-15 09:06:09.843351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.843501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.843529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.496 qpair failed and we were unable to recover it. 00:27:21.496 [2024-07-15 09:06:09.843715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.843848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.843885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.496 qpair failed and we were unable to recover it. 00:27:21.496 [2024-07-15 09:06:09.844072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.844312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.844373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.496 qpair failed and we were unable to recover it. 00:27:21.496 [2024-07-15 09:06:09.844563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.844712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.844738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.496 qpair failed and we were unable to recover it. 00:27:21.496 [2024-07-15 09:06:09.844890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.845057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.845085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.496 qpair failed and we were unable to recover it. 00:27:21.496 [2024-07-15 09:06:09.845210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.845351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.845378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.496 qpair failed and we were unable to recover it. 00:27:21.496 [2024-07-15 09:06:09.845536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.845694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.845723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.496 qpair failed and we were unable to recover it. 00:27:21.496 [2024-07-15 09:06:09.845872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.846049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.846074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.496 qpair failed and we were unable to recover it. 00:27:21.496 [2024-07-15 09:06:09.846241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.846400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.846428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.496 qpair failed and we were unable to recover it. 00:27:21.496 [2024-07-15 09:06:09.846602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.846767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.846793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.496 qpair failed and we were unable to recover it. 00:27:21.496 [2024-07-15 09:06:09.847022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.847183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.847211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.496 qpair failed and we were unable to recover it. 00:27:21.496 [2024-07-15 09:06:09.847359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.847508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.847534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.496 qpair failed and we were unable to recover it. 00:27:21.496 [2024-07-15 09:06:09.847698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.847871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.847905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.496 qpair failed and we were unable to recover it. 00:27:21.496 [2024-07-15 09:06:09.848074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.848226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.848255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.496 qpair failed and we were unable to recover it. 00:27:21.496 [2024-07-15 09:06:09.848416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.848574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.848603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.496 qpair failed and we were unable to recover it. 00:27:21.496 [2024-07-15 09:06:09.848773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.848924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.848950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.496 qpair failed and we were unable to recover it. 00:27:21.496 [2024-07-15 09:06:09.849100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.849386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.849438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.496 qpair failed and we were unable to recover it. 00:27:21.496 [2024-07-15 09:06:09.849601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.849768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.849797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.496 qpair failed and we were unable to recover it. 00:27:21.496 [2024-07-15 09:06:09.849949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.850113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.850142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.496 qpair failed and we were unable to recover it. 00:27:21.496 [2024-07-15 09:06:09.850307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.850501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.850562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.496 qpair failed and we were unable to recover it. 00:27:21.496 [2024-07-15 09:06:09.850748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.850871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.850906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.496 qpair failed and we were unable to recover it. 00:27:21.496 [2024-07-15 09:06:09.851090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.851254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.851279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.496 qpair failed and we were unable to recover it. 00:27:21.496 [2024-07-15 09:06:09.851435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.851580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.851608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.496 qpair failed and we were unable to recover it. 00:27:21.496 [2024-07-15 09:06:09.851780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.851920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.496 [2024-07-15 09:06:09.851947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.497 qpair failed and we were unable to recover it. 00:27:21.497 [2024-07-15 09:06:09.852152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.852297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.852323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.497 qpair failed and we were unable to recover it. 00:27:21.497 [2024-07-15 09:06:09.852461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.852623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.852652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.497 qpair failed and we were unable to recover it. 00:27:21.497 [2024-07-15 09:06:09.852817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.852983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.853010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.497 qpair failed and we were unable to recover it. 00:27:21.497 [2024-07-15 09:06:09.853150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.853337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.853406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.497 qpair failed and we were unable to recover it. 00:27:21.497 [2024-07-15 09:06:09.853588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.853744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.853774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.497 qpair failed and we were unable to recover it. 00:27:21.497 [2024-07-15 09:06:09.853960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.854121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.854150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.497 qpair failed and we were unable to recover it. 00:27:21.497 [2024-07-15 09:06:09.854281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.854476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.854502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.497 qpair failed and we were unable to recover it. 00:27:21.497 [2024-07-15 09:06:09.854626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.854745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.854770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.497 qpair failed and we were unable to recover it. 00:27:21.497 [2024-07-15 09:06:09.854942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.855111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.855140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.497 qpair failed and we were unable to recover it. 00:27:21.497 [2024-07-15 09:06:09.855326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.855485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.855514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.497 qpair failed and we were unable to recover it. 00:27:21.497 [2024-07-15 09:06:09.855699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.855821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.855849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.497 qpair failed and we were unable to recover it. 00:27:21.497 [2024-07-15 09:06:09.856036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.856167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.856192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.497 qpair failed and we were unable to recover it. 00:27:21.497 [2024-07-15 09:06:09.856336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.856479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.856504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.497 qpair failed and we were unable to recover it. 00:27:21.497 [2024-07-15 09:06:09.856625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.856805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.856830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.497 qpair failed and we were unable to recover it. 00:27:21.497 [2024-07-15 09:06:09.856975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.857144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.857173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.497 qpair failed and we were unable to recover it. 00:27:21.497 [2024-07-15 09:06:09.857347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.857499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.857525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.497 qpair failed and we were unable to recover it. 00:27:21.497 [2024-07-15 09:06:09.857672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.857821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.857847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.497 qpair failed and we were unable to recover it. 00:27:21.497 [2024-07-15 09:06:09.858028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.858228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.858280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.497 qpair failed and we were unable to recover it. 00:27:21.497 [2024-07-15 09:06:09.858461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.858657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.858687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.497 qpair failed and we were unable to recover it. 00:27:21.497 [2024-07-15 09:06:09.858856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.859015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.859040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.497 qpair failed and we were unable to recover it. 00:27:21.497 [2024-07-15 09:06:09.859159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.859323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.859351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.497 qpair failed and we were unable to recover it. 00:27:21.497 [2024-07-15 09:06:09.859607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.859787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.859819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.497 qpair failed and we were unable to recover it. 00:27:21.497 [2024-07-15 09:06:09.859960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.860118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.860147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.497 qpair failed and we were unable to recover it. 00:27:21.497 [2024-07-15 09:06:09.860339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.860490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.860515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.497 qpair failed and we were unable to recover it. 00:27:21.497 [2024-07-15 09:06:09.860652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.860799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.860829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.497 qpair failed and we were unable to recover it. 00:27:21.497 [2024-07-15 09:06:09.861010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.861162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.861191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.497 qpair failed and we were unable to recover it. 00:27:21.497 [2024-07-15 09:06:09.861433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.861734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.861785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.497 qpair failed and we were unable to recover it. 00:27:21.497 [2024-07-15 09:06:09.861990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.862145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.862174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.497 qpair failed and we were unable to recover it. 00:27:21.497 [2024-07-15 09:06:09.862359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.862613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.862670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.497 qpair failed and we were unable to recover it. 00:27:21.497 [2024-07-15 09:06:09.862801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.862961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.497 [2024-07-15 09:06:09.862990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.497 qpair failed and we were unable to recover it. 00:27:21.498 [2024-07-15 09:06:09.863150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.863305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.863333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.498 qpair failed and we were unable to recover it. 00:27:21.498 [2024-07-15 09:06:09.863498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.863644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.863674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.498 qpair failed and we were unable to recover it. 00:27:21.498 [2024-07-15 09:06:09.863819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.863964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.863991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.498 qpair failed and we were unable to recover it. 00:27:21.498 [2024-07-15 09:06:09.864157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.864415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.864468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.498 qpair failed and we were unable to recover it. 00:27:21.498 [2024-07-15 09:06:09.864654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.864848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.864884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.498 qpair failed and we were unable to recover it. 00:27:21.498 [2024-07-15 09:06:09.865052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.865193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.865234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.498 qpair failed and we were unable to recover it. 00:27:21.498 [2024-07-15 09:06:09.865383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.865534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.865563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.498 qpair failed and we were unable to recover it. 00:27:21.498 [2024-07-15 09:06:09.865719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.865907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.865936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.498 qpair failed and we were unable to recover it. 00:27:21.498 [2024-07-15 09:06:09.866091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.866343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.866389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.498 qpair failed and we were unable to recover it. 00:27:21.498 [2024-07-15 09:06:09.866558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.866706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.866750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.498 qpair failed and we were unable to recover it. 00:27:21.498 [2024-07-15 09:06:09.866915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.867068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.867097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.498 qpair failed and we were unable to recover it. 00:27:21.498 [2024-07-15 09:06:09.867258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.867450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.867481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.498 qpair failed and we were unable to recover it. 00:27:21.498 [2024-07-15 09:06:09.867625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.867767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.867792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.498 qpair failed and we were unable to recover it. 00:27:21.498 [2024-07-15 09:06:09.867964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.868123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.868152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.498 qpair failed and we were unable to recover it. 00:27:21.498 [2024-07-15 09:06:09.868324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.868462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.868489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.498 qpair failed and we were unable to recover it. 00:27:21.498 [2024-07-15 09:06:09.868680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.868834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.868863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.498 qpair failed and we were unable to recover it. 00:27:21.498 [2024-07-15 09:06:09.869033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.869229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.869255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.498 qpair failed and we were unable to recover it. 00:27:21.498 [2024-07-15 09:06:09.869375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.869524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.869550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.498 qpair failed and we were unable to recover it. 00:27:21.498 [2024-07-15 09:06:09.869752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.869884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.869913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.498 qpair failed and we were unable to recover it. 00:27:21.498 [2024-07-15 09:06:09.870099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.870257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.870286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.498 qpair failed and we were unable to recover it. 00:27:21.498 [2024-07-15 09:06:09.870421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.870617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.870642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.498 qpair failed and we were unable to recover it. 00:27:21.498 [2024-07-15 09:06:09.870820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.870942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.870986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.498 qpair failed and we were unable to recover it. 00:27:21.498 [2024-07-15 09:06:09.871145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.871343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.871369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.498 qpair failed and we were unable to recover it. 00:27:21.498 [2024-07-15 09:06:09.871509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.871671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.871699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.498 qpair failed and we were unable to recover it. 00:27:21.498 [2024-07-15 09:06:09.871866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.872034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.872062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.498 qpair failed and we were unable to recover it. 00:27:21.498 [2024-07-15 09:06:09.872225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.872418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.872481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.498 qpair failed and we were unable to recover it. 00:27:21.498 [2024-07-15 09:06:09.872643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.872826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.872854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.498 qpair failed and we were unable to recover it. 00:27:21.498 [2024-07-15 09:06:09.872995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.873152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.873180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.498 qpair failed and we were unable to recover it. 00:27:21.498 [2024-07-15 09:06:09.873487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.873699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.873728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.498 qpair failed and we were unable to recover it. 00:27:21.498 [2024-07-15 09:06:09.873899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.874048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.874094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.498 qpair failed and we were unable to recover it. 00:27:21.498 [2024-07-15 09:06:09.874277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.498 [2024-07-15 09:06:09.874460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.874489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.499 qpair failed and we were unable to recover it. 00:27:21.499 [2024-07-15 09:06:09.874637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.874773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.874801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.499 qpair failed and we were unable to recover it. 00:27:21.499 [2024-07-15 09:06:09.874964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.875125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.875154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.499 qpair failed and we were unable to recover it. 00:27:21.499 [2024-07-15 09:06:09.875349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.875496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.875537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.499 qpair failed and we were unable to recover it. 00:27:21.499 [2024-07-15 09:06:09.875700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.875856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.875893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.499 qpair failed and we were unable to recover it. 00:27:21.499 [2024-07-15 09:06:09.876078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.876270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.876325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.499 qpair failed and we were unable to recover it. 00:27:21.499 [2024-07-15 09:06:09.876565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.876771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.876800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.499 qpair failed and we were unable to recover it. 00:27:21.499 [2024-07-15 09:06:09.876947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.877097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.877122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.499 qpair failed and we were unable to recover it. 00:27:21.499 [2024-07-15 09:06:09.877305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.877464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.877493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.499 qpair failed and we were unable to recover it. 00:27:21.499 [2024-07-15 09:06:09.877652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.877838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.877865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.499 qpair failed and we were unable to recover it. 00:27:21.499 [2024-07-15 09:06:09.878013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.878189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.878214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.499 qpair failed and we were unable to recover it. 00:27:21.499 [2024-07-15 09:06:09.878359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.878509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.878554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.499 qpair failed and we were unable to recover it. 00:27:21.499 [2024-07-15 09:06:09.878687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.878841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.878870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.499 qpair failed and we were unable to recover it. 00:27:21.499 [2024-07-15 09:06:09.879066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.879224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.879252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.499 qpair failed and we were unable to recover it. 00:27:21.499 [2024-07-15 09:06:09.879443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.879746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.879799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.499 qpair failed and we were unable to recover it. 00:27:21.499 [2024-07-15 09:06:09.879949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.880127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.880171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.499 qpair failed and we were unable to recover it. 00:27:21.499 [2024-07-15 09:06:09.880306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.880459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.880488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.499 qpair failed and we were unable to recover it. 00:27:21.499 [2024-07-15 09:06:09.880671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.880841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.880866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.499 qpair failed and we were unable to recover it. 00:27:21.499 [2024-07-15 09:06:09.881023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.881216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.881245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.499 qpair failed and we were unable to recover it. 00:27:21.499 [2024-07-15 09:06:09.881406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.881562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.881587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.499 qpair failed and we were unable to recover it. 00:27:21.499 [2024-07-15 09:06:09.881736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.881922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.881949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.499 qpair failed and we were unable to recover it. 00:27:21.499 [2024-07-15 09:06:09.882135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.882378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.882430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.499 qpair failed and we were unable to recover it. 00:27:21.499 [2024-07-15 09:06:09.882707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.883004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.883066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.499 qpair failed and we were unable to recover it. 00:27:21.499 [2024-07-15 09:06:09.883239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.883380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.883422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.499 qpair failed and we were unable to recover it. 00:27:21.499 [2024-07-15 09:06:09.883581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.883745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.883774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.499 qpair failed and we were unable to recover it. 00:27:21.499 [2024-07-15 09:06:09.883965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.884119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.884147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.499 qpair failed and we were unable to recover it. 00:27:21.499 [2024-07-15 09:06:09.884368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.884680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.884730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.499 qpair failed and we were unable to recover it. 00:27:21.499 [2024-07-15 09:06:09.884893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.885042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.885069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.499 qpair failed and we were unable to recover it. 00:27:21.499 [2024-07-15 09:06:09.885249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.885410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.885439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.499 qpair failed and we were unable to recover it. 00:27:21.499 [2024-07-15 09:06:09.885580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.885775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.885801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.499 qpair failed and we were unable to recover it. 00:27:21.499 [2024-07-15 09:06:09.885927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.886088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.499 [2024-07-15 09:06:09.886117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.499 qpair failed and we were unable to recover it. 00:27:21.500 [2024-07-15 09:06:09.886311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.886470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.886499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.500 qpair failed and we were unable to recover it. 00:27:21.500 [2024-07-15 09:06:09.886632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.886828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.886854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.500 qpair failed and we were unable to recover it. 00:27:21.500 [2024-07-15 09:06:09.887029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.887237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.887289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.500 qpair failed and we were unable to recover it. 00:27:21.500 [2024-07-15 09:06:09.887598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.887787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.887816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.500 qpair failed and we were unable to recover it. 00:27:21.500 [2024-07-15 09:06:09.888012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.888216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.888246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.500 qpair failed and we were unable to recover it. 00:27:21.500 [2024-07-15 09:06:09.888404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.888528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.888557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.500 qpair failed and we were unable to recover it. 00:27:21.500 [2024-07-15 09:06:09.888715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.888899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.888938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.500 qpair failed and we were unable to recover it. 00:27:21.500 [2024-07-15 09:06:09.889121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.889343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.889406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.500 qpair failed and we were unable to recover it. 00:27:21.500 [2024-07-15 09:06:09.889601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.889769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.889798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.500 qpair failed and we were unable to recover it. 00:27:21.500 [2024-07-15 09:06:09.889958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.890141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.890178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.500 qpair failed and we were unable to recover it. 00:27:21.500 [2024-07-15 09:06:09.890334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.890497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.890527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.500 qpair failed and we were unable to recover it. 00:27:21.500 [2024-07-15 09:06:09.890696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.890886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.890926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.500 qpair failed and we were unable to recover it. 00:27:21.500 [2024-07-15 09:06:09.891055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.891202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.891227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.500 qpair failed and we were unable to recover it. 00:27:21.500 [2024-07-15 09:06:09.891364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.891524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.891553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.500 qpair failed and we were unable to recover it. 00:27:21.500 [2024-07-15 09:06:09.891715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.891872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.891932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.500 qpair failed and we were unable to recover it. 00:27:21.500 [2024-07-15 09:06:09.892099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.892394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.892447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.500 qpair failed and we were unable to recover it. 00:27:21.500 [2024-07-15 09:06:09.892607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.892775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.892818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.500 qpair failed and we were unable to recover it. 00:27:21.500 [2024-07-15 09:06:09.892989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.893139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.893165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.500 qpair failed and we were unable to recover it. 00:27:21.500 [2024-07-15 09:06:09.893374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.893542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.893584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.500 qpair failed and we were unable to recover it. 00:27:21.500 [2024-07-15 09:06:09.893735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.893894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.893931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.500 qpair failed and we were unable to recover it. 00:27:21.500 [2024-07-15 09:06:09.894122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.894377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.894435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.500 qpair failed and we were unable to recover it. 00:27:21.500 [2024-07-15 09:06:09.894623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.894746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.894774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.500 qpair failed and we were unable to recover it. 00:27:21.500 [2024-07-15 09:06:09.894928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.895066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.895094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.500 qpair failed and we were unable to recover it. 00:27:21.500 [2024-07-15 09:06:09.895270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.895390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.895416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.500 qpair failed and we were unable to recover it. 00:27:21.500 [2024-07-15 09:06:09.895591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.895737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.895763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.500 qpair failed and we were unable to recover it. 00:27:21.500 [2024-07-15 09:06:09.895926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.896120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.896156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.500 qpair failed and we were unable to recover it. 00:27:21.500 [2024-07-15 09:06:09.896329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.896494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.500 [2024-07-15 09:06:09.896525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.500 qpair failed and we were unable to recover it. 00:27:21.501 [2024-07-15 09:06:09.896692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.896875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.896925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.501 qpair failed and we were unable to recover it. 00:27:21.501 [2024-07-15 09:06:09.897069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.897240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.897266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.501 qpair failed and we were unable to recover it. 00:27:21.501 [2024-07-15 09:06:09.897437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.897665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.897724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.501 qpair failed and we were unable to recover it. 00:27:21.501 [2024-07-15 09:06:09.897859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.898044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.898071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.501 qpair failed and we were unable to recover it. 00:27:21.501 [2024-07-15 09:06:09.898271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.898556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.898585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.501 qpair failed and we were unable to recover it. 00:27:21.501 [2024-07-15 09:06:09.898757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.898895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.898926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.501 qpair failed and we were unable to recover it. 00:27:21.501 [2024-07-15 09:06:09.899044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.899223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.899248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.501 qpair failed and we were unable to recover it. 00:27:21.501 [2024-07-15 09:06:09.899416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.899600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.899629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.501 qpair failed and we were unable to recover it. 00:27:21.501 [2024-07-15 09:06:09.899767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.899937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.899963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.501 qpair failed and we were unable to recover it. 00:27:21.501 [2024-07-15 09:06:09.900137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.900250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.900275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.501 qpair failed and we were unable to recover it. 00:27:21.501 [2024-07-15 09:06:09.900422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.900599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.900628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.501 qpair failed and we were unable to recover it. 00:27:21.501 [2024-07-15 09:06:09.900788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.900951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.900980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.501 qpair failed and we were unable to recover it. 00:27:21.501 [2024-07-15 09:06:09.901144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.901304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.901332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.501 qpair failed and we were unable to recover it. 00:27:21.501 [2024-07-15 09:06:09.901507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.901685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.901739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.501 qpair failed and we were unable to recover it. 00:27:21.501 [2024-07-15 09:06:09.901926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.902130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.902156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.501 qpair failed and we were unable to recover it. 00:27:21.501 [2024-07-15 09:06:09.902299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.902488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.902559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.501 qpair failed and we were unable to recover it. 00:27:21.501 [2024-07-15 09:06:09.902762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.902928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.902957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.501 qpair failed and we were unable to recover it. 00:27:21.501 [2024-07-15 09:06:09.903101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.903259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.903301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.501 qpair failed and we were unable to recover it. 00:27:21.501 [2024-07-15 09:06:09.903487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.903642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.903671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.501 qpair failed and we were unable to recover it. 00:27:21.501 [2024-07-15 09:06:09.903833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.903989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.904016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.501 qpair failed and we were unable to recover it. 00:27:21.501 [2024-07-15 09:06:09.904157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.904457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.904513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.501 qpair failed and we were unable to recover it. 00:27:21.501 [2024-07-15 09:06:09.904712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.904859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.904891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.501 qpair failed and we were unable to recover it. 00:27:21.501 [2024-07-15 09:06:09.905096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.905259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.905310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.501 qpair failed and we were unable to recover it. 00:27:21.501 [2024-07-15 09:06:09.905469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.905621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.905650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.501 qpair failed and we were unable to recover it. 00:27:21.501 [2024-07-15 09:06:09.905784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.905982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.906011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.501 qpair failed and we were unable to recover it. 00:27:21.501 [2024-07-15 09:06:09.906180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.906327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.906371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.501 qpair failed and we were unable to recover it. 00:27:21.501 [2024-07-15 09:06:09.906500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.906692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.906720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.501 qpair failed and we were unable to recover it. 00:27:21.501 [2024-07-15 09:06:09.906844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.906994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.907023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.501 qpair failed and we were unable to recover it. 00:27:21.501 [2024-07-15 09:06:09.907154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.907348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.907374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.501 qpair failed and we were unable to recover it. 00:27:21.501 [2024-07-15 09:06:09.907546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.907710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.501 [2024-07-15 09:06:09.907740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.501 qpair failed and we were unable to recover it. 00:27:21.501 [2024-07-15 09:06:09.907933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.908121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.908149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.502 qpair failed and we were unable to recover it. 00:27:21.502 [2024-07-15 09:06:09.908336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.908457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.908485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.502 qpair failed and we were unable to recover it. 00:27:21.502 [2024-07-15 09:06:09.908605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.908758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.908787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.502 qpair failed and we were unable to recover it. 00:27:21.502 [2024-07-15 09:06:09.908952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.909097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.909123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.502 qpair failed and we were unable to recover it. 00:27:21.502 [2024-07-15 09:06:09.909296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.909454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.909482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.502 qpair failed and we were unable to recover it. 00:27:21.502 [2024-07-15 09:06:09.909667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.909824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.909853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.502 qpair failed and we were unable to recover it. 00:27:21.502 [2024-07-15 09:06:09.910051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.910200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.910229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.502 qpair failed and we were unable to recover it. 00:27:21.502 [2024-07-15 09:06:09.910394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.910562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.910606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.502 qpair failed and we were unable to recover it. 00:27:21.502 [2024-07-15 09:06:09.910764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.910953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.910982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.502 qpair failed and we were unable to recover it. 00:27:21.502 [2024-07-15 09:06:09.911122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.911308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.911336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.502 qpair failed and we were unable to recover it. 00:27:21.502 [2024-07-15 09:06:09.911495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.911680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.911708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.502 qpair failed and we were unable to recover it. 00:27:21.502 [2024-07-15 09:06:09.911849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.912001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.912028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.502 qpair failed and we were unable to recover it. 00:27:21.502 [2024-07-15 09:06:09.912216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.912372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.912400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.502 qpair failed and we were unable to recover it. 00:27:21.502 [2024-07-15 09:06:09.912532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.912687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.912715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.502 qpair failed and we were unable to recover it. 00:27:21.502 [2024-07-15 09:06:09.912962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.913100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.913129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.502 qpair failed and we were unable to recover it. 00:27:21.502 [2024-07-15 09:06:09.913320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.913483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.913551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.502 qpair failed and we were unable to recover it. 00:27:21.502 [2024-07-15 09:06:09.913703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.913888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.913917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.502 qpair failed and we were unable to recover it. 00:27:21.502 [2024-07-15 09:06:09.914100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.914274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.914341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.502 qpair failed and we were unable to recover it. 00:27:21.502 [2024-07-15 09:06:09.914497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.914678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.914707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.502 qpair failed and we were unable to recover it. 00:27:21.502 [2024-07-15 09:06:09.914849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.915001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.915026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.502 qpair failed and we were unable to recover it. 00:27:21.502 [2024-07-15 09:06:09.915166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.915286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.915314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.502 qpair failed and we were unable to recover it. 00:27:21.502 [2024-07-15 09:06:09.915469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.915631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.915659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.502 qpair failed and we were unable to recover it. 00:27:21.502 [2024-07-15 09:06:09.915818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.915947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.915976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.502 qpair failed and we were unable to recover it. 00:27:21.502 [2024-07-15 09:06:09.916141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.916323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.916350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.502 qpair failed and we were unable to recover it. 00:27:21.502 [2024-07-15 09:06:09.916530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.916696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.916726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.502 qpair failed and we were unable to recover it. 00:27:21.502 [2024-07-15 09:06:09.916872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.917046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.917073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.502 qpair failed and we were unable to recover it. 00:27:21.502 [2024-07-15 09:06:09.917238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.917481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.917537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.502 qpair failed and we were unable to recover it. 00:27:21.502 [2024-07-15 09:06:09.917701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.917846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.917871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.502 qpair failed and we were unable to recover it. 00:27:21.502 [2024-07-15 09:06:09.918054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.918274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.918300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.502 qpair failed and we were unable to recover it. 00:27:21.502 [2024-07-15 09:06:09.918445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.918623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.918649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.502 qpair failed and we were unable to recover it. 00:27:21.502 [2024-07-15 09:06:09.918793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.502 [2024-07-15 09:06:09.918962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.918992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.503 qpair failed and we were unable to recover it. 00:27:21.503 [2024-07-15 09:06:09.919159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.919330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.919373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.503 qpair failed and we were unable to recover it. 00:27:21.503 [2024-07-15 09:06:09.919559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.919691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.919718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.503 qpair failed and we were unable to recover it. 00:27:21.503 [2024-07-15 09:06:09.919902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.920059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.920087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.503 qpair failed and we were unable to recover it. 00:27:21.503 [2024-07-15 09:06:09.920347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.920518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.920548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.503 qpair failed and we were unable to recover it. 00:27:21.503 [2024-07-15 09:06:09.920721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.920844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.920870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.503 qpair failed and we were unable to recover it. 00:27:21.503 [2024-07-15 09:06:09.921054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.921243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.921270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.503 qpair failed and we were unable to recover it. 00:27:21.503 [2024-07-15 09:06:09.921452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.921670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.921743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.503 qpair failed and we were unable to recover it. 00:27:21.503 [2024-07-15 09:06:09.921933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.922117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.922146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.503 qpair failed and we were unable to recover it. 00:27:21.503 [2024-07-15 09:06:09.922308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.922453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.922495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.503 qpair failed and we were unable to recover it. 00:27:21.503 [2024-07-15 09:06:09.922630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.922787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.922815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.503 qpair failed and we were unable to recover it. 00:27:21.503 [2024-07-15 09:06:09.922979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.923137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.923166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.503 qpair failed and we were unable to recover it. 00:27:21.503 [2024-07-15 09:06:09.923411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.923760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.923810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.503 qpair failed and we were unable to recover it. 00:27:21.503 [2024-07-15 09:06:09.924005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.924165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.924194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.503 qpair failed and we were unable to recover it. 00:27:21.503 [2024-07-15 09:06:09.924318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.924476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.924509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.503 qpair failed and we were unable to recover it. 00:27:21.503 [2024-07-15 09:06:09.924669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.924826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.924853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.503 qpair failed and we were unable to recover it. 00:27:21.503 [2024-07-15 09:06:09.925015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.925171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.925199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.503 qpair failed and we were unable to recover it. 00:27:21.503 [2024-07-15 09:06:09.925361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.925596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.925660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.503 qpair failed and we were unable to recover it. 00:27:21.503 [2024-07-15 09:06:09.925852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.926052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.926081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.503 qpair failed and we were unable to recover it. 00:27:21.503 [2024-07-15 09:06:09.926240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.926375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.926403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.503 qpair failed and we were unable to recover it. 00:27:21.503 [2024-07-15 09:06:09.926560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.926719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.926747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.503 qpair failed and we were unable to recover it. 00:27:21.503 [2024-07-15 09:06:09.926913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.927056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.927098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.503 qpair failed and we were unable to recover it. 00:27:21.503 [2024-07-15 09:06:09.927258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.927437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.927495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.503 qpair failed and we were unable to recover it. 00:27:21.503 [2024-07-15 09:06:09.927653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.927817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.927846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.503 qpair failed and we were unable to recover it. 00:27:21.503 [2024-07-15 09:06:09.928014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.928164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.928197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.503 qpair failed and we were unable to recover it. 00:27:21.503 [2024-07-15 09:06:09.928361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.928544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.928573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.503 qpair failed and we were unable to recover it. 00:27:21.503 [2024-07-15 09:06:09.928723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.928886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.928917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.503 qpair failed and we were unable to recover it. 00:27:21.503 [2024-07-15 09:06:09.929080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.929266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.929295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.503 qpair failed and we were unable to recover it. 00:27:21.503 [2024-07-15 09:06:09.929450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.929608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.929637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.503 qpair failed and we were unable to recover it. 00:27:21.503 [2024-07-15 09:06:09.929809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.929962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.930006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.503 qpair failed and we were unable to recover it. 00:27:21.503 [2024-07-15 09:06:09.930167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.930360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.503 [2024-07-15 09:06:09.930415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.503 qpair failed and we were unable to recover it. 00:27:21.503 [2024-07-15 09:06:09.930540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.930678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.930708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.504 qpair failed and we were unable to recover it. 00:27:21.504 [2024-07-15 09:06:09.930871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.931036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.931064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.504 qpair failed and we were unable to recover it. 00:27:21.504 [2024-07-15 09:06:09.931231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.931435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.931492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.504 qpair failed and we were unable to recover it. 00:27:21.504 [2024-07-15 09:06:09.931652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.931784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.931812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.504 qpair failed and we were unable to recover it. 00:27:21.504 [2024-07-15 09:06:09.932011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.932158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.932184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.504 qpair failed and we were unable to recover it. 00:27:21.504 [2024-07-15 09:06:09.932340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.932596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.932625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.504 qpair failed and we were unable to recover it. 00:27:21.504 [2024-07-15 09:06:09.932811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.932962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.932988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.504 qpair failed and we were unable to recover it. 00:27:21.504 [2024-07-15 09:06:09.933138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.933409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.933462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.504 qpair failed and we were unable to recover it. 00:27:21.504 [2024-07-15 09:06:09.933655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.933815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.933842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.504 qpair failed and we were unable to recover it. 00:27:21.504 [2024-07-15 09:06:09.934009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.934133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.934162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.504 qpair failed and we were unable to recover it. 00:27:21.504 [2024-07-15 09:06:09.934359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.934518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.934547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.504 qpair failed and we were unable to recover it. 00:27:21.504 [2024-07-15 09:06:09.934735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.934867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.934918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.504 qpair failed and we were unable to recover it. 00:27:21.504 [2024-07-15 09:06:09.935048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.935183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.935211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.504 qpair failed and we were unable to recover it. 00:27:21.504 [2024-07-15 09:06:09.935373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.935561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.935587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.504 qpair failed and we were unable to recover it. 00:27:21.504 [2024-07-15 09:06:09.935737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.935909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.935953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.504 qpair failed and we were unable to recover it. 00:27:21.504 [2024-07-15 09:06:09.936126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.936391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.936446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.504 qpair failed and we were unable to recover it. 00:27:21.504 [2024-07-15 09:06:09.936643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.936836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.936866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.504 qpair failed and we were unable to recover it. 00:27:21.504 [2024-07-15 09:06:09.937041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.937213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.937239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.504 qpair failed and we were unable to recover it. 00:27:21.504 [2024-07-15 09:06:09.937406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.937567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.937597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.504 qpair failed and we were unable to recover it. 00:27:21.504 [2024-07-15 09:06:09.937795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.937987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.938015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.504 qpair failed and we were unable to recover it. 00:27:21.504 [2024-07-15 09:06:09.938170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.938304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.938332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.504 qpair failed and we were unable to recover it. 00:27:21.504 [2024-07-15 09:06:09.938550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.938757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.938785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.504 qpair failed and we were unable to recover it. 00:27:21.504 [2024-07-15 09:06:09.938944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.939092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.939134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.504 qpair failed and we were unable to recover it. 00:27:21.504 [2024-07-15 09:06:09.939292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.939472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.939502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.504 qpair failed and we were unable to recover it. 00:27:21.504 [2024-07-15 09:06:09.939665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.939818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.939846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.504 qpair failed and we were unable to recover it. 00:27:21.504 [2024-07-15 09:06:09.940034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.940212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.940255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.504 qpair failed and we were unable to recover it. 00:27:21.504 [2024-07-15 09:06:09.940388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.940536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.504 [2024-07-15 09:06:09.940562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.504 qpair failed and we were unable to recover it. 00:27:21.505 [2024-07-15 09:06:09.940727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.940910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.940945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.505 qpair failed and we were unable to recover it. 00:27:21.505 [2024-07-15 09:06:09.941135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.941430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.941456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.505 qpair failed and we were unable to recover it. 00:27:21.505 [2024-07-15 09:06:09.941660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.941816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.941849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.505 qpair failed and we were unable to recover it. 00:27:21.505 [2024-07-15 09:06:09.942028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.942184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.942211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.505 qpair failed and we were unable to recover it. 00:27:21.505 [2024-07-15 09:06:09.942354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.942495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.942521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.505 qpair failed and we were unable to recover it. 00:27:21.505 [2024-07-15 09:06:09.942671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.942809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.942835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.505 qpair failed and we were unable to recover it. 00:27:21.505 [2024-07-15 09:06:09.943011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.943168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.943198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.505 qpair failed and we were unable to recover it. 00:27:21.505 [2024-07-15 09:06:09.943368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.943536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.943563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.505 qpair failed and we were unable to recover it. 00:27:21.505 [2024-07-15 09:06:09.943753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.943908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.943949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.505 qpair failed and we were unable to recover it. 00:27:21.505 [2024-07-15 09:06:09.944140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.944269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.944296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.505 qpair failed and we were unable to recover it. 00:27:21.505 [2024-07-15 09:06:09.944438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.944627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.944655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.505 qpair failed and we were unable to recover it. 00:27:21.505 [2024-07-15 09:06:09.944832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.944958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.944984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.505 qpair failed and we were unable to recover it. 00:27:21.505 [2024-07-15 09:06:09.945158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.945324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.945400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.505 qpair failed and we were unable to recover it. 00:27:21.505 [2024-07-15 09:06:09.945560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.945692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.945721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.505 qpair failed and we were unable to recover it. 00:27:21.505 [2024-07-15 09:06:09.945892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.946170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.946222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.505 qpair failed and we were unable to recover it. 00:27:21.505 [2024-07-15 09:06:09.946363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.946504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.946529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.505 qpair failed and we were unable to recover it. 00:27:21.505 [2024-07-15 09:06:09.946711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.946897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.946930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.505 qpair failed and we were unable to recover it. 00:27:21.505 [2024-07-15 09:06:09.947098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.947232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.947262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.505 qpair failed and we were unable to recover it. 00:27:21.505 [2024-07-15 09:06:09.947514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.947694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.947723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.505 qpair failed and we were unable to recover it. 00:27:21.505 [2024-07-15 09:06:09.947893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.948053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.948078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.505 qpair failed and we were unable to recover it. 00:27:21.505 [2024-07-15 09:06:09.948192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.948387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.948416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.505 qpair failed and we were unable to recover it. 00:27:21.505 [2024-07-15 09:06:09.948572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.948760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.948787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.505 qpair failed and we were unable to recover it. 00:27:21.505 [2024-07-15 09:06:09.948928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.949104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.949131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.505 qpair failed and we were unable to recover it. 00:27:21.505 [2024-07-15 09:06:09.949331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.949496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.949525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.505 qpair failed and we were unable to recover it. 00:27:21.505 [2024-07-15 09:06:09.949660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.949815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.949843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.505 qpair failed and we were unable to recover it. 00:27:21.505 [2024-07-15 09:06:09.950054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.950225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.950254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.505 qpair failed and we were unable to recover it. 00:27:21.505 [2024-07-15 09:06:09.950434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.950643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.950673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.505 qpair failed and we were unable to recover it. 00:27:21.505 [2024-07-15 09:06:09.950872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.951045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.951074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.505 qpair failed and we were unable to recover it. 00:27:21.505 [2024-07-15 09:06:09.951271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.951432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.951461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.505 qpair failed and we were unable to recover it. 00:27:21.505 [2024-07-15 09:06:09.951615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.951800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.505 [2024-07-15 09:06:09.951829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.505 qpair failed and we were unable to recover it. 00:27:21.505 [2024-07-15 09:06:09.951997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.952201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.952228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.506 qpair failed and we were unable to recover it. 00:27:21.506 [2024-07-15 09:06:09.952398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.952610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.952659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.506 qpair failed and we were unable to recover it. 00:27:21.506 [2024-07-15 09:06:09.952853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.953036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.953065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.506 qpair failed and we were unable to recover it. 00:27:21.506 [2024-07-15 09:06:09.953213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.953400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.953429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.506 qpair failed and we were unable to recover it. 00:27:21.506 [2024-07-15 09:06:09.953632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.953785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.953814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.506 qpair failed and we were unable to recover it. 00:27:21.506 [2024-07-15 09:06:09.954002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.954194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.954223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.506 qpair failed and we were unable to recover it. 00:27:21.506 [2024-07-15 09:06:09.954356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.954537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.954567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.506 qpair failed and we were unable to recover it. 00:27:21.506 [2024-07-15 09:06:09.954766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.954956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.955011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.506 qpair failed and we were unable to recover it. 00:27:21.506 [2024-07-15 09:06:09.955275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.955613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.955665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.506 qpair failed and we were unable to recover it. 00:27:21.506 [2024-07-15 09:06:09.955833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.956036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.956065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.506 qpair failed and we were unable to recover it. 00:27:21.506 [2024-07-15 09:06:09.956218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.956402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.956466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.506 qpair failed and we were unable to recover it. 00:27:21.506 [2024-07-15 09:06:09.956605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.956791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.956819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.506 qpair failed and we were unable to recover it. 00:27:21.506 [2024-07-15 09:06:09.957003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.957149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.957176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.506 qpair failed and we were unable to recover it. 00:27:21.506 [2024-07-15 09:06:09.957294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.957442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.957467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.506 qpair failed and we were unable to recover it. 00:27:21.506 [2024-07-15 09:06:09.957635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.957822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.957851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.506 qpair failed and we were unable to recover it. 00:27:21.506 [2024-07-15 09:06:09.958022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.958189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.958215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.506 qpair failed and we were unable to recover it. 00:27:21.506 [2024-07-15 09:06:09.958359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.958520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.958548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.506 qpair failed and we were unable to recover it. 00:27:21.506 [2024-07-15 09:06:09.958725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.958884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.958911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.506 qpair failed and we were unable to recover it. 00:27:21.506 [2024-07-15 09:06:09.959030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.959198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.959226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.506 qpair failed and we were unable to recover it. 00:27:21.506 [2024-07-15 09:06:09.959389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.959547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.959575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.506 qpair failed and we were unable to recover it. 00:27:21.506 [2024-07-15 09:06:09.959710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.959884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.959910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.506 qpair failed and we were unable to recover it. 00:27:21.506 [2024-07-15 09:06:09.960090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.960235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.960261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.506 qpair failed and we were unable to recover it. 00:27:21.506 [2024-07-15 09:06:09.960405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.960543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.960572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.506 qpair failed and we were unable to recover it. 00:27:21.506 [2024-07-15 09:06:09.960760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.960965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.961036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.506 qpair failed and we were unable to recover it. 00:27:21.506 [2024-07-15 09:06:09.961275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.961599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.961653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.506 qpair failed and we were unable to recover it. 00:27:21.506 [2024-07-15 09:06:09.961798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.961966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.961993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.506 qpair failed and we were unable to recover it. 00:27:21.506 [2024-07-15 09:06:09.962191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.962378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.962407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.506 qpair failed and we were unable to recover it. 00:27:21.506 [2024-07-15 09:06:09.962590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.962758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.962787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.506 qpair failed and we were unable to recover it. 00:27:21.506 [2024-07-15 09:06:09.962920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.963041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.963070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.506 qpair failed and we were unable to recover it. 00:27:21.506 [2024-07-15 09:06:09.963265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.963417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.963442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.506 qpair failed and we were unable to recover it. 00:27:21.506 [2024-07-15 09:06:09.963628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.963811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.506 [2024-07-15 09:06:09.963841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.507 qpair failed and we were unable to recover it. 00:27:21.507 [2024-07-15 09:06:09.963986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.964112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.964141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.507 qpair failed and we were unable to recover it. 00:27:21.507 [2024-07-15 09:06:09.964303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.964530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.964560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.507 qpair failed and we were unable to recover it. 00:27:21.507 [2024-07-15 09:06:09.964718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.964860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.964913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.507 qpair failed and we were unable to recover it. 00:27:21.507 [2024-07-15 09:06:09.965084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.965235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.965262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.507 qpair failed and we were unable to recover it. 00:27:21.507 [2024-07-15 09:06:09.965426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.965583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.965612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.507 qpair failed and we were unable to recover it. 00:27:21.507 [2024-07-15 09:06:09.965771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.966011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.966041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.507 qpair failed and we were unable to recover it. 00:27:21.507 [2024-07-15 09:06:09.966205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.966331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.966357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.507 qpair failed and we were unable to recover it. 00:27:21.507 [2024-07-15 09:06:09.966528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.966684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.966713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.507 qpair failed and we were unable to recover it. 00:27:21.507 [2024-07-15 09:06:09.966882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.967038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.967066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.507 qpair failed and we were unable to recover it. 00:27:21.507 [2024-07-15 09:06:09.967319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.967597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.967649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.507 qpair failed and we were unable to recover it. 00:27:21.507 [2024-07-15 09:06:09.967847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.968045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.968074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.507 qpair failed and we were unable to recover it. 00:27:21.507 [2024-07-15 09:06:09.968211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.968401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.968468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.507 qpair failed and we were unable to recover it. 00:27:21.507 [2024-07-15 09:06:09.968646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.968802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.968831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.507 qpair failed and we were unable to recover it. 00:27:21.507 [2024-07-15 09:06:09.968982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.969144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.969173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.507 qpair failed and we were unable to recover it. 00:27:21.507 [2024-07-15 09:06:09.969333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.969501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.969546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.507 qpair failed and we were unable to recover it. 00:27:21.507 [2024-07-15 09:06:09.969679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.969847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.969874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.507 qpair failed and we were unable to recover it. 00:27:21.507 [2024-07-15 09:06:09.970091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.970312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.970366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.507 qpair failed and we were unable to recover it. 00:27:21.507 [2024-07-15 09:06:09.970651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.970833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.970863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.507 qpair failed and we were unable to recover it. 00:27:21.507 [2024-07-15 09:06:09.971071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.971221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.971247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.507 qpair failed and we were unable to recover it. 00:27:21.507 [2024-07-15 09:06:09.971389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.971551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.971580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.507 qpair failed and we were unable to recover it. 00:27:21.507 [2024-07-15 09:06:09.971740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.971901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.971939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.507 qpair failed and we were unable to recover it. 00:27:21.507 [2024-07-15 09:06:09.972107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.972263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.972289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.507 qpair failed and we were unable to recover it. 00:27:21.507 [2024-07-15 09:06:09.972466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.972610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.972652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.507 qpair failed and we were unable to recover it. 00:27:21.507 [2024-07-15 09:06:09.972778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.972949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.972978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.507 qpair failed and we were unable to recover it. 00:27:21.507 [2024-07-15 09:06:09.973141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.973337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.973366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.507 qpair failed and we were unable to recover it. 00:27:21.507 [2024-07-15 09:06:09.973526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.973712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.973741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.507 qpair failed and we were unable to recover it. 00:27:21.507 [2024-07-15 09:06:09.973916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.974066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.974092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.507 qpair failed and we were unable to recover it. 00:27:21.507 [2024-07-15 09:06:09.974240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.974355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.974381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.507 qpair failed and we were unable to recover it. 00:27:21.507 [2024-07-15 09:06:09.974550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.974755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.974781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.507 qpair failed and we were unable to recover it. 00:27:21.507 [2024-07-15 09:06:09.974951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.975122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.975154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.507 qpair failed and we were unable to recover it. 00:27:21.507 [2024-07-15 09:06:09.975323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.507 [2024-07-15 09:06:09.975465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.975491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.508 qpair failed and we were unable to recover it. 00:27:21.508 [2024-07-15 09:06:09.975663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.975796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.975825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.508 qpair failed and we were unable to recover it. 00:27:21.508 [2024-07-15 09:06:09.976007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.976135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.976166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.508 qpair failed and we were unable to recover it. 00:27:21.508 [2024-07-15 09:06:09.976327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.976523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.976576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.508 qpair failed and we were unable to recover it. 00:27:21.508 [2024-07-15 09:06:09.976711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.976887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.976941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.508 qpair failed and we were unable to recover it. 00:27:21.508 [2024-07-15 09:06:09.977104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.977296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.977324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.508 qpair failed and we were unable to recover it. 00:27:21.508 [2024-07-15 09:06:09.977481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.977731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.977795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.508 qpair failed and we were unable to recover it. 00:27:21.508 [2024-07-15 09:06:09.978028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.978258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.978314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.508 qpair failed and we were unable to recover it. 00:27:21.508 [2024-07-15 09:06:09.978482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.978601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.978627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.508 qpair failed and we were unable to recover it. 00:27:21.508 [2024-07-15 09:06:09.978831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.979001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.979030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.508 qpair failed and we were unable to recover it. 00:27:21.508 [2024-07-15 09:06:09.979197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.979337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.979363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.508 qpair failed and we were unable to recover it. 00:27:21.508 [2024-07-15 09:06:09.979508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.979668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.979697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.508 qpair failed and we were unable to recover it. 00:27:21.508 [2024-07-15 09:06:09.979866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.980038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.980064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.508 qpair failed and we were unable to recover it. 00:27:21.508 [2024-07-15 09:06:09.980236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.980426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.980480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.508 qpair failed and we were unable to recover it. 00:27:21.508 [2024-07-15 09:06:09.980610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.980740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.980770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.508 qpair failed and we were unable to recover it. 00:27:21.508 [2024-07-15 09:06:09.980957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.981111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.981138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.508 qpair failed and we were unable to recover it. 00:27:21.508 [2024-07-15 09:06:09.981327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.981442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.981488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.508 qpair failed and we were unable to recover it. 00:27:21.508 [2024-07-15 09:06:09.981681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.981850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.981883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.508 qpair failed and we were unable to recover it. 00:27:21.508 [2024-07-15 09:06:09.982029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.982141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.982169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.508 qpair failed and we were unable to recover it. 00:27:21.508 [2024-07-15 09:06:09.982334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.982533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.982588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.508 qpair failed and we were unable to recover it. 00:27:21.508 [2024-07-15 09:06:09.982721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.982860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.982893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.508 qpair failed and we were unable to recover it. 00:27:21.508 [2024-07-15 09:06:09.983110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.983295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.983338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.508 qpair failed and we were unable to recover it. 00:27:21.508 [2024-07-15 09:06:09.983499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.983627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.983655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.508 qpair failed and we were unable to recover it. 00:27:21.508 [2024-07-15 09:06:09.983790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.983953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.983982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.508 qpair failed and we were unable to recover it. 00:27:21.508 [2024-07-15 09:06:09.984123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.984300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.984345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.508 qpair failed and we were unable to recover it. 00:27:21.508 [2024-07-15 09:06:09.984528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.984712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.984740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.508 qpair failed and we were unable to recover it. 00:27:21.508 [2024-07-15 09:06:09.984884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.985026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.985055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.508 qpair failed and we were unable to recover it. 00:27:21.508 [2024-07-15 09:06:09.985292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.985627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.985684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.508 qpair failed and we were unable to recover it. 00:27:21.508 [2024-07-15 09:06:09.985856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.986062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.986090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.508 qpair failed and we were unable to recover it. 00:27:21.508 [2024-07-15 09:06:09.986225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.986445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.986497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.508 qpair failed and we were unable to recover it. 00:27:21.508 [2024-07-15 09:06:09.986676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.508 [2024-07-15 09:06:09.986847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.986897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.509 qpair failed and we were unable to recover it. 00:27:21.509 [2024-07-15 09:06:09.987069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.987331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.987383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.509 qpair failed and we were unable to recover it. 00:27:21.509 [2024-07-15 09:06:09.987547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.987693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.987735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.509 qpair failed and we were unable to recover it. 00:27:21.509 [2024-07-15 09:06:09.987910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.988162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.988214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.509 qpair failed and we were unable to recover it. 00:27:21.509 [2024-07-15 09:06:09.988375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.988592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.988651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.509 qpair failed and we were unable to recover it. 00:27:21.509 [2024-07-15 09:06:09.988773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.988918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.988945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.509 qpair failed and we were unable to recover it. 00:27:21.509 [2024-07-15 09:06:09.989086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.989196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.989228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.509 qpair failed and we were unable to recover it. 00:27:21.509 [2024-07-15 09:06:09.989434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.989563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.989593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.509 qpair failed and we were unable to recover it. 00:27:21.509 [2024-07-15 09:06:09.989758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.989962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.990044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.509 qpair failed and we were unable to recover it. 00:27:21.509 [2024-07-15 09:06:09.990316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.990667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.990718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.509 qpair failed and we were unable to recover it. 00:27:21.509 [2024-07-15 09:06:09.990919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.991062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.991106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.509 qpair failed and we were unable to recover it. 00:27:21.509 [2024-07-15 09:06:09.991292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.991456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.991484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.509 qpair failed and we were unable to recover it. 00:27:21.509 [2024-07-15 09:06:09.991625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.991807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.991836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.509 qpair failed and we were unable to recover it. 00:27:21.509 [2024-07-15 09:06:09.992007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.992136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.992165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.509 qpair failed and we were unable to recover it. 00:27:21.509 [2024-07-15 09:06:09.992330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.992475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.992517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.509 qpair failed and we were unable to recover it. 00:27:21.509 [2024-07-15 09:06:09.992671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.992806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.992835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.509 qpair failed and we were unable to recover it. 00:27:21.509 [2024-07-15 09:06:09.993004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.993166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.993195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.509 qpair failed and we were unable to recover it. 00:27:21.509 [2024-07-15 09:06:09.993469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.993659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.993689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.509 qpair failed and we were unable to recover it. 00:27:21.509 [2024-07-15 09:06:09.993888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.994067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.994092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.509 qpair failed and we were unable to recover it. 00:27:21.509 [2024-07-15 09:06:09.994287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.994458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.994484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.509 qpair failed and we were unable to recover it. 00:27:21.509 [2024-07-15 09:06:09.994630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.994836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.994862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.509 qpair failed and we were unable to recover it. 00:27:21.509 [2024-07-15 09:06:09.995071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.995266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.995328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.509 qpair failed and we were unable to recover it. 00:27:21.509 [2024-07-15 09:06:09.995491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.995632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.995675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.509 qpair failed and we were unable to recover it. 00:27:21.509 [2024-07-15 09:06:09.995837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.996002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.996032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.509 qpair failed and we were unable to recover it. 00:27:21.509 [2024-07-15 09:06:09.996195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.996362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.996388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.509 qpair failed and we were unable to recover it. 00:27:21.509 [2024-07-15 09:06:09.996528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.996695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.996724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.509 qpair failed and we were unable to recover it. 00:27:21.509 [2024-07-15 09:06:09.996854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.997016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.997042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.509 qpair failed and we were unable to recover it. 00:27:21.509 [2024-07-15 09:06:09.997218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.509 [2024-07-15 09:06:09.997418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:09.997476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.510 qpair failed and we were unable to recover it. 00:27:21.510 [2024-07-15 09:06:09.997638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:09.997823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:09.997853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.510 qpair failed and we were unable to recover it. 00:27:21.510 [2024-07-15 09:06:09.998039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:09.998167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:09.998196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.510 qpair failed and we were unable to recover it. 00:27:21.510 [2024-07-15 09:06:09.998352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:09.998493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:09.998520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.510 qpair failed and we were unable to recover it. 00:27:21.510 [2024-07-15 09:06:09.998718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:09.998905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:09.998937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.510 qpair failed and we were unable to recover it. 00:27:21.510 [2024-07-15 09:06:09.999120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:09.999382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:09.999437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.510 qpair failed and we were unable to recover it. 00:27:21.510 [2024-07-15 09:06:09.999738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:09.999961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:09.999990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.510 qpair failed and we were unable to recover it. 00:27:21.510 [2024-07-15 09:06:10.000134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.000305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.000351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.510 qpair failed and we were unable to recover it. 00:27:21.510 [2024-07-15 09:06:10.000537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.000668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.000698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.510 qpair failed and we were unable to recover it. 00:27:21.510 [2024-07-15 09:06:10.000857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.001057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.001087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.510 qpair failed and we were unable to recover it. 00:27:21.510 [2024-07-15 09:06:10.001360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.001718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.001777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.510 qpair failed and we were unable to recover it. 00:27:21.510 [2024-07-15 09:06:10.001976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.002162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.002192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.510 qpair failed and we were unable to recover it. 00:27:21.510 [2024-07-15 09:06:10.002324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.002463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.002492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.510 qpair failed and we were unable to recover it. 00:27:21.510 [2024-07-15 09:06:10.002657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.002824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.002858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.510 qpair failed and we were unable to recover it. 00:27:21.510 [2024-07-15 09:06:10.003083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.003264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.003297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.510 qpair failed and we were unable to recover it. 00:27:21.510 [2024-07-15 09:06:10.003461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.003607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.003640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.510 qpair failed and we were unable to recover it. 00:27:21.510 [2024-07-15 09:06:10.003783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.003946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.003979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.510 qpair failed and we were unable to recover it. 00:27:21.510 [2024-07-15 09:06:10.004139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.004297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.004344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.510 qpair failed and we were unable to recover it. 00:27:21.510 [2024-07-15 09:06:10.004503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.004658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.004704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.510 qpair failed and we were unable to recover it. 00:27:21.510 [2024-07-15 09:06:10.004873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.005046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.005083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.510 qpair failed and we were unable to recover it. 00:27:21.510 [2024-07-15 09:06:10.005258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.005463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.005501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.510 qpair failed and we were unable to recover it. 00:27:21.510 [2024-07-15 09:06:10.005719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.005926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.005984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.510 qpair failed and we were unable to recover it. 00:27:21.510 [2024-07-15 09:06:10.006161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.006347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.006386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.510 qpair failed and we were unable to recover it. 00:27:21.510 [2024-07-15 09:06:10.006553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.006682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.006711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.510 qpair failed and we were unable to recover it. 00:27:21.510 [2024-07-15 09:06:10.006847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.007000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.007027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.510 qpair failed and we were unable to recover it. 00:27:21.510 [2024-07-15 09:06:10.007199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.007413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.007445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.510 qpair failed and we were unable to recover it. 00:27:21.510 [2024-07-15 09:06:10.007579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.007715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.007745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.510 qpair failed and we were unable to recover it. 00:27:21.510 [2024-07-15 09:06:10.007925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.008079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.008105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.510 qpair failed and we were unable to recover it. 00:27:21.510 [2024-07-15 09:06:10.008261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.008429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.008459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.510 qpair failed and we were unable to recover it. 00:27:21.510 [2024-07-15 09:06:10.008634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.008759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.008788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.510 qpair failed and we were unable to recover it. 00:27:21.510 [2024-07-15 09:06:10.008951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.009077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.510 [2024-07-15 09:06:10.009103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.511 qpair failed and we were unable to recover it. 00:27:21.511 [2024-07-15 09:06:10.009265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.511 [2024-07-15 09:06:10.009394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.511 [2024-07-15 09:06:10.009420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.511 qpair failed and we were unable to recover it. 00:27:21.511 [2024-07-15 09:06:10.009565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.511 [2024-07-15 09:06:10.009719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.511 [2024-07-15 09:06:10.009749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.511 qpair failed and we were unable to recover it. 00:27:21.511 [2024-07-15 09:06:10.009924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.511 [2024-07-15 09:06:10.010075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.511 [2024-07-15 09:06:10.010102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.511 qpair failed and we were unable to recover it. 00:27:21.511 [2024-07-15 09:06:10.010222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.511 [2024-07-15 09:06:10.010331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.511 [2024-07-15 09:06:10.010374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.511 qpair failed and we were unable to recover it. 00:27:21.511 [2024-07-15 09:06:10.010599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.511 [2024-07-15 09:06:10.010776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.511 [2024-07-15 09:06:10.010805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.511 qpair failed and we were unable to recover it. 00:27:21.511 [2024-07-15 09:06:10.010959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.511 [2024-07-15 09:06:10.011083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.511 [2024-07-15 09:06:10.011111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.511 qpair failed and we were unable to recover it. 00:27:21.791 [2024-07-15 09:06:10.011287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.011487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.011517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-07-15 09:06:10.011710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.011885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.011913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-07-15 09:06:10.012044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.012168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.012196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-07-15 09:06:10.012352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.012536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.012567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-07-15 09:06:10.012750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.012897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.012952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-07-15 09:06:10.013072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.013278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.013330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-07-15 09:06:10.013480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.013599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.013629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-07-15 09:06:10.013768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.013942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.013969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-07-15 09:06:10.014121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.014291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.014334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-07-15 09:06:10.014521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.014653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.014683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-07-15 09:06:10.014849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.014992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.015018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-07-15 09:06:10.015165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.015311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.015341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-07-15 09:06:10.015515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.015710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.015739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-07-15 09:06:10.015930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.016072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.016099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-07-15 09:06:10.016223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.016418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.016460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-07-15 09:06:10.016638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.016834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.016863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-07-15 09:06:10.017041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.017184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.017214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-07-15 09:06:10.017376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.017649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.017701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-07-15 09:06:10.017912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.018095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.018121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-07-15 09:06:10.018332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.018544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.018596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-07-15 09:06:10.018809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.018993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.019031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-07-15 09:06:10.019188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.019511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.019564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-07-15 09:06:10.019752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.019956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.019982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-07-15 09:06:10.020103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.020251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.020277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-07-15 09:06:10.020446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.020597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.020635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-07-15 09:06:10.020822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.020982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.021008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-07-15 09:06:10.021129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.021248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.021275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-07-15 09:06:10.021453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.021587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.021617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-07-15 09:06:10.021807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.021964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.791 [2024-07-15 09:06:10.021991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.791 qpair failed and we were unable to recover it. 00:27:21.791 [2024-07-15 09:06:10.022141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.022455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.022510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-07-15 09:06:10.022698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.022948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.022974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-07-15 09:06:10.023121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.023357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.023407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-07-15 09:06:10.023562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.023729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.023759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-07-15 09:06:10.023970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.024096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.024131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-07-15 09:06:10.024353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.024525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.024596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-07-15 09:06:10.024792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.024955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.024982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-07-15 09:06:10.025099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.025348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.025415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-07-15 09:06:10.025645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.025832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.025861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-07-15 09:06:10.026038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.026199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.026242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-07-15 09:06:10.026437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.026629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.026685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-07-15 09:06:10.026892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.027070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.027100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-07-15 09:06:10.027410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.027712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.027759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-07-15 09:06:10.027965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.028134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.028174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-07-15 09:06:10.028360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.028501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.028532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-07-15 09:06:10.028720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.028908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.028946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-07-15 09:06:10.029111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.029283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.029311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-07-15 09:06:10.029512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.029677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.029708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-07-15 09:06:10.029840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.030024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.030053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-07-15 09:06:10.030223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.030387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.030418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-07-15 09:06:10.030638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.030869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.030902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-07-15 09:06:10.031061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.031209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.031251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-07-15 09:06:10.031408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.031614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.031684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-07-15 09:06:10.031844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.032043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.032073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-07-15 09:06:10.032356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.032618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.032680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-07-15 09:06:10.032890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.033045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.033076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-07-15 09:06:10.033269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.033411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.033440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-07-15 09:06:10.033600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.033758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.033787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-07-15 09:06:10.033955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.034125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.034155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-07-15 09:06:10.034350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.034529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.034588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.792 qpair failed and we were unable to recover it. 00:27:21.792 [2024-07-15 09:06:10.034749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.792 [2024-07-15 09:06:10.034902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.034932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-07-15 09:06:10.035096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.035262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.035291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-07-15 09:06:10.035482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.035686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.035716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-07-15 09:06:10.035909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.036081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.036112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-07-15 09:06:10.036305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.036500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.036534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-07-15 09:06:10.036739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.037019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.037049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-07-15 09:06:10.037258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.037516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.037567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-07-15 09:06:10.037731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.037891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.037918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-07-15 09:06:10.038095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.038255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.038284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-07-15 09:06:10.038442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.038572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.038601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-07-15 09:06:10.038741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.038929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.038965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-07-15 09:06:10.039126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.039296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.039340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-07-15 09:06:10.039499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.039682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.039708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-07-15 09:06:10.039837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.040042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.040072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-07-15 09:06:10.040361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.040704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.040762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-07-15 09:06:10.040907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.041089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.041133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-07-15 09:06:10.041319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.041545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.041607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-07-15 09:06:10.041802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.041956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.041984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-07-15 09:06:10.042131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.042326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.042352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-07-15 09:06:10.042475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.042651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.042678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-07-15 09:06:10.042845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.043030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.043058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-07-15 09:06:10.043225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.043478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.043529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-07-15 09:06:10.043722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.043886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.043916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-07-15 09:06:10.044089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.044233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.044259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-07-15 09:06:10.044420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.044548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.044587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-07-15 09:06:10.044770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.044944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.044975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-07-15 09:06:10.045147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.045334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.045365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-07-15 09:06:10.045508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.045633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.045661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-07-15 09:06:10.045814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.045982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.046014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-07-15 09:06:10.046138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.046275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.046303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.793 qpair failed and we were unable to recover it. 00:27:21.793 [2024-07-15 09:06:10.046549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.793 [2024-07-15 09:06:10.046763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.046792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-07-15 09:06:10.046958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.047143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.047174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-07-15 09:06:10.047335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.047495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.047524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-07-15 09:06:10.047682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.047850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.047884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-07-15 09:06:10.048013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.048268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.048304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-07-15 09:06:10.048498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.048651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.048678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-07-15 09:06:10.048848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.049022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.049051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-07-15 09:06:10.049211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.049394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.049424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-07-15 09:06:10.049553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.049728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.049758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-07-15 09:06:10.049958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.050155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.050184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-07-15 09:06:10.050345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.050465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.050494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-07-15 09:06:10.050649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.050837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.050866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-07-15 09:06:10.051024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.051166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.051205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-07-15 09:06:10.051438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.051600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.051629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-07-15 09:06:10.051782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.051975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.052002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-07-15 09:06:10.052126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.052321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.052352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-07-15 09:06:10.052555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.052752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.052788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-07-15 09:06:10.052959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.053125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.053172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-07-15 09:06:10.053355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.053531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.053560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-07-15 09:06:10.053756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.053892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.053922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-07-15 09:06:10.054081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.054237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.054266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-07-15 09:06:10.054460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.054623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.054653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-07-15 09:06:10.054830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.054954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.054981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-07-15 09:06:10.055186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.055332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.055359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-07-15 09:06:10.055493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.055650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.055679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-07-15 09:06:10.055822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.055977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.056005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-07-15 09:06:10.056184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.056434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.056487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-07-15 09:06:10.056653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.056852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.056887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-07-15 09:06:10.057030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.057185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.057252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-07-15 09:06:10.057416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.057539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.057566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.794 qpair failed and we were unable to recover it. 00:27:21.794 [2024-07-15 09:06:10.057701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.057891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.794 [2024-07-15 09:06:10.057932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-07-15 09:06:10.058076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.058242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.058270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-07-15 09:06:10.058405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.058563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.058601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-07-15 09:06:10.058781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.058933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.058960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-07-15 09:06:10.059089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.059248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.059277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-07-15 09:06:10.059470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.059613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.059641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-07-15 09:06:10.059817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.060033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.060061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-07-15 09:06:10.060242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.060507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.060559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-07-15 09:06:10.060722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.060920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.060948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-07-15 09:06:10.061118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.061342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.061403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-07-15 09:06:10.061583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.061732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.061759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-07-15 09:06:10.061935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.062049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.062091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-07-15 09:06:10.062324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.062534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.062563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-07-15 09:06:10.062745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.062919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.062950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-07-15 09:06:10.063153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.063298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.063324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-07-15 09:06:10.063508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.063701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.063741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-07-15 09:06:10.063888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.064093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.064122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-07-15 09:06:10.064283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.064437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.064466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-07-15 09:06:10.064631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.064788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.064817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-07-15 09:06:10.065009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.065127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.065155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-07-15 09:06:10.065311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.065472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.065501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-07-15 09:06:10.065659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.065899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.065928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-07-15 09:06:10.066116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.066364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.066398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.795 qpair failed and we were unable to recover it. 00:27:21.795 [2024-07-15 09:06:10.066594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.795 [2024-07-15 09:06:10.066762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.066790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-07-15 09:06:10.066954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.067092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.067124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-07-15 09:06:10.067292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.067519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.067569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-07-15 09:06:10.067738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.067862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.067901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-07-15 09:06:10.068072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.068220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.068267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-07-15 09:06:10.068441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.068600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.068629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-07-15 09:06:10.068786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.068952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.068982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-07-15 09:06:10.069147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.069307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.069337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-07-15 09:06:10.069506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.069696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.069724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-07-15 09:06:10.069907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.070040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.070071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-07-15 09:06:10.070228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.070429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.070483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-07-15 09:06:10.070645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.070833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.070863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-07-15 09:06:10.071041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.071179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.071222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-07-15 09:06:10.071419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.071615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.071645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-07-15 09:06:10.071807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.071960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.071991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-07-15 09:06:10.072132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.072395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.072454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-07-15 09:06:10.072629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.072782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.072824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-07-15 09:06:10.073013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.073204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.073233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-07-15 09:06:10.073395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.073566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.073643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-07-15 09:06:10.073795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.073965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.073995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-07-15 09:06:10.074167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.074313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.074358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-07-15 09:06:10.074549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.074696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.074726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-07-15 09:06:10.074859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.075032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.075071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-07-15 09:06:10.075208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.075516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.075566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-07-15 09:06:10.075707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.075844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.075870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-07-15 09:06:10.076094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.076230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.076259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-07-15 09:06:10.076450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.076584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.076614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-07-15 09:06:10.076807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.076960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.076990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-07-15 09:06:10.077160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.077351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.077380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-07-15 09:06:10.077536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.077691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.077721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-07-15 09:06:10.077907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.078041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.796 [2024-07-15 09:06:10.078070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.796 qpair failed and we were unable to recover it. 00:27:21.796 [2024-07-15 09:06:10.078231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.078394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.078434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-07-15 09:06:10.078614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.078761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.078802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-07-15 09:06:10.078967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.079127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.079167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-07-15 09:06:10.079327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.079534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.079597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-07-15 09:06:10.079736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.079942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.079969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-07-15 09:06:10.080117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.080265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.080318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-07-15 09:06:10.080489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.080644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.080672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-07-15 09:06:10.080834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.081003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.081033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-07-15 09:06:10.081207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.081328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.081354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-07-15 09:06:10.081498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.081624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.081651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-07-15 09:06:10.081844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.082022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.082053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-07-15 09:06:10.082248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.082422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.082451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-07-15 09:06:10.082640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.082799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.082829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-07-15 09:06:10.083001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.083159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.083202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-07-15 09:06:10.083369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.083517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.083544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-07-15 09:06:10.083745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.083886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.083917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-07-15 09:06:10.084078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.084247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.084277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-07-15 09:06:10.084423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.084600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.084627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-07-15 09:06:10.084772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.084916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.084948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-07-15 09:06:10.085115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.085271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.085301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-07-15 09:06:10.085545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.085730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.085760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-07-15 09:06:10.085904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.086029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.086057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-07-15 09:06:10.086224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.086482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.086539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-07-15 09:06:10.086724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.086906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.086936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-07-15 09:06:10.087107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.087440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.087491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-07-15 09:06:10.087653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.087801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.087848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-07-15 09:06:10.088025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.088173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.088216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-07-15 09:06:10.088410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.088579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.088614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-07-15 09:06:10.088802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.089048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.089076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-07-15 09:06:10.089224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.089534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.089584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.797 qpair failed and we were unable to recover it. 00:27:21.797 [2024-07-15 09:06:10.089819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.090007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.797 [2024-07-15 09:06:10.090038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-07-15 09:06:10.090192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.090370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.090467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-07-15 09:06:10.090633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.090865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.090904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-07-15 09:06:10.091096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.091245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.091272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-07-15 09:06:10.091450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.091588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.091629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-07-15 09:06:10.091814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.091988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.092032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-07-15 09:06:10.092157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.092350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.092377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-07-15 09:06:10.092545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.092710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.092739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-07-15 09:06:10.092894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.093082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.093112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-07-15 09:06:10.093296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.093514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.093561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-07-15 09:06:10.093694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.093885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.093915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-07-15 09:06:10.094081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.094387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.094436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-07-15 09:06:10.094624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.094787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.094816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-07-15 09:06:10.095018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.095156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.095184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-07-15 09:06:10.095428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.095758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.095816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-07-15 09:06:10.096009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.096161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.096188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-07-15 09:06:10.096304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.096577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.096648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-07-15 09:06:10.096815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.096981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.097012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-07-15 09:06:10.097202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.097522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.097571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-07-15 09:06:10.097801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.097973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.098004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-07-15 09:06:10.098176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.098322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.098349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-07-15 09:06:10.098474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.098637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.098672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-07-15 09:06:10.098801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.098962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.098993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-07-15 09:06:10.099157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.099310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.099338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-07-15 09:06:10.099487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.099636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.099663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-07-15 09:06:10.099851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.099989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.100019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-07-15 09:06:10.100156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.100424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.100478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-07-15 09:06:10.100647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.100774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.100803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-07-15 09:06:10.100984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.101144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.101175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-07-15 09:06:10.101335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.101562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.101629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-07-15 09:06:10.101815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.102009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.102037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.798 qpair failed and we were unable to recover it. 00:27:21.798 [2024-07-15 09:06:10.102184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.798 [2024-07-15 09:06:10.102370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.102405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-07-15 09:06:10.102596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.102757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.102786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-07-15 09:06:10.102947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.103108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.103137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-07-15 09:06:10.103409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.103723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.103775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-07-15 09:06:10.103943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.104090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.104133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-07-15 09:06:10.104274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.104459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.104493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-07-15 09:06:10.104697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.104872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.104921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-07-15 09:06:10.105053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.105238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.105267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-07-15 09:06:10.105399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.105578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.105627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-07-15 09:06:10.105785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.105914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.105942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-07-15 09:06:10.106103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.106267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.106301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-07-15 09:06:10.106553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.106763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.106792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-07-15 09:06:10.107043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.107285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.107337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-07-15 09:06:10.107510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.107651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.107679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-07-15 09:06:10.107849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.108018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.108049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-07-15 09:06:10.108256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.108538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.108592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-07-15 09:06:10.108762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.108911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.108940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-07-15 09:06:10.109107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.109336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.109391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-07-15 09:06:10.109563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.109698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.109729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-07-15 09:06:10.110025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.110215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.110245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-07-15 09:06:10.110432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.110600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.110634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-07-15 09:06:10.110789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.110942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.110972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-07-15 09:06:10.111114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.111302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.111331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-07-15 09:06:10.111539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.111696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.111722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-07-15 09:06:10.111874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.112044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.112075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-07-15 09:06:10.112266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.112463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.112492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-07-15 09:06:10.112647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.112836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.112865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.799 qpair failed and we were unable to recover it. 00:27:21.799 [2024-07-15 09:06:10.113064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.799 [2024-07-15 09:06:10.113218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.113246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-07-15 09:06:10.113403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.113526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.113562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-07-15 09:06:10.113754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.113907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.113950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-07-15 09:06:10.114107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.114298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.114327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-07-15 09:06:10.114643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.114869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.114908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-07-15 09:06:10.115069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.115233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.115264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-07-15 09:06:10.115429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.115589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.115619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-07-15 09:06:10.115782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.115968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.116008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-07-15 09:06:10.116248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.116486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.116545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-07-15 09:06:10.116718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.116888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.116916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-07-15 09:06:10.117092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.117253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.117282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-07-15 09:06:10.117435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.117666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.117720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-07-15 09:06:10.117889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.118046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.118075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-07-15 09:06:10.118247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.118370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.118398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-07-15 09:06:10.118584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.118769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.118799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-07-15 09:06:10.118968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.119117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.119145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-07-15 09:06:10.119389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.119645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.119675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-07-15 09:06:10.119822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.119976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.120014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-07-15 09:06:10.120209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.120465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.120525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-07-15 09:06:10.120686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.120829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.120860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-07-15 09:06:10.121034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.121245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.121299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-07-15 09:06:10.121487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.121635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.121661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-07-15 09:06:10.121853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.122033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.122063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-07-15 09:06:10.122215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.122440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.122503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-07-15 09:06:10.122704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.122821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.122854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-07-15 09:06:10.123044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.123164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.123207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-07-15 09:06:10.123370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.123607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.123668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-07-15 09:06:10.123861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.124032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.124062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-07-15 09:06:10.124228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.124506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.124568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-07-15 09:06:10.124710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.124860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.124897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-07-15 09:06:10.125085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.125244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.800 [2024-07-15 09:06:10.125275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.800 qpair failed and we were unable to recover it. 00:27:21.800 [2024-07-15 09:06:10.125467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.125615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.125657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-07-15 09:06:10.125848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.126053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.126084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-07-15 09:06:10.126277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.126401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.126428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-07-15 09:06:10.126603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.126761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.126790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-07-15 09:06:10.126917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.127110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.127139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-07-15 09:06:10.127453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.127643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.127673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-07-15 09:06:10.127836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.128002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.128048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-07-15 09:06:10.128206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.128410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.128467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-07-15 09:06:10.128637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.128785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.128813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-07-15 09:06:10.128984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.129141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.129170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-07-15 09:06:10.129334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.129481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.129512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-07-15 09:06:10.129666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.129856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.129896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-07-15 09:06:10.130059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.130199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.130228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-07-15 09:06:10.130419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.130730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.130788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-07-15 09:06:10.130969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.131141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.131171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-07-15 09:06:10.131356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.131564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.131632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-07-15 09:06:10.131799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.131949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.131977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-07-15 09:06:10.132149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.132310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.132339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-07-15 09:06:10.132478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.132637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.132665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-07-15 09:06:10.132844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.133046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.133073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-07-15 09:06:10.133207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.133383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.133412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-07-15 09:06:10.133642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.133874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.133910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-07-15 09:06:10.134058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.134205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.134249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-07-15 09:06:10.134388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.134544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.134575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-07-15 09:06:10.134741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.134946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.134977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-07-15 09:06:10.135136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.135321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.135351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-07-15 09:06:10.135522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.135663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.135690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-07-15 09:06:10.135904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.136090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.136120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-07-15 09:06:10.136275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.136419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.136449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-07-15 09:06:10.136693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.136904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.136933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.801 qpair failed and we were unable to recover it. 00:27:21.801 [2024-07-15 09:06:10.137084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.801 [2024-07-15 09:06:10.137270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.137332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-07-15 09:06:10.137483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.137638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.137668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-07-15 09:06:10.137825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.138001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.138028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-07-15 09:06:10.138194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.138429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.138463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-07-15 09:06:10.138662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.138837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.138867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-07-15 09:06:10.139029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.139185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.139217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-07-15 09:06:10.139386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.139528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.139554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-07-15 09:06:10.139670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.139809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.139835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-07-15 09:06:10.139963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.140107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.140134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-07-15 09:06:10.140312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.140498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.140539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-07-15 09:06:10.140705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.140892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.140923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-07-15 09:06:10.141080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.141324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.141377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-07-15 09:06:10.141549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.141676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.141704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-07-15 09:06:10.141855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.142056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.142086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-07-15 09:06:10.142276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.142415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.142445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-07-15 09:06:10.142588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.142786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.142817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-07-15 09:06:10.142969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.143088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.143116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-07-15 09:06:10.143314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.143554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.143616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-07-15 09:06:10.143775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.143940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.143971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-07-15 09:06:10.144112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.144323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.144352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-07-15 09:06:10.144526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.144672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.144699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-07-15 09:06:10.144869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.145014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.145045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-07-15 09:06:10.145201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.145373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.145399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-07-15 09:06:10.145542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.145738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.145764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-07-15 09:06:10.145935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.146096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.146126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-07-15 09:06:10.146283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.146471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.146529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-07-15 09:06:10.146722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.146887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.146931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-07-15 09:06:10.147138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.147333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.147371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-07-15 09:06:10.147532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.147683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.147726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-07-15 09:06:10.147860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.148012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.148040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-07-15 09:06:10.148163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.148322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.802 [2024-07-15 09:06:10.148351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.802 qpair failed and we were unable to recover it. 00:27:21.802 [2024-07-15 09:06:10.148498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.148691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.148717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-07-15 09:06:10.148834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.149002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.149046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-07-15 09:06:10.149209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.149336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.149366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-07-15 09:06:10.149529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.149691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.149721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-07-15 09:06:10.149931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.150086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.150115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-07-15 09:06:10.150287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.150434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.150484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-07-15 09:06:10.150680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.150849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.150886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-07-15 09:06:10.151044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.151178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.151208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-07-15 09:06:10.151478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.151660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.151690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-07-15 09:06:10.151845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.152017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.152061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-07-15 09:06:10.152254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.152410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.152439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-07-15 09:06:10.152622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.152762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.152793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-07-15 09:06:10.152953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.153113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.153144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-07-15 09:06:10.153333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.153476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.153519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-07-15 09:06:10.153679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.153865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.153906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-07-15 09:06:10.154070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.154210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.154241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-07-15 09:06:10.154432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.154741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.154790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-07-15 09:06:10.154963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.155114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.155158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-07-15 09:06:10.155285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.155412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.155442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-07-15 09:06:10.155561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.155718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.155748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-07-15 09:06:10.155909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.156102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.156128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-07-15 09:06:10.156272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.156423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.156467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-07-15 09:06:10.156629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.156834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.156865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-07-15 09:06:10.157045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.157206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.157236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-07-15 09:06:10.157419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.157659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.157710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-07-15 09:06:10.157902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.158046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.158089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-07-15 09:06:10.158248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.158449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.158501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-07-15 09:06:10.158670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.158782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.158809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.803 qpair failed and we were unable to recover it. 00:27:21.803 [2024-07-15 09:06:10.159028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.159192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.803 [2024-07-15 09:06:10.159220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-07-15 09:06:10.159356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.159533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.159560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-07-15 09:06:10.159759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.159895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.159925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-07-15 09:06:10.160114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.160318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.160344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-07-15 09:06:10.160601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.160816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.160850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-07-15 09:06:10.161001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.161186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.161215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-07-15 09:06:10.161335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.161486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.161515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-07-15 09:06:10.161689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.161822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.161854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-07-15 09:06:10.162053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.162241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.162268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-07-15 09:06:10.162444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.162620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.162650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-07-15 09:06:10.162815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.163005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.163036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-07-15 09:06:10.163228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.163389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.163420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-07-15 09:06:10.163723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.163931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.163958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-07-15 09:06:10.164105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.164224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.164251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-07-15 09:06:10.164398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.164573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.164624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-07-15 09:06:10.164821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.164978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.165013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-07-15 09:06:10.165185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.165440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.165505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-07-15 09:06:10.165707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.165898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.165928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-07-15 09:06:10.166103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.166259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.166339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-07-15 09:06:10.166530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.166679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.166709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-07-15 09:06:10.166888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.167011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.167039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-07-15 09:06:10.167218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.167366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.167393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-07-15 09:06:10.167574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.167735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.167765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-07-15 09:06:10.167904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.168058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.168088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-07-15 09:06:10.168341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.168625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.168680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-07-15 09:06:10.168850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.169058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.169088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-07-15 09:06:10.169245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.169443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.169469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-07-15 09:06:10.169621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.169830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.169869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-07-15 09:06:10.170020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.170202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.170269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.804 qpair failed and we were unable to recover it. 00:27:21.804 [2024-07-15 09:06:10.170413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.170520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.804 [2024-07-15 09:06:10.170548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-07-15 09:06:10.170726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.170940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.170967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-07-15 09:06:10.171116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.171277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.171307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-07-15 09:06:10.171540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.171754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.171785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-07-15 09:06:10.171965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.172110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.172155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-07-15 09:06:10.172281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.172436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.172470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-07-15 09:06:10.172656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.172834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.172861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-07-15 09:06:10.173002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.173158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.173188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-07-15 09:06:10.173352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.173489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.173515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-07-15 09:06:10.173708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.173863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.173919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-07-15 09:06:10.174109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.174253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.174281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-07-15 09:06:10.174580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.174794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.174824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-07-15 09:06:10.174996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.175159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.175188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-07-15 09:06:10.175348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.175597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.175634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-07-15 09:06:10.175834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.175966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.175992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-07-15 09:06:10.176187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.176525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.176555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-07-15 09:06:10.176741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.176890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.176934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-07-15 09:06:10.177093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.177300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.177355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-07-15 09:06:10.177508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.177693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.177723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-07-15 09:06:10.177946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.178138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.178168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-07-15 09:06:10.178364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.178489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.178516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-07-15 09:06:10.178638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.178839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.178869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-07-15 09:06:10.179008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.179169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.179200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-07-15 09:06:10.179522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.179728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.179767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-07-15 09:06:10.179938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.180088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.180131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-07-15 09:06:10.180292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.180480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.180509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.805 qpair failed and we were unable to recover it. 00:27:21.805 [2024-07-15 09:06:10.180675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.805 [2024-07-15 09:06:10.180814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.180853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-07-15 09:06:10.181029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.181195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.181225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-07-15 09:06:10.181417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.181579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.181608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-07-15 09:06:10.181795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.181958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.181988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-07-15 09:06:10.182177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.182389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.182435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-07-15 09:06:10.182680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.182894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.182925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-07-15 09:06:10.183065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.183206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.183231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-07-15 09:06:10.183405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.183592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.183628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-07-15 09:06:10.183831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.183985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.184012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-07-15 09:06:10.184133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.184336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.184366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-07-15 09:06:10.184519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.184702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.184732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-07-15 09:06:10.184905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.185033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.185062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-07-15 09:06:10.185227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.185386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.185417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-07-15 09:06:10.185586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.185744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.185774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-07-15 09:06:10.185976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.186103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.186148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-07-15 09:06:10.186300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.186486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.186516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-07-15 09:06:10.186711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.186888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.186939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-07-15 09:06:10.187087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.187323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.187379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-07-15 09:06:10.187580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.187754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.187797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-07-15 09:06:10.187932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.188138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.188164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-07-15 09:06:10.188288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.188428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.188457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-07-15 09:06:10.188666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.188810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.188840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-07-15 09:06:10.189000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.189151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.189194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-07-15 09:06:10.189356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.189487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.189527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-07-15 09:06:10.189742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.189866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.189905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-07-15 09:06:10.190081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.190402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.190451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-07-15 09:06:10.190627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.190777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.190828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-07-15 09:06:10.190986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.191165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.191196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.806 [2024-07-15 09:06:10.191336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.191519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.806 [2024-07-15 09:06:10.191549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.806 qpair failed and we were unable to recover it. 00:27:21.807 [2024-07-15 09:06:10.191717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.191897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.191941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-07-15 09:06:10.192138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.192293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.192328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-07-15 09:06:10.192502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.192684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.192712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-07-15 09:06:10.192902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.193091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.193120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-07-15 09:06:10.193420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.193742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.193802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-07-15 09:06:10.194009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.194177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.194218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-07-15 09:06:10.194378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.194593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.194641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-07-15 09:06:10.194803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.195007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.195037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-07-15 09:06:10.195226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.195384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.195414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-07-15 09:06:10.195585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.195736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.195762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-07-15 09:06:10.195923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.196100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.196137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-07-15 09:06:10.196318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.196485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.196514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-07-15 09:06:10.196646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.196830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.196861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-07-15 09:06:10.197066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.197216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.197260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-07-15 09:06:10.197456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.197623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.197653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-07-15 09:06:10.197837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.198010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.198039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-07-15 09:06:10.198245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.198434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.198480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-07-15 09:06:10.198675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.198840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.198871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-07-15 09:06:10.199045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.199241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.199281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-07-15 09:06:10.199446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.199664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.199710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-07-15 09:06:10.199838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.200019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.200049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-07-15 09:06:10.200236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.200439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.200490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-07-15 09:06:10.200680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.200862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.200902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-07-15 09:06:10.201045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.201182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.201212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-07-15 09:06:10.201354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.201536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.201582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-07-15 09:06:10.201756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.201901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.201953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-07-15 09:06:10.202144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.202408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.202459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-07-15 09:06:10.202612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.202773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.202802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-07-15 09:06:10.202987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.203114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.203150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-07-15 09:06:10.203296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.203405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.203432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.807 qpair failed and we were unable to recover it. 00:27:21.807 [2024-07-15 09:06:10.203625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.807 [2024-07-15 09:06:10.203747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.203776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-07-15 09:06:10.203964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.204090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.204118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-07-15 09:06:10.204273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.204393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.204422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-07-15 09:06:10.204592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.204730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.204756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-07-15 09:06:10.204929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.205090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.205119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-07-15 09:06:10.205291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.205442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.205471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-07-15 09:06:10.205657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.205788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.205817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-07-15 09:06:10.205966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.206112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.206138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-07-15 09:06:10.206339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.206496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.206526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-07-15 09:06:10.206679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.206840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.206869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-07-15 09:06:10.207046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.207237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.207266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-07-15 09:06:10.207398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.207557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.207583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-07-15 09:06:10.207724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.207929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.207956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-07-15 09:06:10.208099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.208268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.208298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-07-15 09:06:10.208457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.208581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.208610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-07-15 09:06:10.208802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.208928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.208970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-07-15 09:06:10.209125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.209278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.209308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-07-15 09:06:10.209472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.209613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.209640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-07-15 09:06:10.209787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.209966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.209996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-07-15 09:06:10.210136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.210325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.210352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-07-15 09:06:10.210512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.210698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.210727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-07-15 09:06:10.210863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.211004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.211032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-07-15 09:06:10.211233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.211382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.211409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-07-15 09:06:10.211548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.211660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.211686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-07-15 09:06:10.211829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.212033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.212060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-07-15 09:06:10.212194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.212325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.212355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.808 [2024-07-15 09:06:10.212537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.212706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.808 [2024-07-15 09:06:10.212735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.808 qpair failed and we were unable to recover it. 00:27:21.809 [2024-07-15 09:06:10.212900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.213100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.213129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-07-15 09:06:10.213318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.213443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.213472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-07-15 09:06:10.213662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.213819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.213847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-07-15 09:06:10.214054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.214194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.214222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-07-15 09:06:10.214367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.214515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.214541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-07-15 09:06:10.214710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.214866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.214903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-07-15 09:06:10.215059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.215221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.215250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-07-15 09:06:10.215400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.215600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.215629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-07-15 09:06:10.215787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.215901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.215938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-07-15 09:06:10.216086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.216307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.216332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-07-15 09:06:10.216478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.216673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.216702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-07-15 09:06:10.216890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.217055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.217083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-07-15 09:06:10.217251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.217392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.217433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-07-15 09:06:10.217594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.217734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.217763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-07-15 09:06:10.217897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.218075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.218105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-07-15 09:06:10.218265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.218804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.218835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-07-15 09:06:10.219021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.219189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.219232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-07-15 09:06:10.219427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.219583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.219612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-07-15 09:06:10.219768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.219956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.219986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-07-15 09:06:10.220160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.220291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.220322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-07-15 09:06:10.220492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.220640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.220666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-07-15 09:06:10.220846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.221015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.221044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-07-15 09:06:10.221208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.221358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.221387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-07-15 09:06:10.221543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.221672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.221701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-07-15 09:06:10.221870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.222054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.222087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-07-15 09:06:10.222256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.222420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.222449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-07-15 09:06:10.222589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.222760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.222790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-07-15 09:06:10.222952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.223090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.223118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-07-15 09:06:10.223259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.223406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.223431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-07-15 09:06:10.223645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.223817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.223858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.809 qpair failed and we were unable to recover it. 00:27:21.809 [2024-07-15 09:06:10.224012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.809 [2024-07-15 09:06:10.224154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.224182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-07-15 09:06:10.224380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.224525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.224550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-07-15 09:06:10.224702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.224850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.224884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-07-15 09:06:10.225054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.225246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.225275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-07-15 09:06:10.225439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.225594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.225627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-07-15 09:06:10.225791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.225949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.225978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-07-15 09:06:10.226128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.226288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.226316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-07-15 09:06:10.226496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.226678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.226707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-07-15 09:06:10.226833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.227010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.227039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-07-15 09:06:10.227237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.227397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.227427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-07-15 09:06:10.227593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.227780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.227809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-07-15 09:06:10.227984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.228110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.228138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-07-15 09:06:10.228271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.228424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.228454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-07-15 09:06:10.228616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.228777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.228806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-07-15 09:06:10.228969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.229085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.229115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-07-15 09:06:10.229294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.229456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.229485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-07-15 09:06:10.229615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.229747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.229776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-07-15 09:06:10.229914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.230099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.230126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-07-15 09:06:10.230302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.230466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.230495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-07-15 09:06:10.230683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.230845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.230874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-07-15 09:06:10.231003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.231136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.231170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-07-15 09:06:10.231371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.231519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.231545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-07-15 09:06:10.231664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.231806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.231833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-07-15 09:06:10.231977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.232146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.232180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-07-15 09:06:10.232335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.232467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.232495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-07-15 09:06:10.232696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.232843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.232869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-07-15 09:06:10.233071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.233184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.233211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-07-15 09:06:10.233420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.233591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.233634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-07-15 09:06:10.233783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.233957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.233984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-07-15 09:06:10.234129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.234279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.234308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-07-15 09:06:10.234479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.234663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.810 [2024-07-15 09:06:10.234691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.810 qpair failed and we were unable to recover it. 00:27:21.810 [2024-07-15 09:06:10.234814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.234948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.234977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-07-15 09:06:10.235143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.235305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.235333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-07-15 09:06:10.235523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.235645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.235675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-07-15 09:06:10.235873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.236007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.236051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-07-15 09:06:10.236188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.236338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.236368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-07-15 09:06:10.236532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.236673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.236700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-07-15 09:06:10.236886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.237004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.237030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-07-15 09:06:10.237146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.237270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.237296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-07-15 09:06:10.237445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.237635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.237664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-07-15 09:06:10.237789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.237936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.237966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-07-15 09:06:10.238140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.238281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.238308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-07-15 09:06:10.238448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.238595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.238638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-07-15 09:06:10.238766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.238902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.238935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-07-15 09:06:10.239099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.239257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.239286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-07-15 09:06:10.239416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.239600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.239630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-07-15 09:06:10.239802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.239962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.239988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-07-15 09:06:10.240133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.240320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.240347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-07-15 09:06:10.240494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.240669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.240698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-07-15 09:06:10.240854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.241026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.241055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-07-15 09:06:10.241244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.241395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.241422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-07-15 09:06:10.241571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.241766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.241794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-07-15 09:06:10.241984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.242118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.242159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-07-15 09:06:10.242343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.242500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.242529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-07-15 09:06:10.242700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.242844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.242870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-07-15 09:06:10.243072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.243231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.243260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-07-15 09:06:10.243434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.243608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.243634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-07-15 09:06:10.243812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.243948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.243978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-07-15 09:06:10.244139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.244311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.244355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-07-15 09:06:10.244541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.244703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.244732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-07-15 09:06:10.244887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.245018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.245047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.811 qpair failed and we were unable to recover it. 00:27:21.811 [2024-07-15 09:06:10.245247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.245360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.811 [2024-07-15 09:06:10.245386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-07-15 09:06:10.245560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.245671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.245714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-07-15 09:06:10.245884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.246059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.246085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-07-15 09:06:10.246229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.246408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.246437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-07-15 09:06:10.246593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.246742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.246770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-07-15 09:06:10.246962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.247111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.247156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-07-15 09:06:10.247316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.247505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.247535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-07-15 09:06:10.247709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.247887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.247914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-07-15 09:06:10.248063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.248188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.248218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-07-15 09:06:10.248382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.248573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.248602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-07-15 09:06:10.248807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.249005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.249032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-07-15 09:06:10.249193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.249387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.249413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-07-15 09:06:10.249580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.249762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.249790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-07-15 09:06:10.249924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.250095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.250122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-07-15 09:06:10.250302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.250461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.250491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-07-15 09:06:10.250650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.250838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.250868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-07-15 09:06:10.251030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.251176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.251203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-07-15 09:06:10.251318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.251500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.251527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-07-15 09:06:10.251690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.251837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.251866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-07-15 09:06:10.252001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.252187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.252216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-07-15 09:06:10.252370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.252519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.252548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-07-15 09:06:10.252734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.252885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.252932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-07-15 09:06:10.253085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.253247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.253276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-07-15 09:06:10.253432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.253614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.253642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-07-15 09:06:10.253771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.253890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.253929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-07-15 09:06:10.254121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.254272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.254300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-07-15 09:06:10.254479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.254633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.254661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.812 qpair failed and we were unable to recover it. 00:27:21.812 [2024-07-15 09:06:10.254821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.812 [2024-07-15 09:06:10.255012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.255041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-07-15 09:06:10.255197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.255324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.255352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-07-15 09:06:10.255488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.255602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.255629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-07-15 09:06:10.255792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.255935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.255974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-07-15 09:06:10.256138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.256267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.256295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-07-15 09:06:10.256457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.256604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.256632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-07-15 09:06:10.256796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.256992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.257019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-07-15 09:06:10.257165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.257359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.257386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-07-15 09:06:10.257531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.257695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.257722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-07-15 09:06:10.257843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.257988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.258017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-07-15 09:06:10.258233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.258416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.258444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-07-15 09:06:10.258566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.258708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.258746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-07-15 09:06:10.258908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.259089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.259116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-07-15 09:06:10.259265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.259412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.259443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-07-15 09:06:10.259645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.259817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.259844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-07-15 09:06:10.260011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.260171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.260222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-07-15 09:06:10.260380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.260558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.260585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-07-15 09:06:10.260744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.260927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.260957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-07-15 09:06:10.261108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.261256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.261282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-07-15 09:06:10.261432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.261576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.261602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-07-15 09:06:10.261747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.261866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.261901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-07-15 09:06:10.262023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.262175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.262203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-07-15 09:06:10.262346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.262469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.262497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-07-15 09:06:10.262606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.262728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.262756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-07-15 09:06:10.262895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.263020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.263047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-07-15 09:06:10.263200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.263344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.263371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-07-15 09:06:10.263544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.263689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.263715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-07-15 09:06:10.263828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.263991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.264019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-07-15 09:06:10.264146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.264265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.264291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-07-15 09:06:10.264440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.264614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.264640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.813 [2024-07-15 09:06:10.264785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.264920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.813 [2024-07-15 09:06:10.264947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.813 qpair failed and we were unable to recover it. 00:27:21.814 [2024-07-15 09:06:10.265096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.265232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.265276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-07-15 09:06:10.265407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.265584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.265611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-07-15 09:06:10.265728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.265881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.265909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-07-15 09:06:10.266084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.266233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.266261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-07-15 09:06:10.266401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.266552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.266588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-07-15 09:06:10.266742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.266887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.266914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-07-15 09:06:10.267039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.267172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.267200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-07-15 09:06:10.267373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.267532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.267558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-07-15 09:06:10.267680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.267830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.267858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-07-15 09:06:10.268007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.268129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.268155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-07-15 09:06:10.268337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.268492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.268519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-07-15 09:06:10.268665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.268849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.268907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-07-15 09:06:10.269054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.269229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.269256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-07-15 09:06:10.269428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.269545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.269573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-07-15 09:06:10.269738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.269905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.269936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-07-15 09:06:10.270100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.270252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.270278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-07-15 09:06:10.270463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.270643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.270670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-07-15 09:06:10.270809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.270929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.270955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-07-15 09:06:10.271097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.271248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.271274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-07-15 09:06:10.271424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.271566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.271596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-07-15 09:06:10.271755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.271899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.271931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-07-15 09:06:10.272104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.272249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.272275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-07-15 09:06:10.272421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.272593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.272619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-07-15 09:06:10.272794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.272944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.272973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-07-15 09:06:10.273092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.273241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.273267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-07-15 09:06:10.273444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.273563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.273596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-07-15 09:06:10.273774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.273889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.273929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-07-15 09:06:10.274075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.274207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.274241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-07-15 09:06:10.274394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.274546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.274573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-07-15 09:06:10.274722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.274896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.274930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.814 qpair failed and we were unable to recover it. 00:27:21.814 [2024-07-15 09:06:10.275055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.814 [2024-07-15 09:06:10.275168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.275200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-07-15 09:06:10.275387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.275539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.275567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-07-15 09:06:10.275711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.275860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.275896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-07-15 09:06:10.276082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.276226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.276252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-07-15 09:06:10.276373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.276500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.276527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-07-15 09:06:10.276673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.276788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.276814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-07-15 09:06:10.276957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.277100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.277135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-07-15 09:06:10.277296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.277437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.277464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-07-15 09:06:10.277575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.277752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.277778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-07-15 09:06:10.277929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.278043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.278070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-07-15 09:06:10.278185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.278333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.278359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-07-15 09:06:10.278534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.278676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.278709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-07-15 09:06:10.278858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.278995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.279022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-07-15 09:06:10.279163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.279332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.279358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-07-15 09:06:10.279505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.279654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.279689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-07-15 09:06:10.279842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.279980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.280008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-07-15 09:06:10.280131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.280298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.280328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-07-15 09:06:10.280446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.280593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.280619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-07-15 09:06:10.280764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.280889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.280916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-07-15 09:06:10.281069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.281220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.281248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-07-15 09:06:10.281396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.281514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.281540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-07-15 09:06:10.281681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.281818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.281845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-07-15 09:06:10.281972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.282111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.282138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-07-15 09:06:10.282260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.282381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.282409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-07-15 09:06:10.282581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.282701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.282729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-07-15 09:06:10.282849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.283006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.283033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-07-15 09:06:10.283214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.283366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.283397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-07-15 09:06:10.283550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.283729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.283759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-07-15 09:06:10.283916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.284063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.284090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-07-15 09:06:10.284202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.284349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.284376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-07-15 09:06:10.284549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.284698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.815 [2024-07-15 09:06:10.284731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.815 qpair failed and we were unable to recover it. 00:27:21.815 [2024-07-15 09:06:10.284868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.285023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.285050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-07-15 09:06:10.285237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.285417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.285444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-07-15 09:06:10.285569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.285710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.285737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-07-15 09:06:10.285888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.286044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.286072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-07-15 09:06:10.286191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.286338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.286366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-07-15 09:06:10.286511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.286685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.286711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-07-15 09:06:10.286858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.287010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.287036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-07-15 09:06:10.287181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.287326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.287354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-07-15 09:06:10.287497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.287622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.287649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-07-15 09:06:10.287822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.287934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.287962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-07-15 09:06:10.288107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.288255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.288282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-07-15 09:06:10.288432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.288555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.288583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-07-15 09:06:10.288713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.288853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.288896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-07-15 09:06:10.289028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.289201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.289227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-07-15 09:06:10.289340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.289508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.289534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-07-15 09:06:10.289709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.289863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.289898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-07-15 09:06:10.290081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.290204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.290231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-07-15 09:06:10.290380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.290495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.290521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-07-15 09:06:10.290692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.290864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.290897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-07-15 09:06:10.291039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.291186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.291221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-07-15 09:06:10.291400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.291545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.291572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-07-15 09:06:10.291709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.291858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.291894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-07-15 09:06:10.292047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.292201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.292229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-07-15 09:06:10.292402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.292578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.292604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-07-15 09:06:10.292727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.292868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.292904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-07-15 09:06:10.293056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.293174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.293200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-07-15 09:06:10.293330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.293453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.293481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-07-15 09:06:10.293628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.293768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.293795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-07-15 09:06:10.293930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.294076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.294103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-07-15 09:06:10.294214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.294362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.294388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.816 qpair failed and we were unable to recover it. 00:27:21.816 [2024-07-15 09:06:10.294536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.294686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.816 [2024-07-15 09:06:10.294714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-07-15 09:06:10.294857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.295051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.295078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-07-15 09:06:10.295248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.295428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.295456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-07-15 09:06:10.295636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.295812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.295838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-07-15 09:06:10.295991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.296144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.296172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-07-15 09:06:10.296322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.296457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.296483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-07-15 09:06:10.296630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.296746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.296773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-07-15 09:06:10.296913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.297061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.297087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-07-15 09:06:10.297269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.297427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.297455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-07-15 09:06:10.297600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.297733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.297760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-07-15 09:06:10.297892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.298051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.298077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-07-15 09:06:10.298232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.298344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.298371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-07-15 09:06:10.298523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.298706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.298735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-07-15 09:06:10.298885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.299031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.299058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-07-15 09:06:10.299207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.299355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.299382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-07-15 09:06:10.299529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.299672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.299698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-07-15 09:06:10.299826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.299939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.299968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-07-15 09:06:10.300143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.300294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.300320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-07-15 09:06:10.300440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.300585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.300611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-07-15 09:06:10.300737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.300910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.300937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-07-15 09:06:10.301103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.301251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.301279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-07-15 09:06:10.301387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.301509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.301536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-07-15 09:06:10.301687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.301833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.301860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-07-15 09:06:10.302024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.302149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.302177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-07-15 09:06:10.302353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.302524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.302551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-07-15 09:06:10.302725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.302900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.302928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-07-15 09:06:10.303105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.303234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.303270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.817 qpair failed and we were unable to recover it. 00:27:21.817 [2024-07-15 09:06:10.303445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.817 [2024-07-15 09:06:10.303591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.303617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-07-15 09:06:10.303794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.303938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.303966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-07-15 09:06:10.304170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.304332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.304359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-07-15 09:06:10.304531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.304680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.304707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-07-15 09:06:10.304890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.305037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.305064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-07-15 09:06:10.305209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.305340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.305368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-07-15 09:06:10.305513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.305653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.305680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-07-15 09:06:10.305792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.305962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.305989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-07-15 09:06:10.306132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.306280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.306307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-07-15 09:06:10.306455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.306574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.306602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-07-15 09:06:10.306739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.306916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.306943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-07-15 09:06:10.307121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.307295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.307332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-07-15 09:06:10.307460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.307580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.307607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-07-15 09:06:10.307752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.307902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.307929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-07-15 09:06:10.308074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.308258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.308286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-07-15 09:06:10.308398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.308513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.308539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-07-15 09:06:10.308697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.308821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.308848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-07-15 09:06:10.309009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.309159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.309186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-07-15 09:06:10.309342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.309486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.309517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-07-15 09:06:10.309680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.309793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.309821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-07-15 09:06:10.309964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.310092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.310128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-07-15 09:06:10.310275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.310426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.310454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-07-15 09:06:10.310582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.310704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.310731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-07-15 09:06:10.310889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.311037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.311063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-07-15 09:06:10.311184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.311327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.311353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-07-15 09:06:10.311499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.311673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.311699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-07-15 09:06:10.311882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.312046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.312076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:21.818 qpair failed and we were unable to recover it. 00:27:21.818 [2024-07-15 09:06:10.312260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:21.818 [2024-07-15 09:06:10.312380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.094 [2024-07-15 09:06:10.312405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.094 qpair failed and we were unable to recover it. 00:27:22.094 [2024-07-15 09:06:10.312527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.094 [2024-07-15 09:06:10.312668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.094 [2024-07-15 09:06:10.312693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.094 qpair failed and we were unable to recover it. 00:27:22.094 [2024-07-15 09:06:10.312846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.094 [2024-07-15 09:06:10.312980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.094 [2024-07-15 09:06:10.313006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.094 qpair failed and we were unable to recover it. 00:27:22.094 [2024-07-15 09:06:10.313148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.094 [2024-07-15 09:06:10.313285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.094 [2024-07-15 09:06:10.313309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.094 qpair failed and we were unable to recover it. 00:27:22.094 [2024-07-15 09:06:10.313465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.094 [2024-07-15 09:06:10.313578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.094 [2024-07-15 09:06:10.313602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.094 qpair failed and we were unable to recover it. 00:27:22.094 [2024-07-15 09:06:10.313719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.094 [2024-07-15 09:06:10.313834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.094 [2024-07-15 09:06:10.313860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.094 qpair failed and we were unable to recover it. 00:27:22.094 [2024-07-15 09:06:10.313981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.094 [2024-07-15 09:06:10.314101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.094 [2024-07-15 09:06:10.314126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.094 qpair failed and we were unable to recover it. 00:27:22.094 [2024-07-15 09:06:10.314273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.094 [2024-07-15 09:06:10.314399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.094 [2024-07-15 09:06:10.314425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.094 qpair failed and we were unable to recover it. 00:27:22.094 [2024-07-15 09:06:10.314572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.094 [2024-07-15 09:06:10.314719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.094 [2024-07-15 09:06:10.314744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.094 qpair failed and we were unable to recover it. 00:27:22.094 [2024-07-15 09:06:10.314854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.094 [2024-07-15 09:06:10.315008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.094 [2024-07-15 09:06:10.315033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.094 qpair failed and we were unable to recover it. 00:27:22.094 [2024-07-15 09:06:10.315174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.094 [2024-07-15 09:06:10.315342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.094 [2024-07-15 09:06:10.315366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.094 qpair failed and we were unable to recover it. 00:27:22.094 [2024-07-15 09:06:10.315531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.094 [2024-07-15 09:06:10.315676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.094 [2024-07-15 09:06:10.315702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.094 qpair failed and we were unable to recover it. 00:27:22.094 [2024-07-15 09:06:10.315816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.094 [2024-07-15 09:06:10.315990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.094 [2024-07-15 09:06:10.316021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.094 qpair failed and we were unable to recover it. 00:27:22.094 [2024-07-15 09:06:10.316134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.094 [2024-07-15 09:06:10.316277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.094 [2024-07-15 09:06:10.316302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.094 qpair failed and we were unable to recover it. 00:27:22.094 [2024-07-15 09:06:10.316447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.094 [2024-07-15 09:06:10.316617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.094 [2024-07-15 09:06:10.316642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.094 qpair failed and we were unable to recover it. 00:27:22.094 [2024-07-15 09:06:10.316783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.094 [2024-07-15 09:06:10.316935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.094 [2024-07-15 09:06:10.316960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.094 qpair failed and we were unable to recover it. 00:27:22.094 [2024-07-15 09:06:10.317109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.094 [2024-07-15 09:06:10.317278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.094 [2024-07-15 09:06:10.317303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.094 qpair failed and we were unable to recover it. 00:27:22.094 [2024-07-15 09:06:10.317428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.317574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.317599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.095 qpair failed and we were unable to recover it. 00:27:22.095 [2024-07-15 09:06:10.317746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.317922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.317948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.095 qpair failed and we were unable to recover it. 00:27:22.095 [2024-07-15 09:06:10.318095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.318263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.318289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.095 qpair failed and we were unable to recover it. 00:27:22.095 [2024-07-15 09:06:10.318432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.318604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.318628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.095 qpair failed and we were unable to recover it. 00:27:22.095 [2024-07-15 09:06:10.318773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.318918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.318944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.095 qpair failed and we were unable to recover it. 00:27:22.095 [2024-07-15 09:06:10.319091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.319230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.319256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.095 qpair failed and we were unable to recover it. 00:27:22.095 [2024-07-15 09:06:10.319408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.319579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.319605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.095 qpair failed and we were unable to recover it. 00:27:22.095 [2024-07-15 09:06:10.319751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.319872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.319903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.095 qpair failed and we were unable to recover it. 00:27:22.095 [2024-07-15 09:06:10.320048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.320161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.320187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.095 qpair failed and we were unable to recover it. 00:27:22.095 [2024-07-15 09:06:10.320361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.320510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.320536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.095 qpair failed and we were unable to recover it. 00:27:22.095 [2024-07-15 09:06:10.320702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.320843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.320868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.095 qpair failed and we were unable to recover it. 00:27:22.095 [2024-07-15 09:06:10.320997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.321115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.321140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.095 qpair failed and we were unable to recover it. 00:27:22.095 [2024-07-15 09:06:10.321277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.321422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.321447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.095 qpair failed and we were unable to recover it. 00:27:22.095 [2024-07-15 09:06:10.321614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.321758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.321783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.095 qpair failed and we were unable to recover it. 00:27:22.095 [2024-07-15 09:06:10.321894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.322065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.322091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.095 qpair failed and we were unable to recover it. 00:27:22.095 [2024-07-15 09:06:10.322246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.322389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.322414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.095 qpair failed and we were unable to recover it. 00:27:22.095 [2024-07-15 09:06:10.322559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.322705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.322730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.095 qpair failed and we were unable to recover it. 00:27:22.095 [2024-07-15 09:06:10.322887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.323056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.323082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.095 qpair failed and we were unable to recover it. 00:27:22.095 [2024-07-15 09:06:10.323252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.323423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.323448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.095 qpair failed and we were unable to recover it. 00:27:22.095 [2024-07-15 09:06:10.323596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.323741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.323766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.095 qpair failed and we were unable to recover it. 00:27:22.095 [2024-07-15 09:06:10.323913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.324028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.324052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.095 qpair failed and we were unable to recover it. 00:27:22.095 [2024-07-15 09:06:10.324176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.324348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.324373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.095 qpair failed and we were unable to recover it. 00:27:22.095 [2024-07-15 09:06:10.324541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.324683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.324709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.095 qpair failed and we were unable to recover it. 00:27:22.095 [2024-07-15 09:06:10.324852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.324978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.325003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.095 qpair failed and we were unable to recover it. 00:27:22.095 [2024-07-15 09:06:10.325129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.325309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.325334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.095 qpair failed and we were unable to recover it. 00:27:22.095 [2024-07-15 09:06:10.325483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.325652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.325678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.095 qpair failed and we were unable to recover it. 00:27:22.095 [2024-07-15 09:06:10.325830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.325980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.326007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.095 qpair failed and we were unable to recover it. 00:27:22.095 [2024-07-15 09:06:10.326133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.326275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.326301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.095 qpair failed and we were unable to recover it. 00:27:22.095 [2024-07-15 09:06:10.326441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.326606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.326631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.095 qpair failed and we were unable to recover it. 00:27:22.095 [2024-07-15 09:06:10.326806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.326952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.095 [2024-07-15 09:06:10.326978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.095 qpair failed and we were unable to recover it. 00:27:22.095 [2024-07-15 09:06:10.327120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.327239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.327264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.096 qpair failed and we were unable to recover it. 00:27:22.096 [2024-07-15 09:06:10.327382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.327548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.327574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.096 qpair failed and we were unable to recover it. 00:27:22.096 [2024-07-15 09:06:10.327719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.327842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.327867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.096 qpair failed and we were unable to recover it. 00:27:22.096 [2024-07-15 09:06:10.328001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.328149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.328174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.096 qpair failed and we were unable to recover it. 00:27:22.096 [2024-07-15 09:06:10.328294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.328439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.328464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.096 qpair failed and we were unable to recover it. 00:27:22.096 [2024-07-15 09:06:10.328582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.328696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.328720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.096 qpair failed and we were unable to recover it. 00:27:22.096 [2024-07-15 09:06:10.328864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.329002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.329026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.096 qpair failed and we were unable to recover it. 00:27:22.096 [2024-07-15 09:06:10.329199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.329319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.329346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.096 qpair failed and we were unable to recover it. 00:27:22.096 [2024-07-15 09:06:10.329520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.329638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.329662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.096 qpair failed and we were unable to recover it. 00:27:22.096 [2024-07-15 09:06:10.329829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.329970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.329996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.096 qpair failed and we were unable to recover it. 00:27:22.096 [2024-07-15 09:06:10.330122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.330276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.330301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.096 qpair failed and we were unable to recover it. 00:27:22.096 [2024-07-15 09:06:10.330422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.330538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.330567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.096 qpair failed and we were unable to recover it. 00:27:22.096 [2024-07-15 09:06:10.330738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.330892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.330920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.096 qpair failed and we were unable to recover it. 00:27:22.096 [2024-07-15 09:06:10.331078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.331248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.331274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.096 qpair failed and we were unable to recover it. 00:27:22.096 [2024-07-15 09:06:10.331414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.331579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.331607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.096 qpair failed and we were unable to recover it. 00:27:22.096 [2024-07-15 09:06:10.331797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.331990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.332019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.096 qpair failed and we were unable to recover it. 00:27:22.096 [2024-07-15 09:06:10.332213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.332368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.332397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.096 qpair failed and we were unable to recover it. 00:27:22.096 [2024-07-15 09:06:10.332562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.332721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.332749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.096 qpair failed and we were unable to recover it. 00:27:22.096 [2024-07-15 09:06:10.332889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.333055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.333083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.096 qpair failed and we were unable to recover it. 00:27:22.096 [2024-07-15 09:06:10.333231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.333340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.333365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.096 qpair failed and we were unable to recover it. 00:27:22.096 [2024-07-15 09:06:10.333555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.333741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.333767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.096 qpair failed and we were unable to recover it. 00:27:22.096 [2024-07-15 09:06:10.333928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.334092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.334120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.096 qpair failed and we were unable to recover it. 00:27:22.096 [2024-07-15 09:06:10.334267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.334402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.334430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.096 qpair failed and we were unable to recover it. 00:27:22.096 [2024-07-15 09:06:10.334618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.334807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.334834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.096 qpair failed and we were unable to recover it. 00:27:22.096 [2024-07-15 09:06:10.335011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.335171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.335199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.096 qpair failed and we were unable to recover it. 00:27:22.096 [2024-07-15 09:06:10.335384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.335571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.335628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.096 qpair failed and we were unable to recover it. 00:27:22.096 [2024-07-15 09:06:10.335784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.335993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.336022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.096 qpair failed and we were unable to recover it. 00:27:22.096 [2024-07-15 09:06:10.336214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.336385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.336448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.096 qpair failed and we were unable to recover it. 00:27:22.096 [2024-07-15 09:06:10.336607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.336769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.336798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.096 qpair failed and we were unable to recover it. 00:27:22.096 [2024-07-15 09:06:10.336982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.337110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.337138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.096 qpair failed and we were unable to recover it. 00:27:22.096 [2024-07-15 09:06:10.337294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.337502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.096 [2024-07-15 09:06:10.337551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.096 qpair failed and we were unable to recover it. 00:27:22.097 [2024-07-15 09:06:10.337745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.337907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.337935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.097 qpair failed and we were unable to recover it. 00:27:22.097 [2024-07-15 09:06:10.338055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.338210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.338238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.097 qpair failed and we were unable to recover it. 00:27:22.097 [2024-07-15 09:06:10.338396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.338578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.338606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.097 qpair failed and we were unable to recover it. 00:27:22.097 [2024-07-15 09:06:10.338759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.338948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.339003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.097 qpair failed and we were unable to recover it. 00:27:22.097 [2024-07-15 09:06:10.339164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.339304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.339328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.097 qpair failed and we were unable to recover it. 00:27:22.097 [2024-07-15 09:06:10.339474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.339630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.339658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.097 qpair failed and we were unable to recover it. 00:27:22.097 [2024-07-15 09:06:10.339828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.340007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.340035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.097 qpair failed and we were unable to recover it. 00:27:22.097 [2024-07-15 09:06:10.340237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.340385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.340429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.097 qpair failed and we were unable to recover it. 00:27:22.097 [2024-07-15 09:06:10.340573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.340718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.340744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.097 qpair failed and we were unable to recover it. 00:27:22.097 [2024-07-15 09:06:10.340916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.341044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.341071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.097 qpair failed and we were unable to recover it. 00:27:22.097 [2024-07-15 09:06:10.341275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.341423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.341447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.097 qpair failed and we were unable to recover it. 00:27:22.097 [2024-07-15 09:06:10.341618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.341776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.341805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.097 qpair failed and we were unable to recover it. 00:27:22.097 [2024-07-15 09:06:10.341972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.342123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.342148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.097 qpair failed and we were unable to recover it. 00:27:22.097 [2024-07-15 09:06:10.342327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.342490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.342516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.097 qpair failed and we were unable to recover it. 00:27:22.097 [2024-07-15 09:06:10.342688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.342853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.342895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.097 qpair failed and we were unable to recover it. 00:27:22.097 [2024-07-15 09:06:10.343066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.343217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.343243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.097 qpair failed and we were unable to recover it. 00:27:22.097 [2024-07-15 09:06:10.343393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.343559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.343601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.097 qpair failed and we were unable to recover it. 00:27:22.097 [2024-07-15 09:06:10.343735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.343888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.343917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.097 qpair failed and we were unable to recover it. 00:27:22.097 [2024-07-15 09:06:10.344081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.344330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.344390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.097 qpair failed and we were unable to recover it. 00:27:22.097 [2024-07-15 09:06:10.344618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.344786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.344814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.097 qpair failed and we were unable to recover it. 00:27:22.097 [2024-07-15 09:06:10.344984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.345155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.345197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.097 qpair failed and we were unable to recover it. 00:27:22.097 [2024-07-15 09:06:10.345356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.345511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.345536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.097 qpair failed and we were unable to recover it. 00:27:22.097 [2024-07-15 09:06:10.345707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.345866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.345902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.097 qpair failed and we were unable to recover it. 00:27:22.097 [2024-07-15 09:06:10.346089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.346331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.346356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.097 qpair failed and we were unable to recover it. 00:27:22.097 [2024-07-15 09:06:10.346502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.346719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.346773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.097 qpair failed and we were unable to recover it. 00:27:22.097 [2024-07-15 09:06:10.346967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.347129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.347170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.097 qpair failed and we were unable to recover it. 00:27:22.097 [2024-07-15 09:06:10.347352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.347536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.347564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.097 qpair failed and we were unable to recover it. 00:27:22.097 [2024-07-15 09:06:10.347719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.347884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.347913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.097 qpair failed and we were unable to recover it. 00:27:22.097 [2024-07-15 09:06:10.348082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.348202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.348228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.097 qpair failed and we were unable to recover it. 00:27:22.097 [2024-07-15 09:06:10.348429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.348655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.097 [2024-07-15 09:06:10.348713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.097 qpair failed and we were unable to recover it. 00:27:22.098 [2024-07-15 09:06:10.348886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.349045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.349073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.098 qpair failed and we were unable to recover it. 00:27:22.098 [2024-07-15 09:06:10.349321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.349555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.349585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.098 qpair failed and we were unable to recover it. 00:27:22.098 [2024-07-15 09:06:10.349753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.349874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.349912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.098 qpair failed and we were unable to recover it. 00:27:22.098 [2024-07-15 09:06:10.350087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.350329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.350383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.098 qpair failed and we were unable to recover it. 00:27:22.098 [2024-07-15 09:06:10.350550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.350714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.350739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.098 qpair failed and we were unable to recover it. 00:27:22.098 [2024-07-15 09:06:10.351001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.351132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.351160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.098 qpair failed and we were unable to recover it. 00:27:22.098 [2024-07-15 09:06:10.351326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.351523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.351588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.098 qpair failed and we were unable to recover it. 00:27:22.098 [2024-07-15 09:06:10.351750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.351911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.351940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.098 qpair failed and we were unable to recover it. 00:27:22.098 [2024-07-15 09:06:10.352101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.352309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.352369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.098 qpair failed and we were unable to recover it. 00:27:22.098 [2024-07-15 09:06:10.352626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.352777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.352805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.098 qpair failed and we were unable to recover it. 00:27:22.098 [2024-07-15 09:06:10.352952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.353105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.353130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.098 qpair failed and we were unable to recover it. 00:27:22.098 [2024-07-15 09:06:10.353279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.353467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.353495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.098 qpair failed and we were unable to recover it. 00:27:22.098 [2024-07-15 09:06:10.353619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.353803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.353831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.098 qpair failed and we were unable to recover it. 00:27:22.098 [2024-07-15 09:06:10.354001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.354159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.354187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.098 qpair failed and we were unable to recover it. 00:27:22.098 [2024-07-15 09:06:10.354375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.354522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.354565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.098 qpair failed and we were unable to recover it. 00:27:22.098 [2024-07-15 09:06:10.354723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.354884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.354913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.098 qpair failed and we were unable to recover it. 00:27:22.098 [2024-07-15 09:06:10.355112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.355254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.355278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.098 qpair failed and we were unable to recover it. 00:27:22.098 [2024-07-15 09:06:10.355511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.355689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.355717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.098 qpair failed and we were unable to recover it. 00:27:22.098 [2024-07-15 09:06:10.355889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.356006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.356031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.098 qpair failed and we were unable to recover it. 00:27:22.098 [2024-07-15 09:06:10.356167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.356308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.356335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.098 qpair failed and we were unable to recover it. 00:27:22.098 [2024-07-15 09:06:10.356520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.356691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.356717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.098 qpair failed and we were unable to recover it. 00:27:22.098 [2024-07-15 09:06:10.356863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.098 [2024-07-15 09:06:10.357003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.357032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.099 qpair failed and we were unable to recover it. 00:27:22.099 [2024-07-15 09:06:10.357202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.357386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.357413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.099 qpair failed and we were unable to recover it. 00:27:22.099 [2024-07-15 09:06:10.357549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.357709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.357736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.099 qpair failed and we were unable to recover it. 00:27:22.099 [2024-07-15 09:06:10.357905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.358027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.358053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.099 qpair failed and we were unable to recover it. 00:27:22.099 [2024-07-15 09:06:10.358242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.358513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.358563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.099 qpair failed and we were unable to recover it. 00:27:22.099 [2024-07-15 09:06:10.358724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.358895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.358921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.099 qpair failed and we were unable to recover it. 00:27:22.099 [2024-07-15 09:06:10.359099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.359287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.359343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.099 qpair failed and we were unable to recover it. 00:27:22.099 [2024-07-15 09:06:10.359469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.359620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.359647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.099 qpair failed and we were unable to recover it. 00:27:22.099 [2024-07-15 09:06:10.359804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.360009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.360038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.099 qpair failed and we were unable to recover it. 00:27:22.099 [2024-07-15 09:06:10.360210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.360357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.360382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.099 qpair failed and we were unable to recover it. 00:27:22.099 [2024-07-15 09:06:10.360501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.360675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.360700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.099 qpair failed and we were unable to recover it. 00:27:22.099 [2024-07-15 09:06:10.360868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.361012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.361040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.099 qpair failed and we were unable to recover it. 00:27:22.099 [2024-07-15 09:06:10.361193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.361316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.361343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.099 qpair failed and we were unable to recover it. 00:27:22.099 [2024-07-15 09:06:10.361535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.361679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.361722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.099 qpair failed and we were unable to recover it. 00:27:22.099 [2024-07-15 09:06:10.361908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.362065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.362092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.099 qpair failed and we were unable to recover it. 00:27:22.099 [2024-07-15 09:06:10.362281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.362455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.362480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.099 qpair failed and we were unable to recover it. 00:27:22.099 [2024-07-15 09:06:10.362627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.362775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.362801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.099 qpair failed and we were unable to recover it. 00:27:22.099 [2024-07-15 09:06:10.362988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.363135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.363160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.099 qpair failed and we were unable to recover it. 00:27:22.099 [2024-07-15 09:06:10.363329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.363524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.363583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.099 qpair failed and we were unable to recover it. 00:27:22.099 [2024-07-15 09:06:10.363745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.363918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.363944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.099 qpair failed and we were unable to recover it. 00:27:22.099 [2024-07-15 09:06:10.364063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.364213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.364241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.099 qpair failed and we were unable to recover it. 00:27:22.099 [2024-07-15 09:06:10.364409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.364526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.364552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.099 qpair failed and we were unable to recover it. 00:27:22.099 [2024-07-15 09:06:10.364702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.099 [2024-07-15 09:06:10.364833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.364861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.100 qpair failed and we were unable to recover it. 00:27:22.100 [2024-07-15 09:06:10.365037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.365172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.365199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.100 qpair failed and we were unable to recover it. 00:27:22.100 [2024-07-15 09:06:10.365383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.365621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.365649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.100 qpair failed and we were unable to recover it. 00:27:22.100 [2024-07-15 09:06:10.365844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.365978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.366003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.100 qpair failed and we were unable to recover it. 00:27:22.100 [2024-07-15 09:06:10.366152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.366285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.366317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.100 qpair failed and we were unable to recover it. 00:27:22.100 [2024-07-15 09:06:10.366476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.366662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.366688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.100 qpair failed and we were unable to recover it. 00:27:22.100 [2024-07-15 09:06:10.366874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.367034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.367061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.100 qpair failed and we were unable to recover it. 00:27:22.100 [2024-07-15 09:06:10.367263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.367406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.367433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.100 qpair failed and we were unable to recover it. 00:27:22.100 [2024-07-15 09:06:10.367632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.367812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.367839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.100 qpair failed and we were unable to recover it. 00:27:22.100 [2024-07-15 09:06:10.368045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.368185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.368211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.100 qpair failed and we were unable to recover it. 00:27:22.100 [2024-07-15 09:06:10.368377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.368654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.368709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.100 qpair failed and we were unable to recover it. 00:27:22.100 [2024-07-15 09:06:10.368896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.369083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.369111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.100 qpair failed and we were unable to recover it. 00:27:22.100 [2024-07-15 09:06:10.369278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.369400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.369425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.100 qpair failed and we were unable to recover it. 00:27:22.100 [2024-07-15 09:06:10.369616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.369798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.369827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.100 qpair failed and we were unable to recover it. 00:27:22.100 [2024-07-15 09:06:10.370046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.370194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.370219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.100 qpair failed and we were unable to recover it. 00:27:22.100 [2024-07-15 09:06:10.370394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.370557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.370585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.100 qpair failed and we were unable to recover it. 00:27:22.100 [2024-07-15 09:06:10.370740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.370901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.370928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.100 qpair failed and we were unable to recover it. 00:27:22.100 [2024-07-15 09:06:10.371052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.371216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.371244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.100 qpair failed and we were unable to recover it. 00:27:22.100 [2024-07-15 09:06:10.371481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.371655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.371682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.100 qpair failed and we were unable to recover it. 00:27:22.100 [2024-07-15 09:06:10.371882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.372041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.372070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.100 qpair failed and we were unable to recover it. 00:27:22.100 [2024-07-15 09:06:10.372253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.372471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.372518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.100 qpair failed and we were unable to recover it. 00:27:22.100 [2024-07-15 09:06:10.372679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.372826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.372854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.100 qpair failed and we were unable to recover it. 00:27:22.100 [2024-07-15 09:06:10.373010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.373145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.373172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.100 qpair failed and we were unable to recover it. 00:27:22.100 [2024-07-15 09:06:10.373362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.373509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.373534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.100 qpair failed and we were unable to recover it. 00:27:22.100 [2024-07-15 09:06:10.373677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.373822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.373850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.100 qpair failed and we were unable to recover it. 00:27:22.100 [2024-07-15 09:06:10.374038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.374215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.374240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.100 qpair failed and we were unable to recover it. 00:27:22.100 [2024-07-15 09:06:10.374413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.374740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.374789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.100 qpair failed and we were unable to recover it. 00:27:22.100 [2024-07-15 09:06:10.374954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.375141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.375170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.100 qpair failed and we were unable to recover it. 00:27:22.100 [2024-07-15 09:06:10.375333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.375515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.375542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.100 qpair failed and we were unable to recover it. 00:27:22.100 [2024-07-15 09:06:10.375664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.375853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.375888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.100 qpair failed and we were unable to recover it. 00:27:22.100 [2024-07-15 09:06:10.376040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.376198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.100 [2024-07-15 09:06:10.376226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.100 qpair failed and we were unable to recover it. 00:27:22.100 [2024-07-15 09:06:10.376394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.376516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.376540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.101 qpair failed and we were unable to recover it. 00:27:22.101 [2024-07-15 09:06:10.376737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.376905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.376931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.101 qpair failed and we were unable to recover it. 00:27:22.101 [2024-07-15 09:06:10.377101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.377256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.377283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.101 qpair failed and we were unable to recover it. 00:27:22.101 [2024-07-15 09:06:10.377538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.377706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.377732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.101 qpair failed and we were unable to recover it. 00:27:22.101 [2024-07-15 09:06:10.377938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.378081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.378106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.101 qpair failed and we were unable to recover it. 00:27:22.101 [2024-07-15 09:06:10.378276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.378435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.378463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.101 qpair failed and we were unable to recover it. 00:27:22.101 [2024-07-15 09:06:10.378626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.378774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.378802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.101 qpair failed and we were unable to recover it. 00:27:22.101 [2024-07-15 09:06:10.378962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.379123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.379148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.101 qpair failed and we were unable to recover it. 00:27:22.101 [2024-07-15 09:06:10.379266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.379436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.379461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.101 qpair failed and we were unable to recover it. 00:27:22.101 [2024-07-15 09:06:10.379585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.379749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.379777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.101 qpair failed and we were unable to recover it. 00:27:22.101 [2024-07-15 09:06:10.379940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.380125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.380152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.101 qpair failed and we were unable to recover it. 00:27:22.101 [2024-07-15 09:06:10.380329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.380478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.380504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.101 qpair failed and we were unable to recover it. 00:27:22.101 [2024-07-15 09:06:10.380646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.380838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.380866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.101 qpair failed and we were unable to recover it. 00:27:22.101 [2024-07-15 09:06:10.381033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.381183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.381211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.101 qpair failed and we were unable to recover it. 00:27:22.101 [2024-07-15 09:06:10.381395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.381522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.381550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.101 qpair failed and we were unable to recover it. 00:27:22.101 [2024-07-15 09:06:10.381736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.381960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.381989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.101 qpair failed and we were unable to recover it. 00:27:22.101 [2024-07-15 09:06:10.382185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.382452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.382504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.101 qpair failed and we were unable to recover it. 00:27:22.101 [2024-07-15 09:06:10.382689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.382872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.382910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.101 qpair failed and we were unable to recover it. 00:27:22.101 [2024-07-15 09:06:10.383068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.383224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.383252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.101 qpair failed and we were unable to recover it. 00:27:22.101 [2024-07-15 09:06:10.383560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.383776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.383804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.101 qpair failed and we were unable to recover it. 00:27:22.101 [2024-07-15 09:06:10.383975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.384161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.384189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.101 qpair failed and we were unable to recover it. 00:27:22.101 [2024-07-15 09:06:10.384353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.384526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.384568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.101 qpair failed and we were unable to recover it. 00:27:22.101 [2024-07-15 09:06:10.384757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.384917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.384962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.101 qpair failed and we were unable to recover it. 00:27:22.101 [2024-07-15 09:06:10.385123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.385386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.385439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.101 qpair failed and we were unable to recover it. 00:27:22.101 [2024-07-15 09:06:10.385631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.385790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.385823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.101 qpair failed and we were unable to recover it. 00:27:22.101 [2024-07-15 09:06:10.386012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.386158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.386183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.101 qpair failed and we were unable to recover it. 00:27:22.101 [2024-07-15 09:06:10.386350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.386507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.386534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.101 qpair failed and we were unable to recover it. 00:27:22.101 [2024-07-15 09:06:10.386661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.386819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.386848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.101 qpair failed and we were unable to recover it. 00:27:22.101 [2024-07-15 09:06:10.387030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.387199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.387242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.101 qpair failed and we were unable to recover it. 00:27:22.101 [2024-07-15 09:06:10.387399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.101 [2024-07-15 09:06:10.387554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.387582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.102 qpair failed and we were unable to recover it. 00:27:22.102 [2024-07-15 09:06:10.387737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.387890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.387918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.102 qpair failed and we were unable to recover it. 00:27:22.102 [2024-07-15 09:06:10.388058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.388191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.388218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.102 qpair failed and we were unable to recover it. 00:27:22.102 [2024-07-15 09:06:10.388414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.388564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.388592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.102 qpair failed and we were unable to recover it. 00:27:22.102 [2024-07-15 09:06:10.388788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.388930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.388957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.102 qpair failed and we were unable to recover it. 00:27:22.102 [2024-07-15 09:06:10.389127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.389284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.389313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.102 qpair failed and we were unable to recover it. 00:27:22.102 [2024-07-15 09:06:10.389470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.389624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.389652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.102 qpair failed and we were unable to recover it. 00:27:22.102 [2024-07-15 09:06:10.389812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.389922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.389948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.102 qpair failed and we were unable to recover it. 00:27:22.102 [2024-07-15 09:06:10.390122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.390305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.390333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.102 qpair failed and we were unable to recover it. 00:27:22.102 [2024-07-15 09:06:10.390488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.390646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.390674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.102 qpair failed and we were unable to recover it. 00:27:22.102 [2024-07-15 09:06:10.390836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.391001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.391029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.102 qpair failed and we were unable to recover it. 00:27:22.102 [2024-07-15 09:06:10.391166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.391291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.391316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.102 qpair failed and we were unable to recover it. 00:27:22.102 [2024-07-15 09:06:10.391459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.391647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.391675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.102 qpair failed and we were unable to recover it. 00:27:22.102 [2024-07-15 09:06:10.391805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.391955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.391984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.102 qpair failed and we were unable to recover it. 00:27:22.102 [2024-07-15 09:06:10.392144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.392302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.392330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.102 qpair failed and we were unable to recover it. 00:27:22.102 [2024-07-15 09:06:10.392489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.392683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.392711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.102 qpair failed and we were unable to recover it. 00:27:22.102 [2024-07-15 09:06:10.392871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.393062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.393090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.102 qpair failed and we were unable to recover it. 00:27:22.102 [2024-07-15 09:06:10.393205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.393357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.393385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.102 qpair failed and we were unable to recover it. 00:27:22.102 [2024-07-15 09:06:10.393659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.393848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.393874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.102 qpair failed and we were unable to recover it. 00:27:22.102 [2024-07-15 09:06:10.394035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.394191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.394234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.102 qpair failed and we were unable to recover it. 00:27:22.102 [2024-07-15 09:06:10.394421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.394589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.394614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.102 qpair failed and we were unable to recover it. 00:27:22.102 [2024-07-15 09:06:10.394785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.394917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.394946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.102 qpair failed and we were unable to recover it. 00:27:22.102 [2024-07-15 09:06:10.395110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.395403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.395463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.102 qpair failed and we were unable to recover it. 00:27:22.102 [2024-07-15 09:06:10.395650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.395798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.395824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.102 qpair failed and we were unable to recover it. 00:27:22.102 [2024-07-15 09:06:10.395943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.396109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.396138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.102 qpair failed and we were unable to recover it. 00:27:22.102 [2024-07-15 09:06:10.396301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.396539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.396600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.102 qpair failed and we were unable to recover it. 00:27:22.102 [2024-07-15 09:06:10.396791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.396977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.397006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.102 qpair failed and we were unable to recover it. 00:27:22.102 [2024-07-15 09:06:10.397172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.397318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.397343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.102 qpair failed and we were unable to recover it. 00:27:22.102 [2024-07-15 09:06:10.397557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.397707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.397733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.102 qpair failed and we were unable to recover it. 00:27:22.102 [2024-07-15 09:06:10.397935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.398095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.398123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.102 qpair failed and we were unable to recover it. 00:27:22.102 [2024-07-15 09:06:10.398279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.398432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.102 [2024-07-15 09:06:10.398460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.102 qpair failed and we were unable to recover it. 00:27:22.102 [2024-07-15 09:06:10.398622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.398763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.398789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.103 qpair failed and we were unable to recover it. 00:27:22.103 [2024-07-15 09:06:10.398961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.399130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.399155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.103 qpair failed and we were unable to recover it. 00:27:22.103 [2024-07-15 09:06:10.399342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.399595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.399655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.103 qpair failed and we were unable to recover it. 00:27:22.103 [2024-07-15 09:06:10.399829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.400033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.400059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.103 qpair failed and we were unable to recover it. 00:27:22.103 [2024-07-15 09:06:10.400208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.400356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.400397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.103 qpair failed and we were unable to recover it. 00:27:22.103 [2024-07-15 09:06:10.400580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.400767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.400795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.103 qpair failed and we were unable to recover it. 00:27:22.103 [2024-07-15 09:06:10.400953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.401116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.401144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.103 qpair failed and we were unable to recover it. 00:27:22.103 [2024-07-15 09:06:10.401302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.401489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.401513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.103 qpair failed and we were unable to recover it. 00:27:22.103 [2024-07-15 09:06:10.401681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.401842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.401870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.103 qpair failed and we were unable to recover it. 00:27:22.103 [2024-07-15 09:06:10.402016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.402170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.402198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.103 qpair failed and we were unable to recover it. 00:27:22.103 [2024-07-15 09:06:10.402315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.402473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.402501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.103 qpair failed and we were unable to recover it. 00:27:22.103 [2024-07-15 09:06:10.402684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.402827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.402856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.103 qpair failed and we were unable to recover it. 00:27:22.103 [2024-07-15 09:06:10.403046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.403217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.403259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.103 qpair failed and we were unable to recover it. 00:27:22.103 [2024-07-15 09:06:10.403415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.403617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.403643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.103 qpair failed and we were unable to recover it. 00:27:22.103 [2024-07-15 09:06:10.403788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.403926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.403954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.103 qpair failed and we were unable to recover it. 00:27:22.103 [2024-07-15 09:06:10.404108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.404364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.404418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.103 qpair failed and we were unable to recover it. 00:27:22.103 [2024-07-15 09:06:10.404584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.404753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.404778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.103 qpair failed and we were unable to recover it. 00:27:22.103 [2024-07-15 09:06:10.404948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.405082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.405111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.103 qpair failed and we were unable to recover it. 00:27:22.103 [2024-07-15 09:06:10.405292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.405422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.405449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.103 qpair failed and we were unable to recover it. 00:27:22.103 [2024-07-15 09:06:10.405605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.405742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.405770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.103 qpair failed and we were unable to recover it. 00:27:22.103 [2024-07-15 09:06:10.405961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.406109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.406135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.103 qpair failed and we were unable to recover it. 00:27:22.103 [2024-07-15 09:06:10.406282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.406422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.406447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.103 qpair failed and we were unable to recover it. 00:27:22.103 [2024-07-15 09:06:10.406647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.406831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.406859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.103 qpair failed and we were unable to recover it. 00:27:22.103 [2024-07-15 09:06:10.407020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.407178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.407206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.103 qpair failed and we were unable to recover it. 00:27:22.103 [2024-07-15 09:06:10.407346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.407492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.407517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.103 qpair failed and we were unable to recover it. 00:27:22.103 [2024-07-15 09:06:10.407692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.407814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.407841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.103 qpair failed and we were unable to recover it. 00:27:22.103 [2024-07-15 09:06:10.408013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.103 [2024-07-15 09:06:10.408141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.408169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.104 qpair failed and we were unable to recover it. 00:27:22.104 [2024-07-15 09:06:10.408289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.408420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.408448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.104 qpair failed and we were unable to recover it. 00:27:22.104 [2024-07-15 09:06:10.408639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.408825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.408853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.104 qpair failed and we were unable to recover it. 00:27:22.104 [2024-07-15 09:06:10.409003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.409170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.409213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.104 qpair failed and we were unable to recover it. 00:27:22.104 [2024-07-15 09:06:10.409396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.409644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.409704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.104 qpair failed and we were unable to recover it. 00:27:22.104 [2024-07-15 09:06:10.409902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.410064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.410092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.104 qpair failed and we were unable to recover it. 00:27:22.104 [2024-07-15 09:06:10.410256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.410377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.410402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.104 qpair failed and we were unable to recover it. 00:27:22.104 [2024-07-15 09:06:10.410551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.410694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.410720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.104 qpair failed and we were unable to recover it. 00:27:22.104 [2024-07-15 09:06:10.410912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.411075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.411103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.104 qpair failed and we were unable to recover it. 00:27:22.104 [2024-07-15 09:06:10.411342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.411527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.411555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.104 qpair failed and we were unable to recover it. 00:27:22.104 [2024-07-15 09:06:10.411697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.411842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.411867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.104 qpair failed and we were unable to recover it. 00:27:22.104 [2024-07-15 09:06:10.412071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.412285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.412338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.104 qpair failed and we were unable to recover it. 00:27:22.104 [2024-07-15 09:06:10.412509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.412667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.412694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.104 qpair failed and we were unable to recover it. 00:27:22.104 [2024-07-15 09:06:10.412864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.413031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.413060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.104 qpair failed and we were unable to recover it. 00:27:22.104 [2024-07-15 09:06:10.413205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.413378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.413419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.104 qpair failed and we were unable to recover it. 00:27:22.104 [2024-07-15 09:06:10.413602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.413732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.413759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.104 qpair failed and we were unable to recover it. 00:27:22.104 [2024-07-15 09:06:10.413929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.414068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.414096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.104 qpair failed and we were unable to recover it. 00:27:22.104 [2024-07-15 09:06:10.414282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.414464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.414491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.104 qpair failed and we were unable to recover it. 00:27:22.104 [2024-07-15 09:06:10.414641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.414810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.414852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.104 qpair failed and we were unable to recover it. 00:27:22.104 [2024-07-15 09:06:10.415017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.415132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.415158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.104 qpair failed and we were unable to recover it. 00:27:22.104 [2024-07-15 09:06:10.415357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.415520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.415549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.104 qpair failed and we were unable to recover it. 00:27:22.104 [2024-07-15 09:06:10.415734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.415981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.416010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.104 qpair failed and we were unable to recover it. 00:27:22.104 [2024-07-15 09:06:10.416139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.416282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.416307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.104 qpair failed and we were unable to recover it. 00:27:22.104 [2024-07-15 09:06:10.416441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.416629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.416657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.104 qpair failed and we were unable to recover it. 00:27:22.104 [2024-07-15 09:06:10.416840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.416970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.416998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.104 qpair failed and we were unable to recover it. 00:27:22.104 [2024-07-15 09:06:10.417160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.417311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.417339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.104 qpair failed and we were unable to recover it. 00:27:22.104 [2024-07-15 09:06:10.417506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.417677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.417718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.104 qpair failed and we were unable to recover it. 00:27:22.104 [2024-07-15 09:06:10.417867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.418036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.418064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.104 qpair failed and we were unable to recover it. 00:27:22.104 [2024-07-15 09:06:10.418219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.418347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.418374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.104 qpair failed and we were unable to recover it. 00:27:22.104 [2024-07-15 09:06:10.418625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.418806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.104 [2024-07-15 09:06:10.418834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.104 qpair failed and we were unable to recover it. 00:27:22.104 [2024-07-15 09:06:10.419007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.419154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.419201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.105 qpair failed and we were unable to recover it. 00:27:22.105 [2024-07-15 09:06:10.419339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.419491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.419519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.105 qpair failed and we were unable to recover it. 00:27:22.105 [2024-07-15 09:06:10.419652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.419808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.419838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.105 qpair failed and we were unable to recover it. 00:27:22.105 [2024-07-15 09:06:10.419988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.420147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.420175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.105 qpair failed and we were unable to recover it. 00:27:22.105 [2024-07-15 09:06:10.420346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.420467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.420492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.105 qpair failed and we were unable to recover it. 00:27:22.105 [2024-07-15 09:06:10.420657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.420790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.420819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.105 qpair failed and we were unable to recover it. 00:27:22.105 [2024-07-15 09:06:10.421008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.421168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.421196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.105 qpair failed and we were unable to recover it. 00:27:22.105 [2024-07-15 09:06:10.421410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.421624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.421652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.105 qpair failed and we were unable to recover it. 00:27:22.105 [2024-07-15 09:06:10.421842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.422004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.422030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.105 qpair failed and we were unable to recover it. 00:27:22.105 [2024-07-15 09:06:10.422175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.422346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.422375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.105 qpair failed and we were unable to recover it. 00:27:22.105 [2024-07-15 09:06:10.422506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.422666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.422694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.105 qpair failed and we were unable to recover it. 00:27:22.105 [2024-07-15 09:06:10.422852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.423025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.423054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.105 qpair failed and we were unable to recover it. 00:27:22.105 [2024-07-15 09:06:10.423223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.423392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.423418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.105 qpair failed and we were unable to recover it. 00:27:22.105 [2024-07-15 09:06:10.423564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.423748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.423776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.105 qpair failed and we were unable to recover it. 00:27:22.105 [2024-07-15 09:06:10.423941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.424067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.424095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.105 qpair failed and we were unable to recover it. 00:27:22.105 [2024-07-15 09:06:10.424351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.424682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.424731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.105 qpair failed and we were unable to recover it. 00:27:22.105 [2024-07-15 09:06:10.424933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.425094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.425123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.105 qpair failed and we were unable to recover it. 00:27:22.105 [2024-07-15 09:06:10.425305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.425471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.425533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.105 qpair failed and we were unable to recover it. 00:27:22.105 [2024-07-15 09:06:10.425685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.425867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.425903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.105 qpair failed and we were unable to recover it. 00:27:22.105 [2024-07-15 09:06:10.426088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.426401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.426450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.105 qpair failed and we were unable to recover it. 00:27:22.105 [2024-07-15 09:06:10.426615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.426786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.426829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.105 qpair failed and we were unable to recover it. 00:27:22.105 [2024-07-15 09:06:10.426988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.427140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.427166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.105 qpair failed and we were unable to recover it. 00:27:22.105 [2024-07-15 09:06:10.427308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.427501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.427529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.105 qpair failed and we were unable to recover it. 00:27:22.105 [2024-07-15 09:06:10.427688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.427871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.427907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.105 qpair failed and we were unable to recover it. 00:27:22.105 [2024-07-15 09:06:10.428075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.428216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.428257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.105 qpair failed and we were unable to recover it. 00:27:22.105 [2024-07-15 09:06:10.428393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.428575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.428603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.105 qpair failed and we were unable to recover it. 00:27:22.105 [2024-07-15 09:06:10.428798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.428962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.428991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.105 qpair failed and we were unable to recover it. 00:27:22.105 [2024-07-15 09:06:10.429149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.429368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.429396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.105 qpair failed and we were unable to recover it. 00:27:22.105 [2024-07-15 09:06:10.429566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.429711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.429752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.105 qpair failed and we were unable to recover it. 00:27:22.105 [2024-07-15 09:06:10.429913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.430078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.430106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.105 qpair failed and we were unable to recover it. 00:27:22.105 [2024-07-15 09:06:10.430264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.430423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.105 [2024-07-15 09:06:10.430450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.105 qpair failed and we were unable to recover it. 00:27:22.106 [2024-07-15 09:06:10.430614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.430770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.430799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.106 qpair failed and we were unable to recover it. 00:27:22.106 [2024-07-15 09:06:10.430961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.431107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.431134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.106 qpair failed and we were unable to recover it. 00:27:22.106 [2024-07-15 09:06:10.431308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.431570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.431621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.106 qpair failed and we were unable to recover it. 00:27:22.106 [2024-07-15 09:06:10.431772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.431935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.431963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.106 qpair failed and we were unable to recover it. 00:27:22.106 [2024-07-15 09:06:10.432132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.432319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.432348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.106 qpair failed and we were unable to recover it. 00:27:22.106 [2024-07-15 09:06:10.432515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.432671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.432713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.106 qpair failed and we were unable to recover it. 00:27:22.106 [2024-07-15 09:06:10.432902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.433052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.433077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.106 qpair failed and we were unable to recover it. 00:27:22.106 [2024-07-15 09:06:10.433247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.433456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.433517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.106 qpair failed and we were unable to recover it. 00:27:22.106 [2024-07-15 09:06:10.433701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.433824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.433854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.106 qpair failed and we were unable to recover it. 00:27:22.106 [2024-07-15 09:06:10.434010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.434163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.434188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.106 qpair failed and we were unable to recover it. 00:27:22.106 [2024-07-15 09:06:10.434360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.434557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.434585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.106 qpair failed and we were unable to recover it. 00:27:22.106 [2024-07-15 09:06:10.434742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.434871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.434918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.106 qpair failed and we were unable to recover it. 00:27:22.106 [2024-07-15 09:06:10.435077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.435372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.435424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.106 qpair failed and we were unable to recover it. 00:27:22.106 [2024-07-15 09:06:10.435624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.435811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.435838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.106 qpair failed and we were unable to recover it. 00:27:22.106 [2024-07-15 09:06:10.435990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.436143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.436188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.106 qpair failed and we were unable to recover it. 00:27:22.106 [2024-07-15 09:06:10.436335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.436558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.436608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.106 qpair failed and we were unable to recover it. 00:27:22.106 [2024-07-15 09:06:10.436799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.436933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.436962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.106 qpair failed and we were unable to recover it. 00:27:22.106 [2024-07-15 09:06:10.437128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.437270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.437295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.106 qpair failed and we were unable to recover it. 00:27:22.106 [2024-07-15 09:06:10.437466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.437620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.437648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.106 qpair failed and we were unable to recover it. 00:27:22.106 [2024-07-15 09:06:10.437774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.437902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.437931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.106 qpair failed and we were unable to recover it. 00:27:22.106 [2024-07-15 09:06:10.438092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.438267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.438324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.106 qpair failed and we were unable to recover it. 00:27:22.106 [2024-07-15 09:06:10.438490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.438658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.438683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.106 qpair failed and we were unable to recover it. 00:27:22.106 [2024-07-15 09:06:10.438831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.439036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.439064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.106 qpair failed and we were unable to recover it. 00:27:22.106 [2024-07-15 09:06:10.439218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.439368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.439396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.106 qpair failed and we were unable to recover it. 00:27:22.106 [2024-07-15 09:06:10.439682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.439863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.439897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.106 qpair failed and we were unable to recover it. 00:27:22.106 [2024-07-15 09:06:10.440084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.440226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.440268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.106 qpair failed and we were unable to recover it. 00:27:22.106 [2024-07-15 09:06:10.440427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.440612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.440640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.106 qpair failed and we were unable to recover it. 00:27:22.106 [2024-07-15 09:06:10.440773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.440939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.440970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.106 qpair failed and we were unable to recover it. 00:27:22.106 [2024-07-15 09:06:10.441117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.441275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.441303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.106 qpair failed and we were unable to recover it. 00:27:22.106 [2024-07-15 09:06:10.441494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.441652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.441679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.106 qpair failed and we were unable to recover it. 00:27:22.106 [2024-07-15 09:06:10.441863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.442040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.106 [2024-07-15 09:06:10.442069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.106 qpair failed and we were unable to recover it. 00:27:22.107 [2024-07-15 09:06:10.442215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.442366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.442393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.107 qpair failed and we were unable to recover it. 00:27:22.107 [2024-07-15 09:06:10.442551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.442709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.442737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.107 qpair failed and we were unable to recover it. 00:27:22.107 [2024-07-15 09:06:10.442888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.443034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.443075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.107 qpair failed and we were unable to recover it. 00:27:22.107 [2024-07-15 09:06:10.443234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.443396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.443421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.107 qpair failed and we were unable to recover it. 00:27:22.107 [2024-07-15 09:06:10.443565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.443698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.443725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.107 qpair failed and we were unable to recover it. 00:27:22.107 [2024-07-15 09:06:10.443938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.444103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.444131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.107 qpair failed and we were unable to recover it. 00:27:22.107 [2024-07-15 09:06:10.444266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.444412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.444437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.107 qpair failed and we were unable to recover it. 00:27:22.107 [2024-07-15 09:06:10.444620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.444749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.444777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.107 qpair failed and we were unable to recover it. 00:27:22.107 [2024-07-15 09:06:10.444954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.445091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.445116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.107 qpair failed and we were unable to recover it. 00:27:22.107 [2024-07-15 09:06:10.445281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.445431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.445459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.107 qpair failed and we were unable to recover it. 00:27:22.107 [2024-07-15 09:06:10.445647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.445847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.445887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.107 qpair failed and we were unable to recover it. 00:27:22.107 [2024-07-15 09:06:10.446059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.446209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.446234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.107 qpair failed and we were unable to recover it. 00:27:22.107 [2024-07-15 09:06:10.446429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.446677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.446741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.107 qpair failed and we were unable to recover it. 00:27:22.107 [2024-07-15 09:06:10.446902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.447027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.447055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.107 qpair failed and we were unable to recover it. 00:27:22.107 [2024-07-15 09:06:10.447219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.447387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.447411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.107 qpair failed and we were unable to recover it. 00:27:22.107 [2024-07-15 09:06:10.447610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.447798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.447825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.107 qpair failed and we were unable to recover it. 00:27:22.107 [2024-07-15 09:06:10.447984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.448123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.448151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.107 qpair failed and we were unable to recover it. 00:27:22.107 [2024-07-15 09:06:10.448340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.448489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.448531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.107 qpair failed and we were unable to recover it. 00:27:22.107 [2024-07-15 09:06:10.448676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.448813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.448839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.107 qpair failed and we were unable to recover it. 00:27:22.107 [2024-07-15 09:06:10.449019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.449142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.449183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.107 qpair failed and we were unable to recover it. 00:27:22.107 [2024-07-15 09:06:10.449341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.449575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.449627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.107 qpair failed and we were unable to recover it. 00:27:22.107 [2024-07-15 09:06:10.449815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.449948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.449977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.107 qpair failed and we were unable to recover it. 00:27:22.107 [2024-07-15 09:06:10.450142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.450287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.450313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.107 qpair failed and we were unable to recover it. 00:27:22.107 [2024-07-15 09:06:10.450492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.450637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.450662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.107 qpair failed and we were unable to recover it. 00:27:22.107 [2024-07-15 09:06:10.450811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.450978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.451007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.107 qpair failed and we were unable to recover it. 00:27:22.107 [2024-07-15 09:06:10.451167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.451303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.451330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.107 qpair failed and we were unable to recover it. 00:27:22.107 [2024-07-15 09:06:10.451528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.451718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.107 [2024-07-15 09:06:10.451747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.108 qpair failed and we were unable to recover it. 00:27:22.108 [2024-07-15 09:06:10.451930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.452134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.452159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.108 qpair failed and we were unable to recover it. 00:27:22.108 [2024-07-15 09:06:10.452312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.452479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.452507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.108 qpair failed and we were unable to recover it. 00:27:22.108 [2024-07-15 09:06:10.452638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.452802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.452830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.108 qpair failed and we were unable to recover it. 00:27:22.108 [2024-07-15 09:06:10.453031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.453170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.453213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.108 qpair failed and we were unable to recover it. 00:27:22.108 [2024-07-15 09:06:10.453376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.453526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.453554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.108 qpair failed and we were unable to recover it. 00:27:22.108 [2024-07-15 09:06:10.453703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.453862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.453898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.108 qpair failed and we were unable to recover it. 00:27:22.108 [2024-07-15 09:06:10.454074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.454215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.454241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.108 qpair failed and we were unable to recover it. 00:27:22.108 [2024-07-15 09:06:10.454383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.454557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.454598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.108 qpair failed and we were unable to recover it. 00:27:22.108 [2024-07-15 09:06:10.454755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.454914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.454943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.108 qpair failed and we were unable to recover it. 00:27:22.108 [2024-07-15 09:06:10.455094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.455248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.455276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.108 qpair failed and we were unable to recover it. 00:27:22.108 [2024-07-15 09:06:10.455421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.455567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.455592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.108 qpair failed and we were unable to recover it. 00:27:22.108 [2024-07-15 09:06:10.455710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.455823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.455848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.108 qpair failed and we were unable to recover it. 00:27:22.108 [2024-07-15 09:06:10.455965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.456077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.456102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.108 qpair failed and we were unable to recover it. 00:27:22.108 [2024-07-15 09:06:10.456271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.456455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.456487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.108 qpair failed and we were unable to recover it. 00:27:22.108 [2024-07-15 09:06:10.456673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.456804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.456832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.108 qpair failed and we were unable to recover it. 00:27:22.108 [2024-07-15 09:06:10.457008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.457153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.457193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.108 qpair failed and we were unable to recover it. 00:27:22.108 [2024-07-15 09:06:10.457346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.457483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.457510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.108 qpair failed and we were unable to recover it. 00:27:22.108 [2024-07-15 09:06:10.457630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.457815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.457843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.108 qpair failed and we were unable to recover it. 00:27:22.108 [2024-07-15 09:06:10.458025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.458184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.458213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.108 qpair failed and we were unable to recover it. 00:27:22.108 [2024-07-15 09:06:10.458374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.458481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.458505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.108 qpair failed and we were unable to recover it. 00:27:22.108 [2024-07-15 09:06:10.458676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.458834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.458862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.108 qpair failed and we were unable to recover it. 00:27:22.108 [2024-07-15 09:06:10.459056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.459247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.459303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.108 qpair failed and we were unable to recover it. 00:27:22.108 [2024-07-15 09:06:10.459585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.459763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.459792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.108 qpair failed and we were unable to recover it. 00:27:22.108 [2024-07-15 09:06:10.459985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.460133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.460158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.108 qpair failed and we were unable to recover it. 00:27:22.108 [2024-07-15 09:06:10.460304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.460468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.460497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.108 qpair failed and we were unable to recover it. 00:27:22.108 [2024-07-15 09:06:10.460655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.460790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.460820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.108 qpair failed and we were unable to recover it. 00:27:22.108 [2024-07-15 09:06:10.460965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.461125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.461153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.108 qpair failed and we were unable to recover it. 00:27:22.108 [2024-07-15 09:06:10.461280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.461396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.461421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.108 qpair failed and we were unable to recover it. 00:27:22.108 [2024-07-15 09:06:10.461553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.461700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.461727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.108 qpair failed and we were unable to recover it. 00:27:22.108 [2024-07-15 09:06:10.461846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.462036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.462065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.108 qpair failed and we were unable to recover it. 00:27:22.108 [2024-07-15 09:06:10.462234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.108 [2024-07-15 09:06:10.462349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.462374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.109 qpair failed and we were unable to recover it. 00:27:22.109 [2024-07-15 09:06:10.462516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.462700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.462727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.109 qpair failed and we were unable to recover it. 00:27:22.109 [2024-07-15 09:06:10.462852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.463012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.463039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.109 qpair failed and we were unable to recover it. 00:27:22.109 [2024-07-15 09:06:10.463231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.463474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.463527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.109 qpair failed and we were unable to recover it. 00:27:22.109 [2024-07-15 09:06:10.463722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.463850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.463886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.109 qpair failed and we were unable to recover it. 00:27:22.109 [2024-07-15 09:06:10.464074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.464260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.464288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.109 qpair failed and we were unable to recover it. 00:27:22.109 [2024-07-15 09:06:10.464439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.464634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.464703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.109 qpair failed and we were unable to recover it. 00:27:22.109 [2024-07-15 09:06:10.464862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.465031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.465060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.109 qpair failed and we were unable to recover it. 00:27:22.109 [2024-07-15 09:06:10.465248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.465407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.465435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.109 qpair failed and we were unable to recover it. 00:27:22.109 [2024-07-15 09:06:10.465596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.465782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.465810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.109 qpair failed and we were unable to recover it. 00:27:22.109 [2024-07-15 09:06:10.465967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.466100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.466129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.109 qpair failed and we were unable to recover it. 00:27:22.109 [2024-07-15 09:06:10.466254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.466445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.466473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.109 qpair failed and we were unable to recover it. 00:27:22.109 [2024-07-15 09:06:10.466622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.466772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.466800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.109 qpair failed and we were unable to recover it. 00:27:22.109 [2024-07-15 09:06:10.466936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.467078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.467103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.109 qpair failed and we were unable to recover it. 00:27:22.109 [2024-07-15 09:06:10.467263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.467435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.467463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.109 qpair failed and we were unable to recover it. 00:27:22.109 [2024-07-15 09:06:10.467623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.467811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.467840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.109 qpair failed and we were unable to recover it. 00:27:22.109 [2024-07-15 09:06:10.468014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.468130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.468156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.109 qpair failed and we were unable to recover it. 00:27:22.109 [2024-07-15 09:06:10.468300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.468444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.468487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.109 qpair failed and we were unable to recover it. 00:27:22.109 [2024-07-15 09:06:10.468615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.468768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.468796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.109 qpair failed and we were unable to recover it. 00:27:22.109 [2024-07-15 09:06:10.468972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.469130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.469158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.109 qpair failed and we were unable to recover it. 00:27:22.109 [2024-07-15 09:06:10.469351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.469613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.469663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.109 qpair failed and we were unable to recover it. 00:27:22.109 [2024-07-15 09:06:10.469806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.469982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.470024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.109 qpair failed and we were unable to recover it. 00:27:22.109 [2024-07-15 09:06:10.470187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.470439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.470490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.109 qpair failed and we were unable to recover it. 00:27:22.109 [2024-07-15 09:06:10.470685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.470817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.470845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.109 qpair failed and we were unable to recover it. 00:27:22.109 [2024-07-15 09:06:10.471035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.471236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.471293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.109 qpair failed and we were unable to recover it. 00:27:22.109 [2024-07-15 09:06:10.471464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.471607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.471648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.109 qpair failed and we were unable to recover it. 00:27:22.109 [2024-07-15 09:06:10.471829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.471995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.472024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.109 qpair failed and we were unable to recover it. 00:27:22.109 [2024-07-15 09:06:10.472159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.472280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.472308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.109 qpair failed and we were unable to recover it. 00:27:22.109 [2024-07-15 09:06:10.472468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.472666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.472695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.109 qpair failed and we were unable to recover it. 00:27:22.109 [2024-07-15 09:06:10.472897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.473020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.473065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.109 qpair failed and we were unable to recover it. 00:27:22.109 [2024-07-15 09:06:10.473226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.473477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.473535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.109 qpair failed and we were unable to recover it. 00:27:22.109 [2024-07-15 09:06:10.473695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.109 [2024-07-15 09:06:10.473860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.473905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.110 qpair failed and we were unable to recover it. 00:27:22.110 [2024-07-15 09:06:10.474097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.474269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.474294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.110 qpair failed and we were unable to recover it. 00:27:22.110 [2024-07-15 09:06:10.474405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.474572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.474616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.110 qpair failed and we were unable to recover it. 00:27:22.110 [2024-07-15 09:06:10.474771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.474932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.474962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.110 qpair failed and we were unable to recover it. 00:27:22.110 [2024-07-15 09:06:10.475131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.475291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.475318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.110 qpair failed and we were unable to recover it. 00:27:22.110 [2024-07-15 09:06:10.475511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.475632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.475659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.110 qpair failed and we were unable to recover it. 00:27:22.110 [2024-07-15 09:06:10.475798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.475945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.475988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.110 qpair failed and we were unable to recover it. 00:27:22.110 [2024-07-15 09:06:10.476178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.476392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.476446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.110 qpair failed and we were unable to recover it. 00:27:22.110 [2024-07-15 09:06:10.476606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.476764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.476791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.110 qpair failed and we were unable to recover it. 00:27:22.110 [2024-07-15 09:06:10.476920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.477101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.477126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.110 qpair failed and we were unable to recover it. 00:27:22.110 [2024-07-15 09:06:10.477269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.477413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.477455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.110 qpair failed and we were unable to recover it. 00:27:22.110 [2024-07-15 09:06:10.477641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.477782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.477811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.110 qpair failed and we were unable to recover it. 00:27:22.110 [2024-07-15 09:06:10.477977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.478158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.478185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.110 qpair failed and we were unable to recover it. 00:27:22.110 [2024-07-15 09:06:10.478422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.478691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.478745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.110 qpair failed and we were unable to recover it. 00:27:22.110 [2024-07-15 09:06:10.478927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.479073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.479099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.110 qpair failed and we were unable to recover it. 00:27:22.110 [2024-07-15 09:06:10.479283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.479523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.479549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.110 qpair failed and we were unable to recover it. 00:27:22.110 [2024-07-15 09:06:10.479690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.479887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.479915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.110 qpair failed and we were unable to recover it. 00:27:22.110 [2024-07-15 09:06:10.480076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.480217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.480244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.110 qpair failed and we were unable to recover it. 00:27:22.110 [2024-07-15 09:06:10.480431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.480580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.480604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.110 qpair failed and we were unable to recover it. 00:27:22.110 [2024-07-15 09:06:10.480729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.480916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.480943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.110 qpair failed and we were unable to recover it. 00:27:22.110 [2024-07-15 09:06:10.481111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.481274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.481300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.110 qpair failed and we were unable to recover it. 00:27:22.110 [2024-07-15 09:06:10.481422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.481591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.481620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.110 qpair failed and we were unable to recover it. 00:27:22.110 [2024-07-15 09:06:10.481790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.481934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.481961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.110 qpair failed and we were unable to recover it. 00:27:22.110 [2024-07-15 09:06:10.482095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.482252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.482282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.110 qpair failed and we were unable to recover it. 00:27:22.110 [2024-07-15 09:06:10.482448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.482583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.482611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.110 qpair failed and we were unable to recover it. 00:27:22.110 [2024-07-15 09:06:10.482804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.482976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.483002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.110 qpair failed and we were unable to recover it. 00:27:22.110 [2024-07-15 09:06:10.483148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.483289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.483329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.110 qpair failed and we were unable to recover it. 00:27:22.110 [2024-07-15 09:06:10.483490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.483644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.483672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.110 qpair failed and we were unable to recover it. 00:27:22.110 [2024-07-15 09:06:10.483828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.483971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.483999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.110 qpair failed and we were unable to recover it. 00:27:22.110 [2024-07-15 09:06:10.484185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.484447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.484474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.110 qpair failed and we were unable to recover it. 00:27:22.110 [2024-07-15 09:06:10.484635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.484776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.110 [2024-07-15 09:06:10.484801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.110 qpair failed and we were unable to recover it. 00:27:22.110 [2024-07-15 09:06:10.484972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.485105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.485133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.111 qpair failed and we were unable to recover it. 00:27:22.111 [2024-07-15 09:06:10.485291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.485425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.485452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.111 qpair failed and we were unable to recover it. 00:27:22.111 [2024-07-15 09:06:10.485648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.485793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.485818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.111 qpair failed and we were unable to recover it. 00:27:22.111 [2024-07-15 09:06:10.485957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.486143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.486172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.111 qpair failed and we were unable to recover it. 00:27:22.111 [2024-07-15 09:06:10.486308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.486432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.486456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.111 qpair failed and we were unable to recover it. 00:27:22.111 [2024-07-15 09:06:10.486624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.486780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.486808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.111 qpair failed and we were unable to recover it. 00:27:22.111 [2024-07-15 09:06:10.486966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.487147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.487176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.111 qpair failed and we were unable to recover it. 00:27:22.111 [2024-07-15 09:06:10.487349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.487494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.487519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.111 qpair failed and we were unable to recover it. 00:27:22.111 [2024-07-15 09:06:10.487690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.487845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.487870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.111 qpair failed and we were unable to recover it. 00:27:22.111 [2024-07-15 09:06:10.488024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.488166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.488194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.111 qpair failed and we were unable to recover it. 00:27:22.111 [2024-07-15 09:06:10.488506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.488684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.488713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.111 qpair failed and we were unable to recover it. 00:27:22.111 [2024-07-15 09:06:10.488902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.489068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.489096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.111 qpair failed and we were unable to recover it. 00:27:22.111 [2024-07-15 09:06:10.489255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.489386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.489413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.111 qpair failed and we were unable to recover it. 00:27:22.111 [2024-07-15 09:06:10.489574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.489761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.489793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.111 qpair failed and we were unable to recover it. 00:27:22.111 [2024-07-15 09:06:10.489971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.490134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.490162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.111 qpair failed and we were unable to recover it. 00:27:22.111 [2024-07-15 09:06:10.490329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.490534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.490589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.111 qpair failed and we were unable to recover it. 00:27:22.111 [2024-07-15 09:06:10.490747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.490911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.490940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.111 qpair failed and we were unable to recover it. 00:27:22.111 [2024-07-15 09:06:10.491137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.491306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.491346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.111 qpair failed and we were unable to recover it. 00:27:22.111 [2024-07-15 09:06:10.491584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.491738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.491767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.111 qpair failed and we were unable to recover it. 00:27:22.111 [2024-07-15 09:06:10.491934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.492076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.492116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.111 qpair failed and we were unable to recover it. 00:27:22.111 [2024-07-15 09:06:10.492231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.492382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.492410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.111 qpair failed and we were unable to recover it. 00:27:22.111 [2024-07-15 09:06:10.492572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.492724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.492752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.111 qpair failed and we were unable to recover it. 00:27:22.111 [2024-07-15 09:06:10.492915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.493072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.493100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.111 qpair failed and we were unable to recover it. 00:27:22.111 [2024-07-15 09:06:10.493265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.493417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.493442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.111 qpair failed and we were unable to recover it. 00:27:22.111 [2024-07-15 09:06:10.493645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.493803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.493831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.111 qpair failed and we were unable to recover it. 00:27:22.111 [2024-07-15 09:06:10.493995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.494152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.494180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.111 qpair failed and we were unable to recover it. 00:27:22.111 [2024-07-15 09:06:10.494355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.494497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.494522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.111 qpair failed and we were unable to recover it. 00:27:22.111 [2024-07-15 09:06:10.494710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.494875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.494913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.111 qpair failed and we were unable to recover it. 00:27:22.111 [2024-07-15 09:06:10.495075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.495229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.495257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.111 qpair failed and we were unable to recover it. 00:27:22.111 [2024-07-15 09:06:10.495454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.495606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.495632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.111 qpair failed and we were unable to recover it. 00:27:22.111 [2024-07-15 09:06:10.495780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.495938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.111 [2024-07-15 09:06:10.495967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.112 qpair failed and we were unable to recover it. 00:27:22.112 [2024-07-15 09:06:10.496130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.496299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.496342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.112 qpair failed and we were unable to recover it. 00:27:22.112 [2024-07-15 09:06:10.496500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.496681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.496709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.112 qpair failed and we were unable to recover it. 00:27:22.112 [2024-07-15 09:06:10.496836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.497005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.497034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.112 qpair failed and we were unable to recover it. 00:27:22.112 [2024-07-15 09:06:10.497162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.497414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.497472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.112 qpair failed and we were unable to recover it. 00:27:22.112 [2024-07-15 09:06:10.497665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.497851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.497898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.112 qpair failed and we were unable to recover it. 00:27:22.112 [2024-07-15 09:06:10.498066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.498255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.498325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.112 qpair failed and we were unable to recover it. 00:27:22.112 [2024-07-15 09:06:10.498510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.498704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.498756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.112 qpair failed and we were unable to recover it. 00:27:22.112 [2024-07-15 09:06:10.498896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.499054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.499083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.112 qpair failed and we were unable to recover it. 00:27:22.112 [2024-07-15 09:06:10.499269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.499454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.499482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.112 qpair failed and we were unable to recover it. 00:27:22.112 [2024-07-15 09:06:10.499665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.499831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.499859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.112 qpair failed and we were unable to recover it. 00:27:22.112 [2024-07-15 09:06:10.500061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.500200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.500228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.112 qpair failed and we were unable to recover it. 00:27:22.112 [2024-07-15 09:06:10.500386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.500543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.500571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.112 qpair failed and we were unable to recover it. 00:27:22.112 [2024-07-15 09:06:10.500716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.500826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.500851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.112 qpair failed and we were unable to recover it. 00:27:22.112 [2024-07-15 09:06:10.501030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.501198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.501226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.112 qpair failed and we were unable to recover it. 00:27:22.112 [2024-07-15 09:06:10.501382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.501578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.501606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.112 qpair failed and we were unable to recover it. 00:27:22.112 [2024-07-15 09:06:10.501739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.501924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.501954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.112 qpair failed and we were unable to recover it. 00:27:22.112 [2024-07-15 09:06:10.502116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.502260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.502286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.112 qpair failed and we were unable to recover it. 00:27:22.112 [2024-07-15 09:06:10.502459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.502602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.502627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.112 qpair failed and we were unable to recover it. 00:27:22.112 [2024-07-15 09:06:10.502795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.502993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.503021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.112 qpair failed and we were unable to recover it. 00:27:22.112 [2024-07-15 09:06:10.503153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.503335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.503363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.112 qpair failed and we were unable to recover it. 00:27:22.112 [2024-07-15 09:06:10.503502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.503676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.503701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.112 qpair failed and we were unable to recover it. 00:27:22.112 [2024-07-15 09:06:10.503883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.504044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.504070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.112 qpair failed and we were unable to recover it. 00:27:22.112 [2024-07-15 09:06:10.504206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.504328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.504356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.112 qpair failed and we were unable to recover it. 00:27:22.112 [2024-07-15 09:06:10.504486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.504615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.504642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.112 qpair failed and we were unable to recover it. 00:27:22.112 [2024-07-15 09:06:10.504808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.504954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.504995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.112 qpair failed and we were unable to recover it. 00:27:22.112 [2024-07-15 09:06:10.505156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.505311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.505340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.112 qpair failed and we were unable to recover it. 00:27:22.112 [2024-07-15 09:06:10.505500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.112 [2024-07-15 09:06:10.505659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.505686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.113 qpair failed and we were unable to recover it. 00:27:22.113 [2024-07-15 09:06:10.505842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.506008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.506037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.113 qpair failed and we were unable to recover it. 00:27:22.113 [2024-07-15 09:06:10.506198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.506344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.506385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.113 qpair failed and we were unable to recover it. 00:27:22.113 [2024-07-15 09:06:10.506511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.506660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.506687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.113 qpair failed and we were unable to recover it. 00:27:22.113 [2024-07-15 09:06:10.506849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.506992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.507020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.113 qpair failed and we were unable to recover it. 00:27:22.113 [2024-07-15 09:06:10.507218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.507361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.507387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.113 qpair failed and we were unable to recover it. 00:27:22.113 [2024-07-15 09:06:10.507555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.507698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.507722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.113 qpair failed and we were unable to recover it. 00:27:22.113 [2024-07-15 09:06:10.507893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.508057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.508090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.113 qpair failed and we were unable to recover it. 00:27:22.113 [2024-07-15 09:06:10.508281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.508452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.508479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.113 qpair failed and we were unable to recover it. 00:27:22.113 [2024-07-15 09:06:10.508611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.508766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.508794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.113 qpair failed and we were unable to recover it. 00:27:22.113 [2024-07-15 09:06:10.508965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.509141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.509182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.113 qpair failed and we were unable to recover it. 00:27:22.113 [2024-07-15 09:06:10.509351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.509518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.509543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.113 qpair failed and we were unable to recover it. 00:27:22.113 [2024-07-15 09:06:10.509706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.509869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.509915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.113 qpair failed and we were unable to recover it. 00:27:22.113 [2024-07-15 09:06:10.510087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.510198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.510223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.113 qpair failed and we were unable to recover it. 00:27:22.113 [2024-07-15 09:06:10.510343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.510488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.510513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.113 qpair failed and we were unable to recover it. 00:27:22.113 [2024-07-15 09:06:10.510660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.510777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.510802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.113 qpair failed and we were unable to recover it. 00:27:22.113 [2024-07-15 09:06:10.510969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.511144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.511173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.113 qpair failed and we were unable to recover it. 00:27:22.113 [2024-07-15 09:06:10.511354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.511629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.511680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.113 qpair failed and we were unable to recover it. 00:27:22.113 [2024-07-15 09:06:10.511861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.512015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.512059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.113 qpair failed and we were unable to recover it. 00:27:22.113 [2024-07-15 09:06:10.512257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.512414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.512443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.113 qpair failed and we were unable to recover it. 00:27:22.113 [2024-07-15 09:06:10.512601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.512786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.512813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.113 qpair failed and we were unable to recover it. 00:27:22.113 [2024-07-15 09:06:10.512971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.513129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.513157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.113 qpair failed and we were unable to recover it. 00:27:22.113 [2024-07-15 09:06:10.513327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.513472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.513496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.113 qpair failed and we were unable to recover it. 00:27:22.113 [2024-07-15 09:06:10.513644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.513821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.513848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.113 qpair failed and we were unable to recover it. 00:27:22.113 [2024-07-15 09:06:10.513983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.514172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.514198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.113 qpair failed and we were unable to recover it. 00:27:22.113 [2024-07-15 09:06:10.514307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.514588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.514639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.113 qpair failed and we were unable to recover it. 00:27:22.113 [2024-07-15 09:06:10.514809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.515005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.515034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.113 qpair failed and we were unable to recover it. 00:27:22.113 [2024-07-15 09:06:10.515164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.515323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.515351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.113 qpair failed and we were unable to recover it. 00:27:22.113 [2024-07-15 09:06:10.515534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.515723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.515751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.113 qpair failed and we were unable to recover it. 00:27:22.113 [2024-07-15 09:06:10.515922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.516066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.516091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.113 qpair failed and we were unable to recover it. 00:27:22.113 [2024-07-15 09:06:10.516244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.516387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.516413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.113 qpair failed and we were unable to recover it. 00:27:22.113 [2024-07-15 09:06:10.516585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.113 [2024-07-15 09:06:10.516746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.516775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.114 qpair failed and we were unable to recover it. 00:27:22.114 [2024-07-15 09:06:10.516926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.517090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.517117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.114 qpair failed and we were unable to recover it. 00:27:22.114 [2024-07-15 09:06:10.517242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.517402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.517429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.114 qpair failed and we were unable to recover it. 00:27:22.114 [2024-07-15 09:06:10.517584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.517706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.517731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.114 qpair failed and we were unable to recover it. 00:27:22.114 [2024-07-15 09:06:10.517925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.518055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.518083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.114 qpair failed and we were unable to recover it. 00:27:22.114 [2024-07-15 09:06:10.518281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.518428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.518453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.114 qpair failed and we were unable to recover it. 00:27:22.114 [2024-07-15 09:06:10.518622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.518761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.518791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.114 qpair failed and we were unable to recover it. 00:27:22.114 [2024-07-15 09:06:10.518981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.519155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.519183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.114 qpair failed and we were unable to recover it. 00:27:22.114 [2024-07-15 09:06:10.519335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.519465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.519493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.114 qpair failed and we were unable to recover it. 00:27:22.114 [2024-07-15 09:06:10.519614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.519730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.519757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.114 qpair failed and we were unable to recover it. 00:27:22.114 [2024-07-15 09:06:10.519895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.520088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.520113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.114 qpair failed and we were unable to recover it. 00:27:22.114 [2024-07-15 09:06:10.520249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.520470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.520522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.114 qpair failed and we were unable to recover it. 00:27:22.114 [2024-07-15 09:06:10.520686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.520843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.520870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.114 qpair failed and we were unable to recover it. 00:27:22.114 [2024-07-15 09:06:10.521045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.521163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.521188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.114 qpair failed and we were unable to recover it. 00:27:22.114 [2024-07-15 09:06:10.521335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.521500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.521528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.114 qpair failed and we were unable to recover it. 00:27:22.114 [2024-07-15 09:06:10.521662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.521816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.521842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.114 qpair failed and we were unable to recover it. 00:27:22.114 [2024-07-15 09:06:10.522024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.522180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.522209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.114 qpair failed and we were unable to recover it. 00:27:22.114 [2024-07-15 09:06:10.522371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.522530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.522563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.114 qpair failed and we were unable to recover it. 00:27:22.114 [2024-07-15 09:06:10.522695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.522848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.522885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.114 qpair failed and we were unable to recover it. 00:27:22.114 [2024-07-15 09:06:10.523063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.523204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.523246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.114 qpair failed and we were unable to recover it. 00:27:22.114 [2024-07-15 09:06:10.523377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.523564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.523592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.114 qpair failed and we were unable to recover it. 00:27:22.114 [2024-07-15 09:06:10.523784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.523958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.523984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.114 qpair failed and we were unable to recover it. 00:27:22.114 [2024-07-15 09:06:10.524137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.524266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.524295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.114 qpair failed and we were unable to recover it. 00:27:22.114 [2024-07-15 09:06:10.524454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.524599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.524624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.114 qpair failed and we were unable to recover it. 00:27:22.114 [2024-07-15 09:06:10.524792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.524943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.524972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.114 qpair failed and we were unable to recover it. 00:27:22.114 [2024-07-15 09:06:10.525110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.525269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.525297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.114 qpair failed and we were unable to recover it. 00:27:22.114 [2024-07-15 09:06:10.525423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.525619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.525644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.114 qpair failed and we were unable to recover it. 00:27:22.114 [2024-07-15 09:06:10.525789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.525970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.525999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.114 qpair failed and we were unable to recover it. 00:27:22.114 [2024-07-15 09:06:10.526200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.526311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.526337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.114 qpair failed and we were unable to recover it. 00:27:22.114 [2024-07-15 09:06:10.526527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.526651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.526679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.114 qpair failed and we were unable to recover it. 00:27:22.114 [2024-07-15 09:06:10.526829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.527002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.114 [2024-07-15 09:06:10.527031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.114 qpair failed and we were unable to recover it. 00:27:22.114 [2024-07-15 09:06:10.527199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.527387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.527415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.115 qpair failed and we were unable to recover it. 00:27:22.115 [2024-07-15 09:06:10.527572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.527696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.527725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.115 qpair failed and we were unable to recover it. 00:27:22.115 [2024-07-15 09:06:10.527890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.528065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.528090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.115 qpair failed and we were unable to recover it. 00:27:22.115 [2024-07-15 09:06:10.528247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.528408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.528436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.115 qpair failed and we were unable to recover it. 00:27:22.115 [2024-07-15 09:06:10.528638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.528781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.528824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.115 qpair failed and we were unable to recover it. 00:27:22.115 [2024-07-15 09:06:10.529010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.529174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.529199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.115 qpair failed and we were unable to recover it. 00:27:22.115 [2024-07-15 09:06:10.529339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.529543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.529595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.115 qpair failed and we were unable to recover it. 00:27:22.115 [2024-07-15 09:06:10.529762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.529920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.529950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.115 qpair failed and we were unable to recover it. 00:27:22.115 [2024-07-15 09:06:10.530087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.530234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.530260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.115 qpair failed and we were unable to recover it. 00:27:22.115 [2024-07-15 09:06:10.530408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.530551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.530580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.115 qpair failed and we were unable to recover it. 00:27:22.115 [2024-07-15 09:06:10.530751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.530890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.530916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.115 qpair failed and we were unable to recover it. 00:27:22.115 [2024-07-15 09:06:10.531039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.531150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.531176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.115 qpair failed and we were unable to recover it. 00:27:22.115 [2024-07-15 09:06:10.531312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.531452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.531493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.115 qpair failed and we were unable to recover it. 00:27:22.115 [2024-07-15 09:06:10.531662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.531803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.531828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.115 qpair failed and we were unable to recover it. 00:27:22.115 [2024-07-15 09:06:10.532010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.532169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.532197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.115 qpair failed and we were unable to recover it. 00:27:22.115 [2024-07-15 09:06:10.532357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.532553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.532612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.115 qpair failed and we were unable to recover it. 00:27:22.115 [2024-07-15 09:06:10.532747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.532895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.532921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.115 qpair failed and we were unable to recover it. 00:27:22.115 [2024-07-15 09:06:10.533094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.533240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.533309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.115 qpair failed and we were unable to recover it. 00:27:22.115 [2024-07-15 09:06:10.533506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.533625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.533650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.115 qpair failed and we were unable to recover it. 00:27:22.115 [2024-07-15 09:06:10.533824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.533958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.533987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.115 qpair failed and we were unable to recover it. 00:27:22.115 [2024-07-15 09:06:10.534154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.534350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.534378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.115 qpair failed and we were unable to recover it. 00:27:22.115 [2024-07-15 09:06:10.534529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.534687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.534714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.115 qpair failed and we were unable to recover it. 00:27:22.115 [2024-07-15 09:06:10.534843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.534997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.535023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.115 qpair failed and we were unable to recover it. 00:27:22.115 [2024-07-15 09:06:10.535205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.535407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.535461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.115 qpair failed and we were unable to recover it. 00:27:22.115 [2024-07-15 09:06:10.535598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.535721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.535747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.115 qpair failed and we were unable to recover it. 00:27:22.115 [2024-07-15 09:06:10.535954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.536073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.536099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.115 qpair failed and we were unable to recover it. 00:27:22.115 [2024-07-15 09:06:10.536292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.536417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.536444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.115 qpair failed and we were unable to recover it. 00:27:22.115 [2024-07-15 09:06:10.536625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.536782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.536810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.115 qpair failed and we were unable to recover it. 00:27:22.115 [2024-07-15 09:06:10.536974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.537121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.537162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.115 qpair failed and we were unable to recover it. 00:27:22.115 [2024-07-15 09:06:10.537348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.537498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.537526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.115 qpair failed and we were unable to recover it. 00:27:22.115 [2024-07-15 09:06:10.537715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.537887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.115 [2024-07-15 09:06:10.537929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.115 qpair failed and we were unable to recover it. 00:27:22.116 [2024-07-15 09:06:10.538055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.538215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.538244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.116 qpair failed and we were unable to recover it. 00:27:22.116 [2024-07-15 09:06:10.538403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.538544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.538585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.116 qpair failed and we were unable to recover it. 00:27:22.116 [2024-07-15 09:06:10.538745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.538907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.538935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.116 qpair failed and we were unable to recover it. 00:27:22.116 [2024-07-15 09:06:10.539091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.539214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.539243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.116 qpair failed and we were unable to recover it. 00:27:22.116 [2024-07-15 09:06:10.539498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.539675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.539703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.116 qpair failed and we were unable to recover it. 00:27:22.116 [2024-07-15 09:06:10.539903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.540080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.540108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.116 qpair failed and we were unable to recover it. 00:27:22.116 [2024-07-15 09:06:10.540272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.540429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.540463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.116 qpair failed and we were unable to recover it. 00:27:22.116 [2024-07-15 09:06:10.540597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.540726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.540754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.116 qpair failed and we were unable to recover it. 00:27:22.116 [2024-07-15 09:06:10.540937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.541128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.541153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.116 qpair failed and we were unable to recover it. 00:27:22.116 [2024-07-15 09:06:10.541299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.541446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.541488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.116 qpair failed and we were unable to recover it. 00:27:22.116 [2024-07-15 09:06:10.541649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.541834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.541862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.116 qpair failed and we were unable to recover it. 00:27:22.116 [2024-07-15 09:06:10.542028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.542221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.542246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.116 qpair failed and we were unable to recover it. 00:27:22.116 [2024-07-15 09:06:10.542356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.542495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.542520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.116 qpair failed and we were unable to recover it. 00:27:22.116 [2024-07-15 09:06:10.542666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.542806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.542847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.116 qpair failed and we were unable to recover it. 00:27:22.116 [2024-07-15 09:06:10.543001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.543122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.543148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.116 qpair failed and we were unable to recover it. 00:27:22.116 [2024-07-15 09:06:10.543287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.543476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.543505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.116 qpair failed and we were unable to recover it. 00:27:22.116 [2024-07-15 09:06:10.543692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.543823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.543850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.116 qpair failed and we were unable to recover it. 00:27:22.116 [2024-07-15 09:06:10.544003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.544119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.544145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.116 qpair failed and we were unable to recover it. 00:27:22.116 [2024-07-15 09:06:10.544361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.544476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.544500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.116 qpair failed and we were unable to recover it. 00:27:22.116 [2024-07-15 09:06:10.544672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.544805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.544832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.116 qpair failed and we were unable to recover it. 00:27:22.116 [2024-07-15 09:06:10.545031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.545214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.545243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.116 qpair failed and we were unable to recover it. 00:27:22.116 [2024-07-15 09:06:10.545413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.545528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.545553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.116 qpair failed and we were unable to recover it. 00:27:22.116 [2024-07-15 09:06:10.545674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.545785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.545828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.116 qpair failed and we were unable to recover it. 00:27:22.116 [2024-07-15 09:06:10.546036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.546168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.546197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.116 qpair failed and we were unable to recover it. 00:27:22.116 [2024-07-15 09:06:10.546336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.546491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.546519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.116 qpair failed and we were unable to recover it. 00:27:22.116 [2024-07-15 09:06:10.546686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.546807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.546832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.116 qpair failed and we were unable to recover it. 00:27:22.116 [2024-07-15 09:06:10.547027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.547173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.116 [2024-07-15 09:06:10.547217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.117 qpair failed and we were unable to recover it. 00:27:22.117 [2024-07-15 09:06:10.547379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.547505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.547534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.117 qpair failed and we were unable to recover it. 00:27:22.117 [2024-07-15 09:06:10.547693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.547850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.547902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.117 qpair failed and we were unable to recover it. 00:27:22.117 [2024-07-15 09:06:10.548085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.548197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.548222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.117 qpair failed and we were unable to recover it. 00:27:22.117 [2024-07-15 09:06:10.548392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.548526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.548554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.117 qpair failed and we were unable to recover it. 00:27:22.117 [2024-07-15 09:06:10.548725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.548866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.548901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.117 qpair failed and we were unable to recover it. 00:27:22.117 [2024-07-15 09:06:10.549075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.549195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.549223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.117 qpair failed and we were unable to recover it. 00:27:22.117 [2024-07-15 09:06:10.549386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.549531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.549557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.117 qpair failed and we were unable to recover it. 00:27:22.117 [2024-07-15 09:06:10.549686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.549809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.549835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.117 qpair failed and we were unable to recover it. 00:27:22.117 [2024-07-15 09:06:10.549964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.550136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.550161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.117 qpair failed and we were unable to recover it. 00:27:22.117 [2024-07-15 09:06:10.550298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.550455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.550484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.117 qpair failed and we were unable to recover it. 00:27:22.117 [2024-07-15 09:06:10.550651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.550807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.550832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.117 qpair failed and we were unable to recover it. 00:27:22.117 [2024-07-15 09:06:10.550984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.551154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.551181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.117 qpair failed and we were unable to recover it. 00:27:22.117 [2024-07-15 09:06:10.551336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.551496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.551524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.117 qpair failed and we were unable to recover it. 00:27:22.117 [2024-07-15 09:06:10.551652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.551847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.551872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.117 qpair failed and we were unable to recover it. 00:27:22.117 [2024-07-15 09:06:10.552011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.552152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.552178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.117 qpair failed and we were unable to recover it. 00:27:22.117 [2024-07-15 09:06:10.552348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.552597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.552657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.117 qpair failed and we were unable to recover it. 00:27:22.117 [2024-07-15 09:06:10.552817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.552977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.553006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.117 qpair failed and we were unable to recover it. 00:27:22.117 [2024-07-15 09:06:10.553143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.553273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.553300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.117 qpair failed and we were unable to recover it. 00:27:22.117 [2024-07-15 09:06:10.553442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.553609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.553649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.117 qpair failed and we were unable to recover it. 00:27:22.117 [2024-07-15 09:06:10.553839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.553994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.554040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.117 qpair failed and we were unable to recover it. 00:27:22.117 [2024-07-15 09:06:10.554170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.554309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.554337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.117 qpair failed and we were unable to recover it. 00:27:22.117 [2024-07-15 09:06:10.554522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.554681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.554709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.117 qpair failed and we were unable to recover it. 00:27:22.117 [2024-07-15 09:06:10.554868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.555059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.555087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.117 qpair failed and we were unable to recover it. 00:27:22.117 [2024-07-15 09:06:10.555218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.555348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.555375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.117 qpair failed and we were unable to recover it. 00:27:22.117 [2024-07-15 09:06:10.555557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.555680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.555708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.117 qpair failed and we were unable to recover it. 00:27:22.117 [2024-07-15 09:06:10.555824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.555955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.555984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.117 qpair failed and we were unable to recover it. 00:27:22.117 [2024-07-15 09:06:10.556128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.556299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.556325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.117 qpair failed and we were unable to recover it. 00:27:22.117 [2024-07-15 09:06:10.556495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.556658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.556685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.117 qpair failed and we were unable to recover it. 00:27:22.117 [2024-07-15 09:06:10.556855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.557013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.557039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.117 qpair failed and we were unable to recover it. 00:27:22.117 [2024-07-15 09:06:10.557182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.557349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.117 [2024-07-15 09:06:10.557375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.117 qpair failed and we were unable to recover it. 00:27:22.118 [2024-07-15 09:06:10.557514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.557631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.557660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.118 qpair failed and we were unable to recover it. 00:27:22.118 [2024-07-15 09:06:10.557775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.557949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.557975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.118 qpair failed and we were unable to recover it. 00:27:22.118 [2024-07-15 09:06:10.558165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.558320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.558348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.118 qpair failed and we were unable to recover it. 00:27:22.118 [2024-07-15 09:06:10.558509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.558691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.558718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.118 qpair failed and we were unable to recover it. 00:27:22.118 [2024-07-15 09:06:10.558890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.559011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.559037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.118 qpair failed and we were unable to recover it. 00:27:22.118 [2024-07-15 09:06:10.559193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.559380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.559407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.118 qpair failed and we were unable to recover it. 00:27:22.118 [2024-07-15 09:06:10.559563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.559736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.559762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.118 qpair failed and we were unable to recover it. 00:27:22.118 [2024-07-15 09:06:10.559872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.560071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.560100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.118 qpair failed and we were unable to recover it. 00:27:22.118 [2024-07-15 09:06:10.560260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.560375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.560400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.118 qpair failed and we were unable to recover it. 00:27:22.118 [2024-07-15 09:06:10.560556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.560738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.560765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.118 qpair failed and we were unable to recover it. 00:27:22.118 [2024-07-15 09:06:10.560898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.561033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.561058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.118 qpair failed and we were unable to recover it. 00:27:22.118 [2024-07-15 09:06:10.561204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.561345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.561370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.118 qpair failed and we were unable to recover it. 00:27:22.118 [2024-07-15 09:06:10.561513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.561700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.561728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.118 qpair failed and we were unable to recover it. 00:27:22.118 [2024-07-15 09:06:10.561866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.562008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.562036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.118 qpair failed and we were unable to recover it. 00:27:22.118 [2024-07-15 09:06:10.562187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.562316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.562344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.118 qpair failed and we were unable to recover it. 00:27:22.118 [2024-07-15 09:06:10.562501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.562630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.562658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.118 qpair failed and we were unable to recover it. 00:27:22.118 [2024-07-15 09:06:10.562820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.562937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.562964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.118 qpair failed and we were unable to recover it. 00:27:22.118 [2024-07-15 09:06:10.563132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.563284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.563311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.118 qpair failed and we were unable to recover it. 00:27:22.118 [2024-07-15 09:06:10.563472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.563636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.563665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.118 qpair failed and we were unable to recover it. 00:27:22.118 [2024-07-15 09:06:10.563818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.563941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.563974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.118 qpair failed and we were unable to recover it. 00:27:22.118 [2024-07-15 09:06:10.564142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.564334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.564362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.118 qpair failed and we were unable to recover it. 00:27:22.118 [2024-07-15 09:06:10.564497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.564679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.564707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.118 qpair failed and we were unable to recover it. 00:27:22.118 [2024-07-15 09:06:10.564906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.565066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.565094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.118 qpair failed and we were unable to recover it. 00:27:22.118 [2024-07-15 09:06:10.565259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.565410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.565438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.118 qpair failed and we were unable to recover it. 00:27:22.118 [2024-07-15 09:06:10.565599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.565721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.565747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.118 qpair failed and we were unable to recover it. 00:27:22.118 [2024-07-15 09:06:10.565910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.566097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.566126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.118 qpair failed and we were unable to recover it. 00:27:22.118 [2024-07-15 09:06:10.566249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.566433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.566461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.118 qpair failed and we were unable to recover it. 00:27:22.118 [2024-07-15 09:06:10.566645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.566767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.566795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.118 qpair failed and we were unable to recover it. 00:27:22.118 [2024-07-15 09:06:10.566931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.567047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.567073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.118 qpair failed and we were unable to recover it. 00:27:22.118 [2024-07-15 09:06:10.567244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.567385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.567410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.118 qpair failed and we were unable to recover it. 00:27:22.118 [2024-07-15 09:06:10.567546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.118 [2024-07-15 09:06:10.567731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.567759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.119 qpair failed and we were unable to recover it. 00:27:22.119 [2024-07-15 09:06:10.567921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.568107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.568135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.119 qpair failed and we were unable to recover it. 00:27:22.119 [2024-07-15 09:06:10.568270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.568394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.568419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.119 qpair failed and we were unable to recover it. 00:27:22.119 [2024-07-15 09:06:10.568532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.568647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.568688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.119 qpair failed and we were unable to recover it. 00:27:22.119 [2024-07-15 09:06:10.568821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.568984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.569015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.119 qpair failed and we were unable to recover it. 00:27:22.119 [2024-07-15 09:06:10.569227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.569511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.569563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.119 qpair failed and we were unable to recover it. 00:27:22.119 [2024-07-15 09:06:10.569734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.569855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.569885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.119 qpair failed and we were unable to recover it. 00:27:22.119 [2024-07-15 09:06:10.570052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.570232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.570260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.119 qpair failed and we were unable to recover it. 00:27:22.119 [2024-07-15 09:06:10.570413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.570541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.570569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.119 qpair failed and we were unable to recover it. 00:27:22.119 [2024-07-15 09:06:10.570732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.570897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.570926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.119 qpair failed and we were unable to recover it. 00:27:22.119 [2024-07-15 09:06:10.571056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.571200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.571226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.119 qpair failed and we were unable to recover it. 00:27:22.119 [2024-07-15 09:06:10.571340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.571503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.571535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.119 qpair failed and we were unable to recover it. 00:27:22.119 [2024-07-15 09:06:10.571723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.571886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.571915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.119 qpair failed and we were unable to recover it. 00:27:22.119 [2024-07-15 09:06:10.572077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.572263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.572291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.119 qpair failed and we were unable to recover it. 00:27:22.119 [2024-07-15 09:06:10.572457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.572596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.572621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.119 qpair failed and we were unable to recover it. 00:27:22.119 [2024-07-15 09:06:10.572778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.572948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.572974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.119 qpair failed and we were unable to recover it. 00:27:22.119 [2024-07-15 09:06:10.573113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.573259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.573287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.119 qpair failed and we were unable to recover it. 00:27:22.119 [2024-07-15 09:06:10.573421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.573571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.573599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.119 qpair failed and we were unable to recover it. 00:27:22.119 [2024-07-15 09:06:10.573741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.573910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.573956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.119 qpair failed and we were unable to recover it. 00:27:22.119 [2024-07-15 09:06:10.574080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.574242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.574267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.119 qpair failed and we were unable to recover it. 00:27:22.119 [2024-07-15 09:06:10.574415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.574588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.574616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.119 qpair failed and we were unable to recover it. 00:27:22.119 [2024-07-15 09:06:10.574802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.574989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.575019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.119 qpair failed and we were unable to recover it. 00:27:22.119 [2024-07-15 09:06:10.575197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.575341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.575381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.119 qpair failed and we were unable to recover it. 00:27:22.119 [2024-07-15 09:06:10.575536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.575693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.575721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.119 qpair failed and we were unable to recover it. 00:27:22.119 [2024-07-15 09:06:10.575890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.576035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.576059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.119 qpair failed and we were unable to recover it. 00:27:22.119 [2024-07-15 09:06:10.576203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.576328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.576355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.119 qpair failed and we were unable to recover it. 00:27:22.119 [2024-07-15 09:06:10.576515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.576703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.576731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.119 qpair failed and we were unable to recover it. 00:27:22.119 [2024-07-15 09:06:10.576931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.577077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.577101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.119 qpair failed and we were unable to recover it. 00:27:22.119 [2024-07-15 09:06:10.577271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.577415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.577441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.119 qpair failed and we were unable to recover it. 00:27:22.119 [2024-07-15 09:06:10.577585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.577728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.577756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.119 qpair failed and we were unable to recover it. 00:27:22.119 [2024-07-15 09:06:10.577919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.578036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.119 [2024-07-15 09:06:10.578060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.120 qpair failed and we were unable to recover it. 00:27:22.120 [2024-07-15 09:06:10.578232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.578362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.578389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.120 qpair failed and we were unable to recover it. 00:27:22.120 [2024-07-15 09:06:10.578552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.578711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.578739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.120 qpair failed and we were unable to recover it. 00:27:22.120 [2024-07-15 09:06:10.578895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.579054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.579083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.120 qpair failed and we were unable to recover it. 00:27:22.120 [2024-07-15 09:06:10.579268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.579456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.579505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.120 qpair failed and we were unable to recover it. 00:27:22.120 [2024-07-15 09:06:10.579704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.579837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.579865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.120 qpair failed and we were unable to recover it. 00:27:22.120 [2024-07-15 09:06:10.580028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.580185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.580214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.120 qpair failed and we were unable to recover it. 00:27:22.120 [2024-07-15 09:06:10.580371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.580656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.580681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.120 qpair failed and we were unable to recover it. 00:27:22.120 [2024-07-15 09:06:10.580850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.580978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.581004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.120 qpair failed and we were unable to recover it. 00:27:22.120 [2024-07-15 09:06:10.581176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.581349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.581376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.120 qpair failed and we were unable to recover it. 00:27:22.120 [2024-07-15 09:06:10.581521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.581631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.581656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.120 qpair failed and we were unable to recover it. 00:27:22.120 [2024-07-15 09:06:10.581820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.581972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.582001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.120 qpair failed and we were unable to recover it. 00:27:22.120 [2024-07-15 09:06:10.582170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.582357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.582385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.120 qpair failed and we were unable to recover it. 00:27:22.120 [2024-07-15 09:06:10.582571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.582756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.582784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.120 qpair failed and we were unable to recover it. 00:27:22.120 [2024-07-15 09:06:10.582939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.583062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.583091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.120 qpair failed and we were unable to recover it. 00:27:22.120 [2024-07-15 09:06:10.583359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.583570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.583598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.120 qpair failed and we were unable to recover it. 00:27:22.120 [2024-07-15 09:06:10.583790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.583952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.583980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.120 qpair failed and we were unable to recover it. 00:27:22.120 [2024-07-15 09:06:10.584106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.584230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.584257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.120 qpair failed and we were unable to recover it. 00:27:22.120 [2024-07-15 09:06:10.584437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.584594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.584623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.120 qpair failed and we were unable to recover it. 00:27:22.120 [2024-07-15 09:06:10.584782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.584946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.584975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.120 qpair failed and we were unable to recover it. 00:27:22.120 [2024-07-15 09:06:10.585145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.585253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.585278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.120 qpair failed and we were unable to recover it. 00:27:22.120 [2024-07-15 09:06:10.585471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.585626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.585654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.120 qpair failed and we were unable to recover it. 00:27:22.120 [2024-07-15 09:06:10.585779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.585945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.585974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.120 qpair failed and we were unable to recover it. 00:27:22.120 [2024-07-15 09:06:10.586110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.586261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.586289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.120 qpair failed and we were unable to recover it. 00:27:22.120 [2024-07-15 09:06:10.586476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.586624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.586666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.120 qpair failed and we were unable to recover it. 00:27:22.120 [2024-07-15 09:06:10.586821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.587004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.587033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.120 qpair failed and we were unable to recover it. 00:27:22.120 [2024-07-15 09:06:10.587185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.587384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.120 [2024-07-15 09:06:10.587466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.121 qpair failed and we were unable to recover it. 00:27:22.121 [2024-07-15 09:06:10.587661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.587817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.587845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.121 qpair failed and we were unable to recover it. 00:27:22.121 [2024-07-15 09:06:10.587994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.588117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.588143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.121 qpair failed and we were unable to recover it. 00:27:22.121 [2024-07-15 09:06:10.588322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.588503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.588532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.121 qpair failed and we were unable to recover it. 00:27:22.121 [2024-07-15 09:06:10.588690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.588826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.588854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.121 qpair failed and we were unable to recover it. 00:27:22.121 [2024-07-15 09:06:10.589010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.589164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.589193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.121 qpair failed and we were unable to recover it. 00:27:22.121 [2024-07-15 09:06:10.589358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.589505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.589550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.121 qpair failed and we were unable to recover it. 00:27:22.121 [2024-07-15 09:06:10.589707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.589832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.589860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.121 qpair failed and we were unable to recover it. 00:27:22.121 [2024-07-15 09:06:10.590004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.590134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.590162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.121 qpair failed and we were unable to recover it. 00:27:22.121 [2024-07-15 09:06:10.590321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.590484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.590511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.121 qpair failed and we were unable to recover it. 00:27:22.121 [2024-07-15 09:06:10.590654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.590820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.590861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.121 qpair failed and we were unable to recover it. 00:27:22.121 [2024-07-15 09:06:10.591057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.591228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.591254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.121 qpair failed and we were unable to recover it. 00:27:22.121 [2024-07-15 09:06:10.591447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.591618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.591643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.121 qpair failed and we were unable to recover it. 00:27:22.121 [2024-07-15 09:06:10.591785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.591943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.591972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.121 qpair failed and we were unable to recover it. 00:27:22.121 [2024-07-15 09:06:10.592168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.592320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.592347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.121 qpair failed and we were unable to recover it. 00:27:22.121 [2024-07-15 09:06:10.592478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.592612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.592640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.121 qpair failed and we were unable to recover it. 00:27:22.121 [2024-07-15 09:06:10.592799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.592981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.593010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.121 qpair failed and we were unable to recover it. 00:27:22.121 [2024-07-15 09:06:10.593171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.593441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.593495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.121 qpair failed and we were unable to recover it. 00:27:22.121 [2024-07-15 09:06:10.593640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.593809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.593850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.121 qpair failed and we were unable to recover it. 00:27:22.121 [2024-07-15 09:06:10.594016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.594155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.594181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.121 qpair failed and we were unable to recover it. 00:27:22.121 [2024-07-15 09:06:10.594365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.594489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.594516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.121 qpair failed and we were unable to recover it. 00:27:22.121 [2024-07-15 09:06:10.594678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.594844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.594869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.121 qpair failed and we were unable to recover it. 00:27:22.121 [2024-07-15 09:06:10.595026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.595212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.595240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.121 qpair failed and we were unable to recover it. 00:27:22.121 [2024-07-15 09:06:10.595403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.595579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.595636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.121 qpair failed and we were unable to recover it. 00:27:22.121 [2024-07-15 09:06:10.595845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.596023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.596048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.121 qpair failed and we were unable to recover it. 00:27:22.121 [2024-07-15 09:06:10.596187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.596498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.596548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.121 qpair failed and we were unable to recover it. 00:27:22.121 [2024-07-15 09:06:10.596738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.596906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.596951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.121 qpair failed and we were unable to recover it. 00:27:22.121 [2024-07-15 09:06:10.597111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.597299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.597355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.121 qpair failed and we were unable to recover it. 00:27:22.121 [2024-07-15 09:06:10.597514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.597695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.597723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.121 qpair failed and we were unable to recover it. 00:27:22.121 [2024-07-15 09:06:10.597883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.598084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.598109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.121 qpair failed and we were unable to recover it. 00:27:22.121 [2024-07-15 09:06:10.598282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.121 [2024-07-15 09:06:10.598489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.598544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.122 qpair failed and we were unable to recover it. 00:27:22.122 [2024-07-15 09:06:10.598728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.598861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.598909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.122 qpair failed and we were unable to recover it. 00:27:22.122 [2024-07-15 09:06:10.599096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.599260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.599285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.122 qpair failed and we were unable to recover it. 00:27:22.122 [2024-07-15 09:06:10.599406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.599649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.599704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.122 qpair failed and we were unable to recover it. 00:27:22.122 [2024-07-15 09:06:10.599902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.600090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.600119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.122 qpair failed and we were unable to recover it. 00:27:22.122 [2024-07-15 09:06:10.600394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.600581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.600633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.122 qpair failed and we were unable to recover it. 00:27:22.122 [2024-07-15 09:06:10.600814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.600979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.601004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.122 qpair failed and we were unable to recover it. 00:27:22.122 [2024-07-15 09:06:10.601172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.601395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.601448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.122 qpair failed and we were unable to recover it. 00:27:22.122 [2024-07-15 09:06:10.601611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.601775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.601818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.122 qpair failed and we were unable to recover it. 00:27:22.122 [2024-07-15 09:06:10.601991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.602111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.602136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.122 qpair failed and we were unable to recover it. 00:27:22.122 [2024-07-15 09:06:10.602256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.602458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.602487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.122 qpair failed and we were unable to recover it. 00:27:22.122 [2024-07-15 09:06:10.602636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.602817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.602846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.122 qpair failed and we were unable to recover it. 00:27:22.122 [2024-07-15 09:06:10.603016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.603161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.603186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.122 qpair failed and we were unable to recover it. 00:27:22.122 [2024-07-15 09:06:10.603384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.603571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.603599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.122 qpair failed and we were unable to recover it. 00:27:22.122 [2024-07-15 09:06:10.603757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.603917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.603946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.122 qpair failed and we were unable to recover it. 00:27:22.122 [2024-07-15 09:06:10.604141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.604399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.604424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.122 qpair failed and we were unable to recover it. 00:27:22.122 [2024-07-15 09:06:10.604565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.604729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.604754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.122 qpair failed and we were unable to recover it. 00:27:22.122 [2024-07-15 09:06:10.604919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.605082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.605111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.122 qpair failed and we were unable to recover it. 00:27:22.122 [2024-07-15 09:06:10.605299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.605418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.605446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.122 qpair failed and we were unable to recover it. 00:27:22.122 [2024-07-15 09:06:10.605604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.605761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.605789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.122 qpair failed and we were unable to recover it. 00:27:22.122 [2024-07-15 09:06:10.605956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.606105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.606147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.122 qpair failed and we were unable to recover it. 00:27:22.122 [2024-07-15 09:06:10.606330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.606511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.606538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.122 qpair failed and we were unable to recover it. 00:27:22.122 [2024-07-15 09:06:10.606696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.606841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.606869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.122 qpair failed and we were unable to recover it. 00:27:22.122 [2024-07-15 09:06:10.607047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.607286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.607313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.122 qpair failed and we were unable to recover it. 00:27:22.122 [2024-07-15 09:06:10.607504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.607666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.607694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.122 qpair failed and we were unable to recover it. 00:27:22.122 [2024-07-15 09:06:10.607825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.607996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.608022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.122 qpair failed and we were unable to recover it. 00:27:22.122 [2024-07-15 09:06:10.608169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.608347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.608373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.122 qpair failed and we were unable to recover it. 00:27:22.122 [2024-07-15 09:06:10.608522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.608716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.608748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.122 qpair failed and we were unable to recover it. 00:27:22.122 [2024-07-15 09:06:10.608976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.609122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.609164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.122 qpair failed and we were unable to recover it. 00:27:22.122 [2024-07-15 09:06:10.609324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.609479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.609507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.122 qpair failed and we were unable to recover it. 00:27:22.122 [2024-07-15 09:06:10.609664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.609822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.122 [2024-07-15 09:06:10.609849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.122 qpair failed and we were unable to recover it. 00:27:22.122 [2024-07-15 09:06:10.610015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.610146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.610174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.123 qpair failed and we were unable to recover it. 00:27:22.123 [2024-07-15 09:06:10.610339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.610506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.610552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.123 qpair failed and we were unable to recover it. 00:27:22.123 [2024-07-15 09:06:10.610746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.610905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.610934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.123 qpair failed and we were unable to recover it. 00:27:22.123 [2024-07-15 09:06:10.611076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.611257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.611299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.123 qpair failed and we were unable to recover it. 00:27:22.123 [2024-07-15 09:06:10.611563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.611740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.611768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.123 qpair failed and we were unable to recover it. 00:27:22.123 [2024-07-15 09:06:10.611931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.612079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.612120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.123 qpair failed and we were unable to recover it. 00:27:22.123 [2024-07-15 09:06:10.612302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.612480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.612524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.123 qpair failed and we were unable to recover it. 00:27:22.123 [2024-07-15 09:06:10.612669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.612828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.612855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.123 qpair failed and we were unable to recover it. 00:27:22.123 [2024-07-15 09:06:10.613046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.613206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.613235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.123 qpair failed and we were unable to recover it. 00:27:22.123 [2024-07-15 09:06:10.613401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.613546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.613570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.123 qpair failed and we were unable to recover it. 00:27:22.123 [2024-07-15 09:06:10.613715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.613885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.613913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.123 qpair failed and we were unable to recover it. 00:27:22.123 [2024-07-15 09:06:10.614047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.614226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.614254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.123 qpair failed and we were unable to recover it. 00:27:22.123 [2024-07-15 09:06:10.614551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.614703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.614732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.123 qpair failed and we were unable to recover it. 00:27:22.123 [2024-07-15 09:06:10.614870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.615027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.615053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.123 qpair failed and we were unable to recover it. 00:27:22.123 [2024-07-15 09:06:10.615262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.615431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.615456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.123 qpair failed and we were unable to recover it. 00:27:22.123 [2024-07-15 09:06:10.615624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.615755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.615783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.123 qpair failed and we were unable to recover it. 00:27:22.123 [2024-07-15 09:06:10.615918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.616049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.616077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.123 qpair failed and we were unable to recover it. 00:27:22.123 [2024-07-15 09:06:10.616273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.616394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.616435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.123 qpair failed and we were unable to recover it. 00:27:22.123 [2024-07-15 09:06:10.616595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.616737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.616761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.123 qpair failed and we were unable to recover it. 00:27:22.123 [2024-07-15 09:06:10.616907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.617023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.617048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.123 qpair failed and we were unable to recover it. 00:27:22.123 [2024-07-15 09:06:10.617204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.617387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.617416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.123 qpair failed and we were unable to recover it. 00:27:22.123 [2024-07-15 09:06:10.617602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.617744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.617784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.123 qpair failed and we were unable to recover it. 00:27:22.123 [2024-07-15 09:06:10.617924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.618051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.618078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.123 qpair failed and we were unable to recover it. 00:27:22.123 [2024-07-15 09:06:10.618239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.618398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.618427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.123 qpair failed and we were unable to recover it. 00:27:22.123 [2024-07-15 09:06:10.618587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.618706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.618733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.123 qpair failed and we were unable to recover it. 00:27:22.123 [2024-07-15 09:06:10.618900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.619048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.619073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.123 qpair failed and we were unable to recover it. 00:27:22.123 [2024-07-15 09:06:10.619251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.619432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.619461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.123 qpair failed and we were unable to recover it. 00:27:22.123 [2024-07-15 09:06:10.619638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.619788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.619816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.123 qpair failed and we were unable to recover it. 00:27:22.123 [2024-07-15 09:06:10.619950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.620118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.123 [2024-07-15 09:06:10.620147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.408 qpair failed and we were unable to recover it. 00:27:22.408 [2024-07-15 09:06:10.620310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.408 [2024-07-15 09:06:10.620459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.408 [2024-07-15 09:06:10.620484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.408 qpair failed and we were unable to recover it. 00:27:22.408 [2024-07-15 09:06:10.620653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.408 [2024-07-15 09:06:10.620793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.408 [2024-07-15 09:06:10.620819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.408 qpair failed and we were unable to recover it. 00:27:22.408 [2024-07-15 09:06:10.620940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.408 [2024-07-15 09:06:10.621062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.408 [2024-07-15 09:06:10.621087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.408 qpair failed and we were unable to recover it. 00:27:22.408 [2024-07-15 09:06:10.621347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.408 [2024-07-15 09:06:10.621616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.621644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.409 qpair failed and we were unable to recover it. 00:27:22.409 [2024-07-15 09:06:10.621807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.621951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.621977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.409 qpair failed and we were unable to recover it. 00:27:22.409 [2024-07-15 09:06:10.622118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.622273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.622302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.409 qpair failed and we were unable to recover it. 00:27:22.409 [2024-07-15 09:06:10.622434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.622565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.622592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.409 qpair failed and we were unable to recover it. 00:27:22.409 [2024-07-15 09:06:10.622748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.622904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.622932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.409 qpair failed and we were unable to recover it. 00:27:22.409 [2024-07-15 09:06:10.623090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.623240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.623270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.409 qpair failed and we were unable to recover it. 00:27:22.409 [2024-07-15 09:06:10.623459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.623619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.623647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.409 qpair failed and we were unable to recover it. 00:27:22.409 [2024-07-15 09:06:10.623780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.623940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.623969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.409 qpair failed and we were unable to recover it. 00:27:22.409 [2024-07-15 09:06:10.624150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.624309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.624337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.409 qpair failed and we were unable to recover it. 00:27:22.409 [2024-07-15 09:06:10.624496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.624617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.624641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.409 qpair failed and we were unable to recover it. 00:27:22.409 [2024-07-15 09:06:10.624813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.624997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.625025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.409 qpair failed and we were unable to recover it. 00:27:22.409 [2024-07-15 09:06:10.625211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.625568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.625629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.409 qpair failed and we were unable to recover it. 00:27:22.409 [2024-07-15 09:06:10.625814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.626078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.626104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.409 qpair failed and we were unable to recover it. 00:27:22.409 [2024-07-15 09:06:10.626218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.626358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.626383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.409 qpair failed and we were unable to recover it. 00:27:22.409 [2024-07-15 09:06:10.626551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.626733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.626761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.409 qpair failed and we were unable to recover it. 00:27:22.409 [2024-07-15 09:06:10.626919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.627057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.627083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.409 qpair failed and we were unable to recover it. 00:27:22.409 [2024-07-15 09:06:10.627243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.627420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.627445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.409 qpair failed and we were unable to recover it. 00:27:22.409 [2024-07-15 09:06:10.627581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.627725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.627766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.409 qpair failed and we were unable to recover it. 00:27:22.409 [2024-07-15 09:06:10.627942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.628127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.628156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.409 qpair failed and we were unable to recover it. 00:27:22.409 [2024-07-15 09:06:10.628345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.628468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.628497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.409 qpair failed and we were unable to recover it. 00:27:22.409 [2024-07-15 09:06:10.628663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.628794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.628821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.409 qpair failed and we were unable to recover it. 00:27:22.409 [2024-07-15 09:06:10.628990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.629139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.629163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.409 qpair failed and we were unable to recover it. 00:27:22.409 [2024-07-15 09:06:10.629339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.629524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.629552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.409 qpair failed and we were unable to recover it. 00:27:22.409 [2024-07-15 09:06:10.629685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.629834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.629862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.409 qpair failed and we were unable to recover it. 00:27:22.409 [2024-07-15 09:06:10.630005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.630161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.630189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.409 qpair failed and we were unable to recover it. 00:27:22.409 [2024-07-15 09:06:10.630384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.630568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.630622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.409 qpair failed and we were unable to recover it. 00:27:22.409 [2024-07-15 09:06:10.630784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.630950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.630979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.409 qpair failed and we were unable to recover it. 00:27:22.409 [2024-07-15 09:06:10.631136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.631300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.631326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.409 qpair failed and we were unable to recover it. 00:27:22.409 [2024-07-15 09:06:10.631441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.631612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.631640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.409 qpair failed and we were unable to recover it. 00:27:22.409 [2024-07-15 09:06:10.631780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.631953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.631980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.409 qpair failed and we were unable to recover it. 00:27:22.409 [2024-07-15 09:06:10.632150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.632342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.632367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.409 qpair failed and we were unable to recover it. 00:27:22.409 [2024-07-15 09:06:10.632512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.632686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.632713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.409 qpair failed and we were unable to recover it. 00:27:22.409 [2024-07-15 09:06:10.632865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.633029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.633057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.409 qpair failed and we were unable to recover it. 00:27:22.409 [2024-07-15 09:06:10.633250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.633421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.633484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.409 qpair failed and we were unable to recover it. 00:27:22.409 [2024-07-15 09:06:10.633668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.633822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.633851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.409 qpair failed and we were unable to recover it. 00:27:22.409 [2024-07-15 09:06:10.633985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.634145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.634173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.409 qpair failed and we were unable to recover it. 00:27:22.409 [2024-07-15 09:06:10.634462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.634726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.634755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.409 qpair failed and we were unable to recover it. 00:27:22.409 [2024-07-15 09:06:10.634948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.635148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.635177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.409 qpair failed and we were unable to recover it. 00:27:22.409 [2024-07-15 09:06:10.635360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.635516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.635545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.409 qpair failed and we were unable to recover it. 00:27:22.409 [2024-07-15 09:06:10.635700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.635860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.635897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.409 qpair failed and we were unable to recover it. 00:27:22.409 [2024-07-15 09:06:10.636066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.636231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.636273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.409 qpair failed and we were unable to recover it. 00:27:22.409 [2024-07-15 09:06:10.636435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.409 [2024-07-15 09:06:10.636546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.636571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.636799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.636979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.637005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.637150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.637289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.637333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.637550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.637755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.637784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.637991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.638133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.638159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.638353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.638612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.638665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.638854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.639015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.639041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.639229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.639428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.639485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.639645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.639803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.639830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.640028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.640189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.640217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.640384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.640529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.640570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.640753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.640918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.640960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.641084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.641225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.641251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.641543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.641725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.641754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.641952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.642105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.642130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.642292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.642463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.642493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.642666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.642835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.642863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.643026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.643215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.643262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.643452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.643634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.643661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.643841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.644017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.644043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.644208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.644361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.644389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.644634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.644817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.644846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.645023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.645169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.645211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.645343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.645540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.645592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.645745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.645905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.645949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.646098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.647205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.647240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.647416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.647537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.647562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.647713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.647890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.647918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.648061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.648231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.648258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.648432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.648556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.648583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.648743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.648888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.648926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.649099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.649230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.649257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.649413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.649538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.649566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.649710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.649866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.649908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.650076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.650260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.650288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.650442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.650651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.650704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.650870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.651020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.651044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.651211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.651413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.651460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.651625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.651768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.651794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.651989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.652138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.652163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.652330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.652483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.652512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.652667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.652823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.652852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.653004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.653126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.653152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.653410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.653597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.653647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.653778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.653975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.654002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.654126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.654270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.654295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.654568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.654769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.654798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.654953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.655116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.655142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.655334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.655518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.655546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.655676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.655832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.655860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.656000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.656172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.656197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.656346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.656480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.410 [2024-07-15 09:06:10.656508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.410 qpair failed and we were unable to recover it. 00:27:22.410 [2024-07-15 09:06:10.656628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.656794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.656823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.656990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.657143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.657181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.657348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.657527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.657557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.657747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.657930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.657959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.658110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.658251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.658279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.658558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.658737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.658765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.658940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.659066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.659092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.659220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.659400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.659429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.659564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.659718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.659745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.659934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.660094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.660123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.660291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.660458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.660483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.660625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.660780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.660815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.661014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.661149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.661190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.661444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.661659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.661699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.661873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.661993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.662023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.662174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.662294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.662322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.662455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.662600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.662627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.662811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.662972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.663001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.663150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.663312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.663366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.663555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.663714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.663742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.663891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.664040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.664066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.664213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.664392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.664419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.664610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.664780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.664811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.664966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.665095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.665120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.665278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.665421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.665446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.665627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.665782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.665812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.665973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.666117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.666142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.666318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.666485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.666513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.666698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.666873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.666932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.667057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.667238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.667266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.667458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.667600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.667641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.667789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.667923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.667953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.668121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.668298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.668324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.668572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.668728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.668757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.668936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.669124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.669153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.669346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.669479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.669507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.669628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.669804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.669830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.669983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.670103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.670128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.670262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.670409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.670460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.670602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.670754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.670783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.670921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.671118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.671143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.671270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.671412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.671437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.671586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.671696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.671722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.671884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.672009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.672037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.411 [2024-07-15 09:06:10.672179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.672365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.411 [2024-07-15 09:06:10.672393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.411 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.672525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.672692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.672720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.672910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.673057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.673083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.673268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.673413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.673440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.673601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.673733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.673763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.673903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.674039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.674067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.674240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.674422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.674450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.674583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.674717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.674744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.674906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.675067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.675095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.675325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.675456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.675483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.675678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.675803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.675828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.675997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.676119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.676148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.676320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.676473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.676500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.676683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.676827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.676853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.677000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.677148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.677174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.677341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.677499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.677524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.677690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.677886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.677916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.678049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.678184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.678213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.678382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.678613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.678658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.678872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.679017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.679042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.679188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.679331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.679360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.679522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.679693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.679719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.679862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.680012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.680037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.680185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.680335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.680377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.680535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.680655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.680683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.680823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.681006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.681032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.681168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.681325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.681353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.681532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.681690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.681718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.681873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.682015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.682043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.682206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.682329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.682355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.682517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.682683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.682710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.682845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.682976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.683001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.683143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.683315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.683343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.683539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.683682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.683707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.683870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.684043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.684068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.684215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.684325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.684351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.684555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.684765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.684792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.684953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.685107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.685133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.685322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.685466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.685511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.685674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.685783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.685808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.685980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.686102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.686128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.686274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.686395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.686421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.686609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.686735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.686762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.686935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.687049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.687074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.687181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.687337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.687365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.687537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.687668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.687694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.687888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.688058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.688084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.688301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.688467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.688494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.688628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.688777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.688801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.688977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.689120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.689145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.689301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.689501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.689526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.689646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.689765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.689789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.689940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.690062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.690087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.412 qpair failed and we were unable to recover it. 00:27:22.412 [2024-07-15 09:06:10.690252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.412 [2024-07-15 09:06:10.690430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.690457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.690617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.690757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.690784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.690967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.691089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.691113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.691270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.691404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.691446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.691585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.691715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.691742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.691902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.692070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.692095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.692262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.692460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.692507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.692675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.692821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.692846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.693047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.693161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.693213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.693379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.693533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.693565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.693739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.693903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.693952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.694075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.694200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.694225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.694378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.694540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.694568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.694719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.694882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.694911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.695049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.695156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.695202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.695364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.695532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.695556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.695750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.695895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.695921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.696093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.696220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.696245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.696376] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x53b4b0 is same with the state(5) to be set 00:27:22.413 [2024-07-15 09:06:10.696660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.697216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.697250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.697444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.697661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.697709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.697890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.698016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.698042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.698166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.698342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.698376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.698572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.698707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.698734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.698901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.699110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.699158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.699327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.699535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.699579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.699726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.699870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.699903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.700026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.700175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.700205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.700437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.700627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.700674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.700815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.700956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.700983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.701145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.701356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.701404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.701574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.701758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.701784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.701938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.702102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.702150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.702326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.702547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.702596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.702745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.702863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.702897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.703049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.703255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.703299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.703468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.703614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.703641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.703769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.703887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.703914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.704034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.704182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.704207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.704370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.704517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.704543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.704666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.704790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.704820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.704960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.705087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.705113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.705235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.705384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.705410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.705586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.705723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.705748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.705900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.706064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.706091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.706262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.706420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.706463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.706607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.706733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.706760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.706925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.707092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.707137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.707268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.707422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.707448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.707616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.707761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.707786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.707963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.708124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.708158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.708301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.708448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.708473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.708590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.708706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.708732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.708859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.708992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.709018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.709144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.709283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.413 [2024-07-15 09:06:10.709309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.413 qpair failed and we were unable to recover it. 00:27:22.413 [2024-07-15 09:06:10.709450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.709565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.709592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.709734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.709901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.709945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.710093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.710254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.710283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.710481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.710630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.710656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.710809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.710981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.711030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.711209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.711467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.711516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.711695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.711840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.711866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.712020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.712189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.712234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.712404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.712539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.712564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.712706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.712848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.712874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.712998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.713115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.713141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.713281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.713422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.713448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.713572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.713705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.713733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.713882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.714004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.714030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.714147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.714292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.714317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.714456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.714598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.714624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.714755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.714867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.714899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.715018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.715128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.715154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.715274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.715420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.715446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.715570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.715717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.715742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.715865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.715997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.716023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.716136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.716282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.716308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.716473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.716595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.716622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.716778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.716890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.716916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.717040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.717155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.717180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.717307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.717418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.717444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.717592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.717736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.717761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.717885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.718025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.718051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.718203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.718350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.718375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.718520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.718640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.718666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.718836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.718993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.719039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.719173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.719354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.719398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.719544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.719718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.719743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.719892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.720035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.720080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.720248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.720410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.720438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.720608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.720754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.720779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.720955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.721117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.721163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.721319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.721462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.721488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.721609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.721754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.721779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.721933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.722059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.722085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.722204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.722348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.722375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.722523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.722643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.722670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.722794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.722917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.722944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.723063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.723181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.723207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.723333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.723473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.723499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.723643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.723816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.723841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.723969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.724084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.724109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.724228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.724395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.724421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.414 [2024-07-15 09:06:10.724568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.724684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.414 [2024-07-15 09:06:10.724710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.414 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.724872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.725023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.725069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.725208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.725364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.725408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.725605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.725765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.725791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.725936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.726063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.726089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.726233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.726377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.726403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.726515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.726632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.726658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.726776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.726888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.726915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.727049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.727239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.727284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.727465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.727613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.727640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.727811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.727960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.728006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.728168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.728313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.728341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.728553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.728687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.728713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.728903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.729049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.729093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.729235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.729356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.729381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.729520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.729694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.729720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.729863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.729982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.730008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.730139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.730278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.730321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.730465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.730606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.730632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.730745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.730890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.730917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.731052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.731230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.731273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.731463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.731654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.731679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.731786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.731934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.731964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.732141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.732324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.732367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.732478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.732599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.732627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.732739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.732887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.732914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.733053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.733241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.733285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.733454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.733599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.733625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.733772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.733901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.733927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.734067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.734240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.734269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.734480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.734632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.734657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.734830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.734973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.735018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.735152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.735338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.735382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.735543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.735697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.735722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.735845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.735998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.736043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.736179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.736337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.736379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.736520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.736667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.736695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.736811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.736955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.736999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.737147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.737334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.737377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.737526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.737672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.737697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.737846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.738007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.738053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.738200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.738377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.738419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.738615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.738777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.738803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.738971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.739129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.739158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.739340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.739522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.739550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.739718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.739864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.739896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.740029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.740222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.740265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.740463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.740618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.740662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.740807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.740970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.741014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.741173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.741358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.741402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.741604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.741773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.741799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.741968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.742149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.742192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.742378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.742601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.742644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.742788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.742982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.743027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.743164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.743320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.743346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.743495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.743640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.415 [2024-07-15 09:06:10.743666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.415 qpair failed and we were unable to recover it. 00:27:22.415 [2024-07-15 09:06:10.743786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.743931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.743957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.744095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.744217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.744243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.744391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.744575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.744600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.744744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.744891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.744917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.745059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.745247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.745295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.745426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.745594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.745622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.745744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.745867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.745898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.746053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.746209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.746252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.746399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.746512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.746537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.746691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.746812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.746838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.746997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.747111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.747137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.747305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.747482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.747508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.747652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.747805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.747830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.747955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.748072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.748097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.748217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.748358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.748383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.748529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.748651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.748677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.748848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.748971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.748998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.749122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.749265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.749291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.749439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.749584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.749610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.749765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.749887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.749913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.750059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.750245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.750288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.750428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.750594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.750621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.750734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.750889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.750935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.751095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.751262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.751304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.751471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.751619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.751645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.751820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.751983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.752027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.752169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.752348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.752391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.752578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.752737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.752763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.752927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.753093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.753138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.753301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.753487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.753532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.753651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.753771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.753796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.753920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.754063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.754108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.754280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.754499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.754548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.754667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.754808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.754837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.754999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.755162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.755190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.755410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.755636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.755684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.755842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.756021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.756066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.756220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.756383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.756427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.756622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.756810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.756837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.756988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.757145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.757188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.757330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.757570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.757614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.757743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.757902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.757950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.758080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.758219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.758254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.758433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.758675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.758722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.758890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.759004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.759030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.759146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.759356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.759383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.759517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.759776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.759822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.759981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.760105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.760129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.760273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.760481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.760526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.760690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.760847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.416 [2024-07-15 09:06:10.760874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.416 qpair failed and we were unable to recover it. 00:27:22.416 [2024-07-15 09:06:10.761031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.761157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.761191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.761301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.761456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.761483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.761665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.761834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.761862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.762027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.762151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.762177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.762325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.762523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.762550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.762702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.762886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.762924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.763050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.763170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.763197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.763361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.763578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.763626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.763794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.763971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.763997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.764118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.764313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.764346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.764534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.764751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.764779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.764977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.765092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.765117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.765260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.765434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.765479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.765666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.765858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.765892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.766025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.766186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.766213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.766508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.766664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.766723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.766930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.767074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.767100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.767238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.767396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.767425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.767657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.767785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.767813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.767977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.768096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.768122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.768335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.768507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.768553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.768806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.768983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.769009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.769132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.769313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.769340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.769507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.769707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.769735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.769881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.770004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.770030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.770148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.770324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.770352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.770502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.770653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.770681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.770809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.770928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.770955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.771065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.771198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.771226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.771423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.771557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.771586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.771768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.771901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.771943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.772091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.772244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.772272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.772397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.772513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.772541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.772727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.772938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.772964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.773111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.773302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.773330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.773513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.773655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.773680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.773826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.773943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.773969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.774158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.774330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.774371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.774501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.774700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.774725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.774847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.774976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.775003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.775167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.775332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.775358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.775506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.775664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.775692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.775832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.776006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.776057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.776210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.776371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.776404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.776570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.776722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.776750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.776920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.777064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.777090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.777235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.777429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.777476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.777637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.777794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.777823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.777998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.778135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.778160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.778339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.778537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.778570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.778782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.779004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.779032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.779213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.779337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.779363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.779487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.779724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.779752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.779925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.780064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.780090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.780242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.780413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.780441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.780596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.780731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.780760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.780923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.781048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.417 [2024-07-15 09:06:10.781077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.417 qpair failed and we were unable to recover it. 00:27:22.417 [2024-07-15 09:06:10.781245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.781388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.781430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.781582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.781775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.781801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.781958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.782110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.782139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.782277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.782450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.782491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.782652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.782820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.782849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.782992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.783101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.783127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.783308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.783480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.783524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.783691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.783883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.783912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.784074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.784235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.784263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.784402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.784557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.784583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.784784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.784946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.784972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.785113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.785224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.785250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.785370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.785483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.785508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.785694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.785851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.785884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.786013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.786201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.786229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.786394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.786534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.786560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.786738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.786890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.786922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.787086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.787295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.787340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.787495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.787636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.787661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.787866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.788006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.788035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.788225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.788372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.788397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.788519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.788770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.788797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.788914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.789102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.789130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.789298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.789438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.789464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.789631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.789821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.789850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.790001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.790128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.790153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.790380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.790614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.790642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.790806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.790953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.791000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.791124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.791285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.791313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.791458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.791606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.791634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.791813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.792041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.792069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.792254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.792471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.792520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.792656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.792789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.792816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.792979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.793124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.793150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.793352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.793519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.793561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.793714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.793874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.793907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.794097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.794259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.794287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.794441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.794624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.794652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.794826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.794946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.794973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.795090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.795233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.795258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.795506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.795716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.795743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.795868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.796024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.796050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.796200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.796427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.796455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.796606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.796730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.796757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.796990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.797124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.797152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.797300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.797473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.797498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.797668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.797828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.797856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.798013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.798185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.798224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.798420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.798590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.798631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.798767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.798999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.799029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.799193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.799369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.799402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.799579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.799741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.799768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.799937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.800144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.800169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.800315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.800451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.418 [2024-07-15 09:06:10.800480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.418 qpair failed and we were unable to recover it. 00:27:22.418 [2024-07-15 09:06:10.800636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.800775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.800800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.801001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.801131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.801159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.801347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.801532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.801560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.801725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.801873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.801903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.802092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.802251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.802279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.802438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.802604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.802637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.802803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.802952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.802979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.803124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.803300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.803332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.803520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.803660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.803685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.803917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.804089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.804117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.804298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.804483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.804511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.804680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.804843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.804871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.805007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.805121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.805146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.805355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.805510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.805535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.805706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.805866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.805910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.806047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.806183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.806208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.806377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.806532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.806561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.806742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.806905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.806932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.807103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.807265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.807315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.807522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.807685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.807724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.807852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.808007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.808036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.808173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.808323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.808349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.808509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.808664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.808692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.808881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.809003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.809031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.809176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.809301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.809333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.809513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.809705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.809730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.809872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.810045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.810073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.810242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.810431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.810459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.810612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.810810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.810836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.810965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.811103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.811131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.811275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.811403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.811428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.811619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.811793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.811818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.811967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.812115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.812143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.812278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.812419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.812444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.812647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.812829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.812857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.813037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.813204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.813230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.813374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.813562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.813590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.813784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.813898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.813925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.814122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.814279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.814307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.814472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.814623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.814648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.814767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.814933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.814966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.815089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.815259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.815284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.815456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.815570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.815611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.815797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.815964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.815990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.816120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.816284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.816312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.816448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.816597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.816622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.816745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.816854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.816903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.817072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.817223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.817251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.817397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.817535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.817560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.817753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.817907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.817935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.818067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.818198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.818226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.818394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.818511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.818537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.818694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.818818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.818847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.819018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.819199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.819228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.819417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.819571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.819600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.819748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.819889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.819919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.820082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.820238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.820267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.820437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.820555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.820580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.820722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.820909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.419 [2024-07-15 09:06:10.820938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.419 qpair failed and we were unable to recover it. 00:27:22.419 [2024-07-15 09:06:10.821076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.821248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.821273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.821450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.821646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.821674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.821857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.822014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.822042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.822201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.822354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.822382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.822523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.822693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.822735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.822898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.823020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.823048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.823205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.823354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.823382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.823520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.823655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.823680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.823843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.824016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.824045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.824202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.824383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.824411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.824605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.824768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.824795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.824957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.825113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.825141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.825300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.825458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.825486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.825712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.825872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.825908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.826035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.826168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.826196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.826328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.826480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.826508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.826682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.826830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.826859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.827101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.827298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.827326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.827461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.827626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.827654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.827817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.827974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.828017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.828175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.828374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.828399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.828566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.828728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.828756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.828922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.829039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.829065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.829237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.829402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.829435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.829692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.829861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.829898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.830071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.830244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.830290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.830481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.830623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.830649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.830888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.831060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.831086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.831236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.831357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.831398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.831562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.831792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.831821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.831989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.832149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.832181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.832348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.832497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.832522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.832667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.832836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.832875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.833047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.833192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.833217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.833359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.833478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.833503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.833646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.833798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.833826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.834033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.834203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.834243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.834417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.834604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.834633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.834818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.834981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.835011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.835195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.835374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.835419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.835582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.835728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.835753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.835873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.836051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.836080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.836274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.836452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.836497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.836657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.836829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.836887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.837015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.837209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.837237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.837425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.837594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.837639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.837805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.837943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.837969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.838083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.838244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.838272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.838433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.838578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.838603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.838770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.838966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.838996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.839196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.839343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.839384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.839558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.839700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.839725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.839872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.840016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.840058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.840249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.840405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.840432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.840597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.840741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.840765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.840918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.841058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.841082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.841239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.841406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.841439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.841616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.841762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.841793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.841951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.842122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.842164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.420 qpair failed and we were unable to recover it. 00:27:22.420 [2024-07-15 09:06:10.842323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.420 [2024-07-15 09:06:10.842479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.842507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.842689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.842845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.842873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.843047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.843156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.843181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.843349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.843507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.843535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.843668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.843829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.843857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.844051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.844171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.844196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.844342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.844493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.844521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.844651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.844834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.844862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.845041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.845184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.845209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.845396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.845547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.845575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.845766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.845924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.845953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.846160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.846274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.846314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.846474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.846643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.846668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.846815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.846964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.846991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.847116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.847263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.847304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.847490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.847647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.847675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.847854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.848024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.848053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.848243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.848406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.848433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.848593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.848727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.848755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.848893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.849053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.849081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.849222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.849365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.849391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.849532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.849659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.849687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.849839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.850002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.850031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.850242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.850434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.850462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.850618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.850787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.850812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.850935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.851081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.851106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.851277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.851442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.851470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.851629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.851803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.851829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.851974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.852170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.852198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.852346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.852488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.852512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.852656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.852801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.852844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.853013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.853245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.853296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.853457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.853598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.853640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.853844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.853970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.853995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.854142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.854308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.854332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.854470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.854588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.854613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.854761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.854959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.854987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.855135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.855289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.855316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.855480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.855589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.855614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.855785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.855965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.855994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.856198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.856342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.856367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.856533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.856645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.856686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.856869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.857045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.857073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.857262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.857475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.857527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.857696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.857814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.857838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.858041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.858218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.858261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.858445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.858622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.858686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.858827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.858967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.858994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.859170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.859328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.859356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.859541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.859671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.859703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.859838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.859973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.859999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.860200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.860338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.860364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.860497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.860686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.860715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.860890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.861059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.861085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.861223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.861396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.421 [2024-07-15 09:06:10.861421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.421 qpair failed and we were unable to recover it. 00:27:22.421 [2024-07-15 09:06:10.861593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.861753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.861780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.861917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.862032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.862056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.862226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.862365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.862393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.862526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.862676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.862704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.862885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.863010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.863036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.863245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.863430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.863458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.863618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.863775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.863804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.863996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.864152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.864179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.864360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.864553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.864609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.864770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.864929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.864955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.865079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.865244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.865270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.865470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.865624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.865651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.865778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.865937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.865965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.866132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.866270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.866296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.866430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.866578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.866605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.866797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.866922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.866951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.867143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.867342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.867387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.867517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.867670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.867698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.867859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.867997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.868026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.868165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.868333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.868358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.868530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.868685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.868713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.868873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.869031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.869059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.869246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.869411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.869478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.869640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.869798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.869842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.869991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.870161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.870186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.870298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.870447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.870472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.870641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.870792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.870820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.870963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.871142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.871184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.871348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.871490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.871531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.871667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.871845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.871873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.872006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.872153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.872181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.872384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.872572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.872625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.872752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.872937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.872966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.873098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.873263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.873291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.873476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.873618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.873644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.873769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.873942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.873968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.874095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.874250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.874277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.874419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.874575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.874600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.874795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.874966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.874996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.875180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.875339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.875398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.875588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.875775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.875804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.875989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.876147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.876175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.876307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.876456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.876484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.876673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.876788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.876813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.876929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.877058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.877085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.877238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.877410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.877439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.877560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.877708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.877733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.877942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.878137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.878162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.878326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.878472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.878500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.878662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.878800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.878825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.879045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.879214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.879243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.879364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.879524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.879564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.879699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.879849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.879874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.880024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.880185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.880213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.880374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.880503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.880532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.880659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.880814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.880839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.881026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.881141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.881167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.881372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.881521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.881548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.881692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.881854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.881888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.422 qpair failed and we were unable to recover it. 00:27:22.422 [2024-07-15 09:06:10.882021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.422 [2024-07-15 09:06:10.882203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.882231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.882421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.882587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.882613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.882760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.882886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.882915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.883092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.883260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.883288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.883470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.883640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.883672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.883822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.883993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.884018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.884222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.884369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.884394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.884594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.884752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.884779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.884934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.885052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.885078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.885245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.885420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.885445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.885591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.885774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.885801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.885962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.886101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.886141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.886300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.886485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.886510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.886694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.886829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.886856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.887011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.887159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.887184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.887309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.887444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.887472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.887649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.887822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.887850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.888053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.888170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.888213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.888398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.888521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.888549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.888688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.888818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.888846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.889046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.889166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.889208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.889371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.889499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.889527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.889710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.889868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.889902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.890072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.890254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.890323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.890472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.890629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.890657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.890834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.891024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.891054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.891220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.891367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.891407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.891539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.891698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.891729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.891907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.892071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.892099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.892305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.892495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.892585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.892773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.892933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.892960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.893155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.893421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.893475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.893644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.893812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.893838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.894050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.894259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.894337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.894505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.894630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.894658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.894814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.895007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.895033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.895202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.895370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.895398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.895593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.895711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.895735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.895908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.896067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.896094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.896254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.896381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.896409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.896563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.896719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.896747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.896913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.897034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.897058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.897224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.897383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.897411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.897577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.897732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.897759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.897924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.898073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.898113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.898280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.898462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.898490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.898654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.898849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.898883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.899062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.899216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.899260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.899421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.899603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.899630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.899778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.899951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.899981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.900140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.900284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.900310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.900481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.900610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.900639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.900818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.900983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.901011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.901216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.901364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.901389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.423 [2024-07-15 09:06:10.901531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.901678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.423 [2024-07-15 09:06:10.901708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.423 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.901862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.902058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.902085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.902243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.902412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.902447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.902637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.902795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.902823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.903027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.903226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.903291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.903433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.903582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.903607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.903745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.903906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.903935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.904090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.904225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.904255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.904417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.904560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.904585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.904783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.904951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.904980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.905153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.905303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.905328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.905498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.905661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.905688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.905893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.906036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.906061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.906206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.906338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.906366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.906540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.906683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.906723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.906873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.907069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.907097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.907235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.907391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.907417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.907560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.907704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.907730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.907916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.908065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.908093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.908232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.908420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.908449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.908619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.908763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.908787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.908938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.909104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.909133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.909319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.909451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.909479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.909643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.909807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.909849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.910050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.910165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.910202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.910335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.910493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.910522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.910652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.910797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.910822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.911051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.911163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.911208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.911357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.911520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.911547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.911727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.911888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.911916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.912078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.912248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.912273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.912465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.912581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.912609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.912798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.912987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.913016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.913175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.913372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.913397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.913538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.913699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.913726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.913923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.914070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.914113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.914278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.914520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.914569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.914736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.914899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.914929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.915077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.915253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.915278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.915446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.915605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.915633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.915784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.915947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.915976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.916141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.916293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.916319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.916474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.916621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.916646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.916790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.916974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.917003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.917191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.917380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.917408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.917577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.917763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.917790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.917957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.918122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.918148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.918338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.918524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.918553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.918738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.918930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.918957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.919083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.919207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.919232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.919403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.919577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.919603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.919774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.919966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.919992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.920164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.920344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.920387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.920536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.920722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.920746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.920897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.921065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.921109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.921275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.921426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.921471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.921619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.921779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.921804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.921985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.922174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.922219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.922358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.922525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.922551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.922675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.922846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.922889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.424 qpair failed and we were unable to recover it. 00:27:22.424 [2024-07-15 09:06:10.923058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.424 [2024-07-15 09:06:10.923276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.425 [2024-07-15 09:06:10.923319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.425 qpair failed and we were unable to recover it. 00:27:22.425 [2024-07-15 09:06:10.923474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.425 [2024-07-15 09:06:10.923661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.425 [2024-07-15 09:06:10.923687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.425 qpair failed and we were unable to recover it. 00:27:22.425 [2024-07-15 09:06:10.923837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.425 [2024-07-15 09:06:10.924022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.425 [2024-07-15 09:06:10.924066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.425 qpair failed and we were unable to recover it. 00:27:22.425 [2024-07-15 09:06:10.924257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.425 [2024-07-15 09:06:10.924431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.425 [2024-07-15 09:06:10.924458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.425 qpair failed and we were unable to recover it. 00:27:22.425 [2024-07-15 09:06:10.924573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.425 [2024-07-15 09:06:10.924745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.425 [2024-07-15 09:06:10.924770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e8000b90 with addr=10.0.0.2, port=4420 00:27:22.425 qpair failed and we were unable to recover it. 00:27:22.425 [2024-07-15 09:06:10.924983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.425 [2024-07-15 09:06:10.925121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.425 [2024-07-15 09:06:10.925150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.425 qpair failed and we were unable to recover it. 00:27:22.425 [2024-07-15 09:06:10.925310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.706 [2024-07-15 09:06:10.925439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.706 [2024-07-15 09:06:10.925467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.706 qpair failed and we were unable to recover it. 00:27:22.706 [2024-07-15 09:06:10.925629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.706 [2024-07-15 09:06:10.925788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.706 [2024-07-15 09:06:10.925816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.706 qpair failed and we were unable to recover it. 00:27:22.706 [2024-07-15 09:06:10.925970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.706 [2024-07-15 09:06:10.926140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.706 [2024-07-15 09:06:10.926185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.706 qpair failed and we were unable to recover it. 00:27:22.706 [2024-07-15 09:06:10.926329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.706 [2024-07-15 09:06:10.926497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.706 [2024-07-15 09:06:10.926524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.706 qpair failed and we were unable to recover it. 00:27:22.706 [2024-07-15 09:06:10.926653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.706 [2024-07-15 09:06:10.926766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.706 [2024-07-15 09:06:10.926791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.706 qpair failed and we were unable to recover it. 00:27:22.706 [2024-07-15 09:06:10.926951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.706 [2024-07-15 09:06:10.927102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.706 [2024-07-15 09:06:10.927130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.706 qpair failed and we were unable to recover it. 00:27:22.706 [2024-07-15 09:06:10.927319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.706 [2024-07-15 09:06:10.927464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.706 [2024-07-15 09:06:10.927492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.706 qpair failed and we were unable to recover it. 00:27:22.706 [2024-07-15 09:06:10.927637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.706 [2024-07-15 09:06:10.927772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.706 [2024-07-15 09:06:10.927800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.706 qpair failed and we were unable to recover it. 00:27:22.706 [2024-07-15 09:06:10.927950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.706 [2024-07-15 09:06:10.928078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.706 [2024-07-15 09:06:10.928104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.706 qpair failed and we were unable to recover it. 00:27:22.706 [2024-07-15 09:06:10.928255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.706 [2024-07-15 09:06:10.928464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.706 [2024-07-15 09:06:10.928493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.706 qpair failed and we were unable to recover it. 00:27:22.706 [2024-07-15 09:06:10.928621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.706 [2024-07-15 09:06:10.928779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.706 [2024-07-15 09:06:10.928807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.706 qpair failed and we were unable to recover it. 00:27:22.706 [2024-07-15 09:06:10.928976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.706 [2024-07-15 09:06:10.929115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.706 [2024-07-15 09:06:10.929140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.706 qpair failed and we were unable to recover it. 00:27:22.706 [2024-07-15 09:06:10.929284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.706 [2024-07-15 09:06:10.929408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.706 [2024-07-15 09:06:10.929436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.706 qpair failed and we were unable to recover it. 00:27:22.706 [2024-07-15 09:06:10.929556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.706 [2024-07-15 09:06:10.929712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.706 [2024-07-15 09:06:10.929740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.706 qpair failed and we were unable to recover it. 00:27:22.706 [2024-07-15 09:06:10.929903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.706 [2024-07-15 09:06:10.930039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.706 [2024-07-15 09:06:10.930065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.706 qpair failed and we were unable to recover it. 00:27:22.707 [2024-07-15 09:06:10.930187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.930313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.930339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.707 qpair failed and we were unable to recover it. 00:27:22.707 [2024-07-15 09:06:10.930501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.930659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.930686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.707 qpair failed and we were unable to recover it. 00:27:22.707 [2024-07-15 09:06:10.930841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.930973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.930999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.707 qpair failed and we were unable to recover it. 00:27:22.707 [2024-07-15 09:06:10.931136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.931321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.931349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.707 qpair failed and we were unable to recover it. 00:27:22.707 [2024-07-15 09:06:10.931475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.931668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.931701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.707 qpair failed and we were unable to recover it. 00:27:22.707 [2024-07-15 09:06:10.931863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.932012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.932039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.707 qpair failed and we were unable to recover it. 00:27:22.707 [2024-07-15 09:06:10.932206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.932363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.932390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.707 qpair failed and we were unable to recover it. 00:27:22.707 [2024-07-15 09:06:10.932546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.932702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.932729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.707 qpair failed and we were unable to recover it. 00:27:22.707 [2024-07-15 09:06:10.932866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.933000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.933026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.707 qpair failed and we were unable to recover it. 00:27:22.707 [2024-07-15 09:06:10.933189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.933316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.933342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.707 qpair failed and we were unable to recover it. 00:27:22.707 [2024-07-15 09:06:10.933522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.933653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.933681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.707 qpair failed and we were unable to recover it. 00:27:22.707 [2024-07-15 09:06:10.933869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.934036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.934061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.707 qpair failed and we were unable to recover it. 00:27:22.707 [2024-07-15 09:06:10.934225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.934382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.934410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.707 qpair failed and we were unable to recover it. 00:27:22.707 [2024-07-15 09:06:10.934591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.934720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.934748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.707 qpair failed and we were unable to recover it. 00:27:22.707 [2024-07-15 09:06:10.934938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.935059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.935084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.707 qpair failed and we were unable to recover it. 00:27:22.707 [2024-07-15 09:06:10.935266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.935513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.935559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.707 qpair failed and we were unable to recover it. 00:27:22.707 [2024-07-15 09:06:10.935692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.935853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.935898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.707 qpair failed and we were unable to recover it. 00:27:22.707 [2024-07-15 09:06:10.936066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.936183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.936207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.707 qpair failed and we were unable to recover it. 00:27:22.707 [2024-07-15 09:06:10.936374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.936557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.936585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.707 qpair failed and we were unable to recover it. 00:27:22.707 [2024-07-15 09:06:10.936741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.936891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.936934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.707 qpair failed and we were unable to recover it. 00:27:22.707 [2024-07-15 09:06:10.937082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.937186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.937212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.707 qpair failed and we were unable to recover it. 00:27:22.707 [2024-07-15 09:06:10.937326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.937492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.937520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.707 qpair failed and we were unable to recover it. 00:27:22.707 [2024-07-15 09:06:10.937707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.937862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.937915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.707 qpair failed and we were unable to recover it. 00:27:22.707 [2024-07-15 09:06:10.938060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.938197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.938240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.707 qpair failed and we were unable to recover it. 00:27:22.707 [2024-07-15 09:06:10.938396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.938553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.938580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.707 qpair failed and we were unable to recover it. 00:27:22.707 [2024-07-15 09:06:10.938783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.938958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.938984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.707 qpair failed and we were unable to recover it. 00:27:22.707 [2024-07-15 09:06:10.939155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.939328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.939356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.707 qpair failed and we were unable to recover it. 00:27:22.707 [2024-07-15 09:06:10.939518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.939678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.939705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.707 qpair failed and we were unable to recover it. 00:27:22.707 [2024-07-15 09:06:10.939894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.940028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.707 [2024-07-15 09:06:10.940054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.707 qpair failed and we were unable to recover it. 00:27:22.707 [2024-07-15 09:06:10.940172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.940293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.940318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.708 qpair failed and we were unable to recover it. 00:27:22.708 [2024-07-15 09:06:10.940487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.940638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.940662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.708 qpair failed and we were unable to recover it. 00:27:22.708 [2024-07-15 09:06:10.940785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.940959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.940986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.708 qpair failed and we were unable to recover it. 00:27:22.708 [2024-07-15 09:06:10.941129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.941265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.941291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.708 qpair failed and we were unable to recover it. 00:27:22.708 [2024-07-15 09:06:10.941468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.941611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.941636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.708 qpair failed and we were unable to recover it. 00:27:22.708 [2024-07-15 09:06:10.941807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.941979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.942007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.708 qpair failed and we were unable to recover it. 00:27:22.708 [2024-07-15 09:06:10.942170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.942316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.942358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.708 qpair failed and we were unable to recover it. 00:27:22.708 [2024-07-15 09:06:10.942520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.942647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.942676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.708 qpair failed and we were unable to recover it. 00:27:22.708 [2024-07-15 09:06:10.942814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.942985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.943013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.708 qpair failed and we were unable to recover it. 00:27:22.708 [2024-07-15 09:06:10.943198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.943404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.943456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.708 qpair failed and we were unable to recover it. 00:27:22.708 [2024-07-15 09:06:10.943617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.943761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.943788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.708 qpair failed and we were unable to recover it. 00:27:22.708 [2024-07-15 09:06:10.943978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.944137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.944174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.708 qpair failed and we were unable to recover it. 00:27:22.708 [2024-07-15 09:06:10.944360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.944503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.944545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.708 qpair failed and we were unable to recover it. 00:27:22.708 [2024-07-15 09:06:10.944699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.944824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.944851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.708 qpair failed and we were unable to recover it. 00:27:22.708 [2024-07-15 09:06:10.945046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.945258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.945310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.708 qpair failed and we were unable to recover it. 00:27:22.708 [2024-07-15 09:06:10.945497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.945692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.945720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.708 qpair failed and we were unable to recover it. 00:27:22.708 [2024-07-15 09:06:10.945884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.946039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.946070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.708 qpair failed and we were unable to recover it. 00:27:22.708 [2024-07-15 09:06:10.946233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.946391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.946419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.708 qpair failed and we were unable to recover it. 00:27:22.708 [2024-07-15 09:06:10.946616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.946732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.946773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.708 qpair failed and we were unable to recover it. 00:27:22.708 [2024-07-15 09:06:10.946953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.947104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.947129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.708 qpair failed and we were unable to recover it. 00:27:22.708 [2024-07-15 09:06:10.947296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.947427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.947455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.708 qpair failed and we were unable to recover it. 00:27:22.708 [2024-07-15 09:06:10.947626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.947739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.947764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.708 qpair failed and we were unable to recover it. 00:27:22.708 [2024-07-15 09:06:10.947943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.948141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.948177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.708 qpair failed and we were unable to recover it. 00:27:22.708 [2024-07-15 09:06:10.948291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.948483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.948511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.708 qpair failed and we were unable to recover it. 00:27:22.708 [2024-07-15 09:06:10.948679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.948822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.948864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.708 qpair failed and we were unable to recover it. 00:27:22.708 [2024-07-15 09:06:10.949005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.949163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.949190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.708 qpair failed and we were unable to recover it. 00:27:22.708 [2024-07-15 09:06:10.949330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.949454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.949487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.708 qpair failed and we were unable to recover it. 00:27:22.708 [2024-07-15 09:06:10.949679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.949787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.949812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.708 qpair failed and we were unable to recover it. 00:27:22.708 [2024-07-15 09:06:10.949996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.950105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.950130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.708 qpair failed and we were unable to recover it. 00:27:22.708 [2024-07-15 09:06:10.950315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.950454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.950479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.708 qpair failed and we were unable to recover it. 00:27:22.708 [2024-07-15 09:06:10.950622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.950733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.708 [2024-07-15 09:06:10.950757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.709 qpair failed and we were unable to recover it. 00:27:22.709 [2024-07-15 09:06:10.950928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.951084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.951112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.709 qpair failed and we were unable to recover it. 00:27:22.709 [2024-07-15 09:06:10.951271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.951404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.951432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.709 qpair failed and we were unable to recover it. 00:27:22.709 [2024-07-15 09:06:10.951599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.951723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.951748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.709 qpair failed and we were unable to recover it. 00:27:22.709 [2024-07-15 09:06:10.951898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.952097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.952124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.709 qpair failed and we were unable to recover it. 00:27:22.709 [2024-07-15 09:06:10.952250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.952410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.952439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.709 qpair failed and we were unable to recover it. 00:27:22.709 [2024-07-15 09:06:10.952608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.952728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.952754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.709 qpair failed and we were unable to recover it. 00:27:22.709 [2024-07-15 09:06:10.952956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.953087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.953114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.709 qpair failed and we were unable to recover it. 00:27:22.709 [2024-07-15 09:06:10.953253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.953437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.953465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.709 qpair failed and we were unable to recover it. 00:27:22.709 [2024-07-15 09:06:10.953631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.953751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.953776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.709 qpair failed and we were unable to recover it. 00:27:22.709 [2024-07-15 09:06:10.953922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.954078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.954107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.709 qpair failed and we were unable to recover it. 00:27:22.709 [2024-07-15 09:06:10.954268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.954426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.954451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.709 qpair failed and we were unable to recover it. 00:27:22.709 [2024-07-15 09:06:10.954597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.954715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.954741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.709 qpair failed and we were unable to recover it. 00:27:22.709 [2024-07-15 09:06:10.954909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.955096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.955123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.709 qpair failed and we were unable to recover it. 00:27:22.709 [2024-07-15 09:06:10.955281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.955462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.955490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.709 qpair failed and we were unable to recover it. 00:27:22.709 [2024-07-15 09:06:10.955633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.955774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.955800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.709 qpair failed and we were unable to recover it. 00:27:22.709 [2024-07-15 09:06:10.955969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.956126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.956154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.709 qpair failed and we were unable to recover it. 00:27:22.709 [2024-07-15 09:06:10.956340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.956520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.956581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.709 qpair failed and we were unable to recover it. 00:27:22.709 [2024-07-15 09:06:10.956759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.956899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.956924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.709 qpair failed and we were unable to recover it. 00:27:22.709 [2024-07-15 09:06:10.957141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.957289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.957330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.709 qpair failed and we were unable to recover it. 00:27:22.709 [2024-07-15 09:06:10.957485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.957644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.957672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.709 qpair failed and we were unable to recover it. 00:27:22.709 [2024-07-15 09:06:10.957833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.957986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.958029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.709 qpair failed and we were unable to recover it. 00:27:22.709 [2024-07-15 09:06:10.958188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.958361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.958392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.709 qpair failed and we were unable to recover it. 00:27:22.709 [2024-07-15 09:06:10.958567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.958724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.958750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.709 qpair failed and we were unable to recover it. 00:27:22.709 [2024-07-15 09:06:10.958889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.959050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.959075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.709 qpair failed and we were unable to recover it. 00:27:22.709 [2024-07-15 09:06:10.959275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.959509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.959561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.709 qpair failed and we were unable to recover it. 00:27:22.709 [2024-07-15 09:06:10.959745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.959894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.959932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.709 qpair failed and we were unable to recover it. 00:27:22.709 [2024-07-15 09:06:10.960077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.960256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.960298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.709 qpair failed and we were unable to recover it. 00:27:22.709 [2024-07-15 09:06:10.960451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.960636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.960664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.709 qpair failed and we were unable to recover it. 00:27:22.709 [2024-07-15 09:06:10.960861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.961054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.961081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.709 qpair failed and we were unable to recover it. 00:27:22.709 [2024-07-15 09:06:10.961238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.709 [2024-07-15 09:06:10.961348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.961374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.710 qpair failed and we were unable to recover it. 00:27:22.710 [2024-07-15 09:06:10.961523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.961695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.961723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.710 qpair failed and we were unable to recover it. 00:27:22.710 [2024-07-15 09:06:10.961909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.962047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.962076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.710 qpair failed and we were unable to recover it. 00:27:22.710 [2024-07-15 09:06:10.962269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.962382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.962424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.710 qpair failed and we were unable to recover it. 00:27:22.710 [2024-07-15 09:06:10.962586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.962741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.962769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.710 qpair failed and we were unable to recover it. 00:27:22.710 [2024-07-15 09:06:10.962948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.963073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.963098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.710 qpair failed and we were unable to recover it. 00:27:22.710 [2024-07-15 09:06:10.963237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.963381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.963407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.710 qpair failed and we were unable to recover it. 00:27:22.710 [2024-07-15 09:06:10.963553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.963683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.963716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.710 qpair failed and we were unable to recover it. 00:27:22.710 [2024-07-15 09:06:10.963846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.963976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.964004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.710 qpair failed and we were unable to recover it. 00:27:22.710 [2024-07-15 09:06:10.964162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.964310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.964334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.710 qpair failed and we were unable to recover it. 00:27:22.710 [2024-07-15 09:06:10.964485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.964631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.964655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.710 qpair failed and we were unable to recover it. 00:27:22.710 [2024-07-15 09:06:10.964793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.964945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.964970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.710 qpair failed and we were unable to recover it. 00:27:22.710 [2024-07-15 09:06:10.965127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.965314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.965343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.710 qpair failed and we were unable to recover it. 00:27:22.710 [2024-07-15 09:06:10.965528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.965682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.965709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.710 qpair failed and we were unable to recover it. 00:27:22.710 [2024-07-15 09:06:10.965871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.966061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.966089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.710 qpair failed and we were unable to recover it. 00:27:22.710 [2024-07-15 09:06:10.966228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.966397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.966437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.710 qpair failed and we were unable to recover it. 00:27:22.710 [2024-07-15 09:06:10.966633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.966815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.966843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.710 qpair failed and we were unable to recover it. 00:27:22.710 [2024-07-15 09:06:10.967014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.967138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.967166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.710 qpair failed and we were unable to recover it. 00:27:22.710 [2024-07-15 09:06:10.967367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.967525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.967555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.710 qpair failed and we were unable to recover it. 00:27:22.710 [2024-07-15 09:06:10.967716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.967874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.967922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.710 qpair failed and we were unable to recover it. 00:27:22.710 [2024-07-15 09:06:10.968095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.968240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.968264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.710 qpair failed and we were unable to recover it. 00:27:22.710 [2024-07-15 09:06:10.968440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.968582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.968623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.710 qpair failed and we were unable to recover it. 00:27:22.710 [2024-07-15 09:06:10.968745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.968917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.968945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.710 qpair failed and we were unable to recover it. 00:27:22.710 [2024-07-15 09:06:10.969079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.969236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.969263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.710 qpair failed and we were unable to recover it. 00:27:22.710 [2024-07-15 09:06:10.969427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.969542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.710 [2024-07-15 09:06:10.969567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.710 qpair failed and we were unable to recover it. 00:27:22.710 [2024-07-15 09:06:10.969748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.969906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.969934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.711 qpair failed and we were unable to recover it. 00:27:22.711 [2024-07-15 09:06:10.970094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.970280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.970338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.711 qpair failed and we were unable to recover it. 00:27:22.711 [2024-07-15 09:06:10.970529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.970677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.970702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.711 qpair failed and we were unable to recover it. 00:27:22.711 [2024-07-15 09:06:10.970844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.971001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.971029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.711 qpair failed and we were unable to recover it. 00:27:22.711 [2024-07-15 09:06:10.971224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.971344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.971370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.711 qpair failed and we were unable to recover it. 00:27:22.711 [2024-07-15 09:06:10.971536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.971707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.971735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.711 qpair failed and we were unable to recover it. 00:27:22.711 [2024-07-15 09:06:10.971894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.972059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.972085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.711 qpair failed and we were unable to recover it. 00:27:22.711 [2024-07-15 09:06:10.972276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.972491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.972565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.711 qpair failed and we were unable to recover it. 00:27:22.711 [2024-07-15 09:06:10.972714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.972849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.972874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.711 qpair failed and we were unable to recover it. 00:27:22.711 [2024-07-15 09:06:10.973048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.973229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.973288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.711 qpair failed and we were unable to recover it. 00:27:22.711 [2024-07-15 09:06:10.973473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.973606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.973633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.711 qpair failed and we were unable to recover it. 00:27:22.711 [2024-07-15 09:06:10.973775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.973915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.973941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.711 qpair failed and we were unable to recover it. 00:27:22.711 [2024-07-15 09:06:10.974087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.974244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.974273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.711 qpair failed and we were unable to recover it. 00:27:22.711 [2024-07-15 09:06:10.974479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.974624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.974648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.711 qpair failed and we were unable to recover it. 00:27:22.711 [2024-07-15 09:06:10.974801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.974994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.975022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.711 qpair failed and we were unable to recover it. 00:27:22.711 [2024-07-15 09:06:10.975204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.975362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.975422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.711 qpair failed and we were unable to recover it. 00:27:22.711 [2024-07-15 09:06:10.975607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.975762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.975789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.711 qpair failed and we were unable to recover it. 00:27:22.711 [2024-07-15 09:06:10.975964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.976112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.976138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.711 qpair failed and we were unable to recover it. 00:27:22.711 [2024-07-15 09:06:10.976307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.976469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.976497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.711 qpair failed and we were unable to recover it. 00:27:22.711 [2024-07-15 09:06:10.976667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.976837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.976863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.711 qpair failed and we were unable to recover it. 00:27:22.711 [2024-07-15 09:06:10.977076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.977265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.977293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.711 qpair failed and we were unable to recover it. 00:27:22.711 [2024-07-15 09:06:10.977439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.977623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.977651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.711 qpair failed and we were unable to recover it. 00:27:22.711 [2024-07-15 09:06:10.977835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.978006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.978034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.711 qpair failed and we were unable to recover it. 00:27:22.711 [2024-07-15 09:06:10.978205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.978388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.978413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.711 qpair failed and we were unable to recover it. 00:27:22.711 [2024-07-15 09:06:10.978606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.978800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.978825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.711 qpair failed and we were unable to recover it. 00:27:22.711 [2024-07-15 09:06:10.979019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.979191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.979216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.711 qpair failed and we were unable to recover it. 00:27:22.711 [2024-07-15 09:06:10.979371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.979609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.979669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.711 qpair failed and we were unable to recover it. 00:27:22.711 [2024-07-15 09:06:10.979793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.979977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.980007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.711 qpair failed and we were unable to recover it. 00:27:22.711 [2024-07-15 09:06:10.980165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.980281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.980309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.711 qpair failed and we were unable to recover it. 00:27:22.711 [2024-07-15 09:06:10.980499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.980687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.980715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.711 qpair failed and we were unable to recover it. 00:27:22.711 [2024-07-15 09:06:10.980903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.711 [2024-07-15 09:06:10.981059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.981088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.712 qpair failed and we were unable to recover it. 00:27:22.712 [2024-07-15 09:06:10.981220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.981347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.981375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.712 qpair failed and we were unable to recover it. 00:27:22.712 [2024-07-15 09:06:10.981533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.981681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.981706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.712 qpair failed and we were unable to recover it. 00:27:22.712 [2024-07-15 09:06:10.981822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.982004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.982034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.712 qpair failed and we were unable to recover it. 00:27:22.712 [2024-07-15 09:06:10.982183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.982343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.982371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.712 qpair failed and we were unable to recover it. 00:27:22.712 [2024-07-15 09:06:10.982538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.982682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.982707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.712 qpair failed and we were unable to recover it. 00:27:22.712 [2024-07-15 09:06:10.982874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.983043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.983068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.712 qpair failed and we were unable to recover it. 00:27:22.712 [2024-07-15 09:06:10.983235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.983468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.983520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.712 qpair failed and we were unable to recover it. 00:27:22.712 [2024-07-15 09:06:10.983715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.983860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.983922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.712 qpair failed and we were unable to recover it. 00:27:22.712 [2024-07-15 09:06:10.984087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.984250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.984320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.712 qpair failed and we were unable to recover it. 00:27:22.712 [2024-07-15 09:06:10.984485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.984640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.984668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.712 qpair failed and we were unable to recover it. 00:27:22.712 [2024-07-15 09:06:10.984808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.985003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.985029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.712 qpair failed and we were unable to recover it. 00:27:22.712 [2024-07-15 09:06:10.985189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.985392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.985419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.712 qpair failed and we were unable to recover it. 00:27:22.712 [2024-07-15 09:06:10.985531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.985655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.985683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.712 qpair failed and we were unable to recover it. 00:27:22.712 [2024-07-15 09:06:10.985883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.986002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.986028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.712 qpair failed and we were unable to recover it. 00:27:22.712 [2024-07-15 09:06:10.986166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.986329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.986358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.712 qpair failed and we were unable to recover it. 00:27:22.712 [2024-07-15 09:06:10.986502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.986685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.986711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.712 qpair failed and we were unable to recover it. 00:27:22.712 [2024-07-15 09:06:10.986889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.987011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.987054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.712 qpair failed and we were unable to recover it. 00:27:22.712 [2024-07-15 09:06:10.987243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.987489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.987517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.712 qpair failed and we were unable to recover it. 00:27:22.712 [2024-07-15 09:06:10.987677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.987832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.987860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.712 qpair failed and we were unable to recover it. 00:27:22.712 [2024-07-15 09:06:10.988036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.988154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.988189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.712 qpair failed and we were unable to recover it. 00:27:22.712 [2024-07-15 09:06:10.988362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.988545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.988573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.712 qpair failed and we were unable to recover it. 00:27:22.712 [2024-07-15 09:06:10.988730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.988894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.988922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.712 qpair failed and we were unable to recover it. 00:27:22.712 [2024-07-15 09:06:10.989089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.989273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.989301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.712 qpair failed and we were unable to recover it. 00:27:22.712 [2024-07-15 09:06:10.989489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.989614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.989643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.712 qpair failed and we were unable to recover it. 00:27:22.712 [2024-07-15 09:06:10.989772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.989929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.989958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.712 qpair failed and we were unable to recover it. 00:27:22.712 [2024-07-15 09:06:10.990123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.990279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.990321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.712 qpair failed and we were unable to recover it. 00:27:22.712 [2024-07-15 09:06:10.990444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.990598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.990627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.712 qpair failed and we were unable to recover it. 00:27:22.712 [2024-07-15 09:06:10.990812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.990999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.991028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.712 qpair failed and we were unable to recover it. 00:27:22.712 [2024-07-15 09:06:10.991195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.991388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.991451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.712 qpair failed and we were unable to recover it. 00:27:22.712 [2024-07-15 09:06:10.991611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.991767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.712 [2024-07-15 09:06:10.991796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.712 qpair failed and we were unable to recover it. 00:27:22.713 [2024-07-15 09:06:10.991954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:10.992076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:10.992104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.713 qpair failed and we were unable to recover it. 00:27:22.713 [2024-07-15 09:06:10.992261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:10.992399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:10.992424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.713 qpair failed and we were unable to recover it. 00:27:22.713 [2024-07-15 09:06:10.992582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:10.992706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:10.992733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.713 qpair failed and we were unable to recover it. 00:27:22.713 [2024-07-15 09:06:10.992896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:10.993082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:10.993109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.713 qpair failed and we were unable to recover it. 00:27:22.713 [2024-07-15 09:06:10.993258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:10.993376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:10.993402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.713 qpair failed and we were unable to recover it. 00:27:22.713 [2024-07-15 09:06:10.993596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:10.993756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:10.993783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.713 qpair failed and we were unable to recover it. 00:27:22.713 [2024-07-15 09:06:10.993968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:10.994134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:10.994168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.713 qpair failed and we were unable to recover it. 00:27:22.713 [2024-07-15 09:06:10.994287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:10.994456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:10.994481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.713 qpair failed and we were unable to recover it. 00:27:22.713 [2024-07-15 09:06:10.994652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:10.994834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:10.994862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.713 qpair failed and we were unable to recover it. 00:27:22.713 [2024-07-15 09:06:10.995006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:10.995160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:10.995198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.713 qpair failed and we were unable to recover it. 00:27:22.713 [2024-07-15 09:06:10.995393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:10.995539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:10.995563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.713 qpair failed and we were unable to recover it. 00:27:22.713 [2024-07-15 09:06:10.995707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 1620606 Killed "${NVMF_APP[@]}" "$@" 00:27:22.713 [2024-07-15 09:06:10.995816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:10.995840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.713 qpair failed and we were unable to recover it. 00:27:22.713 [2024-07-15 09:06:10.995979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 09:06:10 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:27:22.713 [2024-07-15 09:06:10.996151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:10.996200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.713 qpair failed and we were unable to recover it. 00:27:22.713 09:06:10 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:27:22.713 [2024-07-15 09:06:10.996394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 09:06:10 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:22.713 [2024-07-15 09:06:10.996537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:10.996579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.713 qpair failed and we were unable to recover it. 00:27:22.713 09:06:10 -- common/autotest_common.sh@712 -- # xtrace_disable 00:27:22.713 [2024-07-15 09:06:10.996714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 09:06:10 -- common/autotest_common.sh@10 -- # set +x 00:27:22.713 [2024-07-15 09:06:10.996890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:10.996918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.713 qpair failed and we were unable to recover it. 00:27:22.713 [2024-07-15 09:06:10.997090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:10.997243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:10.997308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.713 qpair failed and we were unable to recover it. 00:27:22.713 [2024-07-15 09:06:10.997502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:10.997679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:10.997743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.713 qpair failed and we were unable to recover it. 00:27:22.713 [2024-07-15 09:06:10.997928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:10.998106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:10.998134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.713 qpair failed and we were unable to recover it. 00:27:22.713 [2024-07-15 09:06:10.998282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:10.998442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:10.998470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.713 qpair failed and we were unable to recover it. 00:27:22.713 [2024-07-15 09:06:10.998639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:10.998782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:10.998808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.713 qpair failed and we were unable to recover it. 00:27:22.713 [2024-07-15 09:06:10.998931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:10.999096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:10.999125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.713 qpair failed and we were unable to recover it. 00:27:22.713 [2024-07-15 09:06:10.999296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:10.999448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:10.999476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.713 qpair failed and we were unable to recover it. 00:27:22.713 [2024-07-15 09:06:10.999621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:10.999767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:10.999798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.713 qpair failed and we were unable to recover it. 00:27:22.713 [2024-07-15 09:06:10.999940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 09:06:10 -- nvmf/common.sh@469 -- # nvmfpid=1621814 00:27:22.713 [2024-07-15 09:06:11.000063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:11.000092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.713 qpair failed and we were unable to recover it. 00:27:22.713 09:06:10 -- nvmf/common.sh@470 -- # waitforlisten 1621814 00:27:22.713 09:06:10 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:27:22.713 [2024-07-15 09:06:11.000258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 09:06:10 -- common/autotest_common.sh@819 -- # '[' -z 1621814 ']' 00:27:22.713 [2024-07-15 09:06:11.000401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:11.000425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.713 qpair failed and we were unable to recover it. 00:27:22.713 09:06:10 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:22.713 [2024-07-15 09:06:11.000566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 09:06:10 -- common/autotest_common.sh@824 -- # local max_retries=100 00:27:22.713 [2024-07-15 09:06:11.000725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 09:06:10 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:22.713 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:22.713 [2024-07-15 09:06:11.000768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.713 qpair failed and we were unable to recover it. 00:27:22.713 09:06:10 -- common/autotest_common.sh@828 -- # xtrace_disable 00:27:22.713 [2024-07-15 09:06:11.000949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 09:06:11 -- common/autotest_common.sh@10 -- # set +x 00:27:22.713 [2024-07-15 09:06:11.001096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.713 [2024-07-15 09:06:11.001122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.713 qpair failed and we were unable to recover it. 00:27:22.713 [2024-07-15 09:06:11.001270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.001420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.001448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.714 qpair failed and we were unable to recover it. 00:27:22.714 [2024-07-15 09:06:11.001618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.001801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.001829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.714 qpair failed and we were unable to recover it. 00:27:22.714 [2024-07-15 09:06:11.001995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.002134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.002162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.714 qpair failed and we were unable to recover it. 00:27:22.714 [2024-07-15 09:06:11.002347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.002473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.002505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.714 qpair failed and we were unable to recover it. 00:27:22.714 [2024-07-15 09:06:11.002667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.002816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.002865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.714 qpair failed and we were unable to recover it. 00:27:22.714 [2024-07-15 09:06:11.003013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.003173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.003211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.714 qpair failed and we were unable to recover it. 00:27:22.714 [2024-07-15 09:06:11.003410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.003589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.003634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.714 qpair failed and we were unable to recover it. 00:27:22.714 [2024-07-15 09:06:11.003787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.003906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.003933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.714 qpair failed and we were unable to recover it. 00:27:22.714 [2024-07-15 09:06:11.004081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.004249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.004278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.714 qpair failed and we were unable to recover it. 00:27:22.714 [2024-07-15 09:06:11.004435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.004614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.004640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.714 qpair failed and we were unable to recover it. 00:27:22.714 [2024-07-15 09:06:11.004763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.004901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.004927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.714 qpair failed and we were unable to recover it. 00:27:22.714 [2024-07-15 09:06:11.005114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.005297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.005326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.714 qpair failed and we were unable to recover it. 00:27:22.714 [2024-07-15 09:06:11.005479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.005621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.005648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.714 qpair failed and we were unable to recover it. 00:27:22.714 [2024-07-15 09:06:11.005807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.005924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.005950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.714 qpair failed and we were unable to recover it. 00:27:22.714 [2024-07-15 09:06:11.006105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.006264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.006292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.714 qpair failed and we were unable to recover it. 00:27:22.714 [2024-07-15 09:06:11.006418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.006571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.006600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.714 qpair failed and we were unable to recover it. 00:27:22.714 [2024-07-15 09:06:11.006768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.006922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.006965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.714 qpair failed and we were unable to recover it. 00:27:22.714 [2024-07-15 09:06:11.007115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.007280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.007308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.714 qpair failed and we were unable to recover it. 00:27:22.714 [2024-07-15 09:06:11.007442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.007573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.007601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.714 qpair failed and we were unable to recover it. 00:27:22.714 [2024-07-15 09:06:11.007781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.007930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.007973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.714 qpair failed and we were unable to recover it. 00:27:22.714 [2024-07-15 09:06:11.008114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.008269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.008297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.714 qpair failed and we were unable to recover it. 00:27:22.714 [2024-07-15 09:06:11.008452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.008637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.008662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.714 qpair failed and we were unable to recover it. 00:27:22.714 [2024-07-15 09:06:11.008801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.008948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.008989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.714 qpair failed and we were unable to recover it. 00:27:22.714 [2024-07-15 09:06:11.009146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.009303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.009330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.714 qpair failed and we were unable to recover it. 00:27:22.714 [2024-07-15 09:06:11.009517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.009670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.009698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.714 qpair failed and we were unable to recover it. 00:27:22.714 [2024-07-15 09:06:11.009840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.009959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.009985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.714 qpair failed and we were unable to recover it. 00:27:22.714 [2024-07-15 09:06:11.010168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.010334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.010361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.714 qpair failed and we were unable to recover it. 00:27:22.714 [2024-07-15 09:06:11.010530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.010677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.010702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.714 qpair failed and we were unable to recover it. 00:27:22.714 [2024-07-15 09:06:11.010843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.010973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.010999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.714 qpair failed and we were unable to recover it. 00:27:22.714 [2024-07-15 09:06:11.011186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.011325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.011350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.714 qpair failed and we were unable to recover it. 00:27:22.714 [2024-07-15 09:06:11.011514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.011660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.714 [2024-07-15 09:06:11.011688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.714 qpair failed and we were unable to recover it. 00:27:22.715 [2024-07-15 09:06:11.011904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.012019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.012044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.715 qpair failed and we were unable to recover it. 00:27:22.715 [2024-07-15 09:06:11.012188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.012333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.012360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.715 qpair failed and we were unable to recover it. 00:27:22.715 [2024-07-15 09:06:11.012493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.012676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.012704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.715 qpair failed and we were unable to recover it. 00:27:22.715 [2024-07-15 09:06:11.012844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.012981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.013006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.715 qpair failed and we were unable to recover it. 00:27:22.715 [2024-07-15 09:06:11.013128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.013265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.013293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.715 qpair failed and we were unable to recover it. 00:27:22.715 [2024-07-15 09:06:11.013444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.013631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.013656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.715 qpair failed and we were unable to recover it. 00:27:22.715 [2024-07-15 09:06:11.013843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.014002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.014028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.715 qpair failed and we were unable to recover it. 00:27:22.715 [2024-07-15 09:06:11.014218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.014348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.014374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.715 qpair failed and we were unable to recover it. 00:27:22.715 [2024-07-15 09:06:11.014500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.014619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.014646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.715 qpair failed and we were unable to recover it. 00:27:22.715 [2024-07-15 09:06:11.014786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.014943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.014968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.715 qpair failed and we were unable to recover it. 00:27:22.715 [2024-07-15 09:06:11.015135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.015301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.015327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.715 qpair failed and we were unable to recover it. 00:27:22.715 [2024-07-15 09:06:11.015471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.015620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.015645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.715 qpair failed and we were unable to recover it. 00:27:22.715 [2024-07-15 09:06:11.015816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.015991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.016018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.715 qpair failed and we were unable to recover it. 00:27:22.715 [2024-07-15 09:06:11.016139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.016314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.016345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.715 qpair failed and we were unable to recover it. 00:27:22.715 [2024-07-15 09:06:11.016524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.016699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.016724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.715 qpair failed and we were unable to recover it. 00:27:22.715 [2024-07-15 09:06:11.016868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.016994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.017019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.715 qpair failed and we were unable to recover it. 00:27:22.715 [2024-07-15 09:06:11.017139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.017305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.017331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.715 qpair failed and we were unable to recover it. 00:27:22.715 [2024-07-15 09:06:11.017462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.017615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.017642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.715 qpair failed and we were unable to recover it. 00:27:22.715 [2024-07-15 09:06:11.017809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.017926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.017951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.715 qpair failed and we were unable to recover it. 00:27:22.715 [2024-07-15 09:06:11.018074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.018229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.018255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.715 qpair failed and we were unable to recover it. 00:27:22.715 [2024-07-15 09:06:11.018402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.018519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.018546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.715 qpair failed and we were unable to recover it. 00:27:22.715 [2024-07-15 09:06:11.018684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.018818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.018843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.715 qpair failed and we were unable to recover it. 00:27:22.715 [2024-07-15 09:06:11.018996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.019137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.019163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.715 qpair failed and we were unable to recover it. 00:27:22.715 [2024-07-15 09:06:11.019305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.019477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.019507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.715 qpair failed and we were unable to recover it. 00:27:22.715 [2024-07-15 09:06:11.019668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.019787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.715 [2024-07-15 09:06:11.019813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.715 qpair failed and we were unable to recover it. 00:27:22.715 [2024-07-15 09:06:11.019962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.020139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.020165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.716 qpair failed and we were unable to recover it. 00:27:22.716 [2024-07-15 09:06:11.020287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.020407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.020432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.716 qpair failed and we were unable to recover it. 00:27:22.716 [2024-07-15 09:06:11.020617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.020802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.020828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.716 qpair failed and we were unable to recover it. 00:27:22.716 [2024-07-15 09:06:11.020969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.021090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.021114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.716 qpair failed and we were unable to recover it. 00:27:22.716 [2024-07-15 09:06:11.021262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.021403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.021429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.716 qpair failed and we were unable to recover it. 00:27:22.716 [2024-07-15 09:06:11.021589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.021737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.021762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.716 qpair failed and we were unable to recover it. 00:27:22.716 [2024-07-15 09:06:11.021887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.022005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.022032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.716 qpair failed and we were unable to recover it. 00:27:22.716 [2024-07-15 09:06:11.022225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.022368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.022393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.716 qpair failed and we were unable to recover it. 00:27:22.716 [2024-07-15 09:06:11.022551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.022719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.022760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.716 qpair failed and we were unable to recover it. 00:27:22.716 [2024-07-15 09:06:11.022930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.023101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.023126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.716 qpair failed and we were unable to recover it. 00:27:22.716 [2024-07-15 09:06:11.023279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.023453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.023478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.716 qpair failed and we were unable to recover it. 00:27:22.716 [2024-07-15 09:06:11.023627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.023776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.023802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.716 qpair failed and we were unable to recover it. 00:27:22.716 [2024-07-15 09:06:11.023924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.024046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.024072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.716 qpair failed and we were unable to recover it. 00:27:22.716 [2024-07-15 09:06:11.024254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.024394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.024420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.716 qpair failed and we were unable to recover it. 00:27:22.716 [2024-07-15 09:06:11.024565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.024720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.024745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.716 qpair failed and we were unable to recover it. 00:27:22.716 [2024-07-15 09:06:11.024868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.025021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.025046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.716 qpair failed and we were unable to recover it. 00:27:22.716 [2024-07-15 09:06:11.025209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.025347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.025373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.716 qpair failed and we were unable to recover it. 00:27:22.716 [2024-07-15 09:06:11.025551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.025693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.025719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.716 qpair failed and we were unable to recover it. 00:27:22.716 [2024-07-15 09:06:11.025880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.026042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.026068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.716 qpair failed and we were unable to recover it. 00:27:22.716 [2024-07-15 09:06:11.026187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.026322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.026347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.716 qpair failed and we were unable to recover it. 00:27:22.716 [2024-07-15 09:06:11.026489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.026637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.026663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.716 qpair failed and we were unable to recover it. 00:27:22.716 [2024-07-15 09:06:11.026801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.026972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.026998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.716 qpair failed and we were unable to recover it. 00:27:22.716 [2024-07-15 09:06:11.027122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.027259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.027285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.716 qpair failed and we were unable to recover it. 00:27:22.716 [2024-07-15 09:06:11.027406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.027517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.027542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.716 qpair failed and we were unable to recover it. 00:27:22.716 [2024-07-15 09:06:11.027675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.027804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.027830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.716 qpair failed and we were unable to recover it. 00:27:22.716 [2024-07-15 09:06:11.027954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.028105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.028131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.716 qpair failed and we were unable to recover it. 00:27:22.716 [2024-07-15 09:06:11.028308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.028456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.028481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.716 qpair failed and we were unable to recover it. 00:27:22.716 [2024-07-15 09:06:11.028626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.028766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.028792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.716 qpair failed and we were unable to recover it. 00:27:22.716 [2024-07-15 09:06:11.028928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.029043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.029069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.716 qpair failed and we were unable to recover it. 00:27:22.716 [2024-07-15 09:06:11.029222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.029374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.029399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.716 qpair failed and we were unable to recover it. 00:27:22.716 [2024-07-15 09:06:11.029544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.029684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.716 [2024-07-15 09:06:11.029709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.717 qpair failed and we were unable to recover it. 00:27:22.717 [2024-07-15 09:06:11.029856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.030021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.030047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.717 qpair failed and we were unable to recover it. 00:27:22.717 [2024-07-15 09:06:11.030176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.030343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.030369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.717 qpair failed and we were unable to recover it. 00:27:22.717 [2024-07-15 09:06:11.030489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.030614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.030640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.717 qpair failed and we were unable to recover it. 00:27:22.717 [2024-07-15 09:06:11.030789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.030926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.030954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.717 qpair failed and we were unable to recover it. 00:27:22.717 [2024-07-15 09:06:11.031098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.031266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.031291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.717 qpair failed and we were unable to recover it. 00:27:22.717 [2024-07-15 09:06:11.031420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.031571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.031596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.717 qpair failed and we were unable to recover it. 00:27:22.717 [2024-07-15 09:06:11.031727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.031842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.031883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.717 qpair failed and we were unable to recover it. 00:27:22.717 [2024-07-15 09:06:11.032026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.032154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.032185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.717 qpair failed and we were unable to recover it. 00:27:22.717 [2024-07-15 09:06:11.032357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.032517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.032547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.717 qpair failed and we were unable to recover it. 00:27:22.717 [2024-07-15 09:06:11.032669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.032800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.032825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.717 qpair failed and we were unable to recover it. 00:27:22.717 [2024-07-15 09:06:11.032986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.033103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.033129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.717 qpair failed and we were unable to recover it. 00:27:22.717 [2024-07-15 09:06:11.033306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.033428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.033454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.717 qpair failed and we were unable to recover it. 00:27:22.717 [2024-07-15 09:06:11.033575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.033725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.033750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.717 qpair failed and we were unable to recover it. 00:27:22.717 [2024-07-15 09:06:11.033867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.034000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.034027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.717 qpair failed and we were unable to recover it. 00:27:22.717 [2024-07-15 09:06:11.034141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.034300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.034337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.717 qpair failed and we were unable to recover it. 00:27:22.717 [2024-07-15 09:06:11.034506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.034674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.034699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.717 qpair failed and we were unable to recover it. 00:27:22.717 [2024-07-15 09:06:11.034844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.035029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.035067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.717 qpair failed and we were unable to recover it. 00:27:22.717 [2024-07-15 09:06:11.035184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.035329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.035355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.717 qpair failed and we were unable to recover it. 00:27:22.717 [2024-07-15 09:06:11.035525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.035642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.035667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.717 qpair failed and we were unable to recover it. 00:27:22.717 [2024-07-15 09:06:11.035814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.035948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.035973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.717 qpair failed and we were unable to recover it. 00:27:22.717 [2024-07-15 09:06:11.036117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.036250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.036275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.717 qpair failed and we were unable to recover it. 00:27:22.717 [2024-07-15 09:06:11.036406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.036548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.036574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.717 qpair failed and we were unable to recover it. 00:27:22.717 [2024-07-15 09:06:11.036724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.036866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.036896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.717 qpair failed and we were unable to recover it. 00:27:22.717 [2024-07-15 09:06:11.037022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.037191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.037217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.717 qpair failed and we were unable to recover it. 00:27:22.717 [2024-07-15 09:06:11.037359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.037501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.037527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.717 qpair failed and we were unable to recover it. 00:27:22.717 [2024-07-15 09:06:11.037646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.037762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.037788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.717 qpair failed and we were unable to recover it. 00:27:22.717 [2024-07-15 09:06:11.037924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.038032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.038058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.717 qpair failed and we were unable to recover it. 00:27:22.717 [2024-07-15 09:06:11.038216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.038354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.038379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.717 qpair failed and we were unable to recover it. 00:27:22.717 [2024-07-15 09:06:11.038501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.038671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.038707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.717 qpair failed and we were unable to recover it. 00:27:22.717 [2024-07-15 09:06:11.038846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.039003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.039030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.717 qpair failed and we were unable to recover it. 00:27:22.717 [2024-07-15 09:06:11.039176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.717 [2024-07-15 09:06:11.039346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.039372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.718 qpair failed and we were unable to recover it. 00:27:22.718 [2024-07-15 09:06:11.039492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.039628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.039653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.718 qpair failed and we were unable to recover it. 00:27:22.718 [2024-07-15 09:06:11.039827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.039950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.039980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.718 qpair failed and we were unable to recover it. 00:27:22.718 [2024-07-15 09:06:11.040101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.040248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.040274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.718 qpair failed and we were unable to recover it. 00:27:22.718 [2024-07-15 09:06:11.040418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.040593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.040618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.718 qpair failed and we were unable to recover it. 00:27:22.718 [2024-07-15 09:06:11.040737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.040852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.040883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.718 qpair failed and we were unable to recover it. 00:27:22.718 [2024-07-15 09:06:11.041035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.041197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.041221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.718 qpair failed and we were unable to recover it. 00:27:22.718 [2024-07-15 09:06:11.041352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.041498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.041523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.718 qpair failed and we were unable to recover it. 00:27:22.718 [2024-07-15 09:06:11.041673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.041831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.041857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.718 qpair failed and we were unable to recover it. 00:27:22.718 [2024-07-15 09:06:11.041991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.042143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.042168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.718 qpair failed and we were unable to recover it. 00:27:22.718 [2024-07-15 09:06:11.042280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.042398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.042424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.718 qpair failed and we were unable to recover it. 00:27:22.718 [2024-07-15 09:06:11.042562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.042706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.042732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.718 qpair failed and we were unable to recover it. 00:27:22.718 [2024-07-15 09:06:11.042869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.043017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.043043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.718 qpair failed and we were unable to recover it. 00:27:22.718 [2024-07-15 09:06:11.043157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.043317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.043341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.718 qpair failed and we were unable to recover it. 00:27:22.718 [2024-07-15 09:06:11.043489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.043590] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:27:22.718 [2024-07-15 09:06:11.043645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.043653] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:22.718 [2024-07-15 09:06:11.043669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.718 qpair failed and we were unable to recover it. 00:27:22.718 [2024-07-15 09:06:11.043794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.043961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.043987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.718 qpair failed and we were unable to recover it. 00:27:22.718 [2024-07-15 09:06:11.044108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.044267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.044293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.718 qpair failed and we were unable to recover it. 00:27:22.718 [2024-07-15 09:06:11.044468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.044637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.044661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.718 qpair failed and we were unable to recover it. 00:27:22.718 [2024-07-15 09:06:11.044784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.044926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.044956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.718 qpair failed and we were unable to recover it. 00:27:22.718 [2024-07-15 09:06:11.045106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.045279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.045304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.718 qpair failed and we were unable to recover it. 00:27:22.718 [2024-07-15 09:06:11.045453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.045587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.045612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.718 qpair failed and we were unable to recover it. 00:27:22.718 [2024-07-15 09:06:11.045752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.045900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.045925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.718 qpair failed and we were unable to recover it. 00:27:22.718 [2024-07-15 09:06:11.046063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.046207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.046232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.718 qpair failed and we were unable to recover it. 00:27:22.718 [2024-07-15 09:06:11.046404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.046525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.046551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.718 qpair failed and we were unable to recover it. 00:27:22.718 [2024-07-15 09:06:11.046715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.046858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.046887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.718 qpair failed and we were unable to recover it. 00:27:22.718 [2024-07-15 09:06:11.047036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.047152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.047177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.718 qpair failed and we were unable to recover it. 00:27:22.718 [2024-07-15 09:06:11.047293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.047403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.047428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.718 qpair failed and we were unable to recover it. 00:27:22.718 [2024-07-15 09:06:11.047541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.047685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.047711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.718 qpair failed and we were unable to recover it. 00:27:22.718 [2024-07-15 09:06:11.047908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.048055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.048080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.718 qpair failed and we were unable to recover it. 00:27:22.718 [2024-07-15 09:06:11.048226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.048346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.048372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.718 qpair failed and we were unable to recover it. 00:27:22.718 [2024-07-15 09:06:11.048524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.718 [2024-07-15 09:06:11.048671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.048696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.719 qpair failed and we were unable to recover it. 00:27:22.719 [2024-07-15 09:06:11.048819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.048973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.048999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.719 qpair failed and we were unable to recover it. 00:27:22.719 [2024-07-15 09:06:11.049139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.049293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.049319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.719 qpair failed and we were unable to recover it. 00:27:22.719 [2024-07-15 09:06:11.049438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.049552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.049576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.719 qpair failed and we were unable to recover it. 00:27:22.719 [2024-07-15 09:06:11.049716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.049852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.049886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.719 qpair failed and we were unable to recover it. 00:27:22.719 [2024-07-15 09:06:11.050035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.050178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.050204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.719 qpair failed and we were unable to recover it. 00:27:22.719 [2024-07-15 09:06:11.050333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.050478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.050515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.719 qpair failed and we were unable to recover it. 00:27:22.719 [2024-07-15 09:06:11.050685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.050800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.050824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.719 qpair failed and we were unable to recover it. 00:27:22.719 [2024-07-15 09:06:11.050953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.051073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.051098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.719 qpair failed and we were unable to recover it. 00:27:22.719 [2024-07-15 09:06:11.051235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.051366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.051392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.719 qpair failed and we were unable to recover it. 00:27:22.719 [2024-07-15 09:06:11.051539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.051701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.051726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.719 qpair failed and we were unable to recover it. 00:27:22.719 [2024-07-15 09:06:11.051859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.052037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.052064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.719 qpair failed and we were unable to recover it. 00:27:22.719 [2024-07-15 09:06:11.052185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.052338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.052364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.719 qpair failed and we were unable to recover it. 00:27:22.719 [2024-07-15 09:06:11.052486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.052625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.052650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.719 qpair failed and we were unable to recover it. 00:27:22.719 [2024-07-15 09:06:11.052793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.052966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.052991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.719 qpair failed and we were unable to recover it. 00:27:22.719 [2024-07-15 09:06:11.053113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.053230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.053255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.719 qpair failed and we were unable to recover it. 00:27:22.719 [2024-07-15 09:06:11.053370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.053515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.053541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.719 qpair failed and we were unable to recover it. 00:27:22.719 [2024-07-15 09:06:11.053682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.053797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.053822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.719 qpair failed and we were unable to recover it. 00:27:22.719 [2024-07-15 09:06:11.053992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.054122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.054147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.719 qpair failed and we were unable to recover it. 00:27:22.719 [2024-07-15 09:06:11.054312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.054460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.054485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.719 qpair failed and we were unable to recover it. 00:27:22.719 [2024-07-15 09:06:11.054608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.054782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.054807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.719 qpair failed and we were unable to recover it. 00:27:22.719 [2024-07-15 09:06:11.054936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.055055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.055081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.719 qpair failed and we were unable to recover it. 00:27:22.719 [2024-07-15 09:06:11.055259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.055396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.055422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.719 qpair failed and we were unable to recover it. 00:27:22.719 [2024-07-15 09:06:11.055540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.055684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.055709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.719 qpair failed and we were unable to recover it. 00:27:22.719 [2024-07-15 09:06:11.055874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.056032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.056058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.719 qpair failed and we were unable to recover it. 00:27:22.719 [2024-07-15 09:06:11.056229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.056398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.719 [2024-07-15 09:06:11.056423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.719 qpair failed and we were unable to recover it. 00:27:22.719 [2024-07-15 09:06:11.056537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.056711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.056736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.720 qpair failed and we were unable to recover it. 00:27:22.720 [2024-07-15 09:06:11.056888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.057001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.057027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.720 qpair failed and we were unable to recover it. 00:27:22.720 [2024-07-15 09:06:11.057146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.057294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.057318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.720 qpair failed and we were unable to recover it. 00:27:22.720 [2024-07-15 09:06:11.057448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.057603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.057630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.720 qpair failed and we were unable to recover it. 00:27:22.720 [2024-07-15 09:06:11.057801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.057947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.057972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.720 qpair failed and we were unable to recover it. 00:27:22.720 [2024-07-15 09:06:11.058123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.058268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.058293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.720 qpair failed and we were unable to recover it. 00:27:22.720 [2024-07-15 09:06:11.058433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.058578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.058605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.720 qpair failed and we were unable to recover it. 00:27:22.720 [2024-07-15 09:06:11.058775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.058921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.058947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.720 qpair failed and we were unable to recover it. 00:27:22.720 [2024-07-15 09:06:11.059115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.059266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.059290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.720 qpair failed and we were unable to recover it. 00:27:22.720 [2024-07-15 09:06:11.059421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.059551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.059576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.720 qpair failed and we were unable to recover it. 00:27:22.720 [2024-07-15 09:06:11.059721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.059888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.059914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.720 qpair failed and we were unable to recover it. 00:27:22.720 [2024-07-15 09:06:11.060033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.060176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.060202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.720 qpair failed and we were unable to recover it. 00:27:22.720 [2024-07-15 09:06:11.060350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.060485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.060509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.720 qpair failed and we were unable to recover it. 00:27:22.720 [2024-07-15 09:06:11.060650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.060772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.060801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.720 qpair failed and we were unable to recover it. 00:27:22.720 [2024-07-15 09:06:11.060948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.061110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.061134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.720 qpair failed and we were unable to recover it. 00:27:22.720 [2024-07-15 09:06:11.061317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.061469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.061494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.720 qpair failed and we were unable to recover it. 00:27:22.720 [2024-07-15 09:06:11.061640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.061751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.061775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.720 qpair failed and we were unable to recover it. 00:27:22.720 [2024-07-15 09:06:11.061922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.062063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.062087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.720 qpair failed and we were unable to recover it. 00:27:22.720 [2024-07-15 09:06:11.062200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.062338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.062362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.720 qpair failed and we were unable to recover it. 00:27:22.720 [2024-07-15 09:06:11.062474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.062593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.062617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.720 qpair failed and we were unable to recover it. 00:27:22.720 [2024-07-15 09:06:11.062785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.062919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.062944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.720 qpair failed and we were unable to recover it. 00:27:22.720 [2024-07-15 09:06:11.063091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.063213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.063239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.720 qpair failed and we were unable to recover it. 00:27:22.720 [2024-07-15 09:06:11.063394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.063558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.063583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.720 qpair failed and we were unable to recover it. 00:27:22.720 [2024-07-15 09:06:11.063724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.063883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.063908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.720 qpair failed and we were unable to recover it. 00:27:22.720 [2024-07-15 09:06:11.064081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.064197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.064223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.720 qpair failed and we were unable to recover it. 00:27:22.720 [2024-07-15 09:06:11.064376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.064520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.064544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.720 qpair failed and we were unable to recover it. 00:27:22.720 [2024-07-15 09:06:11.064686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.064807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.064832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.720 qpair failed and we were unable to recover it. 00:27:22.720 [2024-07-15 09:06:11.065069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.065209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.065247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.720 qpair failed and we were unable to recover it. 00:27:22.720 [2024-07-15 09:06:11.065389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.065554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.065579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.720 qpair failed and we were unable to recover it. 00:27:22.720 [2024-07-15 09:06:11.065724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.065847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.065871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.720 qpair failed and we were unable to recover it. 00:27:22.720 [2024-07-15 09:06:11.066026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.066167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.720 [2024-07-15 09:06:11.066193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.720 qpair failed and we were unable to recover it. 00:27:22.721 [2024-07-15 09:06:11.066368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.066514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.066540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.721 qpair failed and we were unable to recover it. 00:27:22.721 [2024-07-15 09:06:11.066719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.066872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.066903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.721 qpair failed and we were unable to recover it. 00:27:22.721 [2024-07-15 09:06:11.067055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.067196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.067222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.721 qpair failed and we were unable to recover it. 00:27:22.721 [2024-07-15 09:06:11.067397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.067537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.067562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.721 qpair failed and we were unable to recover it. 00:27:22.721 [2024-07-15 09:06:11.067718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.067863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.067899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.721 qpair failed and we were unable to recover it. 00:27:22.721 [2024-07-15 09:06:11.068047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.068197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.068223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.721 qpair failed and we were unable to recover it. 00:27:22.721 [2024-07-15 09:06:11.068373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.068544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.068570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.721 qpair failed and we were unable to recover it. 00:27:22.721 [2024-07-15 09:06:11.068737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.068887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.068913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.721 qpair failed and we were unable to recover it. 00:27:22.721 [2024-07-15 09:06:11.069062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.069181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.069207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.721 qpair failed and we were unable to recover it. 00:27:22.721 [2024-07-15 09:06:11.069351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.069498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.069524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.721 qpair failed and we were unable to recover it. 00:27:22.721 [2024-07-15 09:06:11.069674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.069796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.069822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.721 qpair failed and we were unable to recover it. 00:27:22.721 [2024-07-15 09:06:11.069988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.070112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.070138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.721 qpair failed and we were unable to recover it. 00:27:22.721 [2024-07-15 09:06:11.070298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.070443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.070469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.721 qpair failed and we were unable to recover it. 00:27:22.721 [2024-07-15 09:06:11.070624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.070779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.070805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.721 qpair failed and we were unable to recover it. 00:27:22.721 [2024-07-15 09:06:11.070936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.071081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.071108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.721 qpair failed and we were unable to recover it. 00:27:22.721 [2024-07-15 09:06:11.071256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.071427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.071453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.721 qpair failed and we were unable to recover it. 00:27:22.721 [2024-07-15 09:06:11.071599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.071770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.071796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.721 qpair failed and we were unable to recover it. 00:27:22.721 [2024-07-15 09:06:11.071911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.072020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.072046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.721 qpair failed and we were unable to recover it. 00:27:22.721 [2024-07-15 09:06:11.072207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.072385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.072411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.721 qpair failed and we were unable to recover it. 00:27:22.721 [2024-07-15 09:06:11.072583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.072729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.072765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.721 qpair failed and we were unable to recover it. 00:27:22.721 [2024-07-15 09:06:11.072930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.073111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.073137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.721 qpair failed and we were unable to recover it. 00:27:22.721 [2024-07-15 09:06:11.073293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.073410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.073439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.721 qpair failed and we were unable to recover it. 00:27:22.721 [2024-07-15 09:06:11.073581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.073706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.073731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.721 qpair failed and we were unable to recover it. 00:27:22.721 [2024-07-15 09:06:11.073848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.074006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.074036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.721 qpair failed and we were unable to recover it. 00:27:22.721 [2024-07-15 09:06:11.074191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.074309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.074335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.721 qpair failed and we were unable to recover it. 00:27:22.721 [2024-07-15 09:06:11.074481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.074652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.074678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.721 qpair failed and we were unable to recover it. 00:27:22.721 [2024-07-15 09:06:11.074833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.075008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.075035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.721 qpair failed and we were unable to recover it. 00:27:22.721 [2024-07-15 09:06:11.075160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.075287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.075312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.721 qpair failed and we were unable to recover it. 00:27:22.721 [2024-07-15 09:06:11.075456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.075613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.075637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.721 qpair failed and we were unable to recover it. 00:27:22.721 [2024-07-15 09:06:11.075795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.075924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.075952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.721 qpair failed and we were unable to recover it. 00:27:22.721 [2024-07-15 09:06:11.076064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.076207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.721 [2024-07-15 09:06:11.076234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.721 qpair failed and we were unable to recover it. 00:27:22.722 [2024-07-15 09:06:11.076380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.076541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.076566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.722 qpair failed and we were unable to recover it. 00:27:22.722 [2024-07-15 09:06:11.076691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.076860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.076890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.722 qpair failed and we were unable to recover it. 00:27:22.722 [2024-07-15 09:06:11.077029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.077194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.077225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.722 qpair failed and we were unable to recover it. 00:27:22.722 [2024-07-15 09:06:11.077365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.077533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.077557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.722 qpair failed and we were unable to recover it. 00:27:22.722 [2024-07-15 09:06:11.077703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.077829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.077854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.722 qpair failed and we were unable to recover it. 00:27:22.722 [2024-07-15 09:06:11.078028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.078168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.078203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.722 qpair failed and we were unable to recover it. 00:27:22.722 [2024-07-15 09:06:11.078346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.078465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.078492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.722 qpair failed and we were unable to recover it. 00:27:22.722 [2024-07-15 09:06:11.078640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.078754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.078779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.722 qpair failed and we were unable to recover it. 00:27:22.722 [2024-07-15 09:06:11.078929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.079090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.079115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.722 qpair failed and we were unable to recover it. 00:27:22.722 [2024-07-15 09:06:11.079265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.079377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.079402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.722 qpair failed and we were unable to recover it. 00:27:22.722 [2024-07-15 09:06:11.079572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.079685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.079709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.722 qpair failed and we were unable to recover it. 00:27:22.722 [2024-07-15 09:06:11.079828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.079989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.080015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.722 qpair failed and we were unable to recover it. 00:27:22.722 [2024-07-15 09:06:11.080157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.080285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.080310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.722 qpair failed and we were unable to recover it. 00:27:22.722 [2024-07-15 09:06:11.080463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.080616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.080641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.722 qpair failed and we were unable to recover it. 00:27:22.722 [2024-07-15 09:06:11.080796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.080932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.080958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.722 qpair failed and we were unable to recover it. 00:27:22.722 [2024-07-15 09:06:11.081126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.081277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.081302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.722 qpair failed and we were unable to recover it. 00:27:22.722 [2024-07-15 09:06:11.081452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.081568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.081593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.722 qpair failed and we were unable to recover it. 00:27:22.722 [2024-07-15 09:06:11.081713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.081860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.081891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.722 qpair failed and we were unable to recover it. 00:27:22.722 [2024-07-15 09:06:11.082005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.082124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 EAL: No free 2048 kB hugepages reported on node 1 00:27:22.722 [2024-07-15 09:06:11.082149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.722 qpair failed and we were unable to recover it. 00:27:22.722 [2024-07-15 09:06:11.082281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.082392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.082416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.722 qpair failed and we were unable to recover it. 00:27:22.722 [2024-07-15 09:06:11.082544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.082715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.082739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.722 qpair failed and we were unable to recover it. 00:27:22.722 [2024-07-15 09:06:11.082909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.083029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.083054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.722 qpair failed and we were unable to recover it. 00:27:22.722 [2024-07-15 09:06:11.083182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.083323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.083349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.722 qpair failed and we were unable to recover it. 00:27:22.722 [2024-07-15 09:06:11.083518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.083632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.083657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.722 qpair failed and we were unable to recover it. 00:27:22.722 [2024-07-15 09:06:11.083802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.083959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.083983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.722 qpair failed and we were unable to recover it. 00:27:22.722 [2024-07-15 09:06:11.084131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.084243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.084268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.722 qpair failed and we were unable to recover it. 00:27:22.722 [2024-07-15 09:06:11.084413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.084540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.084565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.722 qpair failed and we were unable to recover it. 00:27:22.722 [2024-07-15 09:06:11.084711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.084857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.084900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.722 qpair failed and we were unable to recover it. 00:27:22.722 [2024-07-15 09:06:11.085071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.085238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.085263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.722 qpair failed and we were unable to recover it. 00:27:22.722 [2024-07-15 09:06:11.085434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.085555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.085582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.722 qpair failed and we were unable to recover it. 00:27:22.722 [2024-07-15 09:06:11.085699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.722 [2024-07-15 09:06:11.085819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.085844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.723 qpair failed and we were unable to recover it. 00:27:22.723 [2024-07-15 09:06:11.086008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.086123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.086148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.723 qpair failed and we were unable to recover it. 00:27:22.723 [2024-07-15 09:06:11.086277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.086449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.086474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.723 qpair failed and we were unable to recover it. 00:27:22.723 [2024-07-15 09:06:11.086627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.086797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.086823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.723 qpair failed and we were unable to recover it. 00:27:22.723 [2024-07-15 09:06:11.086970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.087094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.087118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.723 qpair failed and we were unable to recover it. 00:27:22.723 [2024-07-15 09:06:11.087275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.087396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.087421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.723 qpair failed and we were unable to recover it. 00:27:22.723 [2024-07-15 09:06:11.087590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.087710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.087735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.723 qpair failed and we were unable to recover it. 00:27:22.723 [2024-07-15 09:06:11.087903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.088021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.088046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.723 qpair failed and we were unable to recover it. 00:27:22.723 [2024-07-15 09:06:11.088167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.088308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.088334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.723 qpair failed and we were unable to recover it. 00:27:22.723 [2024-07-15 09:06:11.088479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.088622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.088647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.723 qpair failed and we were unable to recover it. 00:27:22.723 [2024-07-15 09:06:11.088788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.088969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.089002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.723 qpair failed and we were unable to recover it. 00:27:22.723 [2024-07-15 09:06:11.089178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.089323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.089347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.723 qpair failed and we were unable to recover it. 00:27:22.723 [2024-07-15 09:06:11.089484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.089628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.089653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.723 qpair failed and we were unable to recover it. 00:27:22.723 [2024-07-15 09:06:11.089810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.089946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.089971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.723 qpair failed and we were unable to recover it. 00:27:22.723 [2024-07-15 09:06:11.090108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.090254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.090280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.723 qpair failed and we were unable to recover it. 00:27:22.723 [2024-07-15 09:06:11.090417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.090561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.090587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.723 qpair failed and we were unable to recover it. 00:27:22.723 [2024-07-15 09:06:11.090712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.090884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.090909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.723 qpair failed and we were unable to recover it. 00:27:22.723 [2024-07-15 09:06:11.091073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.091209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.091234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.723 qpair failed and we were unable to recover it. 00:27:22.723 [2024-07-15 09:06:11.091380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.091550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.091575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.723 qpair failed and we were unable to recover it. 00:27:22.723 [2024-07-15 09:06:11.091724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.091883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.091909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.723 qpair failed and we were unable to recover it. 00:27:22.723 [2024-07-15 09:06:11.092049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.092166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.092191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.723 qpair failed and we were unable to recover it. 00:27:22.723 [2024-07-15 09:06:11.092342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.092500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.092525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.723 qpair failed and we were unable to recover it. 00:27:22.723 [2024-07-15 09:06:11.092670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.092791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.092817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.723 qpair failed and we were unable to recover it. 00:27:22.723 [2024-07-15 09:06:11.092964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.093088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.093117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.723 qpair failed and we were unable to recover it. 00:27:22.723 [2024-07-15 09:06:11.093234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.093359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.093384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.723 qpair failed and we were unable to recover it. 00:27:22.723 [2024-07-15 09:06:11.093553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.093673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.093697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.723 qpair failed and we were unable to recover it. 00:27:22.723 [2024-07-15 09:06:11.093841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.093974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.093999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.723 qpair failed and we were unable to recover it. 00:27:22.723 [2024-07-15 09:06:11.094166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.094290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.094314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.723 qpair failed and we were unable to recover it. 00:27:22.723 [2024-07-15 09:06:11.094435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.094572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.723 [2024-07-15 09:06:11.094598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.724 qpair failed and we were unable to recover it. 00:27:22.724 [2024-07-15 09:06:11.094736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.094910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.094936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.724 qpair failed and we were unable to recover it. 00:27:22.724 [2024-07-15 09:06:11.095063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.095185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.095209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.724 qpair failed and we were unable to recover it. 00:27:22.724 [2024-07-15 09:06:11.095330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.095449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.095474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.724 qpair failed and we were unable to recover it. 00:27:22.724 [2024-07-15 09:06:11.095601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.095764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.095789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.724 qpair failed and we were unable to recover it. 00:27:22.724 [2024-07-15 09:06:11.095931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.096075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.096100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.724 qpair failed and we were unable to recover it. 00:27:22.724 [2024-07-15 09:06:11.096252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.096397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.096422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.724 qpair failed and we were unable to recover it. 00:27:22.724 [2024-07-15 09:06:11.096594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.096741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.096766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.724 qpair failed and we were unable to recover it. 00:27:22.724 [2024-07-15 09:06:11.096910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.097063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.097088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.724 qpair failed and we were unable to recover it. 00:27:22.724 [2024-07-15 09:06:11.097235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.097376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.097401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.724 qpair failed and we were unable to recover it. 00:27:22.724 [2024-07-15 09:06:11.097539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.097687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.097712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.724 qpair failed and we were unable to recover it. 00:27:22.724 [2024-07-15 09:06:11.097883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.098002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.098027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.724 qpair failed and we were unable to recover it. 00:27:22.724 [2024-07-15 09:06:11.098173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.098319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.098343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.724 qpair failed and we were unable to recover it. 00:27:22.724 [2024-07-15 09:06:11.098462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.098633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.098658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.724 qpair failed and we were unable to recover it. 00:27:22.724 [2024-07-15 09:06:11.098801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.098948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.098975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.724 qpair failed and we were unable to recover it. 00:27:22.724 [2024-07-15 09:06:11.099147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.099325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.099350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.724 qpair failed and we were unable to recover it. 00:27:22.724 [2024-07-15 09:06:11.099516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.099639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.099664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.724 qpair failed and we were unable to recover it. 00:27:22.724 [2024-07-15 09:06:11.099808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.099942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.099968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.724 qpair failed and we were unable to recover it. 00:27:22.724 [2024-07-15 09:06:11.100140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.100282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.100308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.724 qpair failed and we were unable to recover it. 00:27:22.724 [2024-07-15 09:06:11.100452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.100623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.100648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.724 qpair failed and we were unable to recover it. 00:27:22.724 [2024-07-15 09:06:11.100825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.100975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.101001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.724 qpair failed and we were unable to recover it. 00:27:22.724 [2024-07-15 09:06:11.101115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.101242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.101268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.724 qpair failed and we were unable to recover it. 00:27:22.724 [2024-07-15 09:06:11.101414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.101529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.101556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.724 qpair failed and we were unable to recover it. 00:27:22.724 [2024-07-15 09:06:11.101682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.101805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.101830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.724 qpair failed and we were unable to recover it. 00:27:22.724 [2024-07-15 09:06:11.101943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.102063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.102088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.724 qpair failed and we were unable to recover it. 00:27:22.724 [2024-07-15 09:06:11.102198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.102364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.102390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.724 qpair failed and we were unable to recover it. 00:27:22.724 [2024-07-15 09:06:11.102532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.102665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.102690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.724 qpair failed and we were unable to recover it. 00:27:22.724 [2024-07-15 09:06:11.102859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.103026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.103052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.724 qpair failed and we were unable to recover it. 00:27:22.724 [2024-07-15 09:06:11.103195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.103320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.103346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.724 qpair failed and we were unable to recover it. 00:27:22.724 [2024-07-15 09:06:11.103518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.724 [2024-07-15 09:06:11.103690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.103716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.725 qpair failed and we were unable to recover it. 00:27:22.725 [2024-07-15 09:06:11.103867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.103998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.104023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.725 qpair failed and we were unable to recover it. 00:27:22.725 [2024-07-15 09:06:11.104170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.104280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.104306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.725 qpair failed and we were unable to recover it. 00:27:22.725 [2024-07-15 09:06:11.104478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.104597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.104622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.725 qpair failed and we were unable to recover it. 00:27:22.725 [2024-07-15 09:06:11.104786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.104935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.104961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.725 qpair failed and we were unable to recover it. 00:27:22.725 [2024-07-15 09:06:11.105104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.105245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.105270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.725 qpair failed and we were unable to recover it. 00:27:22.725 [2024-07-15 09:06:11.105395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.105537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.105562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.725 qpair failed and we were unable to recover it. 00:27:22.725 [2024-07-15 09:06:11.105705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.105825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.105854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.725 qpair failed and we were unable to recover it. 00:27:22.725 [2024-07-15 09:06:11.105988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.106129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.106155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.725 qpair failed and we were unable to recover it. 00:27:22.725 [2024-07-15 09:06:11.106313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.106460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.106488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.725 qpair failed and we were unable to recover it. 00:27:22.725 [2024-07-15 09:06:11.106632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.106775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.106800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.725 qpair failed and we were unable to recover it. 00:27:22.725 [2024-07-15 09:06:11.106944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.107089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.107114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.725 qpair failed and we were unable to recover it. 00:27:22.725 [2024-07-15 09:06:11.107268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.107412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.107438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.725 qpair failed and we were unable to recover it. 00:27:22.725 [2024-07-15 09:06:11.107578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.107723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.107749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.725 qpair failed and we were unable to recover it. 00:27:22.725 [2024-07-15 09:06:11.107860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.108013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.108039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.725 qpair failed and we were unable to recover it. 00:27:22.725 [2024-07-15 09:06:11.108160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.108317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.108342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.725 qpair failed and we were unable to recover it. 00:27:22.725 [2024-07-15 09:06:11.108490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.108634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.108660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.725 qpair failed and we were unable to recover it. 00:27:22.725 [2024-07-15 09:06:11.108799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.108925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.108951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.725 qpair failed and we were unable to recover it. 00:27:22.725 [2024-07-15 09:06:11.109103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.109237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.109262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.725 qpair failed and we were unable to recover it. 00:27:22.725 [2024-07-15 09:06:11.109425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.109560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.109585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.725 qpair failed and we were unable to recover it. 00:27:22.725 [2024-07-15 09:06:11.109757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.109906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.109941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.725 qpair failed and we were unable to recover it. 00:27:22.725 [2024-07-15 09:06:11.110101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.110249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.110276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.725 qpair failed and we were unable to recover it. 00:27:22.725 [2024-07-15 09:06:11.110423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.110593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.110618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.725 qpair failed and we were unable to recover it. 00:27:22.725 [2024-07-15 09:06:11.110792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.110915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.110940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.725 qpair failed and we were unable to recover it. 00:27:22.725 [2024-07-15 09:06:11.111091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.111236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.111262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.725 qpair failed and we were unable to recover it. 00:27:22.725 [2024-07-15 09:06:11.111374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.111553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.111580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.725 qpair failed and we were unable to recover it. 00:27:22.725 [2024-07-15 09:06:11.111701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.111857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.111887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.725 qpair failed and we were unable to recover it. 00:27:22.725 [2024-07-15 09:06:11.112068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.112188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.112213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.725 qpair failed and we were unable to recover it. 00:27:22.725 [2024-07-15 09:06:11.112357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.112473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.112499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.725 qpair failed and we were unable to recover it. 00:27:22.725 [2024-07-15 09:06:11.112642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.112763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.112788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.725 qpair failed and we were unable to recover it. 00:27:22.725 [2024-07-15 09:06:11.112909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.113059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.725 [2024-07-15 09:06:11.113084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.725 qpair failed and we were unable to recover it. 00:27:22.726 [2024-07-15 09:06:11.113225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.113344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.113370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.726 qpair failed and we were unable to recover it. 00:27:22.726 [2024-07-15 09:06:11.113513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.113658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.113683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.726 qpair failed and we were unable to recover it. 00:27:22.726 [2024-07-15 09:06:11.113829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.113952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.113977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.726 qpair failed and we were unable to recover it. 00:27:22.726 [2024-07-15 09:06:11.114141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.114275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.114300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.726 qpair failed and we were unable to recover it. 00:27:22.726 [2024-07-15 09:06:11.114442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.114611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.114636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.726 qpair failed and we were unable to recover it. 00:27:22.726 [2024-07-15 09:06:11.114781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.114935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.114960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.726 qpair failed and we were unable to recover it. 00:27:22.726 [2024-07-15 09:06:11.115127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.115259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.115284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.726 qpair failed and we were unable to recover it. 00:27:22.726 [2024-07-15 09:06:11.115408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.115555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.115581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.726 qpair failed and we were unable to recover it. 00:27:22.726 [2024-07-15 09:06:11.115735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.115860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.115891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.726 qpair failed and we were unable to recover it. 00:27:22.726 [2024-07-15 09:06:11.116013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.116130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.116155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.726 qpair failed and we were unable to recover it. 00:27:22.726 [2024-07-15 09:06:11.116325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.116480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.116506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.726 qpair failed and we were unable to recover it. 00:27:22.726 [2024-07-15 09:06:11.116646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.116647] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:22.726 [2024-07-15 09:06:11.116765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.116790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.726 qpair failed and we were unable to recover it. 00:27:22.726 [2024-07-15 09:06:11.116911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.117061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.117086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.726 qpair failed and we were unable to recover it. 00:27:22.726 [2024-07-15 09:06:11.117224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.117344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.117371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.726 qpair failed and we were unable to recover it. 00:27:22.726 [2024-07-15 09:06:11.117520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.117688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.117715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.726 qpair failed and we were unable to recover it. 00:27:22.726 [2024-07-15 09:06:11.117899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.118075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.118100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.726 qpair failed and we were unable to recover it. 00:27:22.726 [2024-07-15 09:06:11.118230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.118375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.118402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.726 qpair failed and we were unable to recover it. 00:27:22.726 [2024-07-15 09:06:11.118550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.118674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.118700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.726 qpair failed and we were unable to recover it. 00:27:22.726 [2024-07-15 09:06:11.118872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.119032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.119057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.726 qpair failed and we were unable to recover it. 00:27:22.726 [2024-07-15 09:06:11.119182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.119318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.119344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.726 qpair failed and we were unable to recover it. 00:27:22.726 [2024-07-15 09:06:11.119487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.119610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.119637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.726 qpair failed and we were unable to recover it. 00:27:22.726 [2024-07-15 09:06:11.119779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.119907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.119943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.726 qpair failed and we were unable to recover it. 00:27:22.726 [2024-07-15 09:06:11.120067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.120189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.120215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.726 qpair failed and we were unable to recover it. 00:27:22.726 [2024-07-15 09:06:11.120351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.120509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.120534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.726 qpair failed and we were unable to recover it. 00:27:22.726 [2024-07-15 09:06:11.120659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.120777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.120803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.726 qpair failed and we were unable to recover it. 00:27:22.726 [2024-07-15 09:06:11.120949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.121095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.121122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.726 qpair failed and we were unable to recover it. 00:27:22.726 [2024-07-15 09:06:11.121276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.121393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.121418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.726 qpair failed and we were unable to recover it. 00:27:22.726 [2024-07-15 09:06:11.121555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.121681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.121706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.726 qpair failed and we were unable to recover it. 00:27:22.726 [2024-07-15 09:06:11.121827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.121965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.121990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.726 qpair failed and we were unable to recover it. 00:27:22.726 [2024-07-15 09:06:11.122108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.122251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.122276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.726 qpair failed and we were unable to recover it. 00:27:22.726 [2024-07-15 09:06:11.122400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.726 [2024-07-15 09:06:11.122546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.122572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.727 qpair failed and we were unable to recover it. 00:27:22.727 [2024-07-15 09:06:11.122761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.122911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.122941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.727 qpair failed and we were unable to recover it. 00:27:22.727 [2024-07-15 09:06:11.123087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.123234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.123260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.727 qpair failed and we were unable to recover it. 00:27:22.727 [2024-07-15 09:06:11.123385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.123498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.123523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.727 qpair failed and we were unable to recover it. 00:27:22.727 [2024-07-15 09:06:11.123672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.123816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.123842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.727 qpair failed and we were unable to recover it. 00:27:22.727 [2024-07-15 09:06:11.123984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.124132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.124158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.727 qpair failed and we were unable to recover it. 00:27:22.727 [2024-07-15 09:06:11.124331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.124470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.124495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.727 qpair failed and we were unable to recover it. 00:27:22.727 [2024-07-15 09:06:11.124665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.124809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.124842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.727 qpair failed and we were unable to recover it. 00:27:22.727 [2024-07-15 09:06:11.125005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.125130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.125156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.727 qpair failed and we were unable to recover it. 00:27:22.727 [2024-07-15 09:06:11.125270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.125404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.125430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.727 qpair failed and we were unable to recover it. 00:27:22.727 [2024-07-15 09:06:11.125571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.125718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.125744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.727 qpair failed and we were unable to recover it. 00:27:22.727 [2024-07-15 09:06:11.125925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.126068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.126094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.727 qpair failed and we were unable to recover it. 00:27:22.727 [2024-07-15 09:06:11.126233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.126384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.126410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.727 qpair failed and we were unable to recover it. 00:27:22.727 [2024-07-15 09:06:11.126532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.126674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.126701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.727 qpair failed and we were unable to recover it. 00:27:22.727 [2024-07-15 09:06:11.126811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.126936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.126962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.727 qpair failed and we were unable to recover it. 00:27:22.727 [2024-07-15 09:06:11.127130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.127281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.127306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.727 qpair failed and we were unable to recover it. 00:27:22.727 [2024-07-15 09:06:11.127448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.127618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.127644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.727 qpair failed and we were unable to recover it. 00:27:22.727 [2024-07-15 09:06:11.127790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.127915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.127941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.727 qpair failed and we were unable to recover it. 00:27:22.727 [2024-07-15 09:06:11.128069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.128239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.128265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.727 qpair failed and we were unable to recover it. 00:27:22.727 [2024-07-15 09:06:11.128386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.128529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.128555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.727 qpair failed and we were unable to recover it. 00:27:22.727 [2024-07-15 09:06:11.128672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.128799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.128825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.727 qpair failed and we were unable to recover it. 00:27:22.727 [2024-07-15 09:06:11.128977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.129123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.129148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.727 qpair failed and we were unable to recover it. 00:27:22.727 [2024-07-15 09:06:11.129329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.129453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.129479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.727 qpair failed and we were unable to recover it. 00:27:22.727 [2024-07-15 09:06:11.129599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.129717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.129743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.727 qpair failed and we were unable to recover it. 00:27:22.727 [2024-07-15 09:06:11.129889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.130046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.130071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.727 qpair failed and we were unable to recover it. 00:27:22.727 [2024-07-15 09:06:11.130243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.130388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.130415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.727 qpair failed and we were unable to recover it. 00:27:22.727 [2024-07-15 09:06:11.130537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.130682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.130708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.727 qpair failed and we were unable to recover it. 00:27:22.727 [2024-07-15 09:06:11.130922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.131066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.131093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.727 qpair failed and we were unable to recover it. 00:27:22.727 [2024-07-15 09:06:11.131242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.131365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.131392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.727 qpair failed and we were unable to recover it. 00:27:22.727 [2024-07-15 09:06:11.131520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.131640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.131666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.727 qpair failed and we were unable to recover it. 00:27:22.727 [2024-07-15 09:06:11.131836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.131985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.132012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.727 qpair failed and we were unable to recover it. 00:27:22.727 [2024-07-15 09:06:11.132157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.727 [2024-07-15 09:06:11.132270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.132296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.728 qpair failed and we were unable to recover it. 00:27:22.728 [2024-07-15 09:06:11.132445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.132563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.132589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.728 qpair failed and we were unable to recover it. 00:27:22.728 [2024-07-15 09:06:11.132739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.132855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.132886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.728 qpair failed and we were unable to recover it. 00:27:22.728 [2024-07-15 09:06:11.133030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.133198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.133225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.728 qpair failed and we were unable to recover it. 00:27:22.728 [2024-07-15 09:06:11.133364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.133533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.133560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.728 qpair failed and we were unable to recover it. 00:27:22.728 [2024-07-15 09:06:11.133712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.133829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.133856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.728 qpair failed and we were unable to recover it. 00:27:22.728 [2024-07-15 09:06:11.134040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.134173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.134199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.728 qpair failed and we were unable to recover it. 00:27:22.728 [2024-07-15 09:06:11.134382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.134508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.134535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.728 qpair failed and we were unable to recover it. 00:27:22.728 [2024-07-15 09:06:11.134682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.134825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.134851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.728 qpair failed and we were unable to recover it. 00:27:22.728 [2024-07-15 09:06:11.135038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.135185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.135212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.728 qpair failed and we were unable to recover it. 00:27:22.728 [2024-07-15 09:06:11.135327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.135447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.135474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.728 qpair failed and we were unable to recover it. 00:27:22.728 [2024-07-15 09:06:11.135656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.135801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.135827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.728 qpair failed and we were unable to recover it. 00:27:22.728 [2024-07-15 09:06:11.135942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.136062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.136088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.728 qpair failed and we were unable to recover it. 00:27:22.728 [2024-07-15 09:06:11.136242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.136367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.136394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.728 qpair failed and we were unable to recover it. 00:27:22.728 [2024-07-15 09:06:11.136517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.136684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.136710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.728 qpair failed and we were unable to recover it. 00:27:22.728 [2024-07-15 09:06:11.136857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.136980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.137006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.728 qpair failed and we were unable to recover it. 00:27:22.728 [2024-07-15 09:06:11.137152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.137327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.137353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.728 qpair failed and we were unable to recover it. 00:27:22.728 [2024-07-15 09:06:11.137495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.137651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.137678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.728 qpair failed and we were unable to recover it. 00:27:22.728 [2024-07-15 09:06:11.137822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.137973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.137999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.728 qpair failed and we were unable to recover it. 00:27:22.728 [2024-07-15 09:06:11.138122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.138246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.138273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.728 qpair failed and we were unable to recover it. 00:27:22.728 [2024-07-15 09:06:11.138426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.138598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.138624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.728 qpair failed and we were unable to recover it. 00:27:22.728 [2024-07-15 09:06:11.138743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.138863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.138909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.728 qpair failed and we were unable to recover it. 00:27:22.728 [2024-07-15 09:06:11.139053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.139175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.139201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.728 qpair failed and we were unable to recover it. 00:27:22.728 [2024-07-15 09:06:11.139323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.139465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.139491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.728 qpair failed and we were unable to recover it. 00:27:22.728 [2024-07-15 09:06:11.139636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.139760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.139787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.728 qpair failed and we were unable to recover it. 00:27:22.728 [2024-07-15 09:06:11.139940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.140092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.140118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.728 qpair failed and we were unable to recover it. 00:27:22.728 [2024-07-15 09:06:11.140270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.140385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.728 [2024-07-15 09:06:11.140411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.728 qpair failed and we were unable to recover it. 00:27:22.729 [2024-07-15 09:06:11.140535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.140656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.140686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.729 qpair failed and we were unable to recover it. 00:27:22.729 [2024-07-15 09:06:11.140837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.140962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.140988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.729 qpair failed and we were unable to recover it. 00:27:22.729 [2024-07-15 09:06:11.141112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.141261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.141286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.729 qpair failed and we were unable to recover it. 00:27:22.729 [2024-07-15 09:06:11.141403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.141573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.141599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.729 qpair failed and we were unable to recover it. 00:27:22.729 [2024-07-15 09:06:11.141714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.141854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.141885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.729 qpair failed and we were unable to recover it. 00:27:22.729 [2024-07-15 09:06:11.142037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.142161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.142195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.729 qpair failed and we were unable to recover it. 00:27:22.729 [2024-07-15 09:06:11.142347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.142518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.142544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.729 qpair failed and we were unable to recover it. 00:27:22.729 [2024-07-15 09:06:11.142689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.142836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.142862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.729 qpair failed and we were unable to recover it. 00:27:22.729 [2024-07-15 09:06:11.143062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.143206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.143233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.729 qpair failed and we were unable to recover it. 00:27:22.729 [2024-07-15 09:06:11.143381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.143505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.143530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.729 qpair failed and we were unable to recover it. 00:27:22.729 [2024-07-15 09:06:11.143669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.143787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.143812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.729 qpair failed and we were unable to recover it. 00:27:22.729 [2024-07-15 09:06:11.143937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.144075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.144100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.729 qpair failed and we were unable to recover it. 00:27:22.729 [2024-07-15 09:06:11.144213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.144378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.144404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.729 qpair failed and we were unable to recover it. 00:27:22.729 [2024-07-15 09:06:11.144532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.144689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.144715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.729 qpair failed and we were unable to recover it. 00:27:22.729 [2024-07-15 09:06:11.144864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.145025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.145052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.729 qpair failed and we were unable to recover it. 00:27:22.729 [2024-07-15 09:06:11.145180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.145362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.145388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.729 qpair failed and we were unable to recover it. 00:27:22.729 [2024-07-15 09:06:11.145529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.145687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.145713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.729 qpair failed and we were unable to recover it. 00:27:22.729 [2024-07-15 09:06:11.145883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.146028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.146054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.729 qpair failed and we were unable to recover it. 00:27:22.729 [2024-07-15 09:06:11.146172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.146290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.146316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.729 qpair failed and we were unable to recover it. 00:27:22.729 [2024-07-15 09:06:11.146458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.146584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.146610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.729 qpair failed and we were unable to recover it. 00:27:22.729 [2024-07-15 09:06:11.146780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.146923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.146950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.729 qpair failed and we were unable to recover it. 00:27:22.729 [2024-07-15 09:06:11.147096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.147261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.147287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.729 qpair failed and we were unable to recover it. 00:27:22.729 [2024-07-15 09:06:11.147425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.147568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.147593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.729 qpair failed and we were unable to recover it. 00:27:22.729 [2024-07-15 09:06:11.147741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.147887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.147926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.729 qpair failed and we were unable to recover it. 00:27:22.729 [2024-07-15 09:06:11.148082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.148251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.148277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.729 qpair failed and we were unable to recover it. 00:27:22.729 [2024-07-15 09:06:11.148420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.148558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.148584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.729 qpair failed and we were unable to recover it. 00:27:22.729 [2024-07-15 09:06:11.148731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.148895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.148921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.729 qpair failed and we were unable to recover it. 00:27:22.729 [2024-07-15 09:06:11.149069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.149186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.149212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.729 qpair failed and we were unable to recover it. 00:27:22.729 [2024-07-15 09:06:11.149360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.149485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.149512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.729 qpair failed and we were unable to recover it. 00:27:22.729 [2024-07-15 09:06:11.149684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.149802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.149828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.729 qpair failed and we were unable to recover it. 00:27:22.729 [2024-07-15 09:06:11.150009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.150126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.729 [2024-07-15 09:06:11.150151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.729 qpair failed and we were unable to recover it. 00:27:22.730 [2024-07-15 09:06:11.150308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.150457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.150483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.730 qpair failed and we were unable to recover it. 00:27:22.730 [2024-07-15 09:06:11.150633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.150804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.150831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.730 qpair failed and we were unable to recover it. 00:27:22.730 [2024-07-15 09:06:11.150981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.151154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.151191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.730 qpair failed and we were unable to recover it. 00:27:22.730 [2024-07-15 09:06:11.151339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.151496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.151523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.730 qpair failed and we were unable to recover it. 00:27:22.730 [2024-07-15 09:06:11.151666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.151846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.151873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.730 qpair failed and we were unable to recover it. 00:27:22.730 [2024-07-15 09:06:11.152005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.152151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.152181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.730 qpair failed and we were unable to recover it. 00:27:22.730 [2024-07-15 09:06:11.152345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.152493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.152520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.730 qpair failed and we were unable to recover it. 00:27:22.730 [2024-07-15 09:06:11.152654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.152769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.152796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.730 qpair failed and we were unable to recover it. 00:27:22.730 [2024-07-15 09:06:11.152940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.153061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.153086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.730 qpair failed and we were unable to recover it. 00:27:22.730 [2024-07-15 09:06:11.153242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.153354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.153379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.730 qpair failed and we were unable to recover it. 00:27:22.730 [2024-07-15 09:06:11.153524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.153643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.153672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.730 qpair failed and we were unable to recover it. 00:27:22.730 [2024-07-15 09:06:11.153779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.153898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.153932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.730 qpair failed and we were unable to recover it. 00:27:22.730 [2024-07-15 09:06:11.154075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.154226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.154252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.730 qpair failed and we were unable to recover it. 00:27:22.730 [2024-07-15 09:06:11.154426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.154554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.154580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.730 qpair failed and we were unable to recover it. 00:27:22.730 [2024-07-15 09:06:11.154739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.154873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.154904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.730 qpair failed and we were unable to recover it. 00:27:22.730 [2024-07-15 09:06:11.155054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.155201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.155227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.730 qpair failed and we were unable to recover it. 00:27:22.730 [2024-07-15 09:06:11.155352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.155498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.155525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.730 qpair failed and we were unable to recover it. 00:27:22.730 [2024-07-15 09:06:11.155645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.155793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.155819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.730 qpair failed and we were unable to recover it. 00:27:22.730 [2024-07-15 09:06:11.155954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.156125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.156151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.730 qpair failed and we were unable to recover it. 00:27:22.730 [2024-07-15 09:06:11.156307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.156453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.156480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.730 qpair failed and we were unable to recover it. 00:27:22.730 [2024-07-15 09:06:11.156625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.156782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.156811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.730 qpair failed and we were unable to recover it. 00:27:22.730 [2024-07-15 09:06:11.156934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.157080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.157106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.730 qpair failed and we were unable to recover it. 00:27:22.730 [2024-07-15 09:06:11.157227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.157363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.157389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.730 qpair failed and we were unable to recover it. 00:27:22.730 [2024-07-15 09:06:11.157532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.157679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.157706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.730 qpair failed and we were unable to recover it. 00:27:22.730 [2024-07-15 09:06:11.157826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.157972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.157999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.730 qpair failed and we were unable to recover it. 00:27:22.730 [2024-07-15 09:06:11.158166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.158308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.158334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.730 qpair failed and we were unable to recover it. 00:27:22.730 [2024-07-15 09:06:11.158503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.158644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.158670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.730 qpair failed and we were unable to recover it. 00:27:22.730 [2024-07-15 09:06:11.158811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.158956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.158983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.730 qpair failed and we were unable to recover it. 00:27:22.730 [2024-07-15 09:06:11.159127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.159251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.159278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.730 qpair failed and we were unable to recover it. 00:27:22.730 [2024-07-15 09:06:11.159416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.159587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.159614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.730 qpair failed and we were unable to recover it. 00:27:22.730 [2024-07-15 09:06:11.159785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.159926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.730 [2024-07-15 09:06:11.159953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.731 qpair failed and we were unable to recover it. 00:27:22.731 [2024-07-15 09:06:11.160097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.160266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.160293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.731 qpair failed and we were unable to recover it. 00:27:22.731 [2024-07-15 09:06:11.160465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.160581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.160615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.731 qpair failed and we were unable to recover it. 00:27:22.731 [2024-07-15 09:06:11.160784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.160932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.160959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.731 qpair failed and we were unable to recover it. 00:27:22.731 [2024-07-15 09:06:11.161106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.161267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.161293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.731 qpair failed and we were unable to recover it. 00:27:22.731 [2024-07-15 09:06:11.161444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.161557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.161582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.731 qpair failed and we were unable to recover it. 00:27:22.731 [2024-07-15 09:06:11.161754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.161902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.161938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.731 qpair failed and we were unable to recover it. 00:27:22.731 [2024-07-15 09:06:11.162053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.162200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.162225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.731 qpair failed and we were unable to recover it. 00:27:22.731 [2024-07-15 09:06:11.162340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.162462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.162487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.731 qpair failed and we were unable to recover it. 00:27:22.731 [2024-07-15 09:06:11.162635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.162777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.162803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.731 qpair failed and we were unable to recover it. 00:27:22.731 [2024-07-15 09:06:11.162974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.163090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.163116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.731 qpair failed and we were unable to recover it. 00:27:22.731 [2024-07-15 09:06:11.163268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.163440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.163467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.731 qpair failed and we were unable to recover it. 00:27:22.731 [2024-07-15 09:06:11.163616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.163741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.163767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.731 qpair failed and we were unable to recover it. 00:27:22.731 [2024-07-15 09:06:11.163920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.164035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.164061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.731 qpair failed and we were unable to recover it. 00:27:22.731 [2024-07-15 09:06:11.164229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.164365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.164392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.731 qpair failed and we were unable to recover it. 00:27:22.731 [2024-07-15 09:06:11.164516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.164653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.164680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.731 qpair failed and we were unable to recover it. 00:27:22.731 [2024-07-15 09:06:11.164816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.164980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.165006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.731 qpair failed and we were unable to recover it. 00:27:22.731 [2024-07-15 09:06:11.165148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.165337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.165362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.731 qpair failed and we were unable to recover it. 00:27:22.731 [2024-07-15 09:06:11.165506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.165626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.165652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.731 qpair failed and we were unable to recover it. 00:27:22.731 [2024-07-15 09:06:11.165772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.165893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.165928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.731 qpair failed and we were unable to recover it. 00:27:22.731 [2024-07-15 09:06:11.166049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.166168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.166194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.731 qpair failed and we were unable to recover it. 00:27:22.731 [2024-07-15 09:06:11.166317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.166470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.166496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.731 qpair failed and we were unable to recover it. 00:27:22.731 [2024-07-15 09:06:11.166615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.166760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.166786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.731 qpair failed and we were unable to recover it. 00:27:22.731 [2024-07-15 09:06:11.166937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.167074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.167100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.731 qpair failed and we were unable to recover it. 00:27:22.731 [2024-07-15 09:06:11.167242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.167349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.167376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.731 qpair failed and we were unable to recover it. 00:27:22.731 [2024-07-15 09:06:11.167511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.167661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.167687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.731 qpair failed and we were unable to recover it. 00:27:22.731 [2024-07-15 09:06:11.167853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.168011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.168037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.731 qpair failed and we were unable to recover it. 00:27:22.731 [2024-07-15 09:06:11.168190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.168303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.168329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.731 qpair failed and we were unable to recover it. 00:27:22.731 [2024-07-15 09:06:11.168445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.168589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.168616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.731 qpair failed and we were unable to recover it. 00:27:22.731 [2024-07-15 09:06:11.168766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.168896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.168932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.731 qpair failed and we were unable to recover it. 00:27:22.731 [2024-07-15 09:06:11.169081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.169225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.169251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.731 qpair failed and we were unable to recover it. 00:27:22.731 [2024-07-15 09:06:11.169397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.169540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.731 [2024-07-15 09:06:11.169569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.732 qpair failed and we were unable to recover it. 00:27:22.732 [2024-07-15 09:06:11.169741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.169886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.169912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.732 qpair failed and we were unable to recover it. 00:27:22.732 [2024-07-15 09:06:11.170079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.170199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.170225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.732 qpair failed and we were unable to recover it. 00:27:22.732 [2024-07-15 09:06:11.170368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.170514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.170540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.732 qpair failed and we were unable to recover it. 00:27:22.732 [2024-07-15 09:06:11.170685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.170805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.170832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.732 qpair failed and we were unable to recover it. 00:27:22.732 [2024-07-15 09:06:11.171019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.171200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.171228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.732 qpair failed and we were unable to recover it. 00:27:22.732 [2024-07-15 09:06:11.171377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.171519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.171545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.732 qpair failed and we were unable to recover it. 00:27:22.732 [2024-07-15 09:06:11.171689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.171827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.171852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.732 qpair failed and we were unable to recover it. 00:27:22.732 [2024-07-15 09:06:11.171979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.172117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.172143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.732 qpair failed and we were unable to recover it. 00:27:22.732 [2024-07-15 09:06:11.172314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.172474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.172500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.732 qpair failed and we were unable to recover it. 00:27:22.732 [2024-07-15 09:06:11.172644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.172788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.172814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.732 qpair failed and we were unable to recover it. 00:27:22.732 [2024-07-15 09:06:11.172993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.173142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.173167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.732 qpair failed and we were unable to recover it. 00:27:22.732 [2024-07-15 09:06:11.173311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.173467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.173494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.732 qpair failed and we were unable to recover it. 00:27:22.732 [2024-07-15 09:06:11.173662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.173773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.173799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.732 qpair failed and we were unable to recover it. 00:27:22.732 [2024-07-15 09:06:11.173946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.174071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.174097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.732 qpair failed and we were unable to recover it. 00:27:22.732 [2024-07-15 09:06:11.174222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.174345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.174370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.732 qpair failed and we were unable to recover it. 00:27:22.732 [2024-07-15 09:06:11.174512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.174663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.174689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.732 qpair failed and we were unable to recover it. 00:27:22.732 [2024-07-15 09:06:11.174808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.174966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.174992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.732 qpair failed and we were unable to recover it. 00:27:22.732 [2024-07-15 09:06:11.175139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.175306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.175331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.732 qpair failed and we were unable to recover it. 00:27:22.732 [2024-07-15 09:06:11.175500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.175645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.175670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.732 qpair failed and we were unable to recover it. 00:27:22.732 [2024-07-15 09:06:11.175886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.176013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.176040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.732 qpair failed and we were unable to recover it. 00:27:22.732 [2024-07-15 09:06:11.176219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.176340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.176366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.732 qpair failed and we were unable to recover it. 00:27:22.732 [2024-07-15 09:06:11.176536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.176679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.176704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.732 qpair failed and we were unable to recover it. 00:27:22.732 [2024-07-15 09:06:11.176875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.177022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.177048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.732 qpair failed and we were unable to recover it. 00:27:22.732 [2024-07-15 09:06:11.177166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.177282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.177308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.732 qpair failed and we were unable to recover it. 00:27:22.732 [2024-07-15 09:06:11.177461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.177619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.177644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.732 qpair failed and we were unable to recover it. 00:27:22.732 [2024-07-15 09:06:11.177790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.177915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.732 [2024-07-15 09:06:11.177942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.732 qpair failed and we were unable to recover it. 00:27:22.733 [2024-07-15 09:06:11.178061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.178238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.178263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.733 qpair failed and we were unable to recover it. 00:27:22.733 [2024-07-15 09:06:11.178411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.178560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.178586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.733 qpair failed and we were unable to recover it. 00:27:22.733 [2024-07-15 09:06:11.178755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.178869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.178916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.733 qpair failed and we were unable to recover it. 00:27:22.733 [2024-07-15 09:06:11.179063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.179234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.179258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.733 qpair failed and we were unable to recover it. 00:27:22.733 [2024-07-15 09:06:11.179410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.179582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.179608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.733 qpair failed and we were unable to recover it. 00:27:22.733 [2024-07-15 09:06:11.179750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.179868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.179899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.733 qpair failed and we were unable to recover it. 00:27:22.733 [2024-07-15 09:06:11.180020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.180185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.180211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.733 qpair failed and we were unable to recover it. 00:27:22.733 [2024-07-15 09:06:11.180353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.180500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.180525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.733 qpair failed and we were unable to recover it. 00:27:22.733 [2024-07-15 09:06:11.180636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.180785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.180811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.733 qpair failed and we were unable to recover it. 00:27:22.733 [2024-07-15 09:06:11.180963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.181107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.181134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.733 qpair failed and we were unable to recover it. 00:27:22.733 [2024-07-15 09:06:11.181255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.181410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.181436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.733 qpair failed and we were unable to recover it. 00:27:22.733 [2024-07-15 09:06:11.181587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.181758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.181783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.733 qpair failed and we were unable to recover it. 00:27:22.733 [2024-07-15 09:06:11.181914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.182038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.182063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.733 qpair failed and we were unable to recover it. 00:27:22.733 [2024-07-15 09:06:11.182199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.182322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.182348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.733 qpair failed and we were unable to recover it. 00:27:22.733 [2024-07-15 09:06:11.182497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.182641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.182667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.733 qpair failed and we were unable to recover it. 00:27:22.733 [2024-07-15 09:06:11.182846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.182993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.183020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.733 qpair failed and we were unable to recover it. 00:27:22.733 [2024-07-15 09:06:11.183128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.183288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.183315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.733 qpair failed and we were unable to recover it. 00:27:22.733 [2024-07-15 09:06:11.183486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.183603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.183630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.733 qpair failed and we were unable to recover it. 00:27:22.733 [2024-07-15 09:06:11.183810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.183960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.183986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.733 qpair failed and we were unable to recover it. 00:27:22.733 [2024-07-15 09:06:11.184122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.184264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.184290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.733 qpair failed and we were unable to recover it. 00:27:22.733 [2024-07-15 09:06:11.184415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.184595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.184620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.733 qpair failed and we were unable to recover it. 00:27:22.733 [2024-07-15 09:06:11.184767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.184910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.184936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.733 qpair failed and we were unable to recover it. 00:27:22.733 [2024-07-15 09:06:11.185078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.185226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.185252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.733 qpair failed and we were unable to recover it. 00:27:22.733 [2024-07-15 09:06:11.185385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.185523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.185548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.733 qpair failed and we were unable to recover it. 00:27:22.733 [2024-07-15 09:06:11.185698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.185872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.185908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.733 qpair failed and we were unable to recover it. 00:27:22.733 [2024-07-15 09:06:11.186045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.186165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.186191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.733 qpair failed and we were unable to recover it. 00:27:22.733 [2024-07-15 09:06:11.186305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.186450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.186476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.733 qpair failed and we were unable to recover it. 00:27:22.733 [2024-07-15 09:06:11.186647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.186817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.186843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.733 qpair failed and we were unable to recover it. 00:27:22.733 [2024-07-15 09:06:11.187008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.187203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.187229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.733 qpair failed and we were unable to recover it. 00:27:22.733 [2024-07-15 09:06:11.187372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.187519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.733 [2024-07-15 09:06:11.187545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.733 qpair failed and we were unable to recover it. 00:27:22.734 [2024-07-15 09:06:11.187691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.187835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.187861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.734 qpair failed and we were unable to recover it. 00:27:22.734 [2024-07-15 09:06:11.187988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.188131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.188157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.734 qpair failed and we were unable to recover it. 00:27:22.734 [2024-07-15 09:06:11.188341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.188507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.188533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.734 qpair failed and we were unable to recover it. 00:27:22.734 [2024-07-15 09:06:11.188677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.188786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.188812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.734 qpair failed and we were unable to recover it. 00:27:22.734 [2024-07-15 09:06:11.188954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.189097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.189123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.734 qpair failed and we were unable to recover it. 00:27:22.734 [2024-07-15 09:06:11.189263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.189406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.189432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.734 qpair failed and we were unable to recover it. 00:27:22.734 [2024-07-15 09:06:11.189588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.189759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.189785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.734 qpair failed and we were unable to recover it. 00:27:22.734 [2024-07-15 09:06:11.189929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.190102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.190128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.734 qpair failed and we were unable to recover it. 00:27:22.734 [2024-07-15 09:06:11.190273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.190416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.190442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.734 qpair failed and we were unable to recover it. 00:27:22.734 [2024-07-15 09:06:11.190571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.190750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.190776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.734 qpair failed and we were unable to recover it. 00:27:22.734 [2024-07-15 09:06:11.190950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.191120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.191146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.734 qpair failed and we were unable to recover it. 00:27:22.734 [2024-07-15 09:06:11.191290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.191432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.191459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.734 qpair failed and we were unable to recover it. 00:27:22.734 [2024-07-15 09:06:11.191614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.191765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.191791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.734 qpair failed and we were unable to recover it. 00:27:22.734 [2024-07-15 09:06:11.191935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.192080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.192107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.734 qpair failed and we were unable to recover it. 00:27:22.734 [2024-07-15 09:06:11.192254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.192396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.192422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.734 qpair failed and we were unable to recover it. 00:27:22.734 [2024-07-15 09:06:11.192554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.192725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.192751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.734 qpair failed and we were unable to recover it. 00:27:22.734 [2024-07-15 09:06:11.192925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.193080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.193106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.734 qpair failed and we were unable to recover it. 00:27:22.734 [2024-07-15 09:06:11.193234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.193353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.193379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.734 qpair failed and we were unable to recover it. 00:27:22.734 [2024-07-15 09:06:11.193550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.193674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.193701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.734 qpair failed and we were unable to recover it. 00:27:22.734 [2024-07-15 09:06:11.193845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.193986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.194012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.734 qpair failed and we were unable to recover it. 00:27:22.734 [2024-07-15 09:06:11.194161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.194300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.194326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.734 qpair failed and we were unable to recover it. 00:27:22.734 [2024-07-15 09:06:11.194481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.194623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.194649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.734 qpair failed and we were unable to recover it. 00:27:22.734 [2024-07-15 09:06:11.194791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.194918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.194946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.734 qpair failed and we were unable to recover it. 00:27:22.734 [2024-07-15 09:06:11.195090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.195258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.195284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.734 qpair failed and we were unable to recover it. 00:27:22.734 [2024-07-15 09:06:11.195424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.195572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.195598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.734 qpair failed and we were unable to recover it. 00:27:22.734 [2024-07-15 09:06:11.195777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.195957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.195985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.734 qpair failed and we were unable to recover it. 00:27:22.734 [2024-07-15 09:06:11.196123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.196270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.196297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.734 qpair failed and we were unable to recover it. 00:27:22.734 [2024-07-15 09:06:11.196442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.196612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.196637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.734 qpair failed and we were unable to recover it. 00:27:22.734 [2024-07-15 09:06:11.196759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.196870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.196903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.734 qpair failed and we were unable to recover it. 00:27:22.734 [2024-07-15 09:06:11.197072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.197187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.197213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.734 qpair failed and we were unable to recover it. 00:27:22.734 [2024-07-15 09:06:11.197338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.197508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.734 [2024-07-15 09:06:11.197534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.734 qpair failed and we were unable to recover it. 00:27:22.735 [2024-07-15 09:06:11.197706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.197846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.197872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.735 qpair failed and we were unable to recover it. 00:27:22.735 [2024-07-15 09:06:11.198056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.198206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.198232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.735 qpair failed and we were unable to recover it. 00:27:22.735 [2024-07-15 09:06:11.198396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.198545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.198571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.735 qpair failed and we were unable to recover it. 00:27:22.735 [2024-07-15 09:06:11.198694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.198865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.198917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.735 qpair failed and we were unable to recover it. 00:27:22.735 [2024-07-15 09:06:11.199068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.199218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.199249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.735 qpair failed and we were unable to recover it. 00:27:22.735 [2024-07-15 09:06:11.199420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.199595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.199621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.735 qpair failed and we were unable to recover it. 00:27:22.735 [2024-07-15 09:06:11.199782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.199928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.199955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.735 qpair failed and we were unable to recover it. 00:27:22.735 [2024-07-15 09:06:11.200113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.200231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.200258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.735 qpair failed and we were unable to recover it. 00:27:22.735 [2024-07-15 09:06:11.200418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.200537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.200563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.735 qpair failed and we were unable to recover it. 00:27:22.735 [2024-07-15 09:06:11.200742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.200860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.200891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.735 qpair failed and we were unable to recover it. 00:27:22.735 [2024-07-15 09:06:11.201008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.201154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.201180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.735 qpair failed and we were unable to recover it. 00:27:22.735 [2024-07-15 09:06:11.201329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.201498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.201525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.735 qpair failed and we were unable to recover it. 00:27:22.735 [2024-07-15 09:06:11.201638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.201785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.201812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.735 qpair failed and we were unable to recover it. 00:27:22.735 [2024-07-15 09:06:11.201924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.202043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.202070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.735 qpair failed and we were unable to recover it. 00:27:22.735 [2024-07-15 09:06:11.202187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.202359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.202390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.735 qpair failed and we were unable to recover it. 00:27:22.735 [2024-07-15 09:06:11.202510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.202657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.202683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.735 qpair failed and we were unable to recover it. 00:27:22.735 [2024-07-15 09:06:11.202831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.202954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.202982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.735 qpair failed and we were unable to recover it. 00:27:22.735 [2024-07-15 09:06:11.203152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.203307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.203334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.735 qpair failed and we were unable to recover it. 00:27:22.735 [2024-07-15 09:06:11.203494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.203638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.203664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.735 qpair failed and we were unable to recover it. 00:27:22.735 [2024-07-15 09:06:11.203833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.203947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.203974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.735 qpair failed and we were unable to recover it. 00:27:22.735 [2024-07-15 09:06:11.204085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.204207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.204235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.735 qpair failed and we were unable to recover it. 00:27:22.735 [2024-07-15 09:06:11.204372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.204529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.204555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.735 qpair failed and we were unable to recover it. 00:27:22.735 [2024-07-15 09:06:11.204691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.204869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.204901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.735 qpair failed and we were unable to recover it. 00:27:22.735 [2024-07-15 09:06:11.205046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.205194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.205220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.735 qpair failed and we were unable to recover it. 00:27:22.735 [2024-07-15 09:06:11.205330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.205477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.205505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.735 qpair failed and we were unable to recover it. 00:27:22.735 [2024-07-15 09:06:11.205632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.205801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.205826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.735 qpair failed and we were unable to recover it. 00:27:22.735 [2024-07-15 09:06:11.205966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.206098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.206125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.735 qpair failed and we were unable to recover it. 00:27:22.735 [2024-07-15 09:06:11.206274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.206397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.206424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.735 qpair failed and we were unable to recover it. 00:27:22.735 [2024-07-15 09:06:11.206588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.206745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.735 [2024-07-15 09:06:11.206771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.735 qpair failed and we were unable to recover it. 00:27:22.735 [2024-07-15 09:06:11.206920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.207063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.207090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.736 qpair failed and we were unable to recover it. 00:27:22.736 [2024-07-15 09:06:11.207259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.207380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.207406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.736 qpair failed and we were unable to recover it. 00:27:22.736 [2024-07-15 09:06:11.207530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.207678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.207704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.736 qpair failed and we were unable to recover it. 00:27:22.736 [2024-07-15 09:06:11.207881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.208010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.208037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.736 qpair failed and we were unable to recover it. 00:27:22.736 [2024-07-15 09:06:11.208197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.208366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.208393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.736 qpair failed and we were unable to recover it. 00:27:22.736 [2024-07-15 09:06:11.208540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.208655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.208681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.736 qpair failed and we were unable to recover it. 00:27:22.736 [2024-07-15 09:06:11.208854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.209002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.209027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.736 qpair failed and we were unable to recover it. 00:27:22.736 [2024-07-15 09:06:11.209163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.209281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.209307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.736 qpair failed and we were unable to recover it. 00:27:22.736 [2024-07-15 09:06:11.209450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.209568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.209594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.736 qpair failed and we were unable to recover it. 00:27:22.736 [2024-07-15 09:06:11.209763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.209890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.209917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.736 qpair failed and we were unable to recover it. 00:27:22.736 [2024-07-15 09:06:11.210043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.210163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.210189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.736 qpair failed and we were unable to recover it. 00:27:22.736 [2024-07-15 09:06:11.210337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.210462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.210488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.736 qpair failed and we were unable to recover it. 00:27:22.736 [2024-07-15 09:06:11.210662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.210799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.210825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.736 qpair failed and we were unable to recover it. 00:27:22.736 [2024-07-15 09:06:11.210956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.211068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.211096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.736 qpair failed and we were unable to recover it. 00:27:22.736 [2024-07-15 09:06:11.211244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.211390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.211416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.736 qpair failed and we were unable to recover it. 00:27:22.736 [2024-07-15 09:06:11.211554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.211699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.211726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.736 qpair failed and we were unable to recover it. 00:27:22.736 [2024-07-15 09:06:11.211886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.212041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.212066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.736 qpair failed and we were unable to recover it. 00:27:22.736 [2024-07-15 09:06:11.212211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.212350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.212376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.736 qpair failed and we were unable to recover it. 00:27:22.736 [2024-07-15 09:06:11.212536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.212683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.212710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.736 qpair failed and we were unable to recover it. 00:27:22.736 [2024-07-15 09:06:11.212859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.213011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.213038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.736 qpair failed and we were unable to recover it. 00:27:22.736 [2024-07-15 09:06:11.213183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.213302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.213329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.736 qpair failed and we were unable to recover it. 00:27:22.736 [2024-07-15 09:06:11.213450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.213619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.213647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.736 qpair failed and we were unable to recover it. 00:27:22.736 [2024-07-15 09:06:11.213819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.213940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.213966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.736 qpair failed and we were unable to recover it. 00:27:22.736 [2024-07-15 09:06:11.214111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.214227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.214253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.736 qpair failed and we were unable to recover it. 00:27:22.736 [2024-07-15 09:06:11.214375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.214513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.214539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.736 qpair failed and we were unable to recover it. 00:27:22.736 [2024-07-15 09:06:11.214659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.214801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.214828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.736 qpair failed and we were unable to recover it. 00:27:22.736 [2024-07-15 09:06:11.214951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.215102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.215134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.736 qpair failed and we were unable to recover it. 00:27:22.736 [2024-07-15 09:06:11.215297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.215455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.215481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.736 qpair failed and we were unable to recover it. 00:27:22.736 [2024-07-15 09:06:11.215627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.215770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.215796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.736 qpair failed and we were unable to recover it. 00:27:22.736 [2024-07-15 09:06:11.215919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.736 [2024-07-15 09:06:11.216044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.216070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.737 qpair failed and we were unable to recover it. 00:27:22.737 [2024-07-15 09:06:11.216189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.216343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.216371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.737 qpair failed and we were unable to recover it. 00:27:22.737 [2024-07-15 09:06:11.216514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.216659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.216685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.737 qpair failed and we were unable to recover it. 00:27:22.737 [2024-07-15 09:06:11.216845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.216975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.217002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.737 qpair failed and we were unable to recover it. 00:27:22.737 [2024-07-15 09:06:11.217151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.217300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.217327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.737 qpair failed and we were unable to recover it. 00:27:22.737 [2024-07-15 09:06:11.217448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.217616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.217642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.737 qpair failed and we were unable to recover it. 00:27:22.737 [2024-07-15 09:06:11.217783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.217930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.217957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.737 qpair failed and we were unable to recover it. 00:27:22.737 [2024-07-15 09:06:11.218084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.218251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.218278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.737 qpair failed and we were unable to recover it. 00:27:22.737 [2024-07-15 09:06:11.218441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.218559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.218585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.737 qpair failed and we were unable to recover it. 00:27:22.737 [2024-07-15 09:06:11.218731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.218875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.218921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.737 qpair failed and we were unable to recover it. 00:27:22.737 [2024-07-15 09:06:11.219050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.219198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.219223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.737 qpair failed and we were unable to recover it. 00:27:22.737 [2024-07-15 09:06:11.219369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.219515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.219541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.737 qpair failed and we were unable to recover it. 00:27:22.737 [2024-07-15 09:06:11.219688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.219857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.219889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.737 qpair failed and we were unable to recover it. 00:27:22.737 [2024-07-15 09:06:11.220033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.220170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.220195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.737 qpair failed and we were unable to recover it. 00:27:22.737 [2024-07-15 09:06:11.220335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.220467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.220494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.737 qpair failed and we were unable to recover it. 00:27:22.737 [2024-07-15 09:06:11.220633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.220779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.220805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.737 qpair failed and we were unable to recover it. 00:27:22.737 [2024-07-15 09:06:11.220986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.221107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.221134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.737 qpair failed and we were unable to recover it. 00:27:22.737 [2024-07-15 09:06:11.221270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.221388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.221415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.737 qpair failed and we were unable to recover it. 00:27:22.737 [2024-07-15 09:06:11.221593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.221762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.221789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.737 qpair failed and we were unable to recover it. 00:27:22.737 [2024-07-15 09:06:11.221936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.222091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.222118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.737 qpair failed and we were unable to recover it. 00:27:22.737 [2024-07-15 09:06:11.222287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.222428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.222454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.737 qpair failed and we were unable to recover it. 00:27:22.737 [2024-07-15 09:06:11.222563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.222710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.222737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.737 qpair failed and we were unable to recover it. 00:27:22.737 [2024-07-15 09:06:11.222886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.223031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.223058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.737 qpair failed and we were unable to recover it. 00:27:22.737 [2024-07-15 09:06:11.223201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.223321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.223348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.737 qpair failed and we were unable to recover it. 00:27:22.737 [2024-07-15 09:06:11.223522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.223638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.223664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.737 qpair failed and we were unable to recover it. 00:27:22.737 [2024-07-15 09:06:11.223808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.223926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.737 [2024-07-15 09:06:11.223955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.738 qpair failed and we were unable to recover it. 00:27:22.738 [2024-07-15 09:06:11.224113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.224256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.224282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.738 qpair failed and we were unable to recover it. 00:27:22.738 [2024-07-15 09:06:11.224427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.224571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.224597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.738 qpair failed and we were unable to recover it. 00:27:22.738 [2024-07-15 09:06:11.224770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.224899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.224925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.738 qpair failed and we were unable to recover it. 00:27:22.738 [2024-07-15 09:06:11.225067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.225185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.225211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.738 qpair failed and we were unable to recover it. 00:27:22.738 [2024-07-15 09:06:11.225381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.225508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.225534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.738 qpair failed and we were unable to recover it. 00:27:22.738 [2024-07-15 09:06:11.225679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.225821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.225848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.738 qpair failed and we were unable to recover it. 00:27:22.738 [2024-07-15 09:06:11.225990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.226217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.226243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.738 qpair failed and we were unable to recover it. 00:27:22.738 [2024-07-15 09:06:11.226415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.226543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.226570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.738 qpair failed and we were unable to recover it. 00:27:22.738 [2024-07-15 09:06:11.226716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.226836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.226863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.738 qpair failed and we were unable to recover it. 00:27:22.738 [2024-07-15 09:06:11.227026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.227157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.227184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.738 qpair failed and we were unable to recover it. 00:27:22.738 [2024-07-15 09:06:11.227343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.227513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.227538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.738 qpair failed and we were unable to recover it. 00:27:22.738 [2024-07-15 09:06:11.227668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.227784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.227809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.738 qpair failed and we were unable to recover it. 00:27:22.738 [2024-07-15 09:06:11.227946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.228121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.228148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.738 qpair failed and we were unable to recover it. 00:27:22.738 [2024-07-15 09:06:11.228268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.228424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.228450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.738 qpair failed and we were unable to recover it. 00:27:22.738 [2024-07-15 09:06:11.228620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.228769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.228794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.738 qpair failed and we were unable to recover it. 00:27:22.738 [2024-07-15 09:06:11.228922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.229057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.229083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.738 qpair failed and we were unable to recover it. 00:27:22.738 [2024-07-15 09:06:11.229206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.229350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.229376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.738 qpair failed and we were unable to recover it. 00:27:22.738 [2024-07-15 09:06:11.229534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.229703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.229729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.738 qpair failed and we were unable to recover it. 00:27:22.738 [2024-07-15 09:06:11.229954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.230083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.230109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.738 qpair failed and we were unable to recover it. 00:27:22.738 [2024-07-15 09:06:11.230247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.230392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.230423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.738 qpair failed and we were unable to recover it. 00:27:22.738 [2024-07-15 09:06:11.230566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.230700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.230726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.738 qpair failed and we were unable to recover it. 00:27:22.738 [2024-07-15 09:06:11.230856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.231341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.231372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.738 qpair failed and we were unable to recover it. 00:27:22.738 [2024-07-15 09:06:11.231524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.231645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.231675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.738 qpair failed and we were unable to recover it. 00:27:22.738 [2024-07-15 09:06:11.231821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.231979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.232007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:22.738 qpair failed and we were unable to recover it. 00:27:22.738 [2024-07-15 09:06:11.232143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.738 [2024-07-15 09:06:11.232299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.011 [2024-07-15 09:06:11.232325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.011 qpair failed and we were unable to recover it. 00:27:23.011 [2024-07-15 09:06:11.232444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.011 [2024-07-15 09:06:11.232588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.011 [2024-07-15 09:06:11.232614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.011 qpair failed and we were unable to recover it. 00:27:23.011 [2024-07-15 09:06:11.232761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.011 [2024-07-15 09:06:11.232880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.011 [2024-07-15 09:06:11.232907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.011 qpair failed and we were unable to recover it. 00:27:23.011 [2024-07-15 09:06:11.233057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.011 [2024-07-15 09:06:11.233204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.011 [2024-07-15 09:06:11.233229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.011 qpair failed and we were unable to recover it. 00:27:23.011 [2024-07-15 09:06:11.233375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.011 [2024-07-15 09:06:11.233491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.233517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.233664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.233804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.233835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.233988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.234215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.234241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.234413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.234533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.234560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.234704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.234827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.234852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.234981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.235118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.235143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.235264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.235384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.235409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.235517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.235622] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:23.012 [2024-07-15 09:06:11.235652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.235677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.235754] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:23.012 [2024-07-15 09:06:11.235772] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:23.012 [2024-07-15 09:06:11.235785] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:23.012 [2024-07-15 09:06:11.235813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.235929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.235854] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:27:23.012 [2024-07-15 09:06:11.235954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.235884] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:27:23.012 [2024-07-15 09:06:11.235918] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:27:23.012 [2024-07-15 09:06:11.235923] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:27:23.012 [2024-07-15 09:06:11.236110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.236264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.236288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.236421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.236564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.236590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.236771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.236931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.236957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.237078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.237204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.237231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.237381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.237493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.237521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.237665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.237854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.237884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.238043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.238164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.238189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.238360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.238504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.238530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.238653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.238802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.238828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.238953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.239080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.239105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.239215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.239344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.239371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.239501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.239640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.239665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.239800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.239948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.239973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.240086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.240259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.240284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.240431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.240547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.240574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.240691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.240815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.240842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.240997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.241168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.241197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.241316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.241438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.241463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.241582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.241731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.241757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.241882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.242070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.242096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.242233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.242423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.242450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.242597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.242739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.242765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.242924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.243067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.243093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.243271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.243449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.243475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.243597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.243825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.243851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.244017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.244161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.244187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.244334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.244464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.244491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.244632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.244813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.244838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.244972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.245088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.245113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.245234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.245368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.245393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.245508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.245656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.245681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.245812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.245953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.245980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.246105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.246227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.246254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.246378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.246529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.246555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.012 [2024-07-15 09:06:11.246701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.246839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.012 [2024-07-15 09:06:11.246868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.012 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.247003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.247217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.247243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.247358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.247500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.247526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.247640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.247758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.247784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.247907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.248080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.248105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.248249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.248354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.248379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.248519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.248638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.248663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.248783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.248928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.248953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.249061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.249205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.249230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.249363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.249556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.249582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.249722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.249837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.249863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.250009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.250124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.250149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.250263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.250386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.250414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.250557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.250697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.250723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.250842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.251028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.251055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.251170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.251283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.251309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.251450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.251587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.251613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.251730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.251834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.251860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.252002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.252132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.252166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.252311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.252449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.252474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.252593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.252713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.252738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.252890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.253046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.253071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.253205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.253331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.253356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.253473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.253614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.253640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.253751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.253897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.253933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.254073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.254202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.254228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.254364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.254502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.254528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.254644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.254782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.254807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.254934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.255068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.255093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.255278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.255394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.255419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.255527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.255642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.255665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.255811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.255932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.255956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.256080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.256206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.256232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.256399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.256545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.256571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.256693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.256810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.256833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.256969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.257079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.257103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.257279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.257425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.257451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.257592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.257732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.257756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.257873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.258004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.258031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.258148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.258296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.258323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.258509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.258656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.258681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.258809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.258935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.258961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.259077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.259208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.259233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.259349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.259485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.259510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.259622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.259738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.259764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.259912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.260052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.260076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.260217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.260385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.260409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.013 qpair failed and we were unable to recover it. 00:27:23.013 [2024-07-15 09:06:11.260532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.013 [2024-07-15 09:06:11.260643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.260667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.014 qpair failed and we were unable to recover it. 00:27:23.014 [2024-07-15 09:06:11.260813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.260941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.260966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.014 qpair failed and we were unable to recover it. 00:27:23.014 [2024-07-15 09:06:11.261094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.261237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.261264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.014 qpair failed and we were unable to recover it. 00:27:23.014 [2024-07-15 09:06:11.261382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.261502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.261529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.014 qpair failed and we were unable to recover it. 00:27:23.014 [2024-07-15 09:06:11.261639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.261753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.261784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.014 qpair failed and we were unable to recover it. 00:27:23.014 [2024-07-15 09:06:11.261927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.262053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.262079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.014 qpair failed and we were unable to recover it. 00:27:23.014 [2024-07-15 09:06:11.262210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.262352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.262375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.014 qpair failed and we were unable to recover it. 00:27:23.014 [2024-07-15 09:06:11.262483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.262594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.262617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.014 qpair failed and we were unable to recover it. 00:27:23.014 [2024-07-15 09:06:11.262753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.262890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.262926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.014 qpair failed and we were unable to recover it. 00:27:23.014 [2024-07-15 09:06:11.263067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.263190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.263214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.014 qpair failed and we were unable to recover it. 00:27:23.014 [2024-07-15 09:06:11.263338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.263473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.263496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.014 qpair failed and we were unable to recover it. 00:27:23.014 [2024-07-15 09:06:11.263613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.263752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.263777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.014 qpair failed and we were unable to recover it. 00:27:23.014 [2024-07-15 09:06:11.263894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.264024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.264049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.014 qpair failed and we were unable to recover it. 00:27:23.014 [2024-07-15 09:06:11.264166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.264307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.264333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.014 qpair failed and we were unable to recover it. 00:27:23.014 [2024-07-15 09:06:11.264454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.264593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.264620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.014 qpair failed and we were unable to recover it. 00:27:23.014 [2024-07-15 09:06:11.264744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.264886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.264912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.014 qpair failed and we were unable to recover it. 00:27:23.014 [2024-07-15 09:06:11.265039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.265188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.265214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.014 qpair failed and we were unable to recover it. 00:27:23.014 [2024-07-15 09:06:11.265362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.265469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.265493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.014 qpair failed and we were unable to recover it. 00:27:23.014 [2024-07-15 09:06:11.265604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.265743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.265767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.014 qpair failed and we were unable to recover it. 00:27:23.014 [2024-07-15 09:06:11.265933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.266042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.266066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.014 qpair failed and we were unable to recover it. 00:27:23.014 [2024-07-15 09:06:11.266207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.266324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.266350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.014 qpair failed and we were unable to recover it. 00:27:23.014 [2024-07-15 09:06:11.266520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.266667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.266693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.014 qpair failed and we were unable to recover it. 00:27:23.014 [2024-07-15 09:06:11.266799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.266941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.266967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.014 qpair failed and we were unable to recover it. 00:27:23.014 [2024-07-15 09:06:11.267077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.267201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.267226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.014 qpair failed and we were unable to recover it. 00:27:23.014 [2024-07-15 09:06:11.267333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.267557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.267585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.014 qpair failed and we were unable to recover it. 00:27:23.014 [2024-07-15 09:06:11.267698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.267819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.267854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.014 qpair failed and we were unable to recover it. 00:27:23.014 [2024-07-15 09:06:11.268001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.268131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.268156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.014 qpair failed and we were unable to recover it. 00:27:23.014 [2024-07-15 09:06:11.268274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.268423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.268449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.014 qpair failed and we were unable to recover it. 00:27:23.014 [2024-07-15 09:06:11.268593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.268707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.268732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.014 qpair failed and we were unable to recover it. 00:27:23.014 [2024-07-15 09:06:11.268955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.269074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.269100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.014 qpair failed and we were unable to recover it. 00:27:23.014 [2024-07-15 09:06:11.269276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.269401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.269427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.014 qpair failed and we were unable to recover it. 00:27:23.014 [2024-07-15 09:06:11.269539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.269683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.269707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.014 qpair failed and we were unable to recover it. 00:27:23.014 [2024-07-15 09:06:11.269853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.269978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.270002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.014 qpair failed and we were unable to recover it. 00:27:23.014 [2024-07-15 09:06:11.270132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.270245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.270270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.014 qpair failed and we were unable to recover it. 00:27:23.014 [2024-07-15 09:06:11.270410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.270551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.270575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.014 qpair failed and we were unable to recover it. 00:27:23.014 [2024-07-15 09:06:11.270722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.270867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.270943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.014 qpair failed and we were unable to recover it. 00:27:23.014 [2024-07-15 09:06:11.271076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.271221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.271247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.014 qpair failed and we were unable to recover it. 00:27:23.014 [2024-07-15 09:06:11.271371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.271488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.271514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.014 qpair failed and we were unable to recover it. 00:27:23.014 [2024-07-15 09:06:11.271637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.271777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.271802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.014 qpair failed and we were unable to recover it. 00:27:23.014 [2024-07-15 09:06:11.271925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.272041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.014 [2024-07-15 09:06:11.272066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.014 qpair failed and we were unable to recover it. 00:27:23.014 [2024-07-15 09:06:11.272194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.272350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.272375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.272524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.272635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.272659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.272828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.273016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.273068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.273220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.273330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.273355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.273503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.273614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.273638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.273751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.273975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.274008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.274123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.274268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.274294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.274412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.274587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.274613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.274730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.274881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.274907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.275060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.275181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.275206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.275314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.275457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.275482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.275631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.275736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.275760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.275905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.276066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.276092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.276241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.276391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.276418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.276539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.276674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.276698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.276809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.276953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.276981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.277111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.277257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.277281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.277457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.277571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.277597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.277747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.277862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.277892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.278012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.278149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.278183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.278301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.278416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.278443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.278583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.278736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.278761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.278881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.279007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.279030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.279139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.279248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.279271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.279381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.279521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.279545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.279654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.279789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.279812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.279950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.280070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.280093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.280290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.280427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.280452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.280604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.280740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.280766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.280931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.281047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.281072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.281221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.281333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.281358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.281464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.281586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.281610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.281731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.281867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.281896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.282048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.282190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.282215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.282330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.282433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.282456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.282576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.282712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.282736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.282862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.283017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.283044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.283153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.283269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.283293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.283449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.283567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.283593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.283719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.283835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.283859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.284005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.284114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.284150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.284290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.284435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.284460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.284574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.284713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.284739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.284886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.285033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.285059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.285186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.285301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.285325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.285437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.285567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.285591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.015 [2024-07-15 09:06:11.285706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.285856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.015 [2024-07-15 09:06:11.285888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.015 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.286018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.286143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.286168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.286342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.286551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.286577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.286695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.286807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.286831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.286972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.287119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.287145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.287290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.287433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.287458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.287600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.287764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.287789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.287915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.288024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.288049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.288160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.288274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.288299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.288411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.288594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.288619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.288736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.288850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.288884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.289032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.289170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.289195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.289312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.289421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.289444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.289559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.289682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.289705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.289813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.289971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.289997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.290130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.290247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.290272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.290443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.290562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.290587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.290727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.290891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.290927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.291068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.291215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.291240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.291388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.291499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.291524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.291646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.291785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.291809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.291933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.292048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.292073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.292233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.292350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.292375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.292526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.292670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.292704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.292826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.292940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.292965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.293085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.293254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.293279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.293394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.293510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.293535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.293648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.293787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.293812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.293936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.294080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.294106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.294229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.294350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.294374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.294486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.294620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.294644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.294784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.294907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.294937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.295057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.295174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.295198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.295344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.295482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.295507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.295629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.295736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.295761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.295902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.296012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.296037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.296188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.296309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.296336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.296546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.296690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.296715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.296827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.296967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.296992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.297169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.297294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.297319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.297461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.297573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.297598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.297752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.297897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.297924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.298050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.298164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.298189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.298371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.298485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.298510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.298628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.298809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.298835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.298957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.299073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.299099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.299214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.299357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.299383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.016 qpair failed and we were unable to recover it. 00:27:23.016 [2024-07-15 09:06:11.299513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.016 [2024-07-15 09:06:11.299624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.299650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.017 qpair failed and we were unable to recover it. 00:27:23.017 [2024-07-15 09:06:11.299817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.299938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.299965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.017 qpair failed and we were unable to recover it. 00:27:23.017 [2024-07-15 09:06:11.300078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.300199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.300225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.017 qpair failed and we were unable to recover it. 00:27:23.017 [2024-07-15 09:06:11.300365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.300507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.300534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.017 qpair failed and we were unable to recover it. 00:27:23.017 [2024-07-15 09:06:11.300645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.300767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.300793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.017 qpair failed and we were unable to recover it. 00:27:23.017 [2024-07-15 09:06:11.300910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.301028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.301054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.017 qpair failed and we were unable to recover it. 00:27:23.017 [2024-07-15 09:06:11.301172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.301313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.301338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.017 qpair failed and we were unable to recover it. 00:27:23.017 [2024-07-15 09:06:11.301455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.301594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.301620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.017 qpair failed and we were unable to recover it. 00:27:23.017 [2024-07-15 09:06:11.301761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.301929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.301955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.017 qpair failed and we were unable to recover it. 00:27:23.017 [2024-07-15 09:06:11.302097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.302204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.302229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.017 qpair failed and we were unable to recover it. 00:27:23.017 [2024-07-15 09:06:11.302374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.302495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.302520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.017 qpair failed and we were unable to recover it. 00:27:23.017 [2024-07-15 09:06:11.302662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.302802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.302828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.017 qpair failed and we were unable to recover it. 00:27:23.017 [2024-07-15 09:06:11.302977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.303088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.303112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.017 qpair failed and we were unable to recover it. 00:27:23.017 [2024-07-15 09:06:11.303223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.303369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.303395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.017 qpair failed and we were unable to recover it. 00:27:23.017 [2024-07-15 09:06:11.303510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.303635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.303666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.017 qpair failed and we were unable to recover it. 00:27:23.017 [2024-07-15 09:06:11.303811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.303922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.303948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.017 qpair failed and we were unable to recover it. 00:27:23.017 [2024-07-15 09:06:11.304058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.304202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.304228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.017 qpair failed and we were unable to recover it. 00:27:23.017 [2024-07-15 09:06:11.304401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.304552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.304578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.017 qpair failed and we were unable to recover it. 00:27:23.017 [2024-07-15 09:06:11.304700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.304825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.304852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.017 qpair failed and we were unable to recover it. 00:27:23.017 [2024-07-15 09:06:11.304981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.305090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.305114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.017 qpair failed and we were unable to recover it. 00:27:23.017 [2024-07-15 09:06:11.305255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.305367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.305393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.017 qpair failed and we were unable to recover it. 00:27:23.017 [2024-07-15 09:06:11.305533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.305675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.305700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.017 qpair failed and we were unable to recover it. 00:27:23.017 [2024-07-15 09:06:11.305811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.305974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.306000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.017 qpair failed and we were unable to recover it. 00:27:23.017 [2024-07-15 09:06:11.306112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.306278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.306304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.017 qpair failed and we were unable to recover it. 00:27:23.017 [2024-07-15 09:06:11.306415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.306554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.306579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.017 qpair failed and we were unable to recover it. 00:27:23.017 [2024-07-15 09:06:11.306725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.306904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.306931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.017 qpair failed and we were unable to recover it. 00:27:23.017 [2024-07-15 09:06:11.307073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.307207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.307233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.017 qpair failed and we were unable to recover it. 00:27:23.017 [2024-07-15 09:06:11.307346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.307469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.307495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.017 qpair failed and we were unable to recover it. 00:27:23.017 [2024-07-15 09:06:11.307621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.307725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.307750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.017 qpair failed and we were unable to recover it. 00:27:23.017 [2024-07-15 09:06:11.307864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.308045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.308070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.017 qpair failed and we were unable to recover it. 00:27:23.017 [2024-07-15 09:06:11.308178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.308348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.308373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.017 qpair failed and we were unable to recover it. 00:27:23.017 [2024-07-15 09:06:11.308492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.308626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.308652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.017 qpair failed and we were unable to recover it. 00:27:23.017 [2024-07-15 09:06:11.308802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.308917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.308944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.017 qpair failed and we were unable to recover it. 00:27:23.017 [2024-07-15 09:06:11.309062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.309197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.309223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.017 qpair failed and we were unable to recover it. 00:27:23.017 [2024-07-15 09:06:11.309337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.309446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.309472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.017 qpair failed and we were unable to recover it. 00:27:23.017 [2024-07-15 09:06:11.309594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.309741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.309766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.017 qpair failed and we were unable to recover it. 00:27:23.017 [2024-07-15 09:06:11.309909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.310029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.310054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.017 qpair failed and we were unable to recover it. 00:27:23.017 [2024-07-15 09:06:11.310195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.310336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.310361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.017 qpair failed and we were unable to recover it. 00:27:23.017 [2024-07-15 09:06:11.310504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.310642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.310667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.017 qpair failed and we were unable to recover it. 00:27:23.017 [2024-07-15 09:06:11.310786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.310898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.310923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.017 qpair failed and we were unable to recover it. 00:27:23.017 [2024-07-15 09:06:11.311067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.311210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.311236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.017 qpair failed and we were unable to recover it. 00:27:23.017 [2024-07-15 09:06:11.311375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.311482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.017 [2024-07-15 09:06:11.311507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.017 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.311653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.311789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.311815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.311939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.312055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.312078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.312262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.312380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.312404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.312520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.312631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.312655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.312807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.312923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.312949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.313064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.313190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.313216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.313368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.313486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.313512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.313624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.313792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.313817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.313948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.314062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.314089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.314205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.314344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.314370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.314485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.314624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.314650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.314823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.314946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.314970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.315084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.315198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.315222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.315427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.315546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.315576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.315719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.315836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.315861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.316016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.316157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.316186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.316307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.316422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.316448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.316656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.316766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.316791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.316927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.317039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.317062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.317205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.317330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.317365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.317478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.317614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.317640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.317748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.317858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.317887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.318007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.318122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.318157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.318319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.318434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.318463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.318612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.318733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.318757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.318870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.319015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.319040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.319189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.319298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.319323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.319445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.319565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.319591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.319698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.319815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.319840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.319964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.320074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.320099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.320219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.320325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.320351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.320459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.320607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.320632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.320769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.320899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.320925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.321043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.321182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.321208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.321351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.321467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.321493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.321603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.321726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.321752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.321927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.322043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.322069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.322186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.322301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.322326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.322469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.322578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.322604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.322712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.322831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.322856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.322972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.323080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.323106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.323239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.323383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.323410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.323521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.323639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.323664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.323794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.323939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.323964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.324086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.324197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.324223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.324364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.324474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.324499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.324642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.324765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.324790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.018 [2024-07-15 09:06:11.324937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.325057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.018 [2024-07-15 09:06:11.325082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.018 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.325203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.325352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.325377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.325515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.325630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.325655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.325880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.326030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.326055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.326166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.326307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.326331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.326440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.326609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.326634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.326775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.326886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.326912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.327054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.327169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.327194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.327320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.327435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.327460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.327581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.327705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.327731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.327845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.327960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.327986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.328126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.328252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.328278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.328419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.328539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.328564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.328689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.328795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.328819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.328957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.329063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.329089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.329208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.329353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.329379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.329530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.329646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.329672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.329789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.329935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.329965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.330088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.330203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.330227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.330411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.330584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.330610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.330732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.330874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.330904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.331013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.331132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.331158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.331266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.331415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.331441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.331607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.331726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.331760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.331872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.332017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.332042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.332169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.332335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.332360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.332485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.332645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.332678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.332853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.332989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.333015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.333161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.333300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.333325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.333438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.333579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.333604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.333750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.333863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.333914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.334067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.334186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.334211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.334353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.334460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.334485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.334622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.334736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.334762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.334914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.335036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.335062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.335180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.335297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.335321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.335475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.335591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.335616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.335754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.335864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.335894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.336018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.336127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.336151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.336269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.336435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.336459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.336570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.336712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.336737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.336855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.336982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.337008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.337163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.337275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.337301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.337469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.337572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.337597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.337729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.337846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.337871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.338025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.338138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.338163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.338283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.338395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.338426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.338571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.338691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.338716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.338861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.338985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.339011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.019 qpair failed and we were unable to recover it. 00:27:23.019 [2024-07-15 09:06:11.339132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.339240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.019 [2024-07-15 09:06:11.339266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.339401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.339540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.339565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.339674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.339814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.339840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.339970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.340121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.340146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.340286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.340441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.340466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.340577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.340693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.340717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.340854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.340976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.341004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.341130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.341245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.341270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.341386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.341533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.341558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.341667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.341821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.341847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.341997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.342113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.342139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.342259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.342400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.342426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.342596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.342704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.342729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.342837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.343007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.343033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.343142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.343251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.343275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.343391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.343554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.343580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.343728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.343861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.343893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.344014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.344163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.344189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.344312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.344421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.344446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.344560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.344703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.344733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.344881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.345000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.345026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.345198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.345312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.345338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.345454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.345565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.345591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.345761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.345869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.345901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.346044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.346185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.346210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.346327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.346432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.346456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.346628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.346735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.346761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.346902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.347038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.347063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.347184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.347301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.347326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.347432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.347565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.347591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.347752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.347903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.347928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.348085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.348199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.348224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.348390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.348507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.348535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.348673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.348814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.348840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.348956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.349065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.349091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.349254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.349358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.349384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.349492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.349633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.349658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.349771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.349918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.349944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.350051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.350188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.350215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.350329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.350465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.350491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.350639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.350781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.350807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.350929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.351073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.351098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.351220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.351332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.351357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.351482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.351595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.351621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.351773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.351896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.351923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.352062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.352234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.352260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.020 qpair failed and we were unable to recover it. 00:27:23.020 [2024-07-15 09:06:11.352370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.020 [2024-07-15 09:06:11.352511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.352537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.352659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.352778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.352804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.352934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.353060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.353083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.353226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.353346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.353371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.353495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.353616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.353642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.353812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.353931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.353957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.354084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.354222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.354247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.354368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.354478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.354504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.354629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.354798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.354823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.354958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.355067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.355093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.355234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.355349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.355376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.355505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.355611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.355636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.355760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.355874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.355904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.356025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.356161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.356187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.356308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.356453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.356483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.356631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.356767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.356793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.356907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.357050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.357074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.357186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.357296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.357321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.357466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.357620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.357646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.357763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.357885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.357910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.358056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.358196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.358222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.358340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.358450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.358476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.358625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.358768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.358793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.358921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.359089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.359114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.359257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.359370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.359399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.359539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.359656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.359680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.359829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.359955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.359981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.360098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.360241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.360265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.360418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.360560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.360586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.360706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.360810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.360834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.360993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.361110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.361136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.361287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.361424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.361450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.361559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.361704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.361729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.361852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.361983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.362008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.362156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.362269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.362295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.362436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.362546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.362572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.362689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.362834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.362859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.362988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.363097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.363120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.363237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.363357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.363382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.363485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.363609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.363634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.363773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.363921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.363948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.364054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.364167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.364191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.364361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.364474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.364499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.364604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.364774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.364799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.364916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.365032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.365057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.365200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.365323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.365349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.365488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.365595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.365620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.365763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.365900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.365925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.366044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.366164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.366189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.366298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.366419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.366445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.366561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.366696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.366721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.021 [2024-07-15 09:06:11.366838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.366955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.021 [2024-07-15 09:06:11.366980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.021 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.367111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.367282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.367308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.367438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.367581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.367606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.367724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.367861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.367918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.368061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.368268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.368295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.368447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.368593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.368619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.368729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.368869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.368901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.369013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.369154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.369180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.369292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.369404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.369429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.369540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.369704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.369729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.369848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.369971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.369996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.370107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.370224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.370248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.370367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.370499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.370525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.370668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.370789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.370814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.370924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.371048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.371076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.371220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.371330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.371356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.371463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.371575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.371600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.371705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.371881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.371908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.372032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.372182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.372208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.372349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.372471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.372497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.372642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.372763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.372788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.372909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.373045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.373070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.373210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.373347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.373372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.373487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.373605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.373630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.373768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.373886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.373911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.374024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.374145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.374169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.374279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.374397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.374421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.374548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.374696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.374722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.374860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.375004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.375030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.375167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.375349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.375374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.375486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.375587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.375612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.375720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.375838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.375863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.376054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.376169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.376195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.376317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.376423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.376448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.376590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.376696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.376722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.376871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.377020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.377055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.377178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.377307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.377332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.377447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.377612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.377636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.377745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.377888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.377913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.378038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.378144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.378169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.378312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.378452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.378478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.378593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.378702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.378728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.378846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.379020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.379046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.379191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.379327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.379353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.379478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.379616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.379640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.379799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.379910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.379935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.380042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.380184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.380208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.380343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.380455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.380481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.380651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.380761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.380786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.380901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.381020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.381045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.381190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.381334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.022 [2024-07-15 09:06:11.381360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.022 qpair failed and we were unable to recover it. 00:27:23.022 [2024-07-15 09:06:11.381487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.381629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.381654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.381801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.381914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.381940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.382063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.382180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.382206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.382315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.382479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.382505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.382621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.382752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.382778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.382896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.383025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.383049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.383162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.383301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.383327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.383470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.383587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.383613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.383759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.383905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.383931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.384047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.384161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.384190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.384311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.384444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.384469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.384617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.384723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.384748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.384923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.385033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.385058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.385176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.385284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.385309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.385477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.385622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.385654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.385762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.385908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.385935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.386054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.386192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.386217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.386365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.386506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.386531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.386638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.386759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.386783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.386905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.387014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.387040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.387177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.387283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.387308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.387450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.387594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.387619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.387741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.387849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.387874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.387997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.388105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.388129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.388238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.388342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.388367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.388486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.388595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.388619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.388736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.388848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.388874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.388999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.389114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.389140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.389254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.389395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.389421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.389534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.389675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.389700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.389832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.389970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.389996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.390170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.390314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.390339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.390467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.390601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.390627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.390798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.390906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.390931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.391052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.391191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.391217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.391367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.391510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.391535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.391708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.391852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.391889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.392075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.392201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.392236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.392352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.392500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.392527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.392671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.392849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.392880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.392990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.393122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.393153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.393301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.393434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.393462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.393607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.393720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.393746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.393888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.394003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.394029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.394137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.394286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.394311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.394479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.394593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.394617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.394742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.394889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.394914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.395056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.395196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.023 [2024-07-15 09:06:11.395221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.023 qpair failed and we were unable to recover it. 00:27:23.023 [2024-07-15 09:06:11.395367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.395487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.395512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.395634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.395770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.395796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.395921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.396065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.396091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.396204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.396318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.396346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.396471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.396614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.396640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.396756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.396870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.396901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.397024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.397137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.397162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.397329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.397450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.397478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.397623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.397793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.397817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.397965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.398084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.398110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.398259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.398411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.398436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.398585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.398729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.398755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.398874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.398988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.399014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.399143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.399312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.399337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.399458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.399604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.399629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.399742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.399856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.399885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.400008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.400121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.400146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.400262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.400402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.400432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.400548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.400667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.400692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.400834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.400984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.401011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.401151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.401269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.401294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.401415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.401525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.401552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.401692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.401803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.401830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.401940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.402108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.402134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.402278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.402420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.402446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.402551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.402657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.402683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.402856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.402975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.403001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.403108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.403241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.403266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.403379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.403491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.403516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.403642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.403750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.403775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.403893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.404001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.404025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.404149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.404317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.404343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.404453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.404555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.404579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.404707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.404818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.404844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.404981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.405119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.405145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.405297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.405406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.405432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.405554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.405720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.405746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.405900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.406017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.406043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.406157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.406269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.406295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.406399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.406539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.406567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.406676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.406811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.406837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.406963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.407099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.407124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.407267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.407392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.407417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.407568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.407708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.407734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.407862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.408048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.408074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.408220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.408337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.408362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.408502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.408616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.408642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.408763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.408870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.408908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.409033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.409150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.409175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.409315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.409417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.409443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.409562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.409723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.409749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.409903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.410043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.410069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.024 [2024-07-15 09:06:11.410236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.410357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.024 [2024-07-15 09:06:11.410382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.024 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.410528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.410636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.410661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.410810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.410943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.410969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.411087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.411232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.411258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.411397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.411552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.411578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.411696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.411802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.411828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.411949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.412086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.412115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.412230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.412334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.412360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.412481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.412614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.412651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.412805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.412924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.412950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.413094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.413212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.413239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.413348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.413465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.413491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.413628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.413784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.413810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.413958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.414100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.414125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.414247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.414364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.414390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.414499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.414609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.414634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.414755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.414869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.414900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.415051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.415163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.415188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.415331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.415443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.415470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.415577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.415712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.415738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.415860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.416007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.416033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.416154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.416265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.416291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.416433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.416553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.416578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.416700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.416840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.416866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.417002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.417137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.417163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.417321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.417470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.417496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.417603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.417740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.417766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.417888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.418009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.418035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.418145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.418257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.418283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.418425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.418531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.418557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.418708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.418841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.418867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.418999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.419105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.419131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.419271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.419412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.419438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.419561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.419674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.419700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.419828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.419941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.419968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.420084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.420196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.420223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.420363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.420582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.420608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.420756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.420897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.420924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.421043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.421184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.421210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.421350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.421489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.421515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.421630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.421779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.421805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.421951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.422064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.422090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.422208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.422325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.422351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.422499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.422637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.422663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.422808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.422926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.422953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.423174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.423308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.423334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.423478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.423596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.423621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.423732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.423887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.423913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.424055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.424190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.424215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.424387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.424506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.424531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.025 qpair failed and we were unable to recover it. 00:27:23.025 [2024-07-15 09:06:11.424668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.025 [2024-07-15 09:06:11.424805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.424831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.424958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.425069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.425095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.425208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.425349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.425375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.425487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.425603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.425629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.425744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.425851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.425891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.426012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.426127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.426154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.426261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.426388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.426414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.426528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.426667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.426697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.426818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.426963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.426990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.427101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.427203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.427227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.427350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.427487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.427512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.427660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.427808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.427834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.427949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.428066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.428092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.428247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.428362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.428390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.428511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.428663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.428691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.428827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.428943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.428969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.429098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.429221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.429247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.429383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.429503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.429528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.429675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.429780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.429806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.429945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.430056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.430081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.430220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.430340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.430366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.430501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.430614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.430641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.430780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.430928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.430954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.431062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.431199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.431225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.431346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.431451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.431476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.431614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.431761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.431787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.431922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.432036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.432062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.432231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.432355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.432381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.432525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.432642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.432667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.432802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.432937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.432964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.433113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.433249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.433274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.433418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.433525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.433550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.433671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.433779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.433805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.433975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.434117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.434142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.434262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.434404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.434430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.434536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.434705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.434731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.434837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.434987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.435014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.435156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.435283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.435308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.435444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.435584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.435610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.435740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.435886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.435913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.436055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.436174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.436200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.436320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.436469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.436495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.436632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.436797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.436822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.436969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.437077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.437103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.437224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.437368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.437394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.437505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.437642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.437668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.437784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.437890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.437916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.438027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.438165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.438191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.438364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.438494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.438524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.438647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.438784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.438809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.438921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.439041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.439067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.439186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.439300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.439325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.439547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.439685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.439711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.439848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.439997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.440023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.026 qpair failed and we were unable to recover it. 00:27:23.026 [2024-07-15 09:06:11.440133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.026 [2024-07-15 09:06:11.440269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.440294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.440438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.440577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.440603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.440719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.440825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.440850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.441001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.441137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.441163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.441300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.441411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.441441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.441580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.441748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.441774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.441889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.441998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.442022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.442161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.442276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.442302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.442440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.442564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.442589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.442733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.442851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.442881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.442994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.443132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.443165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.443284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.443390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.443426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.443566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.443684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.443710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.443865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.443986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.444012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.444124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.444260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.444286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.444401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.444519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.444544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.444681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.444902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.444928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.445047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.445158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.445184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.445325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.445434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.445461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.445681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.445813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.445839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.445960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.446078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.446104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.446253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.446390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.446415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.446561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.446781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.446807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.446947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.447082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.447108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.447247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.447391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.447416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.447640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.447815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.447841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.447954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.448069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.448094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.448316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.448459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.448484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.448599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.448716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.448741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.448893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.449017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.449044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.449169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.449285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.449311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.449531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.449667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.449693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.449840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.449968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.449995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.450103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.450221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.450247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.450358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.450527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.450553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.450674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.450785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.450811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.450927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.451042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.451067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.451207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.451347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.451372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.451510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.451658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.451684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.451801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.451939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.451965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.452076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.452188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.452213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.452355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.452466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.452493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.452619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.452729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.452754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.452891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.453038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.453064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.453209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.453327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.453352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.453505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.453624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.453655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.453764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.453986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.454013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.454129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.454292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.454318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.454458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.454607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.454633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.454740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.454846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.454870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.455043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.455148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.455174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.455323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.455462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.455488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.455595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.455712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.455737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.027 qpair failed and we were unable to recover it. 00:27:23.027 [2024-07-15 09:06:11.455860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.027 [2024-07-15 09:06:11.455987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.456013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.456122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.456262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.456287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.456408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.456512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.456537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.456648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.456792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.456819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.456960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.457116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.457142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.457262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.457376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.457402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.457547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.457656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.457682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.457798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.457913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.457939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.458056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.458197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.458223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.458373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.458489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.458514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.458622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.458739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.458765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.458904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.459022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.459048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.459160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.459278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.459304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.459445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.459589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.459615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.459752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.459873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.459903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.460026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.460143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.460169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.460288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.460398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.460423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.460593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.460720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.460748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.460889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.461025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.461051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.461163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.461303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.461329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.461441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.461578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.461604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.461726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.461846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.461871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.461998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.462104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.462130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.462292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.462408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.462434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.462555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.462660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.462686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.462809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.462942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.462969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.463078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.463180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.463205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.463323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.463490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.463516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.463626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.463763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.463789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.463900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.464039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.464065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.464287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.464403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.464429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.464570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.464685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.464712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.464823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.464960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.464986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.465138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.465281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.465307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.465416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.465552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.465578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.465714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.465865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.465895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.466035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.466177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.466203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.466323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.466463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.466489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.466595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.466750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.466776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.466925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.467063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.467088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.467311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.467416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.467442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.467608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.467727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.467753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.467869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.468000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.468026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.468146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.468257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.468286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.468435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.468543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.468569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.468680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.468801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.468827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.468950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.469067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.469094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.469217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.469331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.469356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.469504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.469626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.469651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.469795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.469914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.469940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.470057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.470189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.470215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.470358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.470504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.470530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.470638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.470751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.470777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.470900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.471017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.471043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.028 [2024-07-15 09:06:11.471160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.471298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.028 [2024-07-15 09:06:11.471323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.028 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.471473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.471646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.471671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.471810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.471924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.471950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.472088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.472207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.472233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.472343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.472480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.472506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.472616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.472753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.472779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.472898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.473037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.473067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.473209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.473326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.473352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.473468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.473638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.473664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.473776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.473890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.473914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.474027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.474134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.474160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.474275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.474432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.474457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.474602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.474749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.474774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.474895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.475060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.475085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.475203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.475314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.475342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.475459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.475598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.475624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.475733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.475852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.475887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.476013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.476121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.476147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.476285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.476451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.476477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.476583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.476721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.476746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.476858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.477039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.477065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.477210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.477318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.477344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.477484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.477650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.477676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.477804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.477914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.477939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.478051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.478172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.478197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.478333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.478464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.478489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.478647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.478787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.478813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.478919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.479029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.479054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.479159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.479271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.479296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.479415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.479583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.479608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.479722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.479862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.479896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.480054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.480173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.480198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.480335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.480450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.480477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.480615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.480728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.480753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.480867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.481016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.481044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.481191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.481315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.481341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.481451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.481589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.481615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.481749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.481888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.481915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.482031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.482165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.482190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.482298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.482402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.482428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.482571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.482714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.482744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.482857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.482982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.483008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.483117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.483225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.483251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.483356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.483475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.483502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.483651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.483790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.483816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.483954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.484063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.484088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.484213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.484361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.484386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.484522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.484626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.484652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.484797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.484942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.484968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.485088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.485214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.485239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.485358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.485467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.485492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.485610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.485750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.485775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.485905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.486025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.486051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.486170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.486287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.486313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.486437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.486559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.486585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.486700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.486820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.486846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.029 [2024-07-15 09:06:11.486997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.487115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.029 [2024-07-15 09:06:11.487141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.029 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.487245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.487380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.487406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.487546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.487682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.487708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.487821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.487968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.487995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.488137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.488243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.488269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.488421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.488536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.488563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.488686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.488803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.488829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.488937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.489053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.489079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.489197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.489337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.489362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.489512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.489632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.489658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.489805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.489943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.489969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.490084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.490196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.490222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.490340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.490447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.490472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.490625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.490766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.490792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.490935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.491083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.491108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.491259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.491372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.491397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.491535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.491655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.491681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.491815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.491931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.491957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.492073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.492193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.492219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.492360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.492501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.492527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.492669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.492774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.492800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.492958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.493074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.493099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.493213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.493357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.493383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.493510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.493645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.493670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.493810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.493951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.493978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.494094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.494231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.494261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.494368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.494533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.494558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.494709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.494836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.494861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.495023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.495137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.495163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.495272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.495421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.495447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.495604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.495751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.495777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.495914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.496058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.496083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.496190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.496308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.496332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.496488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.496597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.496623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.496730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.496867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.496897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.497037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.497182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.497207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.497331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.497444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.497470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.497581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.497738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.497764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.497874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.498026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.498052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.498189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.498331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.498357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.498481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.498618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.498644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.498781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.498922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.498949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.499102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.499243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.499269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.499407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.499547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.499573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.499710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.499849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.499874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.500004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.500147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.500172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.500282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.500397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.500422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.500539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.500648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.500673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.500818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.500943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.500970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.501077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.501215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.501241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.501352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.501509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.501534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.501641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.501790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.501816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.501929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.502038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.502063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.502220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.502328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.502354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.502521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.502665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.030 [2024-07-15 09:06:11.502690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.030 qpair failed and we were unable to recover it. 00:27:23.030 [2024-07-15 09:06:11.502814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.502971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.502997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.503121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.503254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.503279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.503388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.503530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.503559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.503701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.503849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.503875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.503991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.504104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.504132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.504240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.504375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.504401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.504511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.504647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.504673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.504781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.504905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.504932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.505046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.505168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.505194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.505311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.505430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.505457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.505579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.505705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.505730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.505842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.505977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.506003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.506120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.506236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.506262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.506398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.506542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.506567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.506680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.506829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.506854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x52d9f0 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.507004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.507145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.507174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.507323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.507473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.507500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.507642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.507765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.507791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.508020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.508162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.508188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.508303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.508446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.508472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.508583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.508697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.508723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.508896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.509014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.509047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.509192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.509301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.509327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.509443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.509555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.509589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.509737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.509852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.509885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.510006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.510115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.510141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.510281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.510426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.510453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.510566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.510718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.510744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.510859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.510994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.511020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.511141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.511269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.511294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.511439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.511585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.511611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.511725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.511862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.511900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.512020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.512184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.512210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.512332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.512449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.512475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.512598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.512715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.512741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.512853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.512972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.512999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.513145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.513271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.513298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.513443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.513590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.513616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.513775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.513916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.513943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.514112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.514219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.514245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.514396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.514554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.514579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.514716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.514832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.514862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.515007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.515135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.515162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.515313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.515432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.515458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.515595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.515729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.515755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.515904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.516058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.516084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.516206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.516348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.516374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.516499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.516636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.516662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.516799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.516947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.516974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.517095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.517207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.517235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.517406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.517514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.517540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.517680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.517804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.517832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.517965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.518116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.518142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.518310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.518432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.518458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.518583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.518729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.518756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.518902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.519025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.519051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.519166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.519312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.519338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.519459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.519606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.519632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.031 qpair failed and we were unable to recover it. 00:27:23.031 [2024-07-15 09:06:11.519808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.031 [2024-07-15 09:06:11.520030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.520056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.520173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.520287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.520314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.520436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.520557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.520583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.520722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.520835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.520860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.520990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.521104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.521130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.521250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.521357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.521383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.521552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.521669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.521695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.521832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.521986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.522012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.522169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.522284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.522310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.522446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.522592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.522618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.522760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.522905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.522932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.523078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.523190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.523218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.523325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.523494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.523520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.523644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.523787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.523813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.523957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.524105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.524132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.524253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.524369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.524395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.524531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.524704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.524730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.524845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.524993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.525020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.525159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.525283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.525311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.525434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.525583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.525609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.525728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.525841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.525867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.526022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.526143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.526170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.526315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.526444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.526480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.526591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.526744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.526770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.526922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.527070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.527096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.527215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.527323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.527349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.527501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.527649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.527678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.527788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.527912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.527938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.528085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.528203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.528230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.528371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.528539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.528565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.528680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.528791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.528817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.528987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.529129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.529155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.529380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.529496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.529522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.529646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.529791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.529817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.529951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.530073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.530099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.530208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.530330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.530356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.530501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.530646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.530672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.530786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.530909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.530936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.531084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.531229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.531256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.531365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.531511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.531539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.531664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.531782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.531808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.531946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.532068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.532095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.532207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.532319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.532345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.532452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.532599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.532626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.532784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.532903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.532929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.533039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.533185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.533211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.533324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.533441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.533467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.533578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.533712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.533738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.533854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.533978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.534005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.534123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.534269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.534295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.534437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.534659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.534684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.534796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.534941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.534968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.535086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.535236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.032 [2024-07-15 09:06:11.535262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.032 qpair failed and we were unable to recover it. 00:27:23.032 [2024-07-15 09:06:11.535406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.033 [2024-07-15 09:06:11.535547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.033 [2024-07-15 09:06:11.535573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.033 qpair failed and we were unable to recover it. 00:27:23.033 [2024-07-15 09:06:11.535693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.033 [2024-07-15 09:06:11.535832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.033 [2024-07-15 09:06:11.535859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.033 qpair failed and we were unable to recover it. 00:27:23.033 [2024-07-15 09:06:11.535984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.033 [2024-07-15 09:06:11.536137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.033 [2024-07-15 09:06:11.536163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.033 qpair failed and we were unable to recover it. 00:27:23.033 [2024-07-15 09:06:11.536306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.033 [2024-07-15 09:06:11.536443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.033 [2024-07-15 09:06:11.536469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.033 qpair failed and we were unable to recover it. 00:27:23.033 [2024-07-15 09:06:11.536611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.033 [2024-07-15 09:06:11.536724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.033 [2024-07-15 09:06:11.536750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.033 qpair failed and we were unable to recover it. 00:27:23.033 [2024-07-15 09:06:11.536885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.033 [2024-07-15 09:06:11.537011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.033 [2024-07-15 09:06:11.537037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.033 qpair failed and we were unable to recover it. 00:27:23.033 [2024-07-15 09:06:11.537155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.033 [2024-07-15 09:06:11.537267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.033 [2024-07-15 09:06:11.537293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.033 qpair failed and we were unable to recover it. 00:27:23.033 [2024-07-15 09:06:11.537461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.033 [2024-07-15 09:06:11.537581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.033 [2024-07-15 09:06:11.537607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.033 qpair failed and we were unable to recover it. 00:27:23.033 [2024-07-15 09:06:11.537732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.033 [2024-07-15 09:06:11.537873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.033 [2024-07-15 09:06:11.537904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.033 qpair failed and we were unable to recover it. 00:27:23.033 [2024-07-15 09:06:11.538047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.033 [2024-07-15 09:06:11.538174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.033 [2024-07-15 09:06:11.538200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.033 qpair failed and we were unable to recover it. 00:27:23.033 [2024-07-15 09:06:11.538312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.033 [2024-07-15 09:06:11.538435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.033 [2024-07-15 09:06:11.538462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.033 qpair failed and we were unable to recover it. 00:27:23.033 [2024-07-15 09:06:11.538583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.033 [2024-07-15 09:06:11.538709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.033 [2024-07-15 09:06:11.538736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.033 qpair failed and we were unable to recover it. 00:27:23.033 [2024-07-15 09:06:11.538861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.033 [2024-07-15 09:06:11.539013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.033 [2024-07-15 09:06:11.539040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.033 qpair failed and we were unable to recover it. 00:27:23.033 [2024-07-15 09:06:11.539166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.033 [2024-07-15 09:06:11.539281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.033 [2024-07-15 09:06:11.539307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.033 qpair failed and we were unable to recover it. 00:27:23.033 [2024-07-15 09:06:11.539456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.309 [2024-07-15 09:06:11.539679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.309 [2024-07-15 09:06:11.539705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.309 qpair failed and we were unable to recover it. 00:27:23.309 [2024-07-15 09:06:11.539849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.309 [2024-07-15 09:06:11.540002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.309 [2024-07-15 09:06:11.540029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.309 qpair failed and we were unable to recover it. 00:27:23.309 [2024-07-15 09:06:11.540160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.309 [2024-07-15 09:06:11.540272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.309 [2024-07-15 09:06:11.540297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.309 qpair failed and we were unable to recover it. 00:27:23.309 [2024-07-15 09:06:11.540411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.309 [2024-07-15 09:06:11.540529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.309 [2024-07-15 09:06:11.540555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.309 qpair failed and we were unable to recover it. 00:27:23.309 [2024-07-15 09:06:11.540675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.309 [2024-07-15 09:06:11.540813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.309 [2024-07-15 09:06:11.540839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.309 qpair failed and we were unable to recover it. 00:27:23.309 [2024-07-15 09:06:11.541044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.309 [2024-07-15 09:06:11.541197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.309 [2024-07-15 09:06:11.541223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.309 qpair failed and we were unable to recover it. 00:27:23.309 [2024-07-15 09:06:11.541341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.309 [2024-07-15 09:06:11.541486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.309 [2024-07-15 09:06:11.541513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.309 qpair failed and we were unable to recover it. 00:27:23.309 [2024-07-15 09:06:11.541659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.541795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.541821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.541945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.542085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.542111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.542252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.542368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.542394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.542510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.542634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.542661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.542805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.542912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.542938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.543081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.543231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.543257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.543382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.543528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.543554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.543678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.543822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.543848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.543981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.544147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.544173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.544318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.544435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.544462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.544611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.544730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.544757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.544903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.545017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.545044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.545154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.545276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.545302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.545418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.545641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.545667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.545779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.545931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.545959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.546109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.546276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.546303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.546415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.546530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.546556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.546699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.546816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.546842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.546990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.547211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.547238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.547386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.547503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.547529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.547663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.547810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.547836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.547984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.548107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.548134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.548241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.548382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.548408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.548531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.548670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.548695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.548803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.548941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.548968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.549077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.549187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.549213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.549330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.549467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.549493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.549637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.549777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.549803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.549969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.550082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.550108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.550215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.550323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.550349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.550497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.550642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.550667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.550912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.551050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.551076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.551220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.551368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.551395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.551541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.551648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.551673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.551782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.551922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.551949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.552068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.552210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.552236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.552350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.552469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.552496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.552616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.552724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.552751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.552874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.553031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.553057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.553174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.553284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.553310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.553425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.553553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.553584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.553727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.553950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.553976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.554155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.554297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.554324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.554467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.554612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.554639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.554754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.554863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.554894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.555013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.555133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.555159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.310 qpair failed and we were unable to recover it. 00:27:23.310 [2024-07-15 09:06:11.555272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.310 [2024-07-15 09:06:11.555413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.555439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.555590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.555711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.555738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.555884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.556007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.556033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.556146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.556285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.556312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.556444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.556557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.556587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.556762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.556897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.556924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.557067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.557209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.557235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.557343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.557449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.557475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.557593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.557736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.557762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.557893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.558033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.558059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.558179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.558324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.558351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.558525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.558667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.558693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.558802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.558927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.558954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.559072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.559223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.559249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.559367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.559485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.559515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.559738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.559871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.559926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.560046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.560163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.560189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.560328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.560505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.560531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.560667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.560781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.560807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.560925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.561038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.561064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.561174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.561292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.561318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.561486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.561634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.561660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.561786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.561943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.561971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.562124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.562268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.562295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.562416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.562547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.562578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.562722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.562839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.562867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.562981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.563123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.563149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.563293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.563429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.563456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.563565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.563680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.563708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.563856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.564085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.564111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.564284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.564396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.564422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.564533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.564677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.564704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.564819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.564954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.564981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.565088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.565214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.565240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.565383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.565495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.565521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.565678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.565793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.565819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.565931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.566154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.566180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.566321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.566428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.566454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.566565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.566709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.566735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.566874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.566993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.567020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.567143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.567259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.567286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.567425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.567565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.567591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.567702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.567824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.567851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.567985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.568134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.568160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.568338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.568452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.568482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.568613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.568765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.568791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.568930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.569152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.569178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.569285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.569426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.569453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.569630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.569852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.569900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.570049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.570215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.570241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.311 qpair failed and we were unable to recover it. 00:27:23.311 [2024-07-15 09:06:11.570352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.311 [2024-07-15 09:06:11.570497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.570523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.312 qpair failed and we were unable to recover it. 00:27:23.312 [2024-07-15 09:06:11.570632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.570741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.570768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.312 qpair failed and we were unable to recover it. 00:27:23.312 [2024-07-15 09:06:11.570989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.571113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.571139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.312 qpair failed and we were unable to recover it. 00:27:23.312 [2024-07-15 09:06:11.571254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.571399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.571426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.312 qpair failed and we were unable to recover it. 00:27:23.312 [2024-07-15 09:06:11.571543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.571653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.571678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.312 qpair failed and we were unable to recover it. 00:27:23.312 [2024-07-15 09:06:11.571799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.571909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.571936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.312 qpair failed and we were unable to recover it. 00:27:23.312 [2024-07-15 09:06:11.572092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.572228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.572254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.312 qpair failed and we were unable to recover it. 00:27:23.312 [2024-07-15 09:06:11.572369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.572511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.572537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.312 qpair failed and we were unable to recover it. 00:27:23.312 [2024-07-15 09:06:11.572663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.572806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.572832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.312 qpair failed and we were unable to recover it. 00:27:23.312 [2024-07-15 09:06:11.572952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.573074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.573100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.312 qpair failed and we were unable to recover it. 00:27:23.312 [2024-07-15 09:06:11.573228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.573334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.573360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.312 qpair failed and we were unable to recover it. 00:27:23.312 [2024-07-15 09:06:11.573482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.573652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.573678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.312 qpair failed and we were unable to recover it. 00:27:23.312 [2024-07-15 09:06:11.573797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.573941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.573967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.312 qpair failed and we were unable to recover it. 00:27:23.312 [2024-07-15 09:06:11.574105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.574328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.574354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.312 qpair failed and we were unable to recover it. 00:27:23.312 [2024-07-15 09:06:11.574523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.574643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.574669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.312 qpair failed and we were unable to recover it. 00:27:23.312 [2024-07-15 09:06:11.574786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.574903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.574931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.312 qpair failed and we were unable to recover it. 00:27:23.312 [2024-07-15 09:06:11.575068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.575198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.575224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.312 qpair failed and we were unable to recover it. 00:27:23.312 [2024-07-15 09:06:11.575363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.575470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.575496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.312 qpair failed and we were unable to recover it. 00:27:23.312 [2024-07-15 09:06:11.575652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.575775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.575801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.312 qpair failed and we were unable to recover it. 00:27:23.312 [2024-07-15 09:06:11.575935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.576059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.576085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.312 qpair failed and we were unable to recover it. 00:27:23.312 [2024-07-15 09:06:11.576227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.576365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.576391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.312 qpair failed and we were unable to recover it. 00:27:23.312 [2024-07-15 09:06:11.576516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.576659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.576685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.312 qpair failed and we were unable to recover it. 00:27:23.312 [2024-07-15 09:06:11.576794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.576946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.576973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.312 qpair failed and we were unable to recover it. 00:27:23.312 [2024-07-15 09:06:11.577090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.577215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.577242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.312 qpair failed and we were unable to recover it. 00:27:23.312 [2024-07-15 09:06:11.577393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.577532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.577558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.312 qpair failed and we were unable to recover it. 00:27:23.312 [2024-07-15 09:06:11.577696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.577811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.577837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.312 qpair failed and we were unable to recover it. 00:27:23.312 [2024-07-15 09:06:11.577994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.578111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.578137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.312 qpair failed and we were unable to recover it. 00:27:23.312 [2024-07-15 09:06:11.578278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.578451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.578477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.312 qpair failed and we were unable to recover it. 00:27:23.312 [2024-07-15 09:06:11.578596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.578704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.578730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.312 qpair failed and we were unable to recover it. 00:27:23.312 [2024-07-15 09:06:11.578841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.578977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.579004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.312 qpair failed and we were unable to recover it. 00:27:23.312 [2024-07-15 09:06:11.579132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.579259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.579285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.312 qpair failed and we were unable to recover it. 00:27:23.312 [2024-07-15 09:06:11.579403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.579528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.579554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.312 qpair failed and we were unable to recover it. 00:27:23.312 [2024-07-15 09:06:11.579706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.579853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.579887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.312 qpair failed and we were unable to recover it. 00:27:23.312 [2024-07-15 09:06:11.580002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.580153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.580179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.312 qpair failed and we were unable to recover it. 00:27:23.312 [2024-07-15 09:06:11.580335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.580453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.580479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.312 qpair failed and we were unable to recover it. 00:27:23.312 [2024-07-15 09:06:11.580652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.580767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.580793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.312 qpair failed and we were unable to recover it. 00:27:23.312 [2024-07-15 09:06:11.580922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.581066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.581093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.312 qpair failed and we were unable to recover it. 00:27:23.312 [2024-07-15 09:06:11.581206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.581352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.581378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.312 qpair failed and we were unable to recover it. 00:27:23.312 [2024-07-15 09:06:11.581495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.581634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.581660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.312 qpair failed and we were unable to recover it. 00:27:23.312 [2024-07-15 09:06:11.581799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.581941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.581968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.312 qpair failed and we were unable to recover it. 00:27:23.312 [2024-07-15 09:06:11.582084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.582194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.582221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.312 qpair failed and we were unable to recover it. 00:27:23.312 [2024-07-15 09:06:11.582348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.582461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.312 [2024-07-15 09:06:11.582488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.312 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.582640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.582778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.582804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.582950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.583119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.583145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.583264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.583383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.583409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.583531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.583682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.583708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.583886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.584001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.584028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.584196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.584334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.584361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.584470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.584618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.584644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.584790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.584913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.584949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.585070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.585186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.585212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.585327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.585454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.585480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.585619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.585844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.585871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.586024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.586247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.586273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.586425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.586567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.586593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.586740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.586895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.586928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.587074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.587215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.587241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.587382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.587495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.587521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.587633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.587746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.587772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.587893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.588038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.588064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.588204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.588319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.588345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.588466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.588575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.588601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.588737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.588874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.588907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.589128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.589251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.589277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.589382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.589555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.589581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.589730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.589852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.589885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.590015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.590129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.590155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.590263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.590484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.590510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.590647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.590787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.590813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.591036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.591171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.591198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.591365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.591513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.591539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.591680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.591790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.591816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.591935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.592042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.592068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.592216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.592361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.592388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.592505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.592610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.592635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.592860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.593015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.593042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.593186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.593301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.593329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.593456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.593597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.593624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.593768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.593914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.593942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.594081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.594190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.594216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.594439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.594588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.594615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.594753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.594895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.594922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.595091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.595212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.595238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.595359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.595496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.595522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.595663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.595773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.595800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.595924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.596042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.596068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.596206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.596349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.596375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.596545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.596667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.596693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.596804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.596946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.596973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.597095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.597232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.597259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.313 qpair failed and we were unable to recover it. 00:27:23.313 [2024-07-15 09:06:11.597378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.597494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.313 [2024-07-15 09:06:11.597520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.597660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.597772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.597799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.597914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.598063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.598089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.598263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.598378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.598404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.598549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.598657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.598684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.598792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.598935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.598961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.599081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.599223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.599249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.599376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.599494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.599520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.599630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.599768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.599794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.600017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.600122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.600148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.600277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.600425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.600451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.600619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.600734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.600760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.600873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.601016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.601044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.601194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.601300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.601326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.601467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.601589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.601615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.601741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.601909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.601939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.602065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.602186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.602213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.602367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.602488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.602515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.602739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.602888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.602915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.603037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.603258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.603285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.603404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.603545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.603571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.603694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.603809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.603836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.603984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.604137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.604164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.604274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.604388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.604415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.604539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.604646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.604673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.604813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.604950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.604982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.605096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.605218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.605245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.605391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.605535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.605562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.605678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.605794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.605821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.606044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.606195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.606221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.606355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.606500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.606527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.606635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.606771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.606797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.606922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.607068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.607095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.607241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.607348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.607374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.607496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.607612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.607639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.607753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.607873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.607909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.608060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.608204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.608230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.608342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.608479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.608506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.608625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.608748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.608775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.608903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.609029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.609056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.609197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.609318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.609345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.609488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.609635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.609662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.609805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.609950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.609977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.610085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.610231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.610258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.610427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.610567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.610593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.610734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.610843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.610873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.611020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.611137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.611164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.611306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.611455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.611481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.611589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.611723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.611749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.611895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.612031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.612057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.612209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.612330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.612356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.314 [2024-07-15 09:06:11.612474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.612590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.314 [2024-07-15 09:06:11.612617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.314 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.612770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.612923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.612950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.613064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.613190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.613217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.613358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.613478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.613505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.613645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.613767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.613794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.613936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.614076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.614102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.614250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.614398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.614426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.614543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.614667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.614693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.614837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.614970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.614998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.615168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.615286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.615313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.615432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.615554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.615580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.615756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.615895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.615922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.616042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.616182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.616208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.616353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.616491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.616517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.616657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.616782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.616808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.616928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.617081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.617107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.617224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.617365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.617391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.617526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.617638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.617665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.617780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.617931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.617958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.618072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.618213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.618239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.618363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.618506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.618533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.618686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.618802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.618828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.618943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.619058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.619086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.619255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.619424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.619451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.619601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.619728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.619755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.619913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.620138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.620164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.620309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.620430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.620457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.620596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.620746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.620774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.620898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.621016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.621043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.621196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.621310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.621336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.621476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.621590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.621618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.621767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.621913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.621940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.622089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.622224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.622250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.622396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.622517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.622543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.622660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.622787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.622814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.622963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.623079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.623106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.623226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.623373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.623399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.623572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.623731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.623758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.623910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.624032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.624059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.624198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.624312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.624339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.624452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.624610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.624637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.624749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.624901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.624929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.625077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.625187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.625214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.625361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.625519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.625545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.315 qpair failed and we were unable to recover it. 00:27:23.315 [2024-07-15 09:06:11.625685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.625826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.315 [2024-07-15 09:06:11.625852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.625978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.626122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.626148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.626272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.626409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.626436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.626559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.626676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.626704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.626855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.626975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.627003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.627144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.627267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.627295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.627422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.627566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.627593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.627735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.627881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.627909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.628021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.628143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.628169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.628309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.628418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.628445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.628555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.628679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.628706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.628825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.628980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.629007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.629121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.629266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.629294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.629429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.629551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.629579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.629751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.629893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.629920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.630059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.630181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.630206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.630312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.630450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.630476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.630587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.630706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.630733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.630853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.630998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.631025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.631164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.631336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.631363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.631477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.631622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.631649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.631766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.631910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.631937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.632049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.632192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.632219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.632333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.632456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.632482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.632590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.632701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.632728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.632855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.633035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.633063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.633186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.633327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.633354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.633475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.633624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.633651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.633764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.633888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.633916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.634058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.634195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.634221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.634357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.634475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.634502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.634630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.634747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.634775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.634921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.635089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.635115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.635225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.635395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.635421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.635544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.635654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.635682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.635824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.635945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.635972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.636100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.636226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.636253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.636398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.636511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.636537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.636677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.636821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.636848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.636972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.637092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.637119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.637243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.637357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.637384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.637500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.637627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.637653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.637794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.637925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.637953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.638102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.638250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.638277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.638424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.638534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.638560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.316 [2024-07-15 09:06:11.638673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.638813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.316 [2024-07-15 09:06:11.638840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.316 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.638972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.639098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.639125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.639237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.639406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.639433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.639572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.639711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.639738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.639883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.639992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.640020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.640156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.640277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.640303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.640409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.640568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.640594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.640712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.640860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.640914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.641068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.641178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.641204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.641324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.641448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.641474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.641592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.641707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.641734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.641875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.642019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.642046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.642167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.642293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.642320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.642434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.642577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.642604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.642723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.642834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.642860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.643012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.643134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.643161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.643331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.643451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.643477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.643588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.643726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.643752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.643910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.644062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.644089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.644233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.644400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.644427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.644568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.644675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.644701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.644847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.645010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.645038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.645182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.645298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.645325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.645498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.645609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.645635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.645792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.645933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.645960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.646074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.646214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.646241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.646363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.646473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.646503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.646627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.646783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.646809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.646924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.647069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.647095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.647224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.647369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.647395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.647501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.647607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.647633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.647753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.647883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.647911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.648034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.648157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.648184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.648297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.648404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.648431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.648570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.648679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.648705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.648882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.649022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.649049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.649173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.649311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.649341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.649469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.649580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.649606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.649729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.649882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.649909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.650087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.650205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.650231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.650344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.650462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.650489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.650633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.650748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.650774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.650908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.651032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.651060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.651175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.651291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.651318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.651432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.651585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.651611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.651762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.651885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.651912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.652032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.652172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.652203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.652358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.652479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.652505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.317 qpair failed and we were unable to recover it. 00:27:23.317 [2024-07-15 09:06:11.652620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.652762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.317 [2024-07-15 09:06:11.652789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.652915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.653031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.653059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.653197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.653368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.653395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.653537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.653680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.653706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.653867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.654025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.654052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.654219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.654364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.654390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.654537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.654655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.654682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.654822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.654933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.654961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.655085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.655198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.655229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.655369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.655496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.655523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.655645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.655769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.655795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.655935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.656059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.656086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.656221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.656341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.656367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.656485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.656604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.656630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.656756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.656905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.656932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.657042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.657193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.657219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.657364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.657502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.657528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.657645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.657770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.657796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.657940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.658088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.658115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.658244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.658385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.658412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.658523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.658661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.658687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.658796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.658922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.658950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.659073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.659191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.659217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.659358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.659481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.659507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.659648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.659801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.659828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.659946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.660064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.660091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.660210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.660331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.660357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.660476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.660619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.660645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.660788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.660905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.660931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.661075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.661206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.661231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.661353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.661500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.661526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.661643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.661764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.661790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.661906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.662030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.662056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.662167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.662335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.662361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.662478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.662619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.662645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.662757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.662871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.662903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.663043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.663162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.663188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.663297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.663467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.663494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.663612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.663764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.663791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.663943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.664057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.664083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.664236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.664355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.664381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.664519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.664660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.664687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.664803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.664929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.664956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.665074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.665183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.665210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.665319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.665439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.665467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.665624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.665739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.665765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.665904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.666019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.666046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.666166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.666274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.666300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.318 [2024-07-15 09:06:11.666420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.666565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.318 [2024-07-15 09:06:11.666591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.318 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.666736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.666862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.666895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.667067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.667189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.667215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.667328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.667439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.667466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.667604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.667712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.667738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.667889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.668002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.668028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.668148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.668285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.668312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.668424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.668566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.668592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.668732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.668842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.668868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.669036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.669175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.669202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.669339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.669486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.669514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.669640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.669751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.669777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.669926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.670050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.670077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.670213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.670318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.670345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.670514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.670629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.670655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.670777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.670927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.670955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.671125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.671245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.671272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.671383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.671499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.671526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.671674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.671813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.671840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.671987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.672138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.672164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.672303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.672412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.672438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.672569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.672688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.672715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.672887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.673003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.673029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.673144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.673265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.673291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.673413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.673524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.673550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.673690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.673807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.673833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.673993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.674115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.674142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.674281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.674428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.674454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.674599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.674752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.674778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.674948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.675066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.675093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.675237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.675379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.675406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.675553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.675664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.675690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.675813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.675957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.675984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.676102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.676213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.676239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.676355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.676465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.676491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.676637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.676781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.676808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.676924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.677070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.677096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.677208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.677347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.677374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.677487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.677609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.677635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.677782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.677946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.677973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.678092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.678246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.678273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.678401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.678544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.678570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.678698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.678849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.678883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.679004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.679172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.679198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.679319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.679429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.679456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.679564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.679676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.679702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.679843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.679968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.679994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.680130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.680266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.680293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.680402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.680548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.680574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.319 qpair failed and we were unable to recover it. 00:27:23.319 [2024-07-15 09:06:11.680689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.319 [2024-07-15 09:06:11.680831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.680858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.320 qpair failed and we were unable to recover it. 00:27:23.320 [2024-07-15 09:06:11.680991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.681114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.681141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.320 qpair failed and we were unable to recover it. 00:27:23.320 [2024-07-15 09:06:11.681319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.681433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.681460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.320 qpair failed and we were unable to recover it. 00:27:23.320 [2024-07-15 09:06:11.681605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.681725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.681752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.320 qpair failed and we were unable to recover it. 00:27:23.320 [2024-07-15 09:06:11.681871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.681991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.682018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.320 qpair failed and we were unable to recover it. 00:27:23.320 [2024-07-15 09:06:11.682129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.682277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.682304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.320 qpair failed and we were unable to recover it. 00:27:23.320 [2024-07-15 09:06:11.682450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.682578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.682605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.320 qpair failed and we were unable to recover it. 00:27:23.320 [2024-07-15 09:06:11.682750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.682895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.682922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.320 qpair failed and we were unable to recover it. 00:27:23.320 [2024-07-15 09:06:11.683053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.683166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.683193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.320 qpair failed and we were unable to recover it. 00:27:23.320 [2024-07-15 09:06:11.683367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.683488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.683515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.320 qpair failed and we were unable to recover it. 00:27:23.320 [2024-07-15 09:06:11.683665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.683784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.683811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.320 qpair failed and we were unable to recover it. 00:27:23.320 [2024-07-15 09:06:11.683934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.684058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.684084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.320 qpair failed and we were unable to recover it. 00:27:23.320 [2024-07-15 09:06:11.684228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.684388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.684414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.320 qpair failed and we were unable to recover it. 00:27:23.320 [2024-07-15 09:06:11.684543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.684655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.684681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.320 qpair failed and we were unable to recover it. 00:27:23.320 [2024-07-15 09:06:11.684788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.684935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.684962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.320 qpair failed and we were unable to recover it. 00:27:23.320 [2024-07-15 09:06:11.685070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.685193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.685220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.320 qpair failed and we were unable to recover it. 00:27:23.320 [2024-07-15 09:06:11.685342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.685508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.685534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.320 qpair failed and we were unable to recover it. 00:27:23.320 [2024-07-15 09:06:11.685672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.685814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.685840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.320 qpair failed and we were unable to recover it. 00:27:23.320 [2024-07-15 09:06:11.685956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.686093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.686120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.320 qpair failed and we were unable to recover it. 00:27:23.320 [2024-07-15 09:06:11.686237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.686380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.686407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.320 qpair failed and we were unable to recover it. 00:27:23.320 [2024-07-15 09:06:11.686516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.686666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.686692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.320 qpair failed and we were unable to recover it. 00:27:23.320 [2024-07-15 09:06:11.686839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.686964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.686992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.320 qpair failed and we were unable to recover it. 00:27:23.320 [2024-07-15 09:06:11.687099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.687233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.687260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.320 qpair failed and we were unable to recover it. 00:27:23.320 [2024-07-15 09:06:11.687403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.687509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.687535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.320 qpair failed and we were unable to recover it. 00:27:23.320 [2024-07-15 09:06:11.687677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.687785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.687812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.320 qpair failed and we were unable to recover it. 00:27:23.320 [2024-07-15 09:06:11.687960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.688101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.688128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.320 qpair failed and we were unable to recover it. 00:27:23.320 [2024-07-15 09:06:11.688275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.688391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.688418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.320 qpair failed and we were unable to recover it. 00:27:23.320 [2024-07-15 09:06:11.688587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.688724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.688750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.320 qpair failed and we were unable to recover it. 00:27:23.320 [2024-07-15 09:06:11.688867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.689008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.689034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.320 qpair failed and we were unable to recover it. 00:27:23.320 [2024-07-15 09:06:11.689143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.689279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.689305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.320 qpair failed and we were unable to recover it. 00:27:23.320 [2024-07-15 09:06:11.689456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.689606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.689632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.320 qpair failed and we were unable to recover it. 00:27:23.320 [2024-07-15 09:06:11.689740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.689853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.689886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.320 qpair failed and we were unable to recover it. 00:27:23.320 [2024-07-15 09:06:11.690031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.690161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.690188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.320 qpair failed and we were unable to recover it. 00:27:23.320 [2024-07-15 09:06:11.690305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.690443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.690469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.320 qpair failed and we were unable to recover it. 00:27:23.320 [2024-07-15 09:06:11.690596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.690742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.690770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.320 qpair failed and we were unable to recover it. 00:27:23.320 [2024-07-15 09:06:11.690920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.691060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.691086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.320 qpair failed and we were unable to recover it. 00:27:23.320 [2024-07-15 09:06:11.691258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.691380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.691407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.320 qpair failed and we were unable to recover it. 00:27:23.320 [2024-07-15 09:06:11.691540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.691650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.691677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.320 qpair failed and we were unable to recover it. 00:27:23.320 [2024-07-15 09:06:11.691795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.691913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.691941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.320 qpair failed and we were unable to recover it. 00:27:23.320 [2024-07-15 09:06:11.692089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.692206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.692232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.320 qpair failed and we were unable to recover it. 00:27:23.320 [2024-07-15 09:06:11.692344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.692511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.320 [2024-07-15 09:06:11.692537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.320 qpair failed and we were unable to recover it. 00:27:23.320 [2024-07-15 09:06:11.692682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.692854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.692885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.693000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.693107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.693138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.693261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.693401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.693428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.693550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.693658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.693684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.693801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.693922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.693949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.694063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.694205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.694232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.694372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.694495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.694521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.694664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.694790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.694817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.694926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.695047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.695074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.695184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.695355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.695381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.695493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.695665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.695692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.695807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.695926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.695957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.696079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.696225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.696252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.696392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.696543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.696569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.696715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.696837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.696863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.696997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.697141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.697168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.697288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.697431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.697458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.697567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.697678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.697704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.697831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.697959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.697986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.698100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.698245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.698273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.698416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.698566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.698593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.698709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.698846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.698881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.699016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.699158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.699186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.699346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.699496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.699523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.699665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.699810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.699836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.699996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.700127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.700154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.700303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.700425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.700452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.700598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.700709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.700737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.700888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.701033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.701059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.701171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.701284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.701310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.701435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.701549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.701576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.701748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.701888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.701919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.702033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.702171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.702198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.702314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.702421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.702448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.702572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.702741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.702768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.702885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.703001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.703027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.703152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.703262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.703289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.703400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.703515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.703542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.703692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.703803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.703831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.703983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.704113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.704140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.704254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.704363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.704390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.704504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.704623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.704649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.704821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.704973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.705000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.705119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.705261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.705288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.705430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.705568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.705595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.705705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.705842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.705868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.706005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.706112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.706138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.321 qpair failed and we were unable to recover it. 00:27:23.321 [2024-07-15 09:06:11.706260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.706433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.321 [2024-07-15 09:06:11.706459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.706603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.706744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.706771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.706916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.707038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.707065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.707186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.707302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.707329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.707446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.707595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.707621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.707748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.707890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.707918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.708036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.708141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.708168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.708279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.708403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.708430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.708565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.708679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.708706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.708844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.708992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.709017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.709133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.709280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.709306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.709412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.709527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.709553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.709667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.709777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.709804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.709961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.710107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.710134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.710279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.710397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.710424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.710541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.710654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.710680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.710831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.710946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.710973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.711086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.711200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.711227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.711374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.711492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.711519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.711635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.711752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.711780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.711921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.712058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.712085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.712197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.712312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.712338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.712459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.712581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.712608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.712726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.712842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.712868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.713025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.713163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.713190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.713362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.713475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.713502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.713645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.713789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.713815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.713928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.714102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.714128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.714240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.714356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.714382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.714493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.714637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.714663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.714805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.714918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.714945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.715087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.715208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.715235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.715354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.715475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.715502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.715649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.715765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.715793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.715910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.716051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.716077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.716205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.716343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.716370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.716504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.716656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.716683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.716829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.716943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.716971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.717092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.717204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.717230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.717383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.717551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.717578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.717718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.717836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.717862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.717983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.718097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.718123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.718271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.718418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.718445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.718568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.718709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.718735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.718855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.718974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.719002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.719146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.719299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.719326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.719472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.719614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.719640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.719760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.719869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.719901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.720046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.720154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.720180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.322 [2024-07-15 09:06:11.720301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.720414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.322 [2024-07-15 09:06:11.720441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.322 qpair failed and we were unable to recover it. 00:27:23.323 [2024-07-15 09:06:11.720558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.720696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.720723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.323 qpair failed and we were unable to recover it. 00:27:23.323 [2024-07-15 09:06:11.720864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.721007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.721033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.323 qpair failed and we were unable to recover it. 00:27:23.323 [2024-07-15 09:06:11.721150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.721318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.721345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.323 qpair failed and we were unable to recover it. 00:27:23.323 [2024-07-15 09:06:11.721469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.721642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.721669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.323 qpair failed and we were unable to recover it. 00:27:23.323 [2024-07-15 09:06:11.721781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.721900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.721927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.323 qpair failed and we were unable to recover it. 00:27:23.323 [2024-07-15 09:06:11.722058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.722177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.722203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.323 qpair failed and we were unable to recover it. 00:27:23.323 [2024-07-15 09:06:11.722325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.722430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.722456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.323 qpair failed and we were unable to recover it. 00:27:23.323 [2024-07-15 09:06:11.722598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.722737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.722764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.323 qpair failed and we were unable to recover it. 00:27:23.323 [2024-07-15 09:06:11.722908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.723039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.723065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.323 qpair failed and we were unable to recover it. 00:27:23.323 [2024-07-15 09:06:11.723186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.723297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.723324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.323 qpair failed and we were unable to recover it. 00:27:23.323 [2024-07-15 09:06:11.723464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.723606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.723632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.323 qpair failed and we were unable to recover it. 00:27:23.323 [2024-07-15 09:06:11.723751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.723859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.723890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.323 qpair failed and we were unable to recover it. 00:27:23.323 [2024-07-15 09:06:11.724002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.724175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.724202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.323 qpair failed and we were unable to recover it. 00:27:23.323 [2024-07-15 09:06:11.724309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.724432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.724459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.323 qpair failed and we were unable to recover it. 00:27:23.323 [2024-07-15 09:06:11.724600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.724718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.724745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.323 qpair failed and we were unable to recover it. 00:27:23.323 [2024-07-15 09:06:11.724922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.725030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.725057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.323 qpair failed and we were unable to recover it. 00:27:23.323 [2024-07-15 09:06:11.725165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.725283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.725309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.323 qpair failed and we were unable to recover it. 00:27:23.323 [2024-07-15 09:06:11.725424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.725547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.725573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.323 qpair failed and we were unable to recover it. 00:27:23.323 [2024-07-15 09:06:11.725723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.725862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.725895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.323 qpair failed and we were unable to recover it. 00:27:23.323 [2024-07-15 09:06:11.726009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.726126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.726153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.323 qpair failed and we were unable to recover it. 00:27:23.323 [2024-07-15 09:06:11.726270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.726388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.726414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.323 qpair failed and we were unable to recover it. 00:27:23.323 [2024-07-15 09:06:11.726534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.726660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.726687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.323 qpair failed and we were unable to recover it. 00:27:23.323 [2024-07-15 09:06:11.726828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.726949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.726977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.323 qpair failed and we were unable to recover it. 00:27:23.323 [2024-07-15 09:06:11.727150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.727287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.727313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.323 qpair failed and we were unable to recover it. 00:27:23.323 [2024-07-15 09:06:11.727428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.727535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.727562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.323 qpair failed and we were unable to recover it. 00:27:23.323 [2024-07-15 09:06:11.727710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.727835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.727862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.323 qpair failed and we were unable to recover it. 00:27:23.323 [2024-07-15 09:06:11.728013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.728129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.728156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.323 qpair failed and we were unable to recover it. 00:27:23.323 [2024-07-15 09:06:11.728297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.728438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.728465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.323 qpair failed and we were unable to recover it. 00:27:23.323 [2024-07-15 09:06:11.728611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.728746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.728772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.323 qpair failed and we were unable to recover it. 00:27:23.323 [2024-07-15 09:06:11.728915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.729033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.729061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.323 qpair failed and we were unable to recover it. 00:27:23.323 [2024-07-15 09:06:11.729217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.729352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.729379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.323 qpair failed and we were unable to recover it. 00:27:23.323 [2024-07-15 09:06:11.729519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.729660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.729686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.323 qpair failed and we were unable to recover it. 00:27:23.323 [2024-07-15 09:06:11.729838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.729962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.729990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.323 qpair failed and we were unable to recover it. 00:27:23.323 [2024-07-15 09:06:11.730111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.730253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.730279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.323 qpair failed and we were unable to recover it. 00:27:23.323 [2024-07-15 09:06:11.730451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.730576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.730603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.323 qpair failed and we were unable to recover it. 00:27:23.323 [2024-07-15 09:06:11.730744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.730888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.730915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.323 qpair failed and we were unable to recover it. 00:27:23.323 [2024-07-15 09:06:11.731059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.731172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.731198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.323 qpair failed and we were unable to recover it. 00:27:23.323 [2024-07-15 09:06:11.731340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.731486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.731513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.323 qpair failed and we were unable to recover it. 00:27:23.323 [2024-07-15 09:06:11.731654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.731779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.731805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.323 qpair failed and we were unable to recover it. 00:27:23.323 [2024-07-15 09:06:11.731933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.732048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.323 [2024-07-15 09:06:11.732075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.323 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.732190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.732330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.732357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.732474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.732642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.732668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.732815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.732932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.732961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.733105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.733219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.733247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.733362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.733502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.733528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.733645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.733773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.733800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.733944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.734087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.734113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.734231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.734353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.734379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.734490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.734627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.734654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.734790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.734930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.734957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.735097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.735243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.735270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.735407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.735547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.735574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.735713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.735832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.735859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.735983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.736123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.736150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.736290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.736437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.736463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.736582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.736728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.736755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.736901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.737016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.737044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.737191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.737300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.737327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.737449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.737594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.737620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.737764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.737920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.737947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.738065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.738175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.738201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.738329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.738470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.738496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.738642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.738791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.738817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.738937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.739079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.739105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.739250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.739368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.739395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.739538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.739661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.739691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.739815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.739970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.739997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.740116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.740258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.740285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.740421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.740571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.740598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.740770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.740893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.740921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.741058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.741195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.741222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.741333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.741440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.741467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.741583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.741704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.741732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.741854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.742001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.742029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.742177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.742323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.742350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.742488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.742611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.742642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.742761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.742916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.742943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.743062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.743202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.743228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.743340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.743457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.743484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.743625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.743760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.743786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.743908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.744057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.744083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.744213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.744346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.744373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.744488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.744630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.744658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.744812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.744950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.744977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.745094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.745235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.745262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.745371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.745496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.745527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.745664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.745793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.745819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.745969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.746116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.746143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.746297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.746468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.746495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.746608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.746727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.746753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.746866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.747009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.324 [2024-07-15 09:06:11.747035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.324 qpair failed and we were unable to recover it. 00:27:23.324 [2024-07-15 09:06:11.747181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.747328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.747356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.747471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.747590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.747617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.747760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.747895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.747922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.748047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.748206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.748232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.748355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.748524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.748555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.748674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.748827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.748854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.749039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.749207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.749237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.749357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.749496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.749523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.749672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.749786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.749812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.749928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.750070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.750097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.750223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.750373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.750400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.750520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.750663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.750689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.750810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.750922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.750949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.751082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.751224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.751251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.751366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.751513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.751540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.751670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.751787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.751815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.751945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.752060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.752088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.752213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.752382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.752409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.752518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.752690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.752717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.752868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.752991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.753018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.753126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.753235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.753262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.753385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.753515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.753543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.753651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.753791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.753829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.753950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.754068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.754096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.754216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.754357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.754383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.754503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.754626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.754655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.754794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.754936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.754964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.755113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.755228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.755255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.755399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.755547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.755574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.755702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.755856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.755889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.756037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.756186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.756213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.756334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.756447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.756474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.756623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.756781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.756807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.756934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.757050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.757077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.757216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.757357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.757383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.757504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.757634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.757660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.757806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.757976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.758003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.758144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.758282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.758308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.758454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.758597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.758623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.758735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.758859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.758892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.759018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.759147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.759172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.759316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.759452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.759477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.759607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.759717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.759741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.759862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.760017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.760042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.760185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.760321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.760347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.760472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.760586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.760612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.760791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.760925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.760951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.325 qpair failed and we were unable to recover it. 00:27:23.325 [2024-07-15 09:06:11.761078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.325 [2024-07-15 09:06:11.761186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.761211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.326 qpair failed and we were unable to recover it. 00:27:23.326 [2024-07-15 09:06:11.761335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.761478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.761504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.326 qpair failed and we were unable to recover it. 00:27:23.326 [2024-07-15 09:06:11.761660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.761776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.761801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.326 qpair failed and we were unable to recover it. 00:27:23.326 [2024-07-15 09:06:11.761942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.762060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.762087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.326 qpair failed and we were unable to recover it. 00:27:23.326 [2024-07-15 09:06:11.762242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.762352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.762378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.326 qpair failed and we were unable to recover it. 00:27:23.326 [2024-07-15 09:06:11.762494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.762660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.762685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.326 qpair failed and we were unable to recover it. 00:27:23.326 [2024-07-15 09:06:11.762838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.762964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.762989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.326 qpair failed and we were unable to recover it. 00:27:23.326 [2024-07-15 09:06:11.763116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.763252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.763277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.326 qpair failed and we were unable to recover it. 00:27:23.326 [2024-07-15 09:06:11.763398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.763546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.763571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.326 qpair failed and we were unable to recover it. 00:27:23.326 [2024-07-15 09:06:11.763716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.763864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.763897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.326 qpair failed and we were unable to recover it. 00:27:23.326 [2024-07-15 09:06:11.764010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.764150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.764175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.326 qpair failed and we were unable to recover it. 00:27:23.326 [2024-07-15 09:06:11.764329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.764456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.764481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.326 qpair failed and we were unable to recover it. 00:27:23.326 [2024-07-15 09:06:11.764603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.764723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.764748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.326 qpair failed and we were unable to recover it. 00:27:23.326 [2024-07-15 09:06:11.764894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.765039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.765065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.326 qpair failed and we were unable to recover it. 00:27:23.326 [2024-07-15 09:06:11.765206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.765328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.765353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.326 qpair failed and we were unable to recover it. 00:27:23.326 [2024-07-15 09:06:11.765494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.765603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.765628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.326 qpair failed and we were unable to recover it. 00:27:23.326 [2024-07-15 09:06:11.765741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.765885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.765911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.326 qpair failed and we were unable to recover it. 00:27:23.326 [2024-07-15 09:06:11.766023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.766142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.766167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.326 qpair failed and we were unable to recover it. 00:27:23.326 [2024-07-15 09:06:11.766319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.766431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.766456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.326 qpair failed and we were unable to recover it. 00:27:23.326 [2024-07-15 09:06:11.766593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.766711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.766735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.326 qpair failed and we were unable to recover it. 00:27:23.326 [2024-07-15 09:06:11.766889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.766998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.767022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.326 qpair failed and we were unable to recover it. 00:27:23.326 [2024-07-15 09:06:11.767192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.767308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.767334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.326 qpair failed and we were unable to recover it. 00:27:23.326 [2024-07-15 09:06:11.767484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.767634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.767659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.326 qpair failed and we were unable to recover it. 00:27:23.326 [2024-07-15 09:06:11.767786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.767897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.767923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.326 qpair failed and we were unable to recover it. 00:27:23.326 [2024-07-15 09:06:11.768066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.768177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.768204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.326 qpair failed and we were unable to recover it. 00:27:23.326 [2024-07-15 09:06:11.768318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.768466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.768491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.326 qpair failed and we were unable to recover it. 00:27:23.326 [2024-07-15 09:06:11.768630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.768743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.768769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.326 qpair failed and we were unable to recover it. 00:27:23.326 [2024-07-15 09:06:11.768923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.769067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.769093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.326 qpair failed and we were unable to recover it. 00:27:23.326 [2024-07-15 09:06:11.769212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.769352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.769377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.326 qpair failed and we were unable to recover it. 00:27:23.326 [2024-07-15 09:06:11.769491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.769629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.769654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.326 qpair failed and we were unable to recover it. 00:27:23.326 [2024-07-15 09:06:11.769793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.769912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.769939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.326 qpair failed and we were unable to recover it. 00:27:23.326 [2024-07-15 09:06:11.770080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.770219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.770244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.326 qpair failed and we were unable to recover it. 00:27:23.326 [2024-07-15 09:06:11.770360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.770468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.770492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.326 qpair failed and we were unable to recover it. 00:27:23.326 [2024-07-15 09:06:11.770599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.770742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.770767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.326 qpair failed and we were unable to recover it. 00:27:23.326 [2024-07-15 09:06:11.770889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.771031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.771056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.326 qpair failed and we were unable to recover it. 00:27:23.326 [2024-07-15 09:06:11.771199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.771316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.771341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.326 qpair failed and we were unable to recover it. 00:27:23.326 [2024-07-15 09:06:11.771490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.771640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.771665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.326 qpair failed and we were unable to recover it. 00:27:23.326 [2024-07-15 09:06:11.771775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.771910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.771937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.326 qpair failed and we were unable to recover it. 00:27:23.326 [2024-07-15 09:06:11.772052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.772202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.772227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.326 qpair failed and we were unable to recover it. 00:27:23.326 [2024-07-15 09:06:11.772380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.772521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.772546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.326 qpair failed and we were unable to recover it. 00:27:23.326 [2024-07-15 09:06:11.772656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.772766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.772791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.326 qpair failed and we were unable to recover it. 00:27:23.326 [2024-07-15 09:06:11.772901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.773040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.326 [2024-07-15 09:06:11.773065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.326 qpair failed and we were unable to recover it. 00:27:23.326 [2024-07-15 09:06:11.773171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.773306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.773331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.773445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.773565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.773590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.773728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.773870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.773907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.774020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.774149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.774175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.774296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.774437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.774462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.774606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.774750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.774775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.774898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.775027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.775053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.775164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.775289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.775315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.775460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.775581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.775608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.775722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.775862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.775893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.776011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.776161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.776187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.776303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.776424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.776449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.776596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.776711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.776737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.776847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.776973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.776999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.777142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.777249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.777274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.777424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.777533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.777558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.777699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.777839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.777864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.777988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.778096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.778122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.778246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.778396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.778423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.778539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.778653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.778678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.778823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.778949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.778976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.779088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.779230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.779255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.779376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.779498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.779523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.779646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.779787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.779813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.779931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.780055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.780080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.780239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.780358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.780383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.780537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.780678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.780704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.780845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.780998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.781025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.781139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.781275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.781301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.781440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.781549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.781575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.781690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.781808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.781834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.781983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.782092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.782117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56e0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.782166] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x53b4b0 (9): Bad file descriptor 00:27:23.327 [2024-07-15 09:06:11.782351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.782496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.782523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.782654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.782761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.782787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.782906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.783037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.783062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.783205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.783316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.783340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.783485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.783604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.783629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.783741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.783850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.783874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.784005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.784124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.784148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.784261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.784400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.784425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.784537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.784660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.784684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.784797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.784927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.784952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.785068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.785219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.785244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.785367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.785507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.785532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.785674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.785780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.785806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.785932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.786055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.786081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.786263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.786408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.786432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.786577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.786705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.786730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.786839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.786967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.786993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.327 qpair failed and we were unable to recover it. 00:27:23.327 [2024-07-15 09:06:11.787104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.327 [2024-07-15 09:06:11.787227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.787251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.787391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.787512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.787537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.787699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.787818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.787843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.787969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.788127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.788153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.788288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.788429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.788454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.788594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.788703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.788728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.788871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.788994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.789019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.789130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.789274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.789299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.789420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.789526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.789550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.789671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.789781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.789807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.789961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.790184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.790209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.790327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.790432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.790458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.790584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.790723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.790749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.790868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.791007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.791031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.791147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.791293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.791319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.791456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.791568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.791592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.791731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.791854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.791885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.791999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.792129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.792155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.792276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.792396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.792421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.792567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.792678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.792703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.792831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.792953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.792980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.793097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.793271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.793296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.793427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.793575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.793601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.793722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.793833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.793858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.794009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.794116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.794141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.794247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.794366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.794391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.794507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.794646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.794671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.794782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.794927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.794954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.795075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.795224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.795249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.795360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.795493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.795519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.795653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.795792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.795816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.795928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.796034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.796059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.796180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.796288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.796314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.796439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.796573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.796598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.796724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.796843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.796868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.797098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.797248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.797273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.797385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.797503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.797529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.797673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.797791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.797816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.797961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.798104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.798129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.798241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.798382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.798406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.798547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.798673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.798697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.798816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.798930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.798955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.799071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.799223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.799247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.799391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.799532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.799557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.328 qpair failed and we were unable to recover it. 00:27:23.328 [2024-07-15 09:06:11.799698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.328 [2024-07-15 09:06:11.799815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.799842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.800002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.800110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.800134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.800249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.800389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.800413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.800559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.800690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.800721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.800847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.800964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.800989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.801109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.801259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.801285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.801403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.801518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.801545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.801719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.801842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.801867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.802004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.802118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.802143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.802296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.802410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.802434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.802578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.802699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.802723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.802827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.802950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.802975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.803097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.803238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.803262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.803386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.803494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.803525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.803668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.803800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.803824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.803989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.804126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.804151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.804265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.804410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.804438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.804568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.804715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.804740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.804853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.805003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.805030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.805147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.805290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.805325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.805471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.805592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.805617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.805761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.805889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.805913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.806080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.806201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.806225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.806351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.806472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.806500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.806674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.806810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.806836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.806963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.807084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.807110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.807227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.807369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.807395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.807517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.807654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.807687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.807812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.807935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.807960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.808099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.808277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.808302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.808424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.808549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.808575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.808697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.808843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.808868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.809019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.809138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.809163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.809341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.809494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.809522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.809645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.809764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.809787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.809906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.810073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.810098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.810214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.810333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.810357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.810488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.810634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.810659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.810773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.810893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.810918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.811061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.811175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.811200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.811313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.811441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.811467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.811604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.811762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.811787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.811939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.812054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.812080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.812201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.812307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.812331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.812487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.812631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.812654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.812771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.812922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.812947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.813092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.813231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.813256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.813373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.813487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.813513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.813632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.813769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.813795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.329 qpair failed and we were unable to recover it. 00:27:23.329 [2024-07-15 09:06:11.813915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.814036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.329 [2024-07-15 09:06:11.814063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.814182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.814297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.814322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.814432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.814558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.814582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.814717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.814881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.814906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.815066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.815208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.815232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.815359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.815474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.815499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.815622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.815759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.815784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.815908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.816021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.816045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.816184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.816305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.816329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.816447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.816567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.816592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.816704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.816810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.816835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.816987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.817127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.817151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.817296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.817429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.817453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.817589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.817697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.817722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.817835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.817980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.818005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.818133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.818294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.818322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.818462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.818605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.818629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.818777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.818897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.818922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.819066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.819228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.819253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.819372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.819503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.819537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.819679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.819834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.819858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.820019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.820142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.820167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.820280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.820391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.820416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.820529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.820650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.820684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.820788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.820930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.820957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.821088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.821249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.821274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.821413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.821553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.821577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.821689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.821810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.821846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.821994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.822113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.822137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.822284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.822388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.822412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.822526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.822649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.822674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.822787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.822911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.822936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.823060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.823200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.823225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.823365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.823507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.823531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.823649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.823788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.823812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.823937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.824060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.824084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.824199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.824333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.824357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.824468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.824579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.824604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.824755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.824903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.824928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.825056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.825196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.825221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.825348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.825463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.825487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.825597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.825741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.825765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.825889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.826008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.826032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.826144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.826259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.826283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.826403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.826530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.826555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.826701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.826819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.826843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.826972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.827087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.330 [2024-07-15 09:06:11.827111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.330 qpair failed and we were unable to recover it. 00:27:23.330 [2024-07-15 09:06:11.827236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.827351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.827376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.331 qpair failed and we were unable to recover it. 00:27:23.331 [2024-07-15 09:06:11.827512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.827618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.827642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.331 qpair failed and we were unable to recover it. 00:27:23.331 [2024-07-15 09:06:11.827754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.827869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.827899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.331 qpair failed and we were unable to recover it. 00:27:23.331 [2024-07-15 09:06:11.828050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.828187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.828212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.331 qpair failed and we were unable to recover it. 00:27:23.331 [2024-07-15 09:06:11.828376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.828482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.828507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.331 qpair failed and we were unable to recover it. 00:27:23.331 [2024-07-15 09:06:11.828649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.828792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.828816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.331 qpair failed and we were unable to recover it. 00:27:23.331 [2024-07-15 09:06:11.828939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.829084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.829108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.331 qpair failed and we were unable to recover it. 00:27:23.331 [2024-07-15 09:06:11.829234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.829371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.829395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.331 qpair failed and we were unable to recover it. 00:27:23.331 [2024-07-15 09:06:11.829552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.829663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.829686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.331 qpair failed and we were unable to recover it. 00:27:23.331 [2024-07-15 09:06:11.829806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.829947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.829972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.331 qpair failed and we were unable to recover it. 00:27:23.331 [2024-07-15 09:06:11.830096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.830215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.830240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.331 qpair failed and we were unable to recover it. 00:27:23.331 [2024-07-15 09:06:11.830364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.830477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.830502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.331 qpair failed and we were unable to recover it. 00:27:23.331 [2024-07-15 09:06:11.830627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.830767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.830792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.331 qpair failed and we were unable to recover it. 00:27:23.331 [2024-07-15 09:06:11.830930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.831072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.831097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.331 qpair failed and we were unable to recover it. 00:27:23.331 [2024-07-15 09:06:11.831248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.831359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.831383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.331 qpair failed and we were unable to recover it. 00:27:23.331 [2024-07-15 09:06:11.831541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.831653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.831677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.331 qpair failed and we were unable to recover it. 00:27:23.331 [2024-07-15 09:06:11.831803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.831923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.831947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.331 qpair failed and we were unable to recover it. 00:27:23.331 [2024-07-15 09:06:11.832090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.832210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.832233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.331 qpair failed and we were unable to recover it. 00:27:23.331 [2024-07-15 09:06:11.832355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.832493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.832517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.331 qpair failed and we were unable to recover it. 00:27:23.331 [2024-07-15 09:06:11.832667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.832772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.832797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.331 qpair failed and we were unable to recover it. 00:27:23.331 [2024-07-15 09:06:11.832933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.833071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.833096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.331 qpair failed and we were unable to recover it. 00:27:23.331 [2024-07-15 09:06:11.833214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.833350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.833375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.331 qpair failed and we were unable to recover it. 00:27:23.331 [2024-07-15 09:06:11.833489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.833605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.833630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.331 qpair failed and we were unable to recover it. 00:27:23.331 [2024-07-15 09:06:11.833738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.833849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.833880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.331 qpair failed and we were unable to recover it. 00:27:23.331 [2024-07-15 09:06:11.834001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.834115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.834140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.331 qpair failed and we were unable to recover it. 00:27:23.331 [2024-07-15 09:06:11.834254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.834371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.834396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.331 qpair failed and we were unable to recover it. 00:27:23.331 [2024-07-15 09:06:11.834546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.834723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.331 [2024-07-15 09:06:11.834748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.607 qpair failed and we were unable to recover it. 00:27:23.607 [2024-07-15 09:06:11.834859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.835018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.835044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.607 qpair failed and we were unable to recover it. 00:27:23.607 [2024-07-15 09:06:11.835167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.835315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.835339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.607 qpair failed and we were unable to recover it. 00:27:23.607 [2024-07-15 09:06:11.835468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.835607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.835631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.607 qpair failed and we were unable to recover it. 00:27:23.607 [2024-07-15 09:06:11.835768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.835903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.835929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.607 qpair failed and we were unable to recover it. 00:27:23.607 [2024-07-15 09:06:11.836050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.836173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.836206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.607 qpair failed and we were unable to recover it. 00:27:23.607 [2024-07-15 09:06:11.836344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.836491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.836515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.607 qpair failed and we were unable to recover it. 00:27:23.607 [2024-07-15 09:06:11.836636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.836771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.836795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.607 qpair failed and we were unable to recover it. 00:27:23.607 [2024-07-15 09:06:11.836914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.837024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.837048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.607 qpair failed and we were unable to recover it. 00:27:23.607 [2024-07-15 09:06:11.837161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.837308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.837332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.607 qpair failed and we were unable to recover it. 00:27:23.607 [2024-07-15 09:06:11.837450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.837569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.837593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.607 qpair failed and we were unable to recover it. 00:27:23.607 [2024-07-15 09:06:11.837710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.837816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.837840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.607 qpair failed and we were unable to recover it. 00:27:23.607 [2024-07-15 09:06:11.837984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.838134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.838158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.607 qpair failed and we were unable to recover it. 00:27:23.607 [2024-07-15 09:06:11.838305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.838417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.838441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.607 qpair failed and we were unable to recover it. 00:27:23.607 [2024-07-15 09:06:11.838590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.838693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.838717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.607 qpair failed and we were unable to recover it. 00:27:23.607 [2024-07-15 09:06:11.838855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.839016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.839040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.607 qpair failed and we were unable to recover it. 00:27:23.607 [2024-07-15 09:06:11.839162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.839272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.839295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.607 qpair failed and we were unable to recover it. 00:27:23.607 [2024-07-15 09:06:11.839408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.839544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.839568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.607 qpair failed and we were unable to recover it. 00:27:23.607 [2024-07-15 09:06:11.839678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.839790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.839815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.607 qpair failed and we were unable to recover it. 00:27:23.607 [2024-07-15 09:06:11.839944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.840057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.840082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.607 qpair failed and we were unable to recover it. 00:27:23.607 [2024-07-15 09:06:11.840189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.840308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.840332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.607 qpair failed and we were unable to recover it. 00:27:23.607 [2024-07-15 09:06:11.840475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.840590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.840619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.607 qpair failed and we were unable to recover it. 00:27:23.607 [2024-07-15 09:06:11.840737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.840845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.840868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.607 qpair failed and we were unable to recover it. 00:27:23.607 [2024-07-15 09:06:11.841020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.841136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.841161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.607 qpair failed and we were unable to recover it. 00:27:23.607 [2024-07-15 09:06:11.841304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.841424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.607 [2024-07-15 09:06:11.841449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.607 qpair failed and we were unable to recover it. 00:27:23.607 [2024-07-15 09:06:11.841566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.841719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.841743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.608 qpair failed and we were unable to recover it. 00:27:23.608 [2024-07-15 09:06:11.841865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.842002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.842026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.608 qpair failed and we were unable to recover it. 00:27:23.608 [2024-07-15 09:06:11.842147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.842287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.842310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.608 qpair failed and we were unable to recover it. 00:27:23.608 [2024-07-15 09:06:11.842420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.842558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.842582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.608 qpair failed and we were unable to recover it. 00:27:23.608 [2024-07-15 09:06:11.842728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.842849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.842891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.608 qpair failed and we were unable to recover it. 00:27:23.608 [2024-07-15 09:06:11.843034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.843141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.843165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.608 qpair failed and we were unable to recover it. 00:27:23.608 [2024-07-15 09:06:11.843290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.843431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.843456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.608 qpair failed and we were unable to recover it. 00:27:23.608 [2024-07-15 09:06:11.843577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.843726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.843750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.608 qpair failed and we were unable to recover it. 00:27:23.608 [2024-07-15 09:06:11.843859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.844003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.844029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.608 qpair failed and we were unable to recover it. 00:27:23.608 [2024-07-15 09:06:11.844153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.844267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.844292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.608 qpair failed and we were unable to recover it. 00:27:23.608 [2024-07-15 09:06:11.844436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.844587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.844611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.608 qpair failed and we were unable to recover it. 00:27:23.608 [2024-07-15 09:06:11.844723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.844833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.844857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.608 qpair failed and we were unable to recover it. 00:27:23.608 [2024-07-15 09:06:11.845007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.845137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.845162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.608 qpair failed and we were unable to recover it. 00:27:23.608 [2024-07-15 09:06:11.845298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.845419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.845443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.608 qpair failed and we were unable to recover it. 00:27:23.608 [2024-07-15 09:06:11.845583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.845733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.845756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.608 qpair failed and we were unable to recover it. 00:27:23.608 [2024-07-15 09:06:11.845869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.846028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.846053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.608 qpair failed and we were unable to recover it. 00:27:23.608 [2024-07-15 09:06:11.846177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.846320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.846347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.608 qpair failed and we were unable to recover it. 00:27:23.608 [2024-07-15 09:06:11.846476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.846590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.846622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.608 qpair failed and we were unable to recover it. 00:27:23.608 [2024-07-15 09:06:11.846735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.846857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.846889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.608 qpair failed and we were unable to recover it. 00:27:23.608 [2024-07-15 09:06:11.847043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.847163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.847197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.608 qpair failed and we were unable to recover it. 00:27:23.608 [2024-07-15 09:06:11.847339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.847452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.847476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.608 qpair failed and we were unable to recover it. 00:27:23.608 [2024-07-15 09:06:11.847620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.847760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.847784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.608 qpair failed and we were unable to recover it. 00:27:23.608 [2024-07-15 09:06:11.847895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.848005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.848030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.608 qpair failed and we were unable to recover it. 00:27:23.608 [2024-07-15 09:06:11.848148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.848265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.848289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.608 qpair failed and we were unable to recover it. 00:27:23.608 [2024-07-15 09:06:11.848400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.848519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.848544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.608 qpair failed and we were unable to recover it. 00:27:23.608 [2024-07-15 09:06:11.848694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.848835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.848860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.608 qpair failed and we were unable to recover it. 00:27:23.608 [2024-07-15 09:06:11.848976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.849110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.849134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.608 qpair failed and we were unable to recover it. 00:27:23.608 [2024-07-15 09:06:11.849273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.849375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.849403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.608 qpair failed and we were unable to recover it. 00:27:23.608 [2024-07-15 09:06:11.849548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.849677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.849702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.608 qpair failed and we were unable to recover it. 00:27:23.608 [2024-07-15 09:06:11.849845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.850024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.850049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.608 qpair failed and we were unable to recover it. 00:27:23.608 [2024-07-15 09:06:11.850191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.608 [2024-07-15 09:06:11.850312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.850337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.609 qpair failed and we were unable to recover it. 00:27:23.609 [2024-07-15 09:06:11.850479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.850620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.850643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.609 qpair failed and we were unable to recover it. 00:27:23.609 [2024-07-15 09:06:11.850767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.850884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.850908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.609 qpair failed and we were unable to recover it. 00:27:23.609 [2024-07-15 09:06:11.851023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.851142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.851166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.609 qpair failed and we were unable to recover it. 00:27:23.609 [2024-07-15 09:06:11.851298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.851415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.851440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.609 qpair failed and we were unable to recover it. 00:27:23.609 [2024-07-15 09:06:11.851608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.851749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.851773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.609 qpair failed and we were unable to recover it. 00:27:23.609 [2024-07-15 09:06:11.851890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.852005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.852029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.609 qpair failed and we were unable to recover it. 00:27:23.609 [2024-07-15 09:06:11.852179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.852306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.852334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.609 qpair failed and we were unable to recover it. 00:27:23.609 [2024-07-15 09:06:11.852492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.852632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.852655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.609 qpair failed and we were unable to recover it. 00:27:23.609 [2024-07-15 09:06:11.852772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.852890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.852917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.609 qpair failed and we were unable to recover it. 00:27:23.609 [2024-07-15 09:06:11.853069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.853179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.853205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.609 qpair failed and we were unable to recover it. 00:27:23.609 [2024-07-15 09:06:11.853312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.853423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.853448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.609 qpair failed and we were unable to recover it. 00:27:23.609 [2024-07-15 09:06:11.853574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.853724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.853749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.609 qpair failed and we were unable to recover it. 00:27:23.609 [2024-07-15 09:06:11.853864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.853998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.854023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.609 qpair failed and we were unable to recover it. 00:27:23.609 [2024-07-15 09:06:11.854139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.854312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.854337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.609 qpair failed and we were unable to recover it. 00:27:23.609 [2024-07-15 09:06:11.854458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.854576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.854600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.609 qpair failed and we were unable to recover it. 00:27:23.609 [2024-07-15 09:06:11.854748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.854872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.854901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.609 qpair failed and we were unable to recover it. 00:27:23.609 [2024-07-15 09:06:11.855055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.855184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.855209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.609 qpair failed and we were unable to recover it. 00:27:23.609 [2024-07-15 09:06:11.855354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.855474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.855501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.609 qpair failed and we were unable to recover it. 00:27:23.609 [2024-07-15 09:06:11.855653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.855801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.855826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.609 qpair failed and we were unable to recover it. 00:27:23.609 [2024-07-15 09:06:11.855971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.856120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.856145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.609 qpair failed and we were unable to recover it. 00:27:23.609 [2024-07-15 09:06:11.856304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.856423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.856447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.609 qpair failed and we were unable to recover it. 00:27:23.609 [2024-07-15 09:06:11.856591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.856731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.856755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.609 qpair failed and we were unable to recover it. 00:27:23.609 [2024-07-15 09:06:11.856923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.857039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.857064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.609 qpair failed and we were unable to recover it. 00:27:23.609 [2024-07-15 09:06:11.857222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.857347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.857371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.609 qpair failed and we were unable to recover it. 00:27:23.609 [2024-07-15 09:06:11.857518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.857642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.857666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.609 qpair failed and we were unable to recover it. 00:27:23.609 [2024-07-15 09:06:11.857821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.857945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.609 [2024-07-15 09:06:11.857971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.609 qpair failed and we were unable to recover it. 00:27:23.610 [2024-07-15 09:06:11.858116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.858259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.858284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.610 qpair failed and we were unable to recover it. 00:27:23.610 [2024-07-15 09:06:11.858434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.858580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.858604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.610 qpair failed and we were unable to recover it. 00:27:23.610 [2024-07-15 09:06:11.858721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.858856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.858886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.610 qpair failed and we were unable to recover it. 00:27:23.610 [2024-07-15 09:06:11.859003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.859126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.859150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.610 qpair failed and we were unable to recover it. 00:27:23.610 [2024-07-15 09:06:11.859265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.859370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.859394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.610 qpair failed and we were unable to recover it. 00:27:23.610 [2024-07-15 09:06:11.859504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.859651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.859676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.610 qpair failed and we were unable to recover it. 00:27:23.610 [2024-07-15 09:06:11.859814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.859953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.859978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.610 qpair failed and we were unable to recover it. 00:27:23.610 [2024-07-15 09:06:11.860182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.860334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.860359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.610 qpair failed and we were unable to recover it. 00:27:23.610 [2024-07-15 09:06:11.860494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.860609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.860633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.610 qpair failed and we were unable to recover it. 00:27:23.610 [2024-07-15 09:06:11.860769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.860892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.860917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.610 qpair failed and we were unable to recover it. 00:27:23.610 [2024-07-15 09:06:11.861041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.861155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.861181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.610 qpair failed and we were unable to recover it. 00:27:23.610 [2024-07-15 09:06:11.861302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.861425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.861450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.610 qpair failed and we were unable to recover it. 00:27:23.610 [2024-07-15 09:06:11.861603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.861725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.861748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.610 qpair failed and we were unable to recover it. 00:27:23.610 [2024-07-15 09:06:11.861873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.862019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.862043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.610 qpair failed and we were unable to recover it. 00:27:23.610 [2024-07-15 09:06:11.862153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.862313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.862338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.610 qpair failed and we were unable to recover it. 00:27:23.610 [2024-07-15 09:06:11.862459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.862597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.862622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.610 qpair failed and we were unable to recover it. 00:27:23.610 [2024-07-15 09:06:11.862740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.862849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.862887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.610 qpair failed and we were unable to recover it. 00:27:23.610 [2024-07-15 09:06:11.863034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.863146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.863171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.610 qpair failed and we were unable to recover it. 00:27:23.610 [2024-07-15 09:06:11.863332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.863453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.863478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.610 qpair failed and we were unable to recover it. 00:27:23.610 [2024-07-15 09:06:11.863622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.863762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.863786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.610 qpair failed and we were unable to recover it. 00:27:23.610 [2024-07-15 09:06:11.863915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.864060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.864085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.610 qpair failed and we were unable to recover it. 00:27:23.610 [2024-07-15 09:06:11.864201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.864323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.864348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.610 qpair failed and we were unable to recover it. 00:27:23.610 [2024-07-15 09:06:11.864458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.864567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.864591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.610 qpair failed and we were unable to recover it. 00:27:23.610 [2024-07-15 09:06:11.864747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.864872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.864901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.610 qpair failed and we were unable to recover it. 00:27:23.610 [2024-07-15 09:06:11.865024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.865165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.865199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.610 qpair failed and we were unable to recover it. 00:27:23.610 [2024-07-15 09:06:11.865309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.865459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.865484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.610 qpair failed and we were unable to recover it. 00:27:23.610 [2024-07-15 09:06:11.865610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.865723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.865748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.610 qpair failed and we were unable to recover it. 00:27:23.610 [2024-07-15 09:06:11.865921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.866032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.866057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.610 qpair failed and we were unable to recover it. 00:27:23.610 [2024-07-15 09:06:11.866198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.866316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.866341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.610 qpair failed and we were unable to recover it. 00:27:23.610 [2024-07-15 09:06:11.866479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.866589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.610 [2024-07-15 09:06:11.866614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.610 qpair failed and we were unable to recover it. 00:27:23.610 [2024-07-15 09:06:11.866748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.866866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.866898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.611 qpair failed and we were unable to recover it. 00:27:23.611 [2024-07-15 09:06:11.867014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.867121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.867145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.611 qpair failed and we were unable to recover it. 00:27:23.611 [2024-07-15 09:06:11.867275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.867385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.867409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.611 qpair failed and we were unable to recover it. 00:27:23.611 [2024-07-15 09:06:11.867515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.867626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.867649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.611 qpair failed and we were unable to recover it. 00:27:23.611 [2024-07-15 09:06:11.867757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.867918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.867943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.611 qpair failed and we were unable to recover it. 00:27:23.611 [2024-07-15 09:06:11.868078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.868195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.868220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.611 qpair failed and we were unable to recover it. 00:27:23.611 [2024-07-15 09:06:11.868352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.868467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.868491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.611 qpair failed and we were unable to recover it. 00:27:23.611 [2024-07-15 09:06:11.868611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.868746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.868771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.611 qpair failed and we were unable to recover it. 00:27:23.611 [2024-07-15 09:06:11.868899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.869003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.869029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.611 qpair failed and we were unable to recover it. 00:27:23.611 [2024-07-15 09:06:11.869137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.869290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.869314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.611 qpair failed and we were unable to recover it. 00:27:23.611 [2024-07-15 09:06:11.869452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.869595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.869619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.611 qpair failed and we were unable to recover it. 00:27:23.611 [2024-07-15 09:06:11.869761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.869881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.869908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.611 qpair failed and we were unable to recover it. 00:27:23.611 [2024-07-15 09:06:11.870081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.870223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.870247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.611 qpair failed and we were unable to recover it. 00:27:23.611 [2024-07-15 09:06:11.870364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.870478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.870502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.611 qpair failed and we were unable to recover it. 00:27:23.611 [2024-07-15 09:06:11.870613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.870725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.870749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.611 qpair failed and we were unable to recover it. 00:27:23.611 [2024-07-15 09:06:11.870893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.871062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.871087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.611 qpair failed and we were unable to recover it. 00:27:23.611 [2024-07-15 09:06:11.871201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.871319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.871343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.611 qpair failed and we were unable to recover it. 00:27:23.611 [2024-07-15 09:06:11.871484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.871630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.871655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.611 qpair failed and we were unable to recover it. 00:27:23.611 [2024-07-15 09:06:11.871763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.871885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.871912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.611 qpair failed and we were unable to recover it. 00:27:23.611 [2024-07-15 09:06:11.872056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.872173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.872205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.611 qpair failed and we were unable to recover it. 00:27:23.611 [2024-07-15 09:06:11.872326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.872445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.872469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.611 qpair failed and we were unable to recover it. 00:27:23.611 [2024-07-15 09:06:11.872596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.872738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.872763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.611 qpair failed and we were unable to recover it. 00:27:23.611 [2024-07-15 09:06:11.872889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.873032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.611 [2024-07-15 09:06:11.873057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.611 qpair failed and we were unable to recover it. 00:27:23.612 [2024-07-15 09:06:11.873187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.873299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.873336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.612 qpair failed and we were unable to recover it. 00:27:23.612 [2024-07-15 09:06:11.873463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.873614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.873638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.612 qpair failed and we were unable to recover it. 00:27:23.612 [2024-07-15 09:06:11.873755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.873904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.873929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.612 qpair failed and we were unable to recover it. 00:27:23.612 [2024-07-15 09:06:11.874077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.874229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.874254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.612 qpair failed and we were unable to recover it. 00:27:23.612 [2024-07-15 09:06:11.874367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.874502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.874527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.612 qpair failed and we were unable to recover it. 00:27:23.612 [2024-07-15 09:06:11.874641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.874872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.874907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.612 qpair failed and we were unable to recover it. 00:27:23.612 [2024-07-15 09:06:11.875044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.875155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.875190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.612 qpair failed and we were unable to recover it. 00:27:23.612 [2024-07-15 09:06:11.875335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.875519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.875544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.612 qpair failed and we were unable to recover it. 00:27:23.612 [2024-07-15 09:06:11.875666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.875808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.875834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.612 qpair failed and we were unable to recover it. 00:27:23.612 [2024-07-15 09:06:11.875959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.876097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.876122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.612 qpair failed and we were unable to recover it. 00:27:23.612 [2024-07-15 09:06:11.876259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.876425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.876450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.612 qpair failed and we were unable to recover it. 00:27:23.612 [2024-07-15 09:06:11.876577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.876693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.876718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.612 qpair failed and we were unable to recover it. 00:27:23.612 [2024-07-15 09:06:11.876842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.876974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.876999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.612 qpair failed and we were unable to recover it. 00:27:23.612 [2024-07-15 09:06:11.877140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.877260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.877284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.612 qpair failed and we were unable to recover it. 00:27:23.612 [2024-07-15 09:06:11.877443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.877556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.877581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.612 qpair failed and we were unable to recover it. 00:27:23.612 [2024-07-15 09:06:11.877697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.877838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.877864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.612 qpair failed and we were unable to recover it. 00:27:23.612 [2024-07-15 09:06:11.878028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.878167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.878191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.612 qpair failed and we were unable to recover it. 00:27:23.612 [2024-07-15 09:06:11.878307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.878418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.878442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.612 qpair failed and we were unable to recover it. 00:27:23.612 [2024-07-15 09:06:11.878578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.878720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.878745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.612 qpair failed and we were unable to recover it. 00:27:23.612 [2024-07-15 09:06:11.878889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.879004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.879029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.612 qpair failed and we were unable to recover it. 00:27:23.612 [2024-07-15 09:06:11.879174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.879424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.879448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.612 qpair failed and we were unable to recover it. 00:27:23.612 [2024-07-15 09:06:11.879564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.879675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.879700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.612 qpair failed and we were unable to recover it. 00:27:23.612 [2024-07-15 09:06:11.879839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.879994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.880019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.612 qpair failed and we were unable to recover it. 00:27:23.612 [2024-07-15 09:06:11.880131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.880245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.880270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.612 qpair failed and we were unable to recover it. 00:27:23.612 [2024-07-15 09:06:11.880391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.880517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.880541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.612 qpair failed and we were unable to recover it. 00:27:23.612 [2024-07-15 09:06:11.880645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.880759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.880783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.612 qpair failed and we were unable to recover it. 00:27:23.612 [2024-07-15 09:06:11.880899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.881015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.881039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.612 qpair failed and we were unable to recover it. 00:27:23.612 [2024-07-15 09:06:11.881153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.881297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.881321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.612 qpair failed and we were unable to recover it. 00:27:23.612 [2024-07-15 09:06:11.881430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.881552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.612 [2024-07-15 09:06:11.881576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.613 qpair failed and we were unable to recover it. 00:27:23.613 [2024-07-15 09:06:11.881688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.881802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.881826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.613 qpair failed and we were unable to recover it. 00:27:23.613 [2024-07-15 09:06:11.881941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.882080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.882104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.613 qpair failed and we were unable to recover it. 00:27:23.613 [2024-07-15 09:06:11.882253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.882361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.882385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.613 qpair failed and we were unable to recover it. 00:27:23.613 [2024-07-15 09:06:11.882521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.882635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.882659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.613 qpair failed and we were unable to recover it. 00:27:23.613 [2024-07-15 09:06:11.882800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.882953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.882979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.613 qpair failed and we were unable to recover it. 00:27:23.613 [2024-07-15 09:06:11.883097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.883239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.883274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.613 qpair failed and we were unable to recover it. 00:27:23.613 [2024-07-15 09:06:11.883388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.883526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.883551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.613 qpair failed and we were unable to recover it. 00:27:23.613 [2024-07-15 09:06:11.883685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.883855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.883894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.613 qpair failed and we were unable to recover it. 00:27:23.613 [2024-07-15 09:06:11.884064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.884204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.884228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.613 qpair failed and we were unable to recover it. 00:27:23.613 [2024-07-15 09:06:11.884339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.884460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.884485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.613 qpair failed and we were unable to recover it. 00:27:23.613 [2024-07-15 09:06:11.884630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.884763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.884788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.613 qpair failed and we were unable to recover it. 00:27:23.613 [2024-07-15 09:06:11.884922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.885067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.885091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.613 qpair failed and we were unable to recover it. 00:27:23.613 [2024-07-15 09:06:11.885196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.885342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.885367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.613 qpair failed and we were unable to recover it. 00:27:23.613 [2024-07-15 09:06:11.885513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.885617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.885641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.613 qpair failed and we were unable to recover it. 00:27:23.613 [2024-07-15 09:06:11.885810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.885939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.885964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.613 qpair failed and we were unable to recover it. 00:27:23.613 [2024-07-15 09:06:11.886108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.886242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.886267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.613 qpair failed and we were unable to recover it. 00:27:23.613 [2024-07-15 09:06:11.886407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.886525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.886551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.613 qpair failed and we were unable to recover it. 00:27:23.613 [2024-07-15 09:06:11.886666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.886802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.886826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.613 qpair failed and we were unable to recover it. 00:27:23.613 [2024-07-15 09:06:11.886987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.887096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.887121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.613 qpair failed and we were unable to recover it. 00:27:23.613 [2024-07-15 09:06:11.887262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.887375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.887399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.613 qpair failed and we were unable to recover it. 00:27:23.613 [2024-07-15 09:06:11.887520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.887687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.887712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.613 qpair failed and we were unable to recover it. 00:27:23.613 [2024-07-15 09:06:11.887856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.887968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.887993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.613 qpair failed and we were unable to recover it. 00:27:23.613 [2024-07-15 09:06:11.888137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.888245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.888271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.613 qpair failed and we were unable to recover it. 00:27:23.613 [2024-07-15 09:06:11.888418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.888529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.888555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.613 qpair failed and we were unable to recover it. 00:27:23.613 [2024-07-15 09:06:11.888668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.888805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.888830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.613 qpair failed and we were unable to recover it. 00:27:23.613 [2024-07-15 09:06:11.888950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.889059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.889083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.613 qpair failed and we were unable to recover it. 00:27:23.613 [2024-07-15 09:06:11.889250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.889371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.889395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.613 qpair failed and we were unable to recover it. 00:27:23.613 [2024-07-15 09:06:11.889513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.889625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.889650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.613 qpair failed and we were unable to recover it. 00:27:23.613 [2024-07-15 09:06:11.889773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.889906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.889931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.613 qpair failed and we were unable to recover it. 00:27:23.613 [2024-07-15 09:06:11.890051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.613 [2024-07-15 09:06:11.890194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.890224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.614 qpair failed and we were unable to recover it. 00:27:23.614 [2024-07-15 09:06:11.890357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.890472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.890495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.614 qpair failed and we were unable to recover it. 00:27:23.614 [2024-07-15 09:06:11.890619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.890730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.890754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.614 qpair failed and we were unable to recover it. 00:27:23.614 [2024-07-15 09:06:11.890865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.890987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.891011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.614 qpair failed and we were unable to recover it. 00:27:23.614 [2024-07-15 09:06:11.891138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.891265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.891289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.614 qpair failed and we were unable to recover it. 00:27:23.614 [2024-07-15 09:06:11.891416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.891530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.891554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.614 qpair failed and we were unable to recover it. 00:27:23.614 [2024-07-15 09:06:11.891694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.891841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.891866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.614 qpair failed and we were unable to recover it. 00:27:23.614 [2024-07-15 09:06:11.891994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.892113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.892139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.614 qpair failed and we were unable to recover it. 00:27:23.614 [2024-07-15 09:06:11.892280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.892386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.892410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.614 qpair failed and we were unable to recover it. 00:27:23.614 [2024-07-15 09:06:11.892518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.892630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.892656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.614 qpair failed and we were unable to recover it. 00:27:23.614 [2024-07-15 09:06:11.892806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.892925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.892956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.614 qpair failed and we were unable to recover it. 00:27:23.614 [2024-07-15 09:06:11.893086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.893193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.893217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.614 qpair failed and we were unable to recover it. 00:27:23.614 [2024-07-15 09:06:11.893364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.893475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.893500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.614 qpair failed and we were unable to recover it. 00:27:23.614 [2024-07-15 09:06:11.893639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.893753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.893778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.614 qpair failed and we were unable to recover it. 00:27:23.614 [2024-07-15 09:06:11.893925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.894044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.894068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.614 qpair failed and we were unable to recover it. 00:27:23.614 [2024-07-15 09:06:11.894221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.894332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.894357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.614 qpair failed and we were unable to recover it. 00:27:23.614 [2024-07-15 09:06:11.894494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.894662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.894687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.614 qpair failed and we were unable to recover it. 00:27:23.614 [2024-07-15 09:06:11.894797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.894931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.894956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.614 qpair failed and we were unable to recover it. 00:27:23.614 [2024-07-15 09:06:11.895076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.895193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.895218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.614 qpair failed and we were unable to recover it. 00:27:23.614 [2024-07-15 09:06:11.895363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.895478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.895503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.614 qpair failed and we were unable to recover it. 00:27:23.614 [2024-07-15 09:06:11.895607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.895731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.895761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.614 qpair failed and we were unable to recover it. 00:27:23.614 [2024-07-15 09:06:11.895940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.896059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.896083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.614 qpair failed and we were unable to recover it. 00:27:23.614 [2024-07-15 09:06:11.896233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.896369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.896394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.614 qpair failed and we were unable to recover it. 00:27:23.614 [2024-07-15 09:06:11.896519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.896657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.896681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.614 qpair failed and we were unable to recover it. 00:27:23.614 [2024-07-15 09:06:11.896823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.896947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.896982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.614 qpair failed and we were unable to recover it. 00:27:23.614 [2024-07-15 09:06:11.897106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.897219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.897244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.614 qpair failed and we were unable to recover it. 00:27:23.614 [2024-07-15 09:06:11.897388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.897497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.897522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.614 qpair failed and we were unable to recover it. 00:27:23.614 [2024-07-15 09:06:11.897633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.614 [2024-07-15 09:06:11.897745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.897771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.615 qpair failed and we were unable to recover it. 00:27:23.615 [2024-07-15 09:06:11.897944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.898089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.898114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.615 qpair failed and we were unable to recover it. 00:27:23.615 [2024-07-15 09:06:11.898240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.898378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.898403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.615 qpair failed and we were unable to recover it. 00:27:23.615 [2024-07-15 09:06:11.898552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.898659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.898687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.615 qpair failed and we were unable to recover it. 00:27:23.615 [2024-07-15 09:06:11.898836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.898962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.898986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.615 qpair failed and we were unable to recover it. 00:27:23.615 [2024-07-15 09:06:11.899130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.899259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.899284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.615 qpair failed and we were unable to recover it. 00:27:23.615 [2024-07-15 09:06:11.899405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.899509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.899533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.615 qpair failed and we were unable to recover it. 00:27:23.615 [2024-07-15 09:06:11.899673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.899807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.899832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.615 qpair failed and we were unable to recover it. 00:27:23.615 [2024-07-15 09:06:11.899950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.900099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.900123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.615 qpair failed and we were unable to recover it. 00:27:23.615 [2024-07-15 09:06:11.900297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.900412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.900436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.615 qpair failed and we were unable to recover it. 00:27:23.615 [2024-07-15 09:06:11.900556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.900695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.900719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.615 qpair failed and we were unable to recover it. 00:27:23.615 [2024-07-15 09:06:11.900857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.900980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.901004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.615 qpair failed and we were unable to recover it. 00:27:23.615 [2024-07-15 09:06:11.901122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.901246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.901270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.615 qpair failed and we were unable to recover it. 00:27:23.615 [2024-07-15 09:06:11.901419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.901561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.901584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.615 qpair failed and we were unable to recover it. 00:27:23.615 [2024-07-15 09:06:11.901738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.901859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.901895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.615 qpair failed and we were unable to recover it. 00:27:23.615 [2024-07-15 09:06:11.902017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.902162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.902196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.615 qpair failed and we were unable to recover it. 00:27:23.615 [2024-07-15 09:06:11.902342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.902493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.902518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.615 qpair failed and we were unable to recover it. 00:27:23.615 [2024-07-15 09:06:11.902624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.902747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.902771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.615 qpair failed and we were unable to recover it. 00:27:23.615 [2024-07-15 09:06:11.902887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.902994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.903018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.615 qpair failed and we were unable to recover it. 00:27:23.615 [2024-07-15 09:06:11.903141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.903259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.903284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.615 qpair failed and we were unable to recover it. 00:27:23.615 [2024-07-15 09:06:11.903422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.903529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.903554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.615 qpair failed and we were unable to recover it. 00:27:23.615 [2024-07-15 09:06:11.903697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.903851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.903882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.615 qpair failed and we were unable to recover it. 00:27:23.615 [2024-07-15 09:06:11.904006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.904172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.904196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.615 qpair failed and we were unable to recover it. 00:27:23.615 [2024-07-15 09:06:11.904305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.904439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.904464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.615 qpair failed and we were unable to recover it. 00:27:23.615 [2024-07-15 09:06:11.904584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.904700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.904726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.615 qpair failed and we were unable to recover it. 00:27:23.615 [2024-07-15 09:06:11.904844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.905022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.905048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.615 qpair failed and we were unable to recover it. 00:27:23.615 [2024-07-15 09:06:11.905157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.905292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.905317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.615 qpair failed and we were unable to recover it. 00:27:23.615 [2024-07-15 09:06:11.905430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.905573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.905597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.615 qpair failed and we were unable to recover it. 00:27:23.615 [2024-07-15 09:06:11.905714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.905822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.905849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.615 qpair failed and we were unable to recover it. 00:27:23.615 [2024-07-15 09:06:11.906014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.906133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.615 [2024-07-15 09:06:11.906159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.615 qpair failed and we were unable to recover it. 00:27:23.615 [2024-07-15 09:06:11.906306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.906446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.906470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.616 qpair failed and we were unable to recover it. 00:27:23.616 [2024-07-15 09:06:11.906594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.906735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.906759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.616 qpair failed and we were unable to recover it. 00:27:23.616 [2024-07-15 09:06:11.906869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.906991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.907016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.616 qpair failed and we were unable to recover it. 00:27:23.616 [2024-07-15 09:06:11.907156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.907283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.907307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.616 qpair failed and we were unable to recover it. 00:27:23.616 [2024-07-15 09:06:11.907451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.907622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.907646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.616 qpair failed and we were unable to recover it. 00:27:23.616 [2024-07-15 09:06:11.907769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.907895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.907920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.616 qpair failed and we were unable to recover it. 00:27:23.616 [2024-07-15 09:06:11.908040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.908159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.908190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.616 qpair failed and we were unable to recover it. 00:27:23.616 [2024-07-15 09:06:11.908362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.908513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.908538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.616 qpair failed and we were unable to recover it. 00:27:23.616 [2024-07-15 09:06:11.908645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.908762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.908787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.616 qpair failed and we were unable to recover it. 00:27:23.616 [2024-07-15 09:06:11.908909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.909047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.909071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.616 qpair failed and we were unable to recover it. 00:27:23.616 [2024-07-15 09:06:11.909238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.909356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.909380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.616 qpair failed and we were unable to recover it. 00:27:23.616 [2024-07-15 09:06:11.909519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.909660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.909684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.616 qpair failed and we were unable to recover it. 00:27:23.616 [2024-07-15 09:06:11.909806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.909941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.909966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.616 qpair failed and we were unable to recover it. 00:27:23.616 [2024-07-15 09:06:11.910084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.910205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.910230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.616 qpair failed and we were unable to recover it. 00:27:23.616 [2024-07-15 09:06:11.910375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.910480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.910505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.616 qpair failed and we were unable to recover it. 00:27:23.616 [2024-07-15 09:06:11.910651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.910769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.910795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.616 qpair failed and we were unable to recover it. 00:27:23.616 [2024-07-15 09:06:11.910936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.911043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.911068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.616 qpair failed and we were unable to recover it. 00:27:23.616 [2024-07-15 09:06:11.911181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.911300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.911324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.616 qpair failed and we were unable to recover it. 00:27:23.616 [2024-07-15 09:06:11.911441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.911576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.911600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.616 qpair failed and we were unable to recover it. 00:27:23.616 [2024-07-15 09:06:11.911734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.911841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.911865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.616 qpair failed and we were unable to recover it. 00:27:23.616 [2024-07-15 09:06:11.911997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.912106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.912130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.616 qpair failed and we were unable to recover it. 00:27:23.616 [2024-07-15 09:06:11.912271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.912381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.912405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.616 qpair failed and we were unable to recover it. 00:27:23.616 [2024-07-15 09:06:11.912516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.912650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.616 [2024-07-15 09:06:11.912675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.616 qpair failed and we were unable to recover it. 00:27:23.616 [2024-07-15 09:06:11.912788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.912901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.912926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.617 qpair failed and we were unable to recover it. 00:27:23.617 [2024-07-15 09:06:11.913083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.913193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.913217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.617 qpair failed and we were unable to recover it. 00:27:23.617 [2024-07-15 09:06:11.913340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.913450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.913474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.617 qpair failed and we were unable to recover it. 00:27:23.617 [2024-07-15 09:06:11.913585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.913703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.913727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.617 qpair failed and we were unable to recover it. 00:27:23.617 [2024-07-15 09:06:11.913881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.913998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.914023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.617 qpair failed and we were unable to recover it. 00:27:23.617 [2024-07-15 09:06:11.914164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.914281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.914305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.617 qpair failed and we were unable to recover it. 00:27:23.617 [2024-07-15 09:06:11.914445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.914554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.914579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.617 qpair failed and we were unable to recover it. 00:27:23.617 [2024-07-15 09:06:11.914698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.914836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.914861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.617 qpair failed and we were unable to recover it. 00:27:23.617 [2024-07-15 09:06:11.914987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.915154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.915179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.617 qpair failed and we were unable to recover it. 00:27:23.617 [2024-07-15 09:06:11.915291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.915409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.915434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.617 qpair failed and we were unable to recover it. 00:27:23.617 [2024-07-15 09:06:11.915585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.915703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.915729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.617 qpair failed and we were unable to recover it. 00:27:23.617 [2024-07-15 09:06:11.915903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.916051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.916076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.617 qpair failed and we were unable to recover it. 00:27:23.617 [2024-07-15 09:06:11.916193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.916342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.916366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.617 qpair failed and we were unable to recover it. 00:27:23.617 [2024-07-15 09:06:11.916489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.916669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.916693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.617 qpair failed and we were unable to recover it. 00:27:23.617 [2024-07-15 09:06:11.916838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.916991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.917017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.617 qpair failed and we were unable to recover it. 00:27:23.617 [2024-07-15 09:06:11.917157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.917265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.917289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.617 qpair failed and we were unable to recover it. 00:27:23.617 [2024-07-15 09:06:11.917430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.917569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.917593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.617 qpair failed and we were unable to recover it. 00:27:23.617 [2024-07-15 09:06:11.917735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.917847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.917871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.617 qpair failed and we were unable to recover it. 00:27:23.617 [2024-07-15 09:06:11.918013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.918149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.918183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.617 qpair failed and we were unable to recover it. 00:27:23.617 [2024-07-15 09:06:11.918303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.918447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.918473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.617 qpair failed and we were unable to recover it. 00:27:23.617 [2024-07-15 09:06:11.918626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.918766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.918792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.617 qpair failed and we were unable to recover it. 00:27:23.617 [2024-07-15 09:06:11.918926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.919070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.919095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.617 qpair failed and we were unable to recover it. 00:27:23.617 [2024-07-15 09:06:11.919214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.919336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.919360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.617 qpair failed and we were unable to recover it. 00:27:23.617 [2024-07-15 09:06:11.919466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.919582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.919608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.617 qpair failed and we were unable to recover it. 00:27:23.617 [2024-07-15 09:06:11.919735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.919869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.919899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.617 qpair failed and we were unable to recover it. 00:27:23.617 [2024-07-15 09:06:11.920004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.920111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.920134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.617 qpair failed and we were unable to recover it. 00:27:23.617 [2024-07-15 09:06:11.920284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.920402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.920427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.617 qpair failed and we were unable to recover it. 00:27:23.617 [2024-07-15 09:06:11.920541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.920664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.617 [2024-07-15 09:06:11.920688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.617 qpair failed and we were unable to recover it. 00:27:23.617 [2024-07-15 09:06:11.920805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.920920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.920944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.618 qpair failed and we were unable to recover it. 00:27:23.618 [2024-07-15 09:06:11.921057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.921170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.921194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.618 qpair failed and we were unable to recover it. 00:27:23.618 [2024-07-15 09:06:11.921343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.921476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.921500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.618 qpair failed and we were unable to recover it. 00:27:23.618 [2024-07-15 09:06:11.921653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.921773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.921797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.618 qpair failed and we were unable to recover it. 00:27:23.618 [2024-07-15 09:06:11.921918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.922061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.922086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.618 qpair failed and we were unable to recover it. 00:27:23.618 [2024-07-15 09:06:11.922216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.922352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.922377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.618 qpair failed and we were unable to recover it. 00:27:23.618 [2024-07-15 09:06:11.922497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.922614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.922642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.618 qpair failed and we were unable to recover it. 00:27:23.618 [2024-07-15 09:06:11.922786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.922906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.922933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.618 qpair failed and we were unable to recover it. 00:27:23.618 [2024-07-15 09:06:11.923065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.923214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.923238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.618 qpair failed and we were unable to recover it. 00:27:23.618 [2024-07-15 09:06:11.923386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.923495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.923520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.618 qpair failed and we were unable to recover it. 00:27:23.618 [2024-07-15 09:06:11.923629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.923749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.923773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.618 qpair failed and we were unable to recover it. 00:27:23.618 [2024-07-15 09:06:11.923890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.924026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.924050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.618 qpair failed and we were unable to recover it. 00:27:23.618 [2024-07-15 09:06:11.924162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.924304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.924329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.618 qpair failed and we were unable to recover it. 00:27:23.618 [2024-07-15 09:06:11.924468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.924597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.924620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.618 qpair failed and we were unable to recover it. 00:27:23.618 [2024-07-15 09:06:11.924743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.924886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.924912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.618 qpair failed and we were unable to recover it. 00:27:23.618 [2024-07-15 09:06:11.925058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.925169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.925194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.618 qpair failed and we were unable to recover it. 00:27:23.618 [2024-07-15 09:06:11.925320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.925461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.925486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.618 qpair failed and we were unable to recover it. 00:27:23.618 [2024-07-15 09:06:11.925655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.925766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.925791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.618 qpair failed and we were unable to recover it. 00:27:23.618 [2024-07-15 09:06:11.925905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.926044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.926069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.618 qpair failed and we were unable to recover it. 00:27:23.618 [2024-07-15 09:06:11.926189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.926297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.926322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.618 qpair failed and we were unable to recover it. 00:27:23.618 [2024-07-15 09:06:11.926435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.926584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.926608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.618 qpair failed and we were unable to recover it. 00:27:23.618 [2024-07-15 09:06:11.926722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.926868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.926921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.618 qpair failed and we were unable to recover it. 00:27:23.618 [2024-07-15 09:06:11.927041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.927178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.927202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.618 qpair failed and we were unable to recover it. 00:27:23.618 [2024-07-15 09:06:11.927316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.927435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.927459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.618 qpair failed and we were unable to recover it. 00:27:23.618 [2024-07-15 09:06:11.927610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.927720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.927744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.618 qpair failed and we were unable to recover it. 00:27:23.618 [2024-07-15 09:06:11.927854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.927999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.928025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.618 qpair failed and we were unable to recover it. 00:27:23.618 [2024-07-15 09:06:11.928149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.928259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.928284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.618 qpair failed and we were unable to recover it. 00:27:23.618 [2024-07-15 09:06:11.928403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.928519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.928544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.618 qpair failed and we were unable to recover it. 00:27:23.618 [2024-07-15 09:06:11.928663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.928808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.928833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.618 qpair failed and we were unable to recover it. 00:27:23.618 [2024-07-15 09:06:11.928956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.929072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.618 [2024-07-15 09:06:11.929096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.618 qpair failed and we were unable to recover it. 00:27:23.618 [2024-07-15 09:06:11.929216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.929362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.929388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.619 qpair failed and we were unable to recover it. 00:27:23.619 [2024-07-15 09:06:11.929527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.929642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.929666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.619 qpair failed and we were unable to recover it. 00:27:23.619 [2024-07-15 09:06:11.929784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.929904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.929930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.619 qpair failed and we were unable to recover it. 00:27:23.619 [2024-07-15 09:06:11.930042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.930160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.930185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.619 qpair failed and we were unable to recover it. 00:27:23.619 [2024-07-15 09:06:11.930326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.930429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.930453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.619 qpair failed and we were unable to recover it. 00:27:23.619 [2024-07-15 09:06:11.930571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.930682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.930707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.619 qpair failed and we were unable to recover it. 00:27:23.619 [2024-07-15 09:06:11.930820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.930968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.930993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.619 qpair failed and we were unable to recover it. 00:27:23.619 [2024-07-15 09:06:11.931106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.931246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.931270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.619 qpair failed and we were unable to recover it. 00:27:23.619 [2024-07-15 09:06:11.931383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.931498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.931523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.619 qpair failed and we were unable to recover it. 00:27:23.619 [2024-07-15 09:06:11.931648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.931755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.931779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.619 qpair failed and we were unable to recover it. 00:27:23.619 [2024-07-15 09:06:11.931894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.932005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.932030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.619 qpair failed and we were unable to recover it. 00:27:23.619 [2024-07-15 09:06:11.932178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.932306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.932330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.619 qpair failed and we were unable to recover it. 00:27:23.619 [2024-07-15 09:06:11.932464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.932574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.932598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.619 qpair failed and we were unable to recover it. 00:27:23.619 [2024-07-15 09:06:11.932706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.932852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.932881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.619 qpair failed and we were unable to recover it. 00:27:23.619 [2024-07-15 09:06:11.933007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.933123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.933149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.619 qpair failed and we were unable to recover it. 00:27:23.619 [2024-07-15 09:06:11.933320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.933466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.933491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.619 qpair failed and we were unable to recover it. 00:27:23.619 [2024-07-15 09:06:11.933636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.933768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.933793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.619 qpair failed and we were unable to recover it. 00:27:23.619 [2024-07-15 09:06:11.933937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.934062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.934086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.619 qpair failed and we were unable to recover it. 00:27:23.619 [2024-07-15 09:06:11.934198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.934307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.934331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.619 qpair failed and we were unable to recover it. 00:27:23.619 [2024-07-15 09:06:11.934455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.934596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.934621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.619 qpair failed and we were unable to recover it. 00:27:23.619 [2024-07-15 09:06:11.934732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.934843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.934867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.619 qpair failed and we were unable to recover it. 00:27:23.619 [2024-07-15 09:06:11.935008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.935149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.935173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.619 qpair failed and we were unable to recover it. 00:27:23.619 [2024-07-15 09:06:11.935284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.935454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.935479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.619 qpair failed and we were unable to recover it. 00:27:23.619 [2024-07-15 09:06:11.935591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.935731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.935761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.619 qpair failed and we were unable to recover it. 00:27:23.619 [2024-07-15 09:06:11.935889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.936002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.936026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.619 qpair failed and we were unable to recover it. 00:27:23.619 [2024-07-15 09:06:11.936143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.936267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.936293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.619 qpair failed and we were unable to recover it. 00:27:23.619 [2024-07-15 09:06:11.936463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.936585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.936610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.619 qpair failed and we were unable to recover it. 00:27:23.619 [2024-07-15 09:06:11.936725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.936841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.936865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.619 qpair failed and we were unable to recover it. 00:27:23.619 [2024-07-15 09:06:11.937025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.937138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.937162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.619 qpair failed and we were unable to recover it. 00:27:23.619 [2024-07-15 09:06:11.937279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.937419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.937444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.619 qpair failed and we were unable to recover it. 00:27:23.619 [2024-07-15 09:06:11.937555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.619 [2024-07-15 09:06:11.937663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.937687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.620 qpair failed and we were unable to recover it. 00:27:23.620 [2024-07-15 09:06:11.937831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.937971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.937996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.620 qpair failed and we were unable to recover it. 00:27:23.620 [2024-07-15 09:06:11.938114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.938240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.938265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.620 qpair failed and we were unable to recover it. 00:27:23.620 [2024-07-15 09:06:11.938386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.938500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.938529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.620 qpair failed and we were unable to recover it. 00:27:23.620 [2024-07-15 09:06:11.938679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.938788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.938813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.620 qpair failed and we were unable to recover it. 00:27:23.620 [2024-07-15 09:06:11.938933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.939075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.939100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.620 qpair failed and we were unable to recover it. 00:27:23.620 [2024-07-15 09:06:11.939240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.939357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.939381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.620 qpair failed and we were unable to recover it. 00:27:23.620 [2024-07-15 09:06:11.939517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.939643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.939667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.620 qpair failed and we were unable to recover it. 00:27:23.620 [2024-07-15 09:06:11.939806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.939916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.939940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.620 qpair failed and we were unable to recover it. 00:27:23.620 [2024-07-15 09:06:11.940053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.940171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.940196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.620 qpair failed and we were unable to recover it. 00:27:23.620 [2024-07-15 09:06:11.940351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.940470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.940494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.620 qpair failed and we were unable to recover it. 00:27:23.620 [2024-07-15 09:06:11.940604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.940729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.940754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.620 qpair failed and we were unable to recover it. 00:27:23.620 [2024-07-15 09:06:11.940882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.940997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.941022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.620 qpair failed and we were unable to recover it. 00:27:23.620 [2024-07-15 09:06:11.941130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.941245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.941275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.620 qpair failed and we were unable to recover it. 00:27:23.620 [2024-07-15 09:06:11.941416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.941530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.941554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.620 qpair failed and we were unable to recover it. 00:27:23.620 [2024-07-15 09:06:11.941700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.941825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.941849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.620 qpair failed and we were unable to recover it. 00:27:23.620 [2024-07-15 09:06:11.941974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.942091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.942118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.620 qpair failed and we were unable to recover it. 00:27:23.620 [2024-07-15 09:06:11.942233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.942369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.942393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.620 qpair failed and we were unable to recover it. 00:27:23.620 [2024-07-15 09:06:11.942533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.942649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.942673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.620 qpair failed and we were unable to recover it. 00:27:23.620 [2024-07-15 09:06:11.942797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.942940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.942965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.620 qpair failed and we were unable to recover it. 00:27:23.620 [2024-07-15 09:06:11.943076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.943185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.943210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.620 qpair failed and we were unable to recover it. 00:27:23.620 [2024-07-15 09:06:11.943364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.943476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.943500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.620 qpair failed and we were unable to recover it. 00:27:23.620 [2024-07-15 09:06:11.943613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.943729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.943753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.620 qpair failed and we were unable to recover it. 00:27:23.620 [2024-07-15 09:06:11.943873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.943985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.944014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.620 qpair failed and we were unable to recover it. 00:27:23.620 [2024-07-15 09:06:11.944155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.944291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.944316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.620 qpair failed and we were unable to recover it. 00:27:23.620 [2024-07-15 09:06:11.944487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.620 [2024-07-15 09:06:11.944596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.944620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.621 qpair failed and we were unable to recover it. 00:27:23.621 [2024-07-15 09:06:11.944737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.944886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.944911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.621 qpair failed and we were unable to recover it. 00:27:23.621 [2024-07-15 09:06:11.945054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.945171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.945196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.621 qpair failed and we were unable to recover it. 00:27:23.621 [2024-07-15 09:06:11.945312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.945419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.945443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.621 qpair failed and we were unable to recover it. 00:27:23.621 [2024-07-15 09:06:11.945557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.945682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.945706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.621 qpair failed and we were unable to recover it. 00:27:23.621 [2024-07-15 09:06:11.945821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.945935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.945960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.621 qpair failed and we were unable to recover it. 00:27:23.621 [2024-07-15 09:06:11.946072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.946215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.946240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.621 qpair failed and we were unable to recover it. 00:27:23.621 [2024-07-15 09:06:11.946358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.946498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.946521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.621 qpair failed and we were unable to recover it. 00:27:23.621 [2024-07-15 09:06:11.946661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.946779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.946803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.621 qpair failed and we were unable to recover it. 00:27:23.621 [2024-07-15 09:06:11.946947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.947055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.947079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.621 qpair failed and we were unable to recover it. 00:27:23.621 [2024-07-15 09:06:11.947186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.947324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.947348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.621 qpair failed and we were unable to recover it. 00:27:23.621 [2024-07-15 09:06:11.947568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.947676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.947701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.621 qpair failed and we were unable to recover it. 00:27:23.621 [2024-07-15 09:06:11.947848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.947960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.947984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.621 qpair failed and we were unable to recover it. 00:27:23.621 [2024-07-15 09:06:11.948097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.948200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.948224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.621 qpair failed and we were unable to recover it. 00:27:23.621 [2024-07-15 09:06:11.948362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.948498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.948523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.621 qpair failed and we were unable to recover it. 00:27:23.621 [2024-07-15 09:06:11.948641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.948780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.948804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.621 qpair failed and we were unable to recover it. 00:27:23.621 [2024-07-15 09:06:11.948926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.949040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.949065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.621 qpair failed and we were unable to recover it. 00:27:23.621 [2024-07-15 09:06:11.949170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.949285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.949310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.621 qpair failed and we were unable to recover it. 00:27:23.621 [2024-07-15 09:06:11.949448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.949563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.949588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.621 qpair failed and we were unable to recover it. 00:27:23.621 [2024-07-15 09:06:11.949727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.949848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.949872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.621 qpair failed and we were unable to recover it. 00:27:23.621 [2024-07-15 09:06:11.950021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.950137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.950163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.621 qpair failed and we were unable to recover it. 00:27:23.621 [2024-07-15 09:06:11.950282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.950402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.950427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.621 qpair failed and we were unable to recover it. 00:27:23.621 [2024-07-15 09:06:11.950569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.950714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.950738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.621 qpair failed and we were unable to recover it. 00:27:23.621 [2024-07-15 09:06:11.950851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.951017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.951042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.621 qpair failed and we were unable to recover it. 00:27:23.621 [2024-07-15 09:06:11.951187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.951299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.951324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.621 qpair failed and we were unable to recover it. 00:27:23.621 [2024-07-15 09:06:11.951445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.951551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.951575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.621 qpair failed and we were unable to recover it. 00:27:23.621 [2024-07-15 09:06:11.951699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.951836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.951860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.621 qpair failed and we were unable to recover it. 00:27:23.621 [2024-07-15 09:06:11.951983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.952090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.952114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.621 qpair failed and we were unable to recover it. 00:27:23.621 [2024-07-15 09:06:11.952278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.952415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.952439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.621 qpair failed and we were unable to recover it. 00:27:23.621 [2024-07-15 09:06:11.952560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.952706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.952730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.621 qpair failed and we were unable to recover it. 00:27:23.621 [2024-07-15 09:06:11.952836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.952985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.621 [2024-07-15 09:06:11.953010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.621 qpair failed and we were unable to recover it. 00:27:23.622 [2024-07-15 09:06:11.953176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.953288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.953313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.622 qpair failed and we were unable to recover it. 00:27:23.622 [2024-07-15 09:06:11.953425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.953538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.953563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.622 qpair failed and we were unable to recover it. 00:27:23.622 [2024-07-15 09:06:11.953692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.953830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.953855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.622 qpair failed and we were unable to recover it. 00:27:23.622 [2024-07-15 09:06:11.953979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.954121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.954145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.622 qpair failed and we were unable to recover it. 00:27:23.622 [2024-07-15 09:06:11.954281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.954428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.954452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.622 qpair failed and we were unable to recover it. 00:27:23.622 [2024-07-15 09:06:11.954566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.954715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.954739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.622 qpair failed and we were unable to recover it. 00:27:23.622 [2024-07-15 09:06:11.954870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.954987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.955011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.622 qpair failed and we were unable to recover it. 00:27:23.622 [2024-07-15 09:06:11.955125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.955269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.955294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.622 qpair failed and we were unable to recover it. 00:27:23.622 [2024-07-15 09:06:11.955411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.955523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.955548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.622 qpair failed and we were unable to recover it. 00:27:23.622 [2024-07-15 09:06:11.955670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.955781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.955806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.622 qpair failed and we were unable to recover it. 00:27:23.622 [2024-07-15 09:06:11.955933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.956073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.956097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.622 qpair failed and we were unable to recover it. 00:27:23.622 [2024-07-15 09:06:11.956244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.956389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.956414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.622 qpair failed and we were unable to recover it. 00:27:23.622 [2024-07-15 09:06:11.956541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.956654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.956679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.622 qpair failed and we were unable to recover it. 00:27:23.622 [2024-07-15 09:06:11.956798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.956910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.956935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.622 qpair failed and we were unable to recover it. 00:27:23.622 [2024-07-15 09:06:11.957054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.957196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.957222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.622 qpair failed and we were unable to recover it. 00:27:23.622 [2024-07-15 09:06:11.957331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.957452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.957478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.622 qpair failed and we were unable to recover it. 00:27:23.622 [2024-07-15 09:06:11.957592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.957706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.957731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.622 qpair failed and we were unable to recover it. 00:27:23.622 [2024-07-15 09:06:11.957869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.958024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.958049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.622 qpair failed and we were unable to recover it. 00:27:23.622 [2024-07-15 09:06:11.958171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.958312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.958337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.622 qpair failed and we were unable to recover it. 00:27:23.622 [2024-07-15 09:06:11.958472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.958614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.958638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.622 qpair failed and we were unable to recover it. 00:27:23.622 [2024-07-15 09:06:11.958750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.958905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.958930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.622 qpair failed and we were unable to recover it. 00:27:23.622 [2024-07-15 09:06:11.959056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.959166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.959190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.622 qpair failed and we were unable to recover it. 00:27:23.622 [2024-07-15 09:06:11.959301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.959419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.959443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.622 qpair failed and we were unable to recover it. 00:27:23.622 [2024-07-15 09:06:11.959590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.959697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.959722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.622 qpair failed and we were unable to recover it. 00:27:23.622 [2024-07-15 09:06:11.959868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.960045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.960070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.622 qpair failed and we were unable to recover it. 00:27:23.622 [2024-07-15 09:06:11.960215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.960354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.960379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.622 qpair failed and we were unable to recover it. 00:27:23.622 [2024-07-15 09:06:11.960494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.960627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.960652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.622 qpair failed and we were unable to recover it. 00:27:23.622 [2024-07-15 09:06:11.960770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.960882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.960907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.622 qpair failed and we were unable to recover it. 00:27:23.622 [2024-07-15 09:06:11.961019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.961137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.961161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.622 qpair failed and we were unable to recover it. 00:27:23.622 [2024-07-15 09:06:11.961320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.622 [2024-07-15 09:06:11.961457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.961482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.623 qpair failed and we were unable to recover it. 00:27:23.623 [2024-07-15 09:06:11.961622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.961737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.961761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.623 qpair failed and we were unable to recover it. 00:27:23.623 [2024-07-15 09:06:11.961898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.962007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.962031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.623 qpair failed and we were unable to recover it. 00:27:23.623 [2024-07-15 09:06:11.962187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.962323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.962347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.623 qpair failed and we were unable to recover it. 00:27:23.623 [2024-07-15 09:06:11.962463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.962597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.962622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.623 qpair failed and we were unable to recover it. 00:27:23.623 [2024-07-15 09:06:11.962765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.962906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.962930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.623 qpair failed and we were unable to recover it. 00:27:23.623 [2024-07-15 09:06:11.963044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.963159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.963184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.623 qpair failed and we were unable to recover it. 00:27:23.623 [2024-07-15 09:06:11.963310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.963418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.963443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.623 qpair failed and we were unable to recover it. 00:27:23.623 [2024-07-15 09:06:11.963584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.963704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.963729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.623 qpair failed and we were unable to recover it. 00:27:23.623 [2024-07-15 09:06:11.963872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.964015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.964039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.623 qpair failed and we were unable to recover it. 00:27:23.623 [2024-07-15 09:06:11.964173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.964283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.964308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.623 qpair failed and we were unable to recover it. 00:27:23.623 [2024-07-15 09:06:11.964448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.964557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.964581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.623 qpair failed and we were unable to recover it. 00:27:23.623 [2024-07-15 09:06:11.964691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.964833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.964858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.623 qpair failed and we were unable to recover it. 00:27:23.623 [2024-07-15 09:06:11.964985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.965122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.965147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.623 qpair failed and we were unable to recover it. 00:27:23.623 [2024-07-15 09:06:11.965264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.965375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.965400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.623 qpair failed and we were unable to recover it. 00:27:23.623 [2024-07-15 09:06:11.965544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.965664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.965688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.623 qpair failed and we were unable to recover it. 00:27:23.623 [2024-07-15 09:06:11.965812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.965954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.965979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.623 qpair failed and we were unable to recover it. 00:27:23.623 [2024-07-15 09:06:11.966099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.966216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.966242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.623 qpair failed and we were unable to recover it. 00:27:23.623 [2024-07-15 09:06:11.966393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.966507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.966531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.623 qpair failed and we were unable to recover it. 00:27:23.623 [2024-07-15 09:06:11.966686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.966807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.966833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.623 qpair failed and we were unable to recover it. 00:27:23.623 [2024-07-15 09:06:11.966949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.967101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.967126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.623 qpair failed and we were unable to recover it. 00:27:23.623 [2024-07-15 09:06:11.967238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.967361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.967386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.623 qpair failed and we were unable to recover it. 00:27:23.623 [2024-07-15 09:06:11.967534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.967645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.967670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.623 qpair failed and we were unable to recover it. 00:27:23.623 [2024-07-15 09:06:11.967787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.967898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.967923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.623 qpair failed and we were unable to recover it. 00:27:23.623 [2024-07-15 09:06:11.968070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.968178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.968203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.623 qpair failed and we were unable to recover it. 00:27:23.623 [2024-07-15 09:06:11.968317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.968433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.968458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.623 qpair failed and we were unable to recover it. 00:27:23.623 [2024-07-15 09:06:11.968573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.968721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.968746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.623 qpair failed and we were unable to recover it. 00:27:23.623 [2024-07-15 09:06:11.968869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.968988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.969012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.623 qpair failed and we were unable to recover it. 00:27:23.623 [2024-07-15 09:06:11.969149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.969262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.969286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.623 qpair failed and we were unable to recover it. 00:27:23.623 [2024-07-15 09:06:11.969427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.969553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.969578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.623 qpair failed and we were unable to recover it. 00:27:23.623 [2024-07-15 09:06:11.969705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.969870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.623 [2024-07-15 09:06:11.969900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.623 qpair failed and we were unable to recover it. 00:27:23.624 [2024-07-15 09:06:11.970011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.970125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.970149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.624 qpair failed and we were unable to recover it. 00:27:23.624 [2024-07-15 09:06:11.970288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.970410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.970435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.624 qpair failed and we were unable to recover it. 00:27:23.624 [2024-07-15 09:06:11.970578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.970694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.970719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.624 qpair failed and we were unable to recover it. 00:27:23.624 [2024-07-15 09:06:11.970862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.970978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.971002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.624 qpair failed and we were unable to recover it. 00:27:23.624 [2024-07-15 09:06:11.971117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.971241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.971266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.624 qpair failed and we were unable to recover it. 00:27:23.624 [2024-07-15 09:06:11.971406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.971520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.971545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.624 qpair failed and we were unable to recover it. 00:27:23.624 [2024-07-15 09:06:11.971684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.971807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.971831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.624 qpair failed and we were unable to recover it. 00:27:23.624 [2024-07-15 09:06:11.971954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.972103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.972127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.624 qpair failed and we were unable to recover it. 00:27:23.624 [2024-07-15 09:06:11.972242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.972368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.972392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.624 qpair failed and we were unable to recover it. 00:27:23.624 [2024-07-15 09:06:11.972505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.972614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.972638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.624 qpair failed and we were unable to recover it. 00:27:23.624 [2024-07-15 09:06:11.972758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.972873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.972903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.624 qpair failed and we were unable to recover it. 00:27:23.624 [2024-07-15 09:06:11.973019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.973131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.973155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.624 qpair failed and we were unable to recover it. 00:27:23.624 [2024-07-15 09:06:11.973264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.973393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.973418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.624 qpair failed and we were unable to recover it. 00:27:23.624 [2024-07-15 09:06:11.973561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.973670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.973694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.624 qpair failed and we were unable to recover it. 00:27:23.624 [2024-07-15 09:06:11.973807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.973920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.973945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.624 qpair failed and we were unable to recover it. 00:27:23.624 [2024-07-15 09:06:11.974067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.974186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.974210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.624 qpair failed and we were unable to recover it. 00:27:23.624 [2024-07-15 09:06:11.974356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.974490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.974514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.624 qpair failed and we were unable to recover it. 00:27:23.624 [2024-07-15 09:06:11.974636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.974778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.974803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.624 qpair failed and we were unable to recover it. 00:27:23.624 [2024-07-15 09:06:11.974927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.975055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.975080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.624 qpair failed and we were unable to recover it. 00:27:23.624 [2024-07-15 09:06:11.975199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.975333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.975358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.624 qpair failed and we were unable to recover it. 00:27:23.624 [2024-07-15 09:06:11.975478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.975590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.975614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.624 qpair failed and we were unable to recover it. 00:27:23.624 [2024-07-15 09:06:11.975728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.975841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.975866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.624 qpair failed and we were unable to recover it. 00:27:23.624 [2024-07-15 09:06:11.975985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.976104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.976131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.624 qpair failed and we were unable to recover it. 00:27:23.624 [2024-07-15 09:06:11.976244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.976382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.976407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.624 qpair failed and we were unable to recover it. 00:27:23.624 [2024-07-15 09:06:11.976550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.976655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.976680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.624 qpair failed and we were unable to recover it. 00:27:23.624 [2024-07-15 09:06:11.976790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.976903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.976928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.624 qpair failed and we were unable to recover it. 00:27:23.624 [2024-07-15 09:06:11.977076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.977192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.977216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.624 qpair failed and we were unable to recover it. 00:27:23.624 [2024-07-15 09:06:11.977330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.977443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.977468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.624 qpair failed and we were unable to recover it. 00:27:23.624 [2024-07-15 09:06:11.977608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.977727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.977751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.624 qpair failed and we were unable to recover it. 00:27:23.624 [2024-07-15 09:06:11.977856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.977973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.977998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.624 qpair failed and we were unable to recover it. 00:27:23.624 [2024-07-15 09:06:11.978137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.624 [2024-07-15 09:06:11.978244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.978269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.625 qpair failed and we were unable to recover it. 00:27:23.625 [2024-07-15 09:06:11.978390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.978505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.978530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.625 qpair failed and we were unable to recover it. 00:27:23.625 [2024-07-15 09:06:11.978673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.978776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.978800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.625 qpair failed and we were unable to recover it. 00:27:23.625 [2024-07-15 09:06:11.978952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.979066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.979090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.625 qpair failed and we were unable to recover it. 00:27:23.625 [2024-07-15 09:06:11.979200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.979307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.979331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.625 qpair failed and we were unable to recover it. 00:27:23.625 [2024-07-15 09:06:11.979474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.979590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.979614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.625 qpair failed and we were unable to recover it. 00:27:23.625 [2024-07-15 09:06:11.979751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.979895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.979920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.625 qpair failed and we were unable to recover it. 00:27:23.625 [2024-07-15 09:06:11.980039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.980157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.980182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.625 qpair failed and we were unable to recover it. 00:27:23.625 [2024-07-15 09:06:11.980330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.980436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.980464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.625 qpair failed and we were unable to recover it. 00:27:23.625 [2024-07-15 09:06:11.980605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.980751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.980777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.625 qpair failed and we were unable to recover it. 00:27:23.625 [2024-07-15 09:06:11.980924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.981067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.981092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.625 qpair failed and we were unable to recover it. 00:27:23.625 [2024-07-15 09:06:11.981245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.981386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.981410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.625 qpair failed and we were unable to recover it. 00:27:23.625 [2024-07-15 09:06:11.981532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.981671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.981695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.625 qpair failed and we were unable to recover it. 00:27:23.625 [2024-07-15 09:06:11.981836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.981962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.981987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.625 qpair failed and we were unable to recover it. 00:27:23.625 [2024-07-15 09:06:11.982096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.982202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.982226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.625 qpair failed and we were unable to recover it. 00:27:23.625 [2024-07-15 09:06:11.982335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.982475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.982499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.625 qpair failed and we were unable to recover it. 00:27:23.625 [2024-07-15 09:06:11.982645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.982760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.982784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.625 qpair failed and we were unable to recover it. 00:27:23.625 [2024-07-15 09:06:11.982929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.983073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.983100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.625 qpair failed and we were unable to recover it. 00:27:23.625 [2024-07-15 09:06:11.983215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.983339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.983368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.625 qpair failed and we were unable to recover it. 00:27:23.625 [2024-07-15 09:06:11.983520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.983665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.983690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.625 qpair failed and we were unable to recover it. 00:27:23.625 [2024-07-15 09:06:11.983799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.983944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.983969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.625 qpair failed and we were unable to recover it. 00:27:23.625 [2024-07-15 09:06:11.984076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.984222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.984246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.625 qpair failed and we were unable to recover it. 00:27:23.625 [2024-07-15 09:06:11.984386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.984495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.984519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.625 qpair failed and we were unable to recover it. 00:27:23.625 [2024-07-15 09:06:11.984636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.984754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.984778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.625 qpair failed and we were unable to recover it. 00:27:23.625 [2024-07-15 09:06:11.984920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.985042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.985067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.625 qpair failed and we were unable to recover it. 00:27:23.625 [2024-07-15 09:06:11.985188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.985314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.985339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.625 qpair failed and we were unable to recover it. 00:27:23.625 [2024-07-15 09:06:11.985483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.625 [2024-07-15 09:06:11.985633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.985659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.626 qpair failed and we were unable to recover it. 00:27:23.626 [2024-07-15 09:06:11.985781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.985922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.985946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.626 qpair failed and we were unable to recover it. 00:27:23.626 [2024-07-15 09:06:11.986059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.986180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.986208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.626 qpair failed and we were unable to recover it. 00:27:23.626 [2024-07-15 09:06:11.986322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.986465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.986489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.626 qpair failed and we were unable to recover it. 00:27:23.626 [2024-07-15 09:06:11.986624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.986727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.986751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.626 qpair failed and we were unable to recover it. 00:27:23.626 [2024-07-15 09:06:11.986900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.987023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.987048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.626 qpair failed and we were unable to recover it. 00:27:23.626 [2024-07-15 09:06:11.987189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.987357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.987381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.626 qpair failed and we were unable to recover it. 00:27:23.626 [2024-07-15 09:06:11.987509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.987622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.987646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.626 qpair failed and we were unable to recover it. 00:27:23.626 [2024-07-15 09:06:11.987766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.987888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.987914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.626 qpair failed and we were unable to recover it. 00:27:23.626 [2024-07-15 09:06:11.988026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.988132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.988157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.626 qpair failed and we were unable to recover it. 00:27:23.626 [2024-07-15 09:06:11.988291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.988436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.988461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.626 qpair failed and we were unable to recover it. 00:27:23.626 [2024-07-15 09:06:11.988582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.988723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.988748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.626 qpair failed and we were unable to recover it. 00:27:23.626 [2024-07-15 09:06:11.988868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.988983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.989007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.626 qpair failed and we were unable to recover it. 00:27:23.626 [2024-07-15 09:06:11.989133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.989272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.989296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.626 qpair failed and we were unable to recover it. 00:27:23.626 [2024-07-15 09:06:11.989411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.989557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.989583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.626 qpair failed and we were unable to recover it. 00:27:23.626 [2024-07-15 09:06:11.989708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.989816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.989840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.626 qpair failed and we were unable to recover it. 00:27:23.626 [2024-07-15 09:06:11.989958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.990102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.990127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.626 qpair failed and we were unable to recover it. 00:27:23.626 [2024-07-15 09:06:11.990238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.990346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.990370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.626 qpair failed and we were unable to recover it. 00:27:23.626 [2024-07-15 09:06:11.990483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.990586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.990611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.626 qpair failed and we were unable to recover it. 00:27:23.626 [2024-07-15 09:06:11.990755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.990891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.990916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.626 qpair failed and we were unable to recover it. 00:27:23.626 [2024-07-15 09:06:11.991034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.991148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.991173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.626 qpair failed and we were unable to recover it. 00:27:23.626 [2024-07-15 09:06:11.991314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.991457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.991482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.626 qpair failed and we were unable to recover it. 00:27:23.626 [2024-07-15 09:06:11.991595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.991708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.991732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.626 qpair failed and we were unable to recover it. 00:27:23.626 [2024-07-15 09:06:11.991888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.992032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.992058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.626 qpair failed and we were unable to recover it. 00:27:23.626 [2024-07-15 09:06:11.992210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.992347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.992371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.626 qpair failed and we were unable to recover it. 00:27:23.626 [2024-07-15 09:06:11.992477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.992593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.992617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.626 qpair failed and we were unable to recover it. 00:27:23.626 [2024-07-15 09:06:11.992758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.992881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.992906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.626 qpair failed and we were unable to recover it. 00:27:23.626 [2024-07-15 09:06:11.993065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.993179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.993205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.626 qpair failed and we were unable to recover it. 00:27:23.626 [2024-07-15 09:06:11.993346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.993490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.993514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.626 qpair failed and we were unable to recover it. 00:27:23.626 [2024-07-15 09:06:11.993660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.993777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.993802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.626 qpair failed and we were unable to recover it. 00:27:23.626 [2024-07-15 09:06:11.993923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.994091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.626 [2024-07-15 09:06:11.994115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.626 qpair failed and we were unable to recover it. 00:27:23.627 [2024-07-15 09:06:11.994256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:11.994375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:11.994401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.627 qpair failed and we were unable to recover it. 00:27:23.627 [2024-07-15 09:06:11.994550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:11.994696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:11.994720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.627 qpair failed and we were unable to recover it. 00:27:23.627 [2024-07-15 09:06:11.994835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:11.995002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:11.995028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.627 qpair failed and we were unable to recover it. 00:27:23.627 [2024-07-15 09:06:11.995148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:11.995284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:11.995309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.627 qpair failed and we were unable to recover it. 00:27:23.627 [2024-07-15 09:06:11.995424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:11.995571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:11.995596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.627 qpair failed and we were unable to recover it. 00:27:23.627 [2024-07-15 09:06:11.995740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:11.995863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:11.995895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.627 qpair failed and we were unable to recover it. 00:27:23.627 [2024-07-15 09:06:11.996064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:11.996207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:11.996232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.627 qpair failed and we were unable to recover it. 00:27:23.627 [2024-07-15 09:06:11.996374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:11.996484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:11.996508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.627 qpair failed and we were unable to recover it. 00:27:23.627 [2024-07-15 09:06:11.996659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:11.996783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:11.996806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.627 qpair failed and we were unable to recover it. 00:27:23.627 [2024-07-15 09:06:11.996957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:11.997108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:11.997134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.627 qpair failed and we were unable to recover it. 00:27:23.627 [2024-07-15 09:06:11.997257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:11.997403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:11.997428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.627 qpair failed and we were unable to recover it. 00:27:23.627 [2024-07-15 09:06:11.997545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:11.997671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:11.997696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.627 qpair failed and we were unable to recover it. 00:27:23.627 [2024-07-15 09:06:11.997811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:11.997928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:11.997953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.627 qpair failed and we were unable to recover it. 00:27:23.627 [2024-07-15 09:06:11.998099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:11.998214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:11.998240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.627 qpair failed and we were unable to recover it. 00:27:23.627 [2024-07-15 09:06:11.998349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:11.998469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:11.998493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.627 qpair failed and we were unable to recover it. 00:27:23.627 [2024-07-15 09:06:11.998606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:11.998743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:11.998768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.627 qpair failed and we were unable to recover it. 00:27:23.627 [2024-07-15 09:06:11.998881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:11.998998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:11.999023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.627 qpair failed and we were unable to recover it. 00:27:23.627 [2024-07-15 09:06:11.999138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:11.999278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:11.999303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.627 qpair failed and we were unable to recover it. 00:27:23.627 [2024-07-15 09:06:11.999443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:11.999553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:11.999578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.627 qpair failed and we were unable to recover it. 00:27:23.627 [2024-07-15 09:06:11.999699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:11.999835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:11.999860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.627 qpair failed and we were unable to recover it. 00:27:23.627 [2024-07-15 09:06:12.000036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:12.000160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:12.000186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.627 qpair failed and we were unable to recover it. 00:27:23.627 [2024-07-15 09:06:12.000319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:12.000433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:12.000458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.627 qpair failed and we were unable to recover it. 00:27:23.627 [2024-07-15 09:06:12.000580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:12.000719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:12.000744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.627 qpair failed and we were unable to recover it. 00:27:23.627 [2024-07-15 09:06:12.000885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:12.001006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:12.001033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.627 qpair failed and we were unable to recover it. 00:27:23.627 [2024-07-15 09:06:12.001185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:12.001291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:12.001316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.627 qpair failed and we were unable to recover it. 00:27:23.627 [2024-07-15 09:06:12.001432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:12.001543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:12.001569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.627 qpair failed and we were unable to recover it. 00:27:23.627 [2024-07-15 09:06:12.001705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:12.001863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:12.001894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.627 qpair failed and we were unable to recover it. 00:27:23.627 [2024-07-15 09:06:12.002003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:12.002173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:12.002197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.627 qpair failed and we were unable to recover it. 00:27:23.627 [2024-07-15 09:06:12.002309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:12.002415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:12.002439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.627 qpair failed and we were unable to recover it. 00:27:23.627 [2024-07-15 09:06:12.002547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:12.002691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.627 [2024-07-15 09:06:12.002716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.627 qpair failed and we were unable to recover it. 00:27:23.627 [2024-07-15 09:06:12.002825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.002959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.002985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.628 qpair failed and we were unable to recover it. 00:27:23.628 [2024-07-15 09:06:12.003103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.003247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.003272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.628 qpair failed and we were unable to recover it. 00:27:23.628 [2024-07-15 09:06:12.003387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.003526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.003551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.628 qpair failed and we were unable to recover it. 00:27:23.628 [2024-07-15 09:06:12.003661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.003783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.003808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.628 qpair failed and we were unable to recover it. 00:27:23.628 [2024-07-15 09:06:12.003966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.004075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.004100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.628 qpair failed and we were unable to recover it. 00:27:23.628 [2024-07-15 09:06:12.004243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.004381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.004406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.628 qpair failed and we were unable to recover it. 00:27:23.628 [2024-07-15 09:06:12.004522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.004656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.004681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.628 qpair failed and we were unable to recover it. 00:27:23.628 [2024-07-15 09:06:12.004793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.004933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.004959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.628 qpair failed and we were unable to recover it. 00:27:23.628 [2024-07-15 09:06:12.005067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.005203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.005228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.628 qpair failed and we were unable to recover it. 00:27:23.628 [2024-07-15 09:06:12.005380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.005536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.005561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.628 qpair failed and we were unable to recover it. 00:27:23.628 [2024-07-15 09:06:12.005703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.005821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.005847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.628 qpair failed and we were unable to recover it. 00:27:23.628 [2024-07-15 09:06:12.005976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.006112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.006136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.628 qpair failed and we were unable to recover it. 00:27:23.628 [2024-07-15 09:06:12.006275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.006391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.006416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.628 qpair failed and we were unable to recover it. 00:27:23.628 [2024-07-15 09:06:12.006531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.006667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.006691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.628 qpair failed and we were unable to recover it. 00:27:23.628 [2024-07-15 09:06:12.006830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.006943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.006968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.628 qpair failed and we were unable to recover it. 00:27:23.628 [2024-07-15 09:06:12.007080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.007196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.007221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.628 qpair failed and we were unable to recover it. 00:27:23.628 [2024-07-15 09:06:12.007332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.007452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.007477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.628 qpair failed and we were unable to recover it. 00:27:23.628 [2024-07-15 09:06:12.007620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.007741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.007767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.628 qpair failed and we were unable to recover it. 00:27:23.628 [2024-07-15 09:06:12.007882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.007994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.008020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.628 qpair failed and we were unable to recover it. 00:27:23.628 [2024-07-15 09:06:12.008138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.008276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.008301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.628 qpair failed and we were unable to recover it. 00:27:23.628 [2024-07-15 09:06:12.008415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.008584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.008609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.628 qpair failed and we were unable to recover it. 00:27:23.628 [2024-07-15 09:06:12.008726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.008858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.008887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.628 qpair failed and we were unable to recover it. 00:27:23.628 [2024-07-15 09:06:12.009004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.009121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.009145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.628 qpair failed and we were unable to recover it. 00:27:23.628 [2024-07-15 09:06:12.009298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.009414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.009439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.628 qpair failed and we were unable to recover it. 00:27:23.628 [2024-07-15 09:06:12.009564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.009681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.009706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.628 qpair failed and we were unable to recover it. 00:27:23.628 [2024-07-15 09:06:12.009855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.009970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.009995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.628 qpair failed and we were unable to recover it. 00:27:23.628 [2024-07-15 09:06:12.010120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.010234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.010260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.628 qpair failed and we were unable to recover it. 00:27:23.628 [2024-07-15 09:06:12.010366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.010481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.010506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.628 qpair failed and we were unable to recover it. 00:27:23.628 [2024-07-15 09:06:12.010626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.010752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.010776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.628 qpair failed and we were unable to recover it. 00:27:23.628 [2024-07-15 09:06:12.010908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.011018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.628 [2024-07-15 09:06:12.011044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.629 qpair failed and we were unable to recover it. 00:27:23.629 [2024-07-15 09:06:12.011157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.011277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.011302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.629 qpair failed and we were unable to recover it. 00:27:23.629 [2024-07-15 09:06:12.011423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.011536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.011560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.629 qpair failed and we were unable to recover it. 00:27:23.629 [2024-07-15 09:06:12.011672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.011827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.011852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.629 qpair failed and we were unable to recover it. 00:27:23.629 [2024-07-15 09:06:12.012002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.012122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.012147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.629 qpair failed and we were unable to recover it. 00:27:23.629 [2024-07-15 09:06:12.012261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.012403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.012428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.629 qpair failed and we were unable to recover it. 00:27:23.629 [2024-07-15 09:06:12.012539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.012680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.012706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.629 qpair failed and we were unable to recover it. 00:27:23.629 [2024-07-15 09:06:12.012824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.012956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.012982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.629 qpair failed and we were unable to recover it. 00:27:23.629 [2024-07-15 09:06:12.013097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.013217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.013242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.629 qpair failed and we were unable to recover it. 00:27:23.629 [2024-07-15 09:06:12.013385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.013523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.013548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.629 qpair failed and we were unable to recover it. 00:27:23.629 [2024-07-15 09:06:12.013671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.013794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.013819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.629 qpair failed and we were unable to recover it. 00:27:23.629 [2024-07-15 09:06:12.013962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.014101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.014126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.629 qpair failed and we were unable to recover it. 00:27:23.629 [2024-07-15 09:06:12.014278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.014385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.014410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.629 qpair failed and we were unable to recover it. 00:27:23.629 [2024-07-15 09:06:12.014550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.014661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.014686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.629 qpair failed and we were unable to recover it. 00:27:23.629 [2024-07-15 09:06:12.014829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.014971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.014996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.629 qpair failed and we were unable to recover it. 00:27:23.629 [2024-07-15 09:06:12.015120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.015229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.015254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.629 qpair failed and we were unable to recover it. 00:27:23.629 [2024-07-15 09:06:12.015403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.015510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.015534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.629 qpair failed and we were unable to recover it. 00:27:23.629 [2024-07-15 09:06:12.015673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.015789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.015813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.629 qpair failed and we were unable to recover it. 00:27:23.629 [2024-07-15 09:06:12.015955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.016074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.016099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.629 qpair failed and we were unable to recover it. 00:27:23.629 [2024-07-15 09:06:12.016220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.016388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.016412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.629 qpair failed and we were unable to recover it. 00:27:23.629 [2024-07-15 09:06:12.016522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.016630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.016655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.629 qpair failed and we were unable to recover it. 00:27:23.629 [2024-07-15 09:06:12.016769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.016906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.016931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.629 qpair failed and we were unable to recover it. 00:27:23.629 [2024-07-15 09:06:12.017044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.017156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.017180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.629 qpair failed and we were unable to recover it. 00:27:23.629 [2024-07-15 09:06:12.017304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.017446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.017471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.629 qpair failed and we were unable to recover it. 00:27:23.629 [2024-07-15 09:06:12.017593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.017705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.017730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.629 qpair failed and we were unable to recover it. 00:27:23.629 [2024-07-15 09:06:12.017845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.017962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.017987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.629 qpair failed and we were unable to recover it. 00:27:23.629 [2024-07-15 09:06:12.018142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.629 [2024-07-15 09:06:12.018253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.018277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.630 qpair failed and we were unable to recover it. 00:27:23.630 [2024-07-15 09:06:12.018408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.018513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.018537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.630 qpair failed and we were unable to recover it. 00:27:23.630 [2024-07-15 09:06:12.018657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.018790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.018815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.630 qpair failed and we were unable to recover it. 00:27:23.630 [2024-07-15 09:06:12.018934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.019102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.019128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.630 qpair failed and we were unable to recover it. 00:27:23.630 [2024-07-15 09:06:12.019244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.019364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.019389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.630 qpair failed and we were unable to recover it. 00:27:23.630 [2024-07-15 09:06:12.019507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.019646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.019671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.630 qpair failed and we were unable to recover it. 00:27:23.630 [2024-07-15 09:06:12.019813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.019928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.019954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.630 qpair failed and we were unable to recover it. 00:27:23.630 [2024-07-15 09:06:12.020098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.020259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.020284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.630 qpair failed and we were unable to recover it. 00:27:23.630 [2024-07-15 09:06:12.020406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.020511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.020535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.630 qpair failed and we were unable to recover it. 00:27:23.630 [2024-07-15 09:06:12.020684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.020795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.020820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.630 qpair failed and we were unable to recover it. 00:27:23.630 [2024-07-15 09:06:12.020935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.021059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.021084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.630 qpair failed and we were unable to recover it. 00:27:23.630 [2024-07-15 09:06:12.021235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.021355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.021380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.630 qpair failed and we were unable to recover it. 00:27:23.630 [2024-07-15 09:06:12.021503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.021720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.021745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.630 qpair failed and we were unable to recover it. 00:27:23.630 [2024-07-15 09:06:12.021862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.021980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.022005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.630 qpair failed and we were unable to recover it. 00:27:23.630 [2024-07-15 09:06:12.022365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.022514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.022539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.630 qpair failed and we were unable to recover it. 00:27:23.630 [2024-07-15 09:06:12.022652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.022769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.022793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.630 qpair failed and we were unable to recover it. 00:27:23.630 09:06:12 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:27:23.630 [2024-07-15 09:06:12.022930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 09:06:12 -- common/autotest_common.sh@852 -- # return 0 00:27:23.630 [2024-07-15 09:06:12.023040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.023065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.630 qpair failed and we were unable to recover it. 00:27:23.630 09:06:12 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:23.630 [2024-07-15 09:06:12.023179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 09:06:12 -- common/autotest_common.sh@718 -- # xtrace_disable 00:27:23.630 [2024-07-15 09:06:12.023304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.023329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.630 qpair failed and we were unable to recover it. 00:27:23.630 09:06:12 -- common/autotest_common.sh@10 -- # set +x 00:27:23.630 [2024-07-15 09:06:12.023494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.023615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.023641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.630 qpair failed and we were unable to recover it. 00:27:23.630 [2024-07-15 09:06:12.023753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.023902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.023928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.630 qpair failed and we were unable to recover it. 00:27:23.630 [2024-07-15 09:06:12.024078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.024202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.024227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.630 qpair failed and we were unable to recover it. 00:27:23.630 [2024-07-15 09:06:12.024340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.024457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.024482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.630 qpair failed and we were unable to recover it. 00:27:23.630 [2024-07-15 09:06:12.024589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.024729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.024754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.630 qpair failed and we were unable to recover it. 00:27:23.630 [2024-07-15 09:06:12.024887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.024993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.025018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.630 qpair failed and we were unable to recover it. 00:27:23.630 [2024-07-15 09:06:12.025143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.025312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.025338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.630 qpair failed and we were unable to recover it. 00:27:23.630 [2024-07-15 09:06:12.025485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.025619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.025644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.630 qpair failed and we were unable to recover it. 00:27:23.630 [2024-07-15 09:06:12.025754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.025866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.025895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.630 qpair failed and we were unable to recover it. 00:27:23.630 [2024-07-15 09:06:12.026021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.026131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.026158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.630 qpair failed and we were unable to recover it. 00:27:23.630 [2024-07-15 09:06:12.026332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.026444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.026469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.630 qpair failed and we were unable to recover it. 00:27:23.630 [2024-07-15 09:06:12.026583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.026717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.630 [2024-07-15 09:06:12.026743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.631 qpair failed and we were unable to recover it. 00:27:23.631 [2024-07-15 09:06:12.026857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.026979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.027004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.631 qpair failed and we were unable to recover it. 00:27:23.631 [2024-07-15 09:06:12.027227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.027336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.027361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.631 qpair failed and we were unable to recover it. 00:27:23.631 [2024-07-15 09:06:12.027479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.027590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.027616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.631 qpair failed and we were unable to recover it. 00:27:23.631 [2024-07-15 09:06:12.027740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.027857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.027890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.631 qpair failed and we were unable to recover it. 00:27:23.631 [2024-07-15 09:06:12.028015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.028123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.028149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.631 qpair failed and we were unable to recover it. 00:27:23.631 [2024-07-15 09:06:12.028261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.028376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.028402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.631 qpair failed and we were unable to recover it. 00:27:23.631 [2024-07-15 09:06:12.028515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.028685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.028711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.631 qpair failed and we were unable to recover it. 00:27:23.631 [2024-07-15 09:06:12.028843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.028965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.028989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.631 qpair failed and we were unable to recover it. 00:27:23.631 [2024-07-15 09:06:12.029099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.029233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.029257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.631 qpair failed and we were unable to recover it. 00:27:23.631 [2024-07-15 09:06:12.029400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.029508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.029533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.631 qpair failed and we were unable to recover it. 00:27:23.631 [2024-07-15 09:06:12.029654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.029874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.029906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.631 qpair failed and we were unable to recover it. 00:27:23.631 [2024-07-15 09:06:12.030037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.030189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.030215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.631 qpair failed and we were unable to recover it. 00:27:23.631 [2024-07-15 09:06:12.030326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.030491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.030516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.631 qpair failed and we were unable to recover it. 00:27:23.631 [2024-07-15 09:06:12.030650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.030791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.030816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.631 qpair failed and we were unable to recover it. 00:27:23.631 [2024-07-15 09:06:12.030930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.031040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.031066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.631 qpair failed and we were unable to recover it. 00:27:23.631 [2024-07-15 09:06:12.031175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.031286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.031313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.631 qpair failed and we were unable to recover it. 00:27:23.631 [2024-07-15 09:06:12.031463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.031599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.031624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.631 qpair failed and we were unable to recover it. 00:27:23.631 [2024-07-15 09:06:12.031773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.031891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.031925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.631 qpair failed and we were unable to recover it. 00:27:23.631 [2024-07-15 09:06:12.032038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.032163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.032188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.631 qpair failed and we were unable to recover it. 00:27:23.631 [2024-07-15 09:06:12.032304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.032444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.032469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.631 qpair failed and we were unable to recover it. 00:27:23.631 [2024-07-15 09:06:12.032592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.032709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.032734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.631 qpair failed and we were unable to recover it. 00:27:23.631 [2024-07-15 09:06:12.032959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.033087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.033112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.631 qpair failed and we were unable to recover it. 00:27:23.631 [2024-07-15 09:06:12.033230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.033398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.033423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.631 qpair failed and we were unable to recover it. 00:27:23.631 [2024-07-15 09:06:12.033534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.033678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.033716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.631 qpair failed and we were unable to recover it. 00:27:23.631 [2024-07-15 09:06:12.033836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.033949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.033974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.631 qpair failed and we were unable to recover it. 00:27:23.631 [2024-07-15 09:06:12.034093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.034226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.034251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.631 qpair failed and we were unable to recover it. 00:27:23.631 [2024-07-15 09:06:12.034358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.034477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.034502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.631 qpair failed and we were unable to recover it. 00:27:23.631 [2024-07-15 09:06:12.034620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.034743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.034768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.631 qpair failed and we were unable to recover it. 00:27:23.631 [2024-07-15 09:06:12.034909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.035051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.035076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.631 qpair failed and we were unable to recover it. 00:27:23.631 [2024-07-15 09:06:12.035219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.035329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.631 [2024-07-15 09:06:12.035354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.631 qpair failed and we were unable to recover it. 00:27:23.632 [2024-07-15 09:06:12.035493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.035617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.035642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.632 qpair failed and we were unable to recover it. 00:27:23.632 [2024-07-15 09:06:12.035751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.035895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.035920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.632 qpair failed and we were unable to recover it. 00:27:23.632 [2024-07-15 09:06:12.036041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.036161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.036187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.632 qpair failed and we were unable to recover it. 00:27:23.632 [2024-07-15 09:06:12.036306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.036428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.036453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.632 qpair failed and we were unable to recover it. 00:27:23.632 [2024-07-15 09:06:12.036613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.036719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.036744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.632 qpair failed and we were unable to recover it. 00:27:23.632 [2024-07-15 09:06:12.036859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.037025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.037051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.632 qpair failed and we were unable to recover it. 00:27:23.632 [2024-07-15 09:06:12.037164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.037272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.037296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.632 qpair failed and we were unable to recover it. 00:27:23.632 [2024-07-15 09:06:12.037467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.037640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.037665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.632 qpair failed and we were unable to recover it. 00:27:23.632 [2024-07-15 09:06:12.037808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.037928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.037954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.632 qpair failed and we were unable to recover it. 00:27:23.632 [2024-07-15 09:06:12.038085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.038249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.038274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.632 qpair failed and we were unable to recover it. 00:27:23.632 [2024-07-15 09:06:12.038411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.038525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.038552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.632 qpair failed and we were unable to recover it. 00:27:23.632 [2024-07-15 09:06:12.038673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.038787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.038811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.632 qpair failed and we were unable to recover it. 00:27:23.632 [2024-07-15 09:06:12.038958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.039097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.039122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.632 qpair failed and we were unable to recover it. 00:27:23.632 [2024-07-15 09:06:12.039247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.039398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.039423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.632 qpair failed and we were unable to recover it. 00:27:23.632 [2024-07-15 09:06:12.039555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.039695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.039721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.632 qpair failed and we were unable to recover it. 00:27:23.632 [2024-07-15 09:06:12.039848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.039974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.039999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.632 qpair failed and we were unable to recover it. 00:27:23.632 [2024-07-15 09:06:12.040114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.040285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.040310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.632 qpair failed and we were unable to recover it. 00:27:23.632 [2024-07-15 09:06:12.040436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.040606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.040631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.632 qpair failed and we were unable to recover it. 00:27:23.632 [2024-07-15 09:06:12.040743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.040860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.040890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.632 qpair failed and we were unable to recover it. 00:27:23.632 [2024-07-15 09:06:12.040999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.041121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.041146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.632 qpair failed and we were unable to recover it. 00:27:23.632 [2024-07-15 09:06:12.041261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.041398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.041423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.632 qpair failed and we were unable to recover it. 00:27:23.632 [2024-07-15 09:06:12.041532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.041654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.041680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.632 qpair failed and we were unable to recover it. 00:27:23.632 [2024-07-15 09:06:12.041816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.041937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.041962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.632 qpair failed and we were unable to recover it. 00:27:23.632 [2024-07-15 09:06:12.042074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.042194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.042219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.632 qpair failed and we were unable to recover it. 00:27:23.632 [2024-07-15 09:06:12.042355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.042466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.042491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.632 qpair failed and we were unable to recover it. 00:27:23.632 [2024-07-15 09:06:12.042606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.042753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.042778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.632 qpair failed and we were unable to recover it. 00:27:23.632 [2024-07-15 09:06:12.042896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.043037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.043062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.632 qpair failed and we were unable to recover it. 00:27:23.632 [2024-07-15 09:06:12.043184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.043325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.043349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.632 qpair failed and we were unable to recover it. 00:27:23.632 [2024-07-15 09:06:12.043485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.043598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.632 [2024-07-15 09:06:12.043622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.632 qpair failed and we were unable to recover it. 00:27:23.632 [2024-07-15 09:06:12.043769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.043903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.043928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.633 qpair failed and we were unable to recover it. 00:27:23.633 [2024-07-15 09:06:12.044072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.044182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.044207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.633 qpair failed and we were unable to recover it. 00:27:23.633 [2024-07-15 09:06:12.044325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.044472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.044497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.633 qpair failed and we were unable to recover it. 00:27:23.633 [2024-07-15 09:06:12.044620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.044732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.044757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.633 qpair failed and we were unable to recover it. 00:27:23.633 [2024-07-15 09:06:12.044871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.045001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.045025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.633 qpair failed and we were unable to recover it. 00:27:23.633 [2024-07-15 09:06:12.045146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.045265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.045290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.633 qpair failed and we were unable to recover it. 00:27:23.633 [2024-07-15 09:06:12.045437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.045544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.045568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.633 qpair failed and we were unable to recover it. 00:27:23.633 [2024-07-15 09:06:12.045684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 09:06:12 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:23.633 [2024-07-15 09:06:12.045937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.045964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.633 qpair failed and we were unable to recover it. 00:27:23.633 09:06:12 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:23.633 [2024-07-15 09:06:12.046077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.046199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.046226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.633 qpair failed and we were unable to recover it. 00:27:23.633 09:06:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:23.633 [2024-07-15 09:06:12.046335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.046472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 09:06:12 -- common/autotest_common.sh@10 -- # set +x 00:27:23.633 [2024-07-15 09:06:12.046498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.633 qpair failed and we were unable to recover it. 00:27:23.633 [2024-07-15 09:06:12.046610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.046730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.046755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.633 qpair failed and we were unable to recover it. 00:27:23.633 [2024-07-15 09:06:12.046888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.047036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.047060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.633 qpair failed and we were unable to recover it. 00:27:23.633 [2024-07-15 09:06:12.047169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.047289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.047313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.633 qpair failed and we were unable to recover it. 00:27:23.633 [2024-07-15 09:06:12.047448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.047565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.047590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.633 qpair failed and we were unable to recover it. 00:27:23.633 [2024-07-15 09:06:12.047728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.047835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.047859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.633 qpair failed and we were unable to recover it. 00:27:23.633 [2024-07-15 09:06:12.048009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.048152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.048176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.633 qpair failed and we were unable to recover it. 00:27:23.633 [2024-07-15 09:06:12.048283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.048434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.048457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.633 qpair failed and we were unable to recover it. 00:27:23.633 [2024-07-15 09:06:12.048593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.048705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.048735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.633 qpair failed and we were unable to recover it. 00:27:23.633 [2024-07-15 09:06:12.048897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.049008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.049035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.633 qpair failed and we were unable to recover it. 00:27:23.633 [2024-07-15 09:06:12.049151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.049273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.049297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.633 qpair failed and we were unable to recover it. 00:27:23.633 [2024-07-15 09:06:12.049440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.049553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.049577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.633 qpair failed and we were unable to recover it. 00:27:23.633 [2024-07-15 09:06:12.049715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.049820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.049843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.633 qpair failed and we were unable to recover it. 00:27:23.633 [2024-07-15 09:06:12.049968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.050085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.050110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.633 qpair failed and we were unable to recover it. 00:27:23.633 [2024-07-15 09:06:12.050223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.050330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.050354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.633 qpair failed and we were unable to recover it. 00:27:23.633 [2024-07-15 09:06:12.050489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.050629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.633 [2024-07-15 09:06:12.050653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.634 qpair failed and we were unable to recover it. 00:27:23.634 [2024-07-15 09:06:12.050798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.050918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.050949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.634 qpair failed and we were unable to recover it. 00:27:23.634 [2024-07-15 09:06:12.051094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.051205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.051231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.634 qpair failed and we were unable to recover it. 00:27:23.634 [2024-07-15 09:06:12.051382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.051495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.051524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.634 qpair failed and we were unable to recover it. 00:27:23.634 [2024-07-15 09:06:12.051640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.051760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.051784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.634 qpair failed and we were unable to recover it. 00:27:23.634 [2024-07-15 09:06:12.051904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.052015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.052040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.634 qpair failed and we were unable to recover it. 00:27:23.634 [2024-07-15 09:06:12.052161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.052288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.052313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.634 qpair failed and we were unable to recover it. 00:27:23.634 [2024-07-15 09:06:12.052439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.052583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.052609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.634 qpair failed and we were unable to recover it. 00:27:23.634 [2024-07-15 09:06:12.052750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.052890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.052914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.634 qpair failed and we were unable to recover it. 00:27:23.634 [2024-07-15 09:06:12.053024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.053147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.053171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.634 qpair failed and we were unable to recover it. 00:27:23.634 [2024-07-15 09:06:12.053290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.053433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.053457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.634 qpair failed and we were unable to recover it. 00:27:23.634 [2024-07-15 09:06:12.053593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.053705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.053730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.634 qpair failed and we were unable to recover it. 00:27:23.634 [2024-07-15 09:06:12.053848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.054004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.054030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.634 qpair failed and we were unable to recover it. 00:27:23.634 [2024-07-15 09:06:12.054153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.054356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.054385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.634 qpair failed and we were unable to recover it. 00:27:23.634 [2024-07-15 09:06:12.054504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.054613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.054637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.634 qpair failed and we were unable to recover it. 00:27:23.634 [2024-07-15 09:06:12.054754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.054924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.054956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.634 qpair failed and we were unable to recover it. 00:27:23.634 [2024-07-15 09:06:12.055074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.055186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.055211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.634 qpair failed and we were unable to recover it. 00:27:23.634 [2024-07-15 09:06:12.055363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.055504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.055529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.634 qpair failed and we were unable to recover it. 00:27:23.634 [2024-07-15 09:06:12.055677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.055788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.055812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.634 qpair failed and we were unable to recover it. 00:27:23.634 [2024-07-15 09:06:12.055932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.056071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.056096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.634 qpair failed and we were unable to recover it. 00:27:23.634 [2024-07-15 09:06:12.056284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.056420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.056444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.634 qpair failed and we were unable to recover it. 00:27:23.634 [2024-07-15 09:06:12.056595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.056712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.056736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.634 qpair failed and we were unable to recover it. 00:27:23.634 [2024-07-15 09:06:12.056874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.057024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.057049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.634 qpair failed and we were unable to recover it. 00:27:23.634 [2024-07-15 09:06:12.057168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.057289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.057314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.634 qpair failed and we were unable to recover it. 00:27:23.634 [2024-07-15 09:06:12.057439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.057577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.057602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.634 qpair failed and we were unable to recover it. 00:27:23.634 [2024-07-15 09:06:12.057751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.057869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.057898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.634 qpair failed and we were unable to recover it. 00:27:23.634 [2024-07-15 09:06:12.058061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.058179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.058204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.634 qpair failed and we were unable to recover it. 00:27:23.634 [2024-07-15 09:06:12.058322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.058442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.058466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.634 qpair failed and we were unable to recover it. 00:27:23.634 [2024-07-15 09:06:12.058615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.058725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.058749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.634 qpair failed and we were unable to recover it. 00:27:23.634 [2024-07-15 09:06:12.058864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.059021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.059047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.634 qpair failed and we were unable to recover it. 00:27:23.634 [2024-07-15 09:06:12.059256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.059398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.634 [2024-07-15 09:06:12.059423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.634 qpair failed and we were unable to recover it. 00:27:23.635 [2024-07-15 09:06:12.059565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.059679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.059704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.635 qpair failed and we were unable to recover it. 00:27:23.635 [2024-07-15 09:06:12.059890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.060026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.060052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.635 qpair failed and we were unable to recover it. 00:27:23.635 [2024-07-15 09:06:12.060194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.060321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.060345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.635 qpair failed and we were unable to recover it. 00:27:23.635 [2024-07-15 09:06:12.060500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.060615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.060640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.635 qpair failed and we were unable to recover it. 00:27:23.635 [2024-07-15 09:06:12.060826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.060994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.061019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.635 qpair failed and we were unable to recover it. 00:27:23.635 [2024-07-15 09:06:12.061137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.061288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.061314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.635 qpair failed and we were unable to recover it. 00:27:23.635 [2024-07-15 09:06:12.061429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.061544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.061570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.635 qpair failed and we were unable to recover it. 00:27:23.635 [2024-07-15 09:06:12.061718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.061828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.061853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.635 qpair failed and we were unable to recover it. 00:27:23.635 [2024-07-15 09:06:12.062046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.062186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.062210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.635 qpair failed and we were unable to recover it. 00:27:23.635 [2024-07-15 09:06:12.062318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.062430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.062455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.635 qpair failed and we were unable to recover it. 00:27:23.635 [2024-07-15 09:06:12.062694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.062896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.062921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.635 qpair failed and we were unable to recover it. 00:27:23.635 [2024-07-15 09:06:12.063047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.063159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.063184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.635 qpair failed and we were unable to recover it. 00:27:23.635 [2024-07-15 09:06:12.063362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.063469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.063494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.635 qpair failed and we were unable to recover it. 00:27:23.635 [2024-07-15 09:06:12.063613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.063851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.063883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.635 qpair failed and we were unable to recover it. 00:27:23.635 [2024-07-15 09:06:12.064036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.064173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.064198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.635 qpair failed and we were unable to recover it. 00:27:23.635 [2024-07-15 09:06:12.064325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.064442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.064467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.635 qpair failed and we were unable to recover it. 00:27:23.635 [2024-07-15 09:06:12.064580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.064703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.064728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.635 qpair failed and we were unable to recover it. 00:27:23.635 [2024-07-15 09:06:12.064871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.065051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.065076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.635 qpair failed and we were unable to recover it. 00:27:23.635 [2024-07-15 09:06:12.065189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.065330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.065355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.635 qpair failed and we were unable to recover it. 00:27:23.635 [2024-07-15 09:06:12.065476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.065595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.065621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.635 qpair failed and we were unable to recover it. 00:27:23.635 [2024-07-15 09:06:12.065771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.065892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.065918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.635 qpair failed and we were unable to recover it. 00:27:23.635 [2024-07-15 09:06:12.066040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.066183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.066209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.635 qpair failed and we were unable to recover it. 00:27:23.635 [2024-07-15 09:06:12.066320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.066457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.066482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.635 qpair failed and we were unable to recover it. 00:27:23.635 [2024-07-15 09:06:12.066604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.066730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.066755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.635 qpair failed and we were unable to recover it. 00:27:23.635 [2024-07-15 09:06:12.066892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.067073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.067098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.635 qpair failed and we were unable to recover it. 00:27:23.635 [2024-07-15 09:06:12.067213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.067355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.067380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.635 qpair failed and we were unable to recover it. 00:27:23.635 [2024-07-15 09:06:12.067494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.067638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.067664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.635 qpair failed and we were unable to recover it. 00:27:23.635 [2024-07-15 09:06:12.067784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.067952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.067978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.635 qpair failed and we were unable to recover it. 00:27:23.635 [2024-07-15 09:06:12.068089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.068204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.068229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.635 qpair failed and we were unable to recover it. 00:27:23.635 [2024-07-15 09:06:12.068349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.068458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.635 [2024-07-15 09:06:12.068483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.635 qpair failed and we were unable to recover it. 00:27:23.636 [2024-07-15 09:06:12.068596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.068744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.068768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.636 qpair failed and we were unable to recover it. 00:27:23.636 [2024-07-15 09:06:12.068881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.069027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.069051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.636 qpair failed and we were unable to recover it. 00:27:23.636 [2024-07-15 09:06:12.069200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.069335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.069361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.636 qpair failed and we were unable to recover it. 00:27:23.636 [2024-07-15 09:06:12.069495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.069666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.069691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.636 qpair failed and we were unable to recover it. 00:27:23.636 [2024-07-15 09:06:12.069837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.069957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.069982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.636 qpair failed and we were unable to recover it. 00:27:23.636 [2024-07-15 09:06:12.070104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.070251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.070275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.636 qpair failed and we were unable to recover it. 00:27:23.636 [2024-07-15 09:06:12.070395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.070537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.070561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.636 qpair failed and we were unable to recover it. 00:27:23.636 [2024-07-15 09:06:12.070711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.070835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.070859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.636 qpair failed and we were unable to recover it. 00:27:23.636 [2024-07-15 09:06:12.071016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.071129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.071155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.636 qpair failed and we were unable to recover it. 00:27:23.636 [2024-07-15 09:06:12.071302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.071414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.071439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.636 qpair failed and we were unable to recover it. 00:27:23.636 [2024-07-15 09:06:12.071552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.071694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.071718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.636 qpair failed and we were unable to recover it. 00:27:23.636 [2024-07-15 09:06:12.071857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.072016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.072043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.636 qpair failed and we were unable to recover it. 00:27:23.636 [2024-07-15 09:06:12.072156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 Malloc0 00:27:23.636 [2024-07-15 09:06:12.072275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.072300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.636 qpair failed and we were unable to recover it. 00:27:23.636 [2024-07-15 09:06:12.072425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.072543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.072567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.636 qpair failed and we were unable to recover it. 00:27:23.636 09:06:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:23.636 [2024-07-15 09:06:12.072705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 09:06:12 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:27:23.636 [2024-07-15 09:06:12.072852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.072884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.636 qpair failed and we were unable to recover it. 00:27:23.636 09:06:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:23.636 [2024-07-15 09:06:12.073022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 09:06:12 -- common/autotest_common.sh@10 -- # set +x 00:27:23.636 [2024-07-15 09:06:12.073145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.073172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.636 qpair failed and we were unable to recover it. 00:27:23.636 [2024-07-15 09:06:12.073285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.073436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.073460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.636 qpair failed and we were unable to recover it. 00:27:23.636 [2024-07-15 09:06:12.073578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.073717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.073742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.636 qpair failed and we were unable to recover it. 00:27:23.636 [2024-07-15 09:06:12.073896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.074032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.074057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.636 qpair failed and we were unable to recover it. 00:27:23.636 [2024-07-15 09:06:12.074185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.074331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.074356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.636 qpair failed and we were unable to recover it. 00:27:23.636 [2024-07-15 09:06:12.074473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.074616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.074641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.636 qpair failed and we were unable to recover it. 00:27:23.636 [2024-07-15 09:06:12.074784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.074906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.074940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.636 qpair failed and we were unable to recover it. 00:27:23.636 [2024-07-15 09:06:12.075071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.075213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.075237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.636 qpair failed and we were unable to recover it. 00:27:23.636 [2024-07-15 09:06:12.075353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.075498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.075523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.636 qpair failed and we were unable to recover it. 00:27:23.636 [2024-07-15 09:06:12.075629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.075739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.075764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.636 qpair failed and we were unable to recover it. 00:27:23.636 [2024-07-15 09:06:12.075902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.076031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.076040] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:23.636 [2024-07-15 09:06:12.076056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.636 qpair failed and we were unable to recover it. 00:27:23.636 [2024-07-15 09:06:12.076174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.076301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.076325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.636 qpair failed and we were unable to recover it. 00:27:23.636 [2024-07-15 09:06:12.076436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.076559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.076584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.636 qpair failed and we were unable to recover it. 00:27:23.636 [2024-07-15 09:06:12.076758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.076898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.636 [2024-07-15 09:06:12.076932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.637 qpair failed and we were unable to recover it. 00:27:23.637 [2024-07-15 09:06:12.077054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.077171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.077195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.637 qpair failed and we were unable to recover it. 00:27:23.637 [2024-07-15 09:06:12.077318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.077472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.077496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.637 qpair failed and we were unable to recover it. 00:27:23.637 [2024-07-15 09:06:12.077636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.077757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.077782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.637 qpair failed and we were unable to recover it. 00:27:23.637 [2024-07-15 09:06:12.077897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.078026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.078052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.637 qpair failed and we were unable to recover it. 00:27:23.637 [2024-07-15 09:06:12.078162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.078306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.078331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.637 qpair failed and we were unable to recover it. 00:27:23.637 [2024-07-15 09:06:12.078468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.078614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.078638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.637 qpair failed and we were unable to recover it. 00:27:23.637 [2024-07-15 09:06:12.078792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.078908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.078943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.637 qpair failed and we were unable to recover it. 00:27:23.637 [2024-07-15 09:06:12.079069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.079207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.079231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.637 qpair failed and we were unable to recover it. 00:27:23.637 [2024-07-15 09:06:12.079343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.079451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.079476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.637 qpair failed and we were unable to recover it. 00:27:23.637 [2024-07-15 09:06:12.079582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.079693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.079717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.637 qpair failed and we were unable to recover it. 00:27:23.637 [2024-07-15 09:06:12.079843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.079980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.080004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.637 qpair failed and we were unable to recover it. 00:27:23.637 [2024-07-15 09:06:12.080148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.080273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.080299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.637 qpair failed and we were unable to recover it. 00:27:23.637 [2024-07-15 09:06:12.080427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.080548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.080572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.637 qpair failed and we were unable to recover it. 00:27:23.637 [2024-07-15 09:06:12.080694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.080830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.080856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.637 qpair failed and we were unable to recover it. 00:27:23.637 [2024-07-15 09:06:12.080994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.081113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.081139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.637 qpair failed and we were unable to recover it. 00:27:23.637 [2024-07-15 09:06:12.081288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.081399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.081424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.637 qpair failed and we were unable to recover it. 00:27:23.637 [2024-07-15 09:06:12.081568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.081686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.081711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.637 qpair failed and we were unable to recover it. 00:27:23.637 [2024-07-15 09:06:12.081827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.081941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.081965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.637 qpair failed and we were unable to recover it. 00:27:23.637 [2024-07-15 09:06:12.082096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.082237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.082261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.637 qpair failed and we were unable to recover it. 00:27:23.637 [2024-07-15 09:06:12.082404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.082525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.082549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.637 qpair failed and we were unable to recover it. 00:27:23.637 [2024-07-15 09:06:12.082676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.082797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.082821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.637 qpair failed and we were unable to recover it. 00:27:23.637 [2024-07-15 09:06:12.082938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.083089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.083114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.637 qpair failed and we were unable to recover it. 00:27:23.637 [2024-07-15 09:06:12.083255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.083362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.083387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.637 qpair failed and we were unable to recover it. 00:27:23.637 [2024-07-15 09:06:12.083499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.083645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.083670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.637 qpair failed and we were unable to recover it. 00:27:23.637 [2024-07-15 09:06:12.083782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.083895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.083928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.637 qpair failed and we were unable to recover it. 00:27:23.637 [2024-07-15 09:06:12.084049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.084185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.084210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.637 qpair failed and we were unable to recover it. 00:27:23.637 09:06:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:23.637 [2024-07-15 09:06:12.084349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 09:06:12 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:23.637 [2024-07-15 09:06:12.084467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.084491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.637 09:06:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:23.637 qpair failed and we were unable to recover it. 00:27:23.637 [2024-07-15 09:06:12.084607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 09:06:12 -- common/autotest_common.sh@10 -- # set +x 00:27:23.637 [2024-07-15 09:06:12.084722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.084746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.637 qpair failed and we were unable to recover it. 00:27:23.637 [2024-07-15 09:06:12.084862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.084993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.085018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.637 qpair failed and we were unable to recover it. 00:27:23.637 [2024-07-15 09:06:12.085141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.637 [2024-07-15 09:06:12.085264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.085288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.638 qpair failed and we were unable to recover it. 00:27:23.638 [2024-07-15 09:06:12.085411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.085548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.085572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.638 qpair failed and we were unable to recover it. 00:27:23.638 [2024-07-15 09:06:12.085719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.085826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.085851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.638 qpair failed and we were unable to recover it. 00:27:23.638 [2024-07-15 09:06:12.085990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.086109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.086139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.638 qpair failed and we were unable to recover it. 00:27:23.638 [2024-07-15 09:06:12.086268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.086375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.086400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.638 qpair failed and we were unable to recover it. 00:27:23.638 [2024-07-15 09:06:12.086525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.086653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.086678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.638 qpair failed and we were unable to recover it. 00:27:23.638 [2024-07-15 09:06:12.086785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.086921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.086946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.638 qpair failed and we were unable to recover it. 00:27:23.638 [2024-07-15 09:06:12.087071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.087190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.087215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.638 qpair failed and we were unable to recover it. 00:27:23.638 [2024-07-15 09:06:12.087357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.087471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.087495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.638 qpair failed and we were unable to recover it. 00:27:23.638 [2024-07-15 09:06:12.087607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.087743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.087768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.638 qpair failed and we were unable to recover it. 00:27:23.638 [2024-07-15 09:06:12.087891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.088043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.088068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.638 qpair failed and we were unable to recover it. 00:27:23.638 [2024-07-15 09:06:12.088189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.088327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.088351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.638 qpair failed and we were unable to recover it. 00:27:23.638 [2024-07-15 09:06:12.088497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.088611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.088635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.638 qpair failed and we were unable to recover it. 00:27:23.638 [2024-07-15 09:06:12.088769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.088910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.088935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.638 qpair failed and we were unable to recover it. 00:27:23.638 [2024-07-15 09:06:12.089062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.089184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.089208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.638 qpair failed and we were unable to recover it. 00:27:23.638 [2024-07-15 09:06:12.089356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.089497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.089521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.638 qpair failed and we were unable to recover it. 00:27:23.638 [2024-07-15 09:06:12.089672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.089815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.089839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.638 qpair failed and we were unable to recover it. 00:27:23.638 [2024-07-15 09:06:12.089987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.090128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.090153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.638 qpair failed and we were unable to recover it. 00:27:23.638 [2024-07-15 09:06:12.090270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.090391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.090415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.638 qpair failed and we were unable to recover it. 00:27:23.638 [2024-07-15 09:06:12.090555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.090669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.090693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.638 qpair failed and we were unable to recover it. 00:27:23.638 [2024-07-15 09:06:12.090841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.090960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.090985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.638 qpair failed and we were unable to recover it. 00:27:23.638 [2024-07-15 09:06:12.091109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.091231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.091256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.638 qpair failed and we were unable to recover it. 00:27:23.638 [2024-07-15 09:06:12.091397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.091533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.091557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.638 qpair failed and we were unable to recover it. 00:27:23.638 [2024-07-15 09:06:12.091665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.091803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.091828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.638 qpair failed and we were unable to recover it. 00:27:23.638 [2024-07-15 09:06:12.091966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.092089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 [2024-07-15 09:06:12.092113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.638 qpair failed and we were unable to recover it. 00:27:23.638 09:06:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:23.638 [2024-07-15 09:06:12.092226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.638 09:06:12 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:23.639 [2024-07-15 09:06:12.092344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.092369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.639 qpair failed and we were unable to recover it. 00:27:23.639 09:06:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:23.639 [2024-07-15 09:06:12.092484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 09:06:12 -- common/autotest_common.sh@10 -- # set +x 00:27:23.639 [2024-07-15 09:06:12.092605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.092630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.639 qpair failed and we were unable to recover it. 00:27:23.639 [2024-07-15 09:06:12.092776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.092902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.092927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.639 qpair failed and we were unable to recover it. 00:27:23.639 [2024-07-15 09:06:12.093051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.093166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.093191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.639 qpair failed and we were unable to recover it. 00:27:23.639 [2024-07-15 09:06:12.093315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.093441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.093465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.639 qpair failed and we were unable to recover it. 00:27:23.639 [2024-07-15 09:06:12.093605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.093721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.093747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.639 qpair failed and we were unable to recover it. 00:27:23.639 [2024-07-15 09:06:12.093866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.093998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.094023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.639 qpair failed and we were unable to recover it. 00:27:23.639 [2024-07-15 09:06:12.094130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.094250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.094275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.639 qpair failed and we were unable to recover it. 00:27:23.639 [2024-07-15 09:06:12.094392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.094536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.094562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.639 qpair failed and we were unable to recover it. 00:27:23.639 [2024-07-15 09:06:12.094686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.094806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.094832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.639 qpair failed and we were unable to recover it. 00:27:23.639 [2024-07-15 09:06:12.094954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.095072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.095098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.639 qpair failed and we were unable to recover it. 00:27:23.639 [2024-07-15 09:06:12.095221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.095338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.095363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.639 qpair failed and we were unable to recover it. 00:27:23.639 [2024-07-15 09:06:12.095509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.095620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.095645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.639 qpair failed and we were unable to recover it. 00:27:23.639 [2024-07-15 09:06:12.095759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.095880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.095905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.639 qpair failed and we were unable to recover it. 00:27:23.639 [2024-07-15 09:06:12.096033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.096153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.096178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.639 qpair failed and we were unable to recover it. 00:27:23.639 [2024-07-15 09:06:12.096290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.096414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.096439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.639 qpair failed and we were unable to recover it. 00:27:23.639 [2024-07-15 09:06:12.096562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.096666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.096690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.639 qpair failed and we were unable to recover it. 00:27:23.639 [2024-07-15 09:06:12.096829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.096976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.097001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.639 qpair failed and we were unable to recover it. 00:27:23.639 [2024-07-15 09:06:12.097116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.097262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.097286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.639 qpair failed and we were unable to recover it. 00:27:23.639 [2024-07-15 09:06:12.097401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.097542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.097566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.639 qpair failed and we were unable to recover it. 00:27:23.639 [2024-07-15 09:06:12.097720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.097862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.097891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.639 qpair failed and we were unable to recover it. 00:27:23.639 [2024-07-15 09:06:12.098006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.098174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.098199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.639 qpair failed and we were unable to recover it. 00:27:23.639 [2024-07-15 09:06:12.098321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.098462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.098487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.639 qpair failed and we were unable to recover it. 00:27:23.639 [2024-07-15 09:06:12.098606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.098779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.098804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.639 qpair failed and we were unable to recover it. 00:27:23.639 [2024-07-15 09:06:12.098926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.099051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.099075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.639 qpair failed and we were unable to recover it. 00:27:23.639 [2024-07-15 09:06:12.099196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.099313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.099337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.639 qpair failed and we were unable to recover it. 00:27:23.639 [2024-07-15 09:06:12.099452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.099573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.099598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.639 qpair failed and we were unable to recover it. 00:27:23.639 [2024-07-15 09:06:12.099743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.099858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.099890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.639 qpair failed and we were unable to recover it. 00:27:23.639 [2024-07-15 09:06:12.100013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.100132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 [2024-07-15 09:06:12.100157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.639 qpair failed and we were unable to recover it. 00:27:23.639 09:06:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:23.639 [2024-07-15 09:06:12.100289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.639 09:06:12 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:23.639 [2024-07-15 09:06:12.100427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.640 [2024-07-15 09:06:12.100451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.640 qpair failed and we were unable to recover it. 00:27:23.640 09:06:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:23.640 [2024-07-15 09:06:12.100577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.640 09:06:12 -- common/autotest_common.sh@10 -- # set +x 00:27:23.640 [2024-07-15 09:06:12.100724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.640 [2024-07-15 09:06:12.100749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.640 qpair failed and we were unable to recover it. 00:27:23.640 [2024-07-15 09:06:12.100860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.640 [2024-07-15 09:06:12.100984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.640 [2024-07-15 09:06:12.101009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.640 qpair failed and we were unable to recover it. 00:27:23.640 [2024-07-15 09:06:12.101155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.640 [2024-07-15 09:06:12.101275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.640 [2024-07-15 09:06:12.101300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.640 qpair failed and we were unable to recover it. 00:27:23.640 [2024-07-15 09:06:12.101435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.640 [2024-07-15 09:06:12.101559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.640 [2024-07-15 09:06:12.101584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.640 qpair failed and we were unable to recover it. 00:27:23.640 [2024-07-15 09:06:12.101700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.640 [2024-07-15 09:06:12.101822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.640 [2024-07-15 09:06:12.101847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.640 qpair failed and we were unable to recover it. 00:27:23.640 [2024-07-15 09:06:12.101993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.640 [2024-07-15 09:06:12.102108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.640 [2024-07-15 09:06:12.102133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.640 qpair failed and we were unable to recover it. 00:27:23.640 [2024-07-15 09:06:12.102290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.640 [2024-07-15 09:06:12.102429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.640 [2024-07-15 09:06:12.102454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.640 qpair failed and we were unable to recover it. 00:27:23.640 [2024-07-15 09:06:12.102560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.640 [2024-07-15 09:06:12.102669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.640 [2024-07-15 09:06:12.102700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.640 qpair failed and we were unable to recover it. 00:27:23.640 [2024-07-15 09:06:12.102995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.640 [2024-07-15 09:06:12.103137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.640 [2024-07-15 09:06:12.103162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.640 qpair failed and we were unable to recover it. 00:27:23.640 [2024-07-15 09:06:12.103286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.640 [2024-07-15 09:06:12.103418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.640 [2024-07-15 09:06:12.103443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.640 qpair failed and we were unable to recover it. 00:27:23.640 [2024-07-15 09:06:12.103607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.640 [2024-07-15 09:06:12.103738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.640 [2024-07-15 09:06:12.103764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.640 qpair failed and we were unable to recover it. 00:27:23.640 [2024-07-15 09:06:12.103900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.640 [2024-07-15 09:06:12.104014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.640 [2024-07-15 09:06:12.104040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f56f0000b90 with addr=10.0.0.2, port=4420 00:27:23.640 qpair failed and we were unable to recover it. 00:27:23.640 [2024-07-15 09:06:12.104216] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:23.640 [2024-07-15 09:06:12.106726] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:23.640 [2024-07-15 09:06:12.106894] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:23.640 [2024-07-15 09:06:12.106921] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:23.640 [2024-07-15 09:06:12.106936] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:23.640 [2024-07-15 09:06:12.106948] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:23.640 [2024-07-15 09:06:12.106982] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:23.640 qpair failed and we were unable to recover it. 00:27:23.640 09:06:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:23.640 09:06:12 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:23.640 09:06:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:23.640 09:06:12 -- common/autotest_common.sh@10 -- # set +x 00:27:23.640 09:06:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:23.640 09:06:12 -- host/target_disconnect.sh@58 -- # wait 1620766 00:27:23.640 [2024-07-15 09:06:12.116674] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:23.640 [2024-07-15 09:06:12.116802] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:23.640 [2024-07-15 09:06:12.116839] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:23.640 [2024-07-15 09:06:12.116854] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:23.640 [2024-07-15 09:06:12.116866] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:23.640 [2024-07-15 09:06:12.116905] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:23.640 qpair failed and we were unable to recover it. 00:27:23.640 [2024-07-15 09:06:12.126643] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:23.640 [2024-07-15 09:06:12.126775] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:23.640 [2024-07-15 09:06:12.126802] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:23.640 [2024-07-15 09:06:12.126822] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:23.640 [2024-07-15 09:06:12.126837] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:23.640 [2024-07-15 09:06:12.126882] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:23.640 qpair failed and we were unable to recover it. 00:27:23.899 [2024-07-15 09:06:12.136657] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:23.899 [2024-07-15 09:06:12.136798] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:23.899 [2024-07-15 09:06:12.136825] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:23.899 [2024-07-15 09:06:12.136840] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:23.899 [2024-07-15 09:06:12.136853] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:23.899 [2024-07-15 09:06:12.136896] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:23.899 qpair failed and we were unable to recover it. 00:27:23.899 [2024-07-15 09:06:12.146632] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:23.899 [2024-07-15 09:06:12.146762] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:23.899 [2024-07-15 09:06:12.146789] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:23.899 [2024-07-15 09:06:12.146804] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:23.899 [2024-07-15 09:06:12.146819] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:23.899 [2024-07-15 09:06:12.146849] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:23.900 qpair failed and we were unable to recover it. 00:27:23.900 [2024-07-15 09:06:12.156634] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:23.900 [2024-07-15 09:06:12.156757] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:23.900 [2024-07-15 09:06:12.156784] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:23.900 [2024-07-15 09:06:12.156799] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:23.900 [2024-07-15 09:06:12.156813] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:23.900 [2024-07-15 09:06:12.156843] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:23.900 qpair failed and we were unable to recover it. 00:27:23.900 [2024-07-15 09:06:12.166640] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:23.900 [2024-07-15 09:06:12.166760] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:23.900 [2024-07-15 09:06:12.166791] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:23.900 [2024-07-15 09:06:12.166807] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:23.900 [2024-07-15 09:06:12.166821] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:23.900 [2024-07-15 09:06:12.166850] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:23.900 qpair failed and we were unable to recover it. 00:27:23.900 [2024-07-15 09:06:12.176713] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:23.900 [2024-07-15 09:06:12.176848] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:23.900 [2024-07-15 09:06:12.176874] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:23.900 [2024-07-15 09:06:12.176898] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:23.900 [2024-07-15 09:06:12.176911] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:23.900 [2024-07-15 09:06:12.176941] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:23.900 qpair failed and we were unable to recover it. 00:27:23.900 [2024-07-15 09:06:12.186720] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:23.900 [2024-07-15 09:06:12.186848] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:23.900 [2024-07-15 09:06:12.186873] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:23.900 [2024-07-15 09:06:12.186898] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:23.900 [2024-07-15 09:06:12.186912] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:23.900 [2024-07-15 09:06:12.186942] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:23.900 qpair failed and we were unable to recover it. 00:27:23.900 [2024-07-15 09:06:12.196760] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:23.900 [2024-07-15 09:06:12.196892] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:23.900 [2024-07-15 09:06:12.196918] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:23.900 [2024-07-15 09:06:12.196932] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:23.900 [2024-07-15 09:06:12.196945] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:23.900 [2024-07-15 09:06:12.196975] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:23.900 qpair failed and we were unable to recover it. 00:27:23.900 [2024-07-15 09:06:12.206748] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:23.900 [2024-07-15 09:06:12.206869] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:23.900 [2024-07-15 09:06:12.206903] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:23.900 [2024-07-15 09:06:12.206918] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:23.900 [2024-07-15 09:06:12.206931] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:23.900 [2024-07-15 09:06:12.206968] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:23.900 qpair failed and we were unable to recover it. 00:27:23.900 [2024-07-15 09:06:12.216782] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:23.900 [2024-07-15 09:06:12.216931] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:23.900 [2024-07-15 09:06:12.216957] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:23.900 [2024-07-15 09:06:12.216972] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:23.900 [2024-07-15 09:06:12.216986] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:23.900 [2024-07-15 09:06:12.217018] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:23.900 qpair failed and we were unable to recover it. 00:27:23.900 [2024-07-15 09:06:12.226838] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:23.900 [2024-07-15 09:06:12.226981] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:23.900 [2024-07-15 09:06:12.227007] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:23.900 [2024-07-15 09:06:12.227025] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:23.900 [2024-07-15 09:06:12.227039] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:23.900 [2024-07-15 09:06:12.227069] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:23.900 qpair failed and we were unable to recover it. 00:27:23.900 [2024-07-15 09:06:12.236855] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:23.900 [2024-07-15 09:06:12.237001] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:23.900 [2024-07-15 09:06:12.237027] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:23.900 [2024-07-15 09:06:12.237042] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:23.900 [2024-07-15 09:06:12.237055] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:23.900 [2024-07-15 09:06:12.237086] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:23.900 qpair failed and we were unable to recover it. 00:27:23.900 [2024-07-15 09:06:12.246905] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:23.900 [2024-07-15 09:06:12.247025] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:23.900 [2024-07-15 09:06:12.247051] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:23.900 [2024-07-15 09:06:12.247065] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:23.900 [2024-07-15 09:06:12.247079] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:23.900 [2024-07-15 09:06:12.247110] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:23.900 qpair failed and we were unable to recover it. 00:27:23.900 [2024-07-15 09:06:12.256929] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:23.900 [2024-07-15 09:06:12.257058] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:23.900 [2024-07-15 09:06:12.257091] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:23.900 [2024-07-15 09:06:12.257109] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:23.900 [2024-07-15 09:06:12.257123] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:23.900 [2024-07-15 09:06:12.257154] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:23.900 qpair failed and we were unable to recover it. 00:27:23.900 [2024-07-15 09:06:12.267059] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:23.900 [2024-07-15 09:06:12.267195] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:23.900 [2024-07-15 09:06:12.267221] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:23.900 [2024-07-15 09:06:12.267236] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:23.900 [2024-07-15 09:06:12.267253] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:23.900 [2024-07-15 09:06:12.267282] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:23.900 qpair failed and we were unable to recover it. 00:27:23.900 [2024-07-15 09:06:12.277020] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:23.900 [2024-07-15 09:06:12.277189] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:23.900 [2024-07-15 09:06:12.277215] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:23.900 [2024-07-15 09:06:12.277230] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:23.900 [2024-07-15 09:06:12.277243] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:23.900 [2024-07-15 09:06:12.277273] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:23.900 qpair failed and we were unable to recover it. 00:27:23.900 [2024-07-15 09:06:12.287048] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:23.900 [2024-07-15 09:06:12.287169] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:23.900 [2024-07-15 09:06:12.287195] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:23.900 [2024-07-15 09:06:12.287210] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:23.900 [2024-07-15 09:06:12.287224] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:23.900 [2024-07-15 09:06:12.287253] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:23.900 qpair failed and we were unable to recover it. 00:27:23.900 [2024-07-15 09:06:12.297055] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:23.900 [2024-07-15 09:06:12.297192] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:23.901 [2024-07-15 09:06:12.297217] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:23.901 [2024-07-15 09:06:12.297232] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:23.901 [2024-07-15 09:06:12.297246] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:23.901 [2024-07-15 09:06:12.297285] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:23.901 qpair failed and we were unable to recover it. 00:27:23.901 [2024-07-15 09:06:12.307093] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:23.901 [2024-07-15 09:06:12.307226] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:23.901 [2024-07-15 09:06:12.307252] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:23.901 [2024-07-15 09:06:12.307266] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:23.901 [2024-07-15 09:06:12.307282] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:23.901 [2024-07-15 09:06:12.307313] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:23.901 qpair failed and we were unable to recover it. 00:27:23.901 [2024-07-15 09:06:12.317117] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:23.901 [2024-07-15 09:06:12.317238] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:23.901 [2024-07-15 09:06:12.317264] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:23.901 [2024-07-15 09:06:12.317279] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:23.901 [2024-07-15 09:06:12.317292] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:23.901 [2024-07-15 09:06:12.317322] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:23.901 qpair failed and we were unable to recover it. 00:27:23.901 [2024-07-15 09:06:12.327130] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:23.901 [2024-07-15 09:06:12.327263] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:23.901 [2024-07-15 09:06:12.327288] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:23.901 [2024-07-15 09:06:12.327304] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:23.901 [2024-07-15 09:06:12.327318] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:23.901 [2024-07-15 09:06:12.327355] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:23.901 qpair failed and we were unable to recover it. 00:27:23.901 [2024-07-15 09:06:12.337144] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:23.901 [2024-07-15 09:06:12.337285] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:23.901 [2024-07-15 09:06:12.337311] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:23.901 [2024-07-15 09:06:12.337326] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:23.901 [2024-07-15 09:06:12.337339] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:23.901 [2024-07-15 09:06:12.337369] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:23.901 qpair failed and we were unable to recover it. 00:27:23.901 [2024-07-15 09:06:12.347165] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:23.901 [2024-07-15 09:06:12.347296] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:23.901 [2024-07-15 09:06:12.347322] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:23.901 [2024-07-15 09:06:12.347337] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:23.901 [2024-07-15 09:06:12.347350] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:23.901 [2024-07-15 09:06:12.347380] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:23.901 qpair failed and we were unable to recover it. 00:27:23.901 [2024-07-15 09:06:12.357254] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:23.901 [2024-07-15 09:06:12.357389] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:23.901 [2024-07-15 09:06:12.357415] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:23.901 [2024-07-15 09:06:12.357430] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:23.901 [2024-07-15 09:06:12.357444] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:23.901 [2024-07-15 09:06:12.357487] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:23.901 qpair failed and we were unable to recover it. 00:27:23.901 [2024-07-15 09:06:12.367229] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:23.901 [2024-07-15 09:06:12.367359] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:23.901 [2024-07-15 09:06:12.367385] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:23.901 [2024-07-15 09:06:12.367400] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:23.901 [2024-07-15 09:06:12.367414] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:23.901 [2024-07-15 09:06:12.367444] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:23.901 qpair failed and we were unable to recover it. 00:27:23.901 [2024-07-15 09:06:12.377237] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:23.901 [2024-07-15 09:06:12.377362] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:23.901 [2024-07-15 09:06:12.377387] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:23.901 [2024-07-15 09:06:12.377402] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:23.901 [2024-07-15 09:06:12.377416] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:23.901 [2024-07-15 09:06:12.377447] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:23.901 qpair failed and we were unable to recover it. 00:27:23.901 [2024-07-15 09:06:12.387330] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:23.901 [2024-07-15 09:06:12.387466] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:23.901 [2024-07-15 09:06:12.387492] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:23.901 [2024-07-15 09:06:12.387511] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:23.901 [2024-07-15 09:06:12.387530] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:23.901 [2024-07-15 09:06:12.387562] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:23.901 qpair failed and we were unable to recover it. 00:27:23.901 [2024-07-15 09:06:12.397304] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:23.901 [2024-07-15 09:06:12.397431] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:23.901 [2024-07-15 09:06:12.397456] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:23.901 [2024-07-15 09:06:12.397471] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:23.901 [2024-07-15 09:06:12.397485] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:23.901 [2024-07-15 09:06:12.397515] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:23.901 qpair failed and we were unable to recover it. 00:27:23.901 [2024-07-15 09:06:12.407341] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:23.901 [2024-07-15 09:06:12.407499] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:23.901 [2024-07-15 09:06:12.407531] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:23.901 [2024-07-15 09:06:12.407547] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:23.901 [2024-07-15 09:06:12.407561] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:23.901 [2024-07-15 09:06:12.407590] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:23.901 qpair failed and we were unable to recover it. 00:27:23.901 [2024-07-15 09:06:12.417361] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:23.901 [2024-07-15 09:06:12.417492] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:23.901 [2024-07-15 09:06:12.417518] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:23.901 [2024-07-15 09:06:12.417532] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:23.901 [2024-07-15 09:06:12.417546] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:23.901 [2024-07-15 09:06:12.417576] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:23.901 qpair failed and we were unable to recover it. 00:27:23.901 [2024-07-15 09:06:12.427400] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:23.901 [2024-07-15 09:06:12.427521] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:23.901 [2024-07-15 09:06:12.427546] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:23.901 [2024-07-15 09:06:12.427561] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:23.901 [2024-07-15 09:06:12.427575] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:23.901 [2024-07-15 09:06:12.427605] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:23.901 qpair failed and we were unable to recover it. 00:27:23.901 [2024-07-15 09:06:12.437413] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:23.901 [2024-07-15 09:06:12.437542] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:23.901 [2024-07-15 09:06:12.437567] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:23.901 [2024-07-15 09:06:12.437582] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:23.902 [2024-07-15 09:06:12.437596] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:23.902 [2024-07-15 09:06:12.437625] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:23.902 qpair failed and we were unable to recover it. 00:27:24.160 [2024-07-15 09:06:12.447467] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.161 [2024-07-15 09:06:12.447615] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.161 [2024-07-15 09:06:12.447640] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.161 [2024-07-15 09:06:12.447654] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.161 [2024-07-15 09:06:12.447667] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.161 [2024-07-15 09:06:12.447704] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.161 qpair failed and we were unable to recover it. 00:27:24.161 [2024-07-15 09:06:12.457476] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.161 [2024-07-15 09:06:12.457616] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.161 [2024-07-15 09:06:12.457641] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.161 [2024-07-15 09:06:12.457657] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.161 [2024-07-15 09:06:12.457671] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.161 [2024-07-15 09:06:12.457701] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.161 qpair failed and we were unable to recover it. 00:27:24.161 [2024-07-15 09:06:12.467505] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.161 [2024-07-15 09:06:12.467641] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.161 [2024-07-15 09:06:12.467667] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.161 [2024-07-15 09:06:12.467685] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.161 [2024-07-15 09:06:12.467699] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.161 [2024-07-15 09:06:12.467731] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.161 qpair failed and we were unable to recover it. 00:27:24.161 [2024-07-15 09:06:12.477520] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.161 [2024-07-15 09:06:12.477643] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.161 [2024-07-15 09:06:12.477669] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.161 [2024-07-15 09:06:12.477690] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.161 [2024-07-15 09:06:12.477704] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.161 [2024-07-15 09:06:12.477734] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.161 qpair failed and we were unable to recover it. 00:27:24.161 [2024-07-15 09:06:12.487569] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.161 [2024-07-15 09:06:12.487728] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.161 [2024-07-15 09:06:12.487754] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.161 [2024-07-15 09:06:12.487769] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.161 [2024-07-15 09:06:12.487783] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.161 [2024-07-15 09:06:12.487813] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.161 qpair failed and we were unable to recover it. 00:27:24.161 [2024-07-15 09:06:12.497606] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.161 [2024-07-15 09:06:12.497782] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.161 [2024-07-15 09:06:12.497808] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.161 [2024-07-15 09:06:12.497822] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.161 [2024-07-15 09:06:12.497836] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.161 [2024-07-15 09:06:12.497866] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.161 qpair failed and we were unable to recover it. 00:27:24.161 [2024-07-15 09:06:12.507599] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.161 [2024-07-15 09:06:12.507720] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.161 [2024-07-15 09:06:12.507745] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.161 [2024-07-15 09:06:12.507759] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.161 [2024-07-15 09:06:12.507773] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.161 [2024-07-15 09:06:12.507802] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.161 qpair failed and we were unable to recover it. 00:27:24.161 [2024-07-15 09:06:12.517639] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.161 [2024-07-15 09:06:12.517766] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.161 [2024-07-15 09:06:12.517800] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.161 [2024-07-15 09:06:12.517815] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.161 [2024-07-15 09:06:12.517828] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.161 [2024-07-15 09:06:12.517857] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.161 qpair failed and we were unable to recover it. 00:27:24.161 [2024-07-15 09:06:12.527780] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.161 [2024-07-15 09:06:12.527922] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.161 [2024-07-15 09:06:12.527948] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.161 [2024-07-15 09:06:12.527962] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.161 [2024-07-15 09:06:12.527976] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.161 [2024-07-15 09:06:12.528006] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.161 qpair failed and we were unable to recover it. 00:27:24.161 [2024-07-15 09:06:12.537709] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.161 [2024-07-15 09:06:12.537853] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.161 [2024-07-15 09:06:12.537884] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.161 [2024-07-15 09:06:12.537905] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.161 [2024-07-15 09:06:12.537919] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.161 [2024-07-15 09:06:12.537949] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.161 qpair failed and we were unable to recover it. 00:27:24.161 [2024-07-15 09:06:12.547722] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.161 [2024-07-15 09:06:12.547852] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.161 [2024-07-15 09:06:12.547884] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.161 [2024-07-15 09:06:12.547902] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.161 [2024-07-15 09:06:12.547915] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.161 [2024-07-15 09:06:12.547945] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.161 qpair failed and we were unable to recover it. 00:27:24.161 [2024-07-15 09:06:12.557738] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.161 [2024-07-15 09:06:12.557870] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.161 [2024-07-15 09:06:12.557902] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.161 [2024-07-15 09:06:12.557918] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.161 [2024-07-15 09:06:12.557932] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.161 [2024-07-15 09:06:12.557962] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.161 qpair failed and we were unable to recover it. 00:27:24.161 [2024-07-15 09:06:12.567769] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.161 [2024-07-15 09:06:12.567906] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.161 [2024-07-15 09:06:12.567931] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.161 [2024-07-15 09:06:12.567952] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.161 [2024-07-15 09:06:12.567966] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.161 [2024-07-15 09:06:12.567997] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.161 qpair failed and we were unable to recover it. 00:27:24.161 [2024-07-15 09:06:12.577806] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.161 [2024-07-15 09:06:12.577944] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.161 [2024-07-15 09:06:12.577970] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.161 [2024-07-15 09:06:12.577984] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.161 [2024-07-15 09:06:12.577998] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.161 [2024-07-15 09:06:12.578028] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.161 qpair failed and we were unable to recover it. 00:27:24.161 [2024-07-15 09:06:12.587824] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.161 [2024-07-15 09:06:12.587965] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.161 [2024-07-15 09:06:12.587991] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.161 [2024-07-15 09:06:12.588006] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.162 [2024-07-15 09:06:12.588020] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.162 [2024-07-15 09:06:12.588051] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.162 qpair failed and we were unable to recover it. 00:27:24.162 [2024-07-15 09:06:12.597847] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.162 [2024-07-15 09:06:12.597984] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.162 [2024-07-15 09:06:12.598009] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.162 [2024-07-15 09:06:12.598023] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.162 [2024-07-15 09:06:12.598037] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.162 [2024-07-15 09:06:12.598067] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.162 qpair failed and we were unable to recover it. 00:27:24.162 [2024-07-15 09:06:12.607929] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.162 [2024-07-15 09:06:12.608066] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.162 [2024-07-15 09:06:12.608092] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.162 [2024-07-15 09:06:12.608107] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.162 [2024-07-15 09:06:12.608119] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.162 [2024-07-15 09:06:12.608161] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.162 qpair failed and we were unable to recover it. 00:27:24.162 [2024-07-15 09:06:12.617975] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.162 [2024-07-15 09:06:12.618140] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.162 [2024-07-15 09:06:12.618166] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.162 [2024-07-15 09:06:12.618181] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.162 [2024-07-15 09:06:12.618197] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.162 [2024-07-15 09:06:12.618228] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.162 qpair failed and we were unable to recover it. 00:27:24.162 [2024-07-15 09:06:12.627961] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.162 [2024-07-15 09:06:12.628089] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.162 [2024-07-15 09:06:12.628115] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.162 [2024-07-15 09:06:12.628130] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.162 [2024-07-15 09:06:12.628143] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.162 [2024-07-15 09:06:12.628173] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.162 qpair failed and we were unable to recover it. 00:27:24.162 [2024-07-15 09:06:12.637978] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.162 [2024-07-15 09:06:12.638108] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.162 [2024-07-15 09:06:12.638134] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.162 [2024-07-15 09:06:12.638148] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.162 [2024-07-15 09:06:12.638162] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.162 [2024-07-15 09:06:12.638192] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.162 qpair failed and we were unable to recover it. 00:27:24.162 [2024-07-15 09:06:12.648029] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.162 [2024-07-15 09:06:12.648157] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.162 [2024-07-15 09:06:12.648183] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.162 [2024-07-15 09:06:12.648198] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.162 [2024-07-15 09:06:12.648211] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.162 [2024-07-15 09:06:12.648241] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.162 qpair failed and we were unable to recover it. 00:27:24.162 [2024-07-15 09:06:12.658054] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.162 [2024-07-15 09:06:12.658195] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.162 [2024-07-15 09:06:12.658225] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.162 [2024-07-15 09:06:12.658241] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.162 [2024-07-15 09:06:12.658255] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.162 [2024-07-15 09:06:12.658285] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.162 qpair failed and we were unable to recover it. 00:27:24.162 [2024-07-15 09:06:12.668135] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.162 [2024-07-15 09:06:12.668290] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.162 [2024-07-15 09:06:12.668316] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.162 [2024-07-15 09:06:12.668331] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.162 [2024-07-15 09:06:12.668344] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.162 [2024-07-15 09:06:12.668374] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.162 qpair failed and we were unable to recover it. 00:27:24.162 [2024-07-15 09:06:12.678104] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.162 [2024-07-15 09:06:12.678236] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.162 [2024-07-15 09:06:12.678261] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.162 [2024-07-15 09:06:12.678276] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.162 [2024-07-15 09:06:12.678290] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.162 [2024-07-15 09:06:12.678320] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.162 qpair failed and we were unable to recover it. 00:27:24.162 [2024-07-15 09:06:12.688146] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.162 [2024-07-15 09:06:12.688291] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.162 [2024-07-15 09:06:12.688317] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.162 [2024-07-15 09:06:12.688332] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.162 [2024-07-15 09:06:12.688346] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.162 [2024-07-15 09:06:12.688375] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.162 qpair failed and we were unable to recover it. 00:27:24.162 [2024-07-15 09:06:12.698165] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.162 [2024-07-15 09:06:12.698293] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.162 [2024-07-15 09:06:12.698318] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.162 [2024-07-15 09:06:12.698333] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.162 [2024-07-15 09:06:12.698347] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.162 [2024-07-15 09:06:12.698382] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.162 qpair failed and we were unable to recover it. 00:27:24.422 [2024-07-15 09:06:12.708197] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.422 [2024-07-15 09:06:12.708322] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.422 [2024-07-15 09:06:12.708347] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.422 [2024-07-15 09:06:12.708361] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.422 [2024-07-15 09:06:12.708374] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.422 [2024-07-15 09:06:12.708403] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.422 qpair failed and we were unable to recover it. 00:27:24.422 [2024-07-15 09:06:12.718261] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.422 [2024-07-15 09:06:12.718405] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.422 [2024-07-15 09:06:12.718430] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.422 [2024-07-15 09:06:12.718445] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.422 [2024-07-15 09:06:12.718459] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.422 [2024-07-15 09:06:12.718488] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.422 qpair failed and we were unable to recover it. 00:27:24.422 [2024-07-15 09:06:12.728271] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.422 [2024-07-15 09:06:12.728399] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.422 [2024-07-15 09:06:12.728425] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.422 [2024-07-15 09:06:12.728440] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.422 [2024-07-15 09:06:12.728453] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.422 [2024-07-15 09:06:12.728484] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.422 qpair failed and we were unable to recover it. 00:27:24.422 [2024-07-15 09:06:12.738288] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.422 [2024-07-15 09:06:12.738431] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.422 [2024-07-15 09:06:12.738456] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.422 [2024-07-15 09:06:12.738470] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.422 [2024-07-15 09:06:12.738484] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.422 [2024-07-15 09:06:12.738514] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.422 qpair failed and we were unable to recover it. 00:27:24.422 [2024-07-15 09:06:12.748352] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.422 [2024-07-15 09:06:12.748480] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.422 [2024-07-15 09:06:12.748511] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.422 [2024-07-15 09:06:12.748526] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.422 [2024-07-15 09:06:12.748540] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.422 [2024-07-15 09:06:12.748569] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.422 qpair failed and we were unable to recover it. 00:27:24.422 [2024-07-15 09:06:12.758331] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.422 [2024-07-15 09:06:12.758450] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.422 [2024-07-15 09:06:12.758476] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.422 [2024-07-15 09:06:12.758491] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.422 [2024-07-15 09:06:12.758505] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.422 [2024-07-15 09:06:12.758534] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.422 qpair failed and we were unable to recover it. 00:27:24.423 [2024-07-15 09:06:12.768462] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.423 [2024-07-15 09:06:12.768588] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.423 [2024-07-15 09:06:12.768613] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.423 [2024-07-15 09:06:12.768628] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.423 [2024-07-15 09:06:12.768642] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.423 [2024-07-15 09:06:12.768672] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.423 qpair failed and we were unable to recover it. 00:27:24.423 [2024-07-15 09:06:12.778409] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.423 [2024-07-15 09:06:12.778538] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.423 [2024-07-15 09:06:12.778563] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.423 [2024-07-15 09:06:12.778578] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.423 [2024-07-15 09:06:12.778592] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.423 [2024-07-15 09:06:12.778622] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.423 qpair failed and we were unable to recover it. 00:27:24.423 [2024-07-15 09:06:12.788447] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.423 [2024-07-15 09:06:12.788570] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.423 [2024-07-15 09:06:12.788595] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.423 [2024-07-15 09:06:12.788611] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.423 [2024-07-15 09:06:12.788624] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.423 [2024-07-15 09:06:12.788660] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.423 qpair failed and we were unable to recover it. 00:27:24.423 [2024-07-15 09:06:12.798442] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.423 [2024-07-15 09:06:12.798571] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.423 [2024-07-15 09:06:12.798597] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.423 [2024-07-15 09:06:12.798611] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.423 [2024-07-15 09:06:12.798625] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.423 [2024-07-15 09:06:12.798654] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.423 qpair failed and we were unable to recover it. 00:27:24.423 [2024-07-15 09:06:12.808515] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.423 [2024-07-15 09:06:12.808630] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.423 [2024-07-15 09:06:12.808656] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.423 [2024-07-15 09:06:12.808671] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.423 [2024-07-15 09:06:12.808685] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.423 [2024-07-15 09:06:12.808714] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.423 qpair failed and we were unable to recover it. 00:27:24.423 [2024-07-15 09:06:12.818559] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.423 [2024-07-15 09:06:12.818695] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.423 [2024-07-15 09:06:12.818720] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.423 [2024-07-15 09:06:12.818735] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.423 [2024-07-15 09:06:12.818748] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.423 [2024-07-15 09:06:12.818777] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.423 qpair failed and we were unable to recover it. 00:27:24.423 [2024-07-15 09:06:12.828596] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.423 [2024-07-15 09:06:12.828767] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.423 [2024-07-15 09:06:12.828793] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.423 [2024-07-15 09:06:12.828811] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.423 [2024-07-15 09:06:12.828825] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.423 [2024-07-15 09:06:12.828855] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.423 qpair failed and we were unable to recover it. 00:27:24.423 [2024-07-15 09:06:12.838585] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.423 [2024-07-15 09:06:12.838710] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.423 [2024-07-15 09:06:12.838741] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.423 [2024-07-15 09:06:12.838757] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.423 [2024-07-15 09:06:12.838770] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.423 [2024-07-15 09:06:12.838800] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.423 qpair failed and we were unable to recover it. 00:27:24.423 [2024-07-15 09:06:12.848626] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.423 [2024-07-15 09:06:12.848753] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.423 [2024-07-15 09:06:12.848779] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.423 [2024-07-15 09:06:12.848794] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.423 [2024-07-15 09:06:12.848808] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.423 [2024-07-15 09:06:12.848837] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.423 qpair failed and we were unable to recover it. 00:27:24.423 [2024-07-15 09:06:12.858665] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.423 [2024-07-15 09:06:12.858814] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.423 [2024-07-15 09:06:12.858839] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.423 [2024-07-15 09:06:12.858853] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.423 [2024-07-15 09:06:12.858868] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.423 [2024-07-15 09:06:12.858905] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.423 qpair failed and we were unable to recover it. 00:27:24.423 [2024-07-15 09:06:12.868675] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.423 [2024-07-15 09:06:12.868806] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.423 [2024-07-15 09:06:12.868831] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.423 [2024-07-15 09:06:12.868846] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.423 [2024-07-15 09:06:12.868859] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.423 [2024-07-15 09:06:12.868898] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.423 qpair failed and we were unable to recover it. 00:27:24.423 [2024-07-15 09:06:12.878707] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.423 [2024-07-15 09:06:12.878837] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.423 [2024-07-15 09:06:12.878863] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.423 [2024-07-15 09:06:12.878886] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.423 [2024-07-15 09:06:12.878907] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.423 [2024-07-15 09:06:12.878938] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.423 qpair failed and we were unable to recover it. 00:27:24.423 [2024-07-15 09:06:12.888746] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.423 [2024-07-15 09:06:12.888866] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.423 [2024-07-15 09:06:12.888899] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.423 [2024-07-15 09:06:12.888916] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.423 [2024-07-15 09:06:12.888929] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.423 [2024-07-15 09:06:12.888959] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.423 qpair failed and we were unable to recover it. 00:27:24.423 [2024-07-15 09:06:12.898794] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.423 [2024-07-15 09:06:12.898964] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.423 [2024-07-15 09:06:12.898989] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.423 [2024-07-15 09:06:12.899004] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.423 [2024-07-15 09:06:12.899016] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.423 [2024-07-15 09:06:12.899047] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.423 qpair failed and we were unable to recover it. 00:27:24.423 [2024-07-15 09:06:12.908813] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.423 [2024-07-15 09:06:12.908948] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.424 [2024-07-15 09:06:12.908976] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.424 [2024-07-15 09:06:12.908995] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.424 [2024-07-15 09:06:12.909008] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.424 [2024-07-15 09:06:12.909040] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.424 qpair failed and we were unable to recover it. 00:27:24.424 [2024-07-15 09:06:12.918806] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.424 [2024-07-15 09:06:12.918952] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.424 [2024-07-15 09:06:12.918978] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.424 [2024-07-15 09:06:12.918993] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.424 [2024-07-15 09:06:12.919006] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.424 [2024-07-15 09:06:12.919036] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.424 qpair failed and we were unable to recover it. 00:27:24.424 [2024-07-15 09:06:12.928848] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.424 [2024-07-15 09:06:12.929016] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.424 [2024-07-15 09:06:12.929043] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.424 [2024-07-15 09:06:12.929058] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.424 [2024-07-15 09:06:12.929071] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.424 [2024-07-15 09:06:12.929101] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.424 qpair failed and we were unable to recover it. 00:27:24.424 [2024-07-15 09:06:12.938906] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.424 [2024-07-15 09:06:12.939073] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.424 [2024-07-15 09:06:12.939098] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.424 [2024-07-15 09:06:12.939113] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.424 [2024-07-15 09:06:12.939125] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.424 [2024-07-15 09:06:12.939156] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.424 qpair failed and we were unable to recover it. 00:27:24.424 [2024-07-15 09:06:12.948893] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.424 [2024-07-15 09:06:12.949022] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.424 [2024-07-15 09:06:12.949048] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.424 [2024-07-15 09:06:12.949063] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.424 [2024-07-15 09:06:12.949077] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.424 [2024-07-15 09:06:12.949108] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.424 qpair failed and we were unable to recover it. 00:27:24.424 [2024-07-15 09:06:12.958951] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.424 [2024-07-15 09:06:12.959066] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.424 [2024-07-15 09:06:12.959091] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.424 [2024-07-15 09:06:12.959106] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.424 [2024-07-15 09:06:12.959120] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.424 [2024-07-15 09:06:12.959149] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.424 qpair failed and we were unable to recover it. 00:27:24.685 [2024-07-15 09:06:12.968983] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.685 [2024-07-15 09:06:12.969111] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.685 [2024-07-15 09:06:12.969138] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.685 [2024-07-15 09:06:12.969157] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.685 [2024-07-15 09:06:12.969177] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.685 [2024-07-15 09:06:12.969209] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.685 qpair failed and we were unable to recover it. 00:27:24.685 [2024-07-15 09:06:12.979006] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.685 [2024-07-15 09:06:12.979136] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.685 [2024-07-15 09:06:12.979163] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.685 [2024-07-15 09:06:12.979177] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.685 [2024-07-15 09:06:12.979190] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.685 [2024-07-15 09:06:12.979220] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.685 qpair failed and we were unable to recover it. 00:27:24.685 [2024-07-15 09:06:12.989019] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.685 [2024-07-15 09:06:12.989140] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.685 [2024-07-15 09:06:12.989166] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.685 [2024-07-15 09:06:12.989181] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.685 [2024-07-15 09:06:12.989194] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.685 [2024-07-15 09:06:12.989224] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.685 qpair failed and we were unable to recover it. 00:27:24.685 [2024-07-15 09:06:12.999078] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.685 [2024-07-15 09:06:12.999217] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.685 [2024-07-15 09:06:12.999243] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.685 [2024-07-15 09:06:12.999260] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.685 [2024-07-15 09:06:12.999274] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.685 [2024-07-15 09:06:12.999304] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.685 qpair failed and we were unable to recover it. 00:27:24.685 [2024-07-15 09:06:13.009111] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.685 [2024-07-15 09:06:13.009236] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.685 [2024-07-15 09:06:13.009263] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.685 [2024-07-15 09:06:13.009282] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.685 [2024-07-15 09:06:13.009296] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.685 [2024-07-15 09:06:13.009339] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.685 qpair failed and we were unable to recover it. 00:27:24.685 [2024-07-15 09:06:13.019172] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.685 [2024-07-15 09:06:13.019334] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.685 [2024-07-15 09:06:13.019360] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.685 [2024-07-15 09:06:13.019376] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.685 [2024-07-15 09:06:13.019388] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.685 [2024-07-15 09:06:13.019418] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.685 qpair failed and we were unable to recover it. 00:27:24.685 [2024-07-15 09:06:13.029168] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.685 [2024-07-15 09:06:13.029301] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.685 [2024-07-15 09:06:13.029326] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.685 [2024-07-15 09:06:13.029341] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.685 [2024-07-15 09:06:13.029356] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.685 [2024-07-15 09:06:13.029398] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.685 qpair failed and we were unable to recover it. 00:27:24.685 [2024-07-15 09:06:13.039179] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.685 [2024-07-15 09:06:13.039303] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.685 [2024-07-15 09:06:13.039339] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.685 [2024-07-15 09:06:13.039357] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.685 [2024-07-15 09:06:13.039372] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.685 [2024-07-15 09:06:13.039403] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.685 qpair failed and we were unable to recover it. 00:27:24.685 [2024-07-15 09:06:13.049229] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.685 [2024-07-15 09:06:13.049404] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.685 [2024-07-15 09:06:13.049432] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.685 [2024-07-15 09:06:13.049447] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.685 [2024-07-15 09:06:13.049460] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.685 [2024-07-15 09:06:13.049490] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.685 qpair failed and we were unable to recover it. 00:27:24.685 [2024-07-15 09:06:13.059288] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.685 [2024-07-15 09:06:13.059466] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.685 [2024-07-15 09:06:13.059490] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.685 [2024-07-15 09:06:13.059514] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.685 [2024-07-15 09:06:13.059529] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.685 [2024-07-15 09:06:13.059559] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.685 qpair failed and we were unable to recover it. 00:27:24.685 [2024-07-15 09:06:13.069322] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.685 [2024-07-15 09:06:13.069441] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.685 [2024-07-15 09:06:13.069466] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.685 [2024-07-15 09:06:13.069481] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.686 [2024-07-15 09:06:13.069494] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.686 [2024-07-15 09:06:13.069525] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.686 qpair failed and we were unable to recover it. 00:27:24.686 [2024-07-15 09:06:13.079312] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.686 [2024-07-15 09:06:13.079457] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.686 [2024-07-15 09:06:13.079483] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.686 [2024-07-15 09:06:13.079502] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.686 [2024-07-15 09:06:13.079515] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.686 [2024-07-15 09:06:13.079546] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.686 qpair failed and we were unable to recover it. 00:27:24.686 [2024-07-15 09:06:13.089359] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.686 [2024-07-15 09:06:13.089479] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.686 [2024-07-15 09:06:13.089506] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.686 [2024-07-15 09:06:13.089521] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.686 [2024-07-15 09:06:13.089534] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.686 [2024-07-15 09:06:13.089564] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.686 qpair failed and we were unable to recover it. 00:27:24.686 [2024-07-15 09:06:13.099359] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.686 [2024-07-15 09:06:13.099482] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.686 [2024-07-15 09:06:13.099507] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.686 [2024-07-15 09:06:13.099522] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.686 [2024-07-15 09:06:13.099535] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.686 [2024-07-15 09:06:13.099566] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.686 qpair failed and we were unable to recover it. 00:27:24.686 [2024-07-15 09:06:13.109385] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.686 [2024-07-15 09:06:13.109514] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.686 [2024-07-15 09:06:13.109541] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.686 [2024-07-15 09:06:13.109556] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.686 [2024-07-15 09:06:13.109570] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.686 [2024-07-15 09:06:13.109600] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.686 qpair failed and we were unable to recover it. 00:27:24.686 [2024-07-15 09:06:13.119420] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.686 [2024-07-15 09:06:13.119535] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.686 [2024-07-15 09:06:13.119560] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.686 [2024-07-15 09:06:13.119575] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.686 [2024-07-15 09:06:13.119589] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.686 [2024-07-15 09:06:13.119620] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.686 qpair failed and we were unable to recover it. 00:27:24.686 [2024-07-15 09:06:13.129483] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.686 [2024-07-15 09:06:13.129617] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.686 [2024-07-15 09:06:13.129642] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.686 [2024-07-15 09:06:13.129657] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.686 [2024-07-15 09:06:13.129670] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.686 [2024-07-15 09:06:13.129700] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.686 qpair failed and we were unable to recover it. 00:27:24.686 [2024-07-15 09:06:13.139478] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.686 [2024-07-15 09:06:13.139607] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.686 [2024-07-15 09:06:13.139633] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.686 [2024-07-15 09:06:13.139647] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.686 [2024-07-15 09:06:13.139661] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.686 [2024-07-15 09:06:13.139690] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.686 qpair failed and we were unable to recover it. 00:27:24.686 [2024-07-15 09:06:13.149464] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.686 [2024-07-15 09:06:13.149582] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.686 [2024-07-15 09:06:13.149612] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.686 [2024-07-15 09:06:13.149628] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.686 [2024-07-15 09:06:13.149642] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.686 [2024-07-15 09:06:13.149672] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.686 qpair failed and we were unable to recover it. 00:27:24.686 [2024-07-15 09:06:13.159507] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.686 [2024-07-15 09:06:13.159628] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.686 [2024-07-15 09:06:13.159652] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.686 [2024-07-15 09:06:13.159667] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.686 [2024-07-15 09:06:13.159681] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.686 [2024-07-15 09:06:13.159712] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.686 qpair failed and we were unable to recover it. 00:27:24.686 [2024-07-15 09:06:13.169549] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.686 [2024-07-15 09:06:13.169712] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.686 [2024-07-15 09:06:13.169737] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.686 [2024-07-15 09:06:13.169753] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.686 [2024-07-15 09:06:13.169766] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.686 [2024-07-15 09:06:13.169795] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.686 qpair failed and we were unable to recover it. 00:27:24.686 [2024-07-15 09:06:13.179656] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.686 [2024-07-15 09:06:13.179811] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.686 [2024-07-15 09:06:13.179837] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.686 [2024-07-15 09:06:13.179853] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.686 [2024-07-15 09:06:13.179866] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.686 [2024-07-15 09:06:13.179909] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.686 qpair failed and we were unable to recover it. 00:27:24.686 [2024-07-15 09:06:13.189643] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.686 [2024-07-15 09:06:13.189766] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.686 [2024-07-15 09:06:13.189790] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.686 [2024-07-15 09:06:13.189805] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.686 [2024-07-15 09:06:13.189819] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.686 [2024-07-15 09:06:13.189849] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.686 qpair failed and we were unable to recover it. 00:27:24.686 [2024-07-15 09:06:13.199626] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.686 [2024-07-15 09:06:13.199794] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.687 [2024-07-15 09:06:13.199821] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.687 [2024-07-15 09:06:13.199840] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.687 [2024-07-15 09:06:13.199854] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.687 [2024-07-15 09:06:13.199895] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.687 qpair failed and we were unable to recover it. 00:27:24.687 [2024-07-15 09:06:13.209684] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.687 [2024-07-15 09:06:13.209802] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.687 [2024-07-15 09:06:13.209826] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.687 [2024-07-15 09:06:13.209842] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.687 [2024-07-15 09:06:13.209855] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.687 [2024-07-15 09:06:13.209893] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.687 qpair failed and we were unable to recover it. 00:27:24.687 [2024-07-15 09:06:13.219710] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.687 [2024-07-15 09:06:13.219863] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.687 [2024-07-15 09:06:13.219897] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.687 [2024-07-15 09:06:13.219913] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.687 [2024-07-15 09:06:13.219927] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.687 [2024-07-15 09:06:13.219956] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.687 qpair failed and we were unable to recover it. 00:27:24.948 [2024-07-15 09:06:13.229708] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.948 [2024-07-15 09:06:13.229834] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.948 [2024-07-15 09:06:13.229860] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.948 [2024-07-15 09:06:13.229882] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.948 [2024-07-15 09:06:13.229897] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.948 [2024-07-15 09:06:13.229929] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.948 qpair failed and we were unable to recover it. 00:27:24.948 [2024-07-15 09:06:13.239729] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.948 [2024-07-15 09:06:13.239867] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.948 [2024-07-15 09:06:13.239906] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.948 [2024-07-15 09:06:13.239923] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.948 [2024-07-15 09:06:13.239937] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.948 [2024-07-15 09:06:13.239967] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.948 qpair failed and we were unable to recover it. 00:27:24.948 [2024-07-15 09:06:13.249757] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.948 [2024-07-15 09:06:13.249885] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.949 [2024-07-15 09:06:13.249910] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.949 [2024-07-15 09:06:13.249925] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.949 [2024-07-15 09:06:13.249938] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.949 [2024-07-15 09:06:13.249968] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.949 qpair failed and we were unable to recover it. 00:27:24.949 [2024-07-15 09:06:13.259814] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.949 [2024-07-15 09:06:13.259937] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.949 [2024-07-15 09:06:13.259962] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.949 [2024-07-15 09:06:13.259979] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.949 [2024-07-15 09:06:13.259992] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.949 [2024-07-15 09:06:13.260022] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.949 qpair failed and we were unable to recover it. 00:27:24.949 [2024-07-15 09:06:13.269924] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.949 [2024-07-15 09:06:13.270057] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.949 [2024-07-15 09:06:13.270084] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.949 [2024-07-15 09:06:13.270099] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.949 [2024-07-15 09:06:13.270112] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.949 [2024-07-15 09:06:13.270142] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.949 qpair failed and we were unable to recover it. 00:27:24.949 [2024-07-15 09:06:13.279852] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.949 [2024-07-15 09:06:13.279975] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.949 [2024-07-15 09:06:13.280001] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.949 [2024-07-15 09:06:13.280015] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.949 [2024-07-15 09:06:13.280028] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.949 [2024-07-15 09:06:13.280066] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.949 qpair failed and we were unable to recover it. 00:27:24.949 [2024-07-15 09:06:13.289889] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.949 [2024-07-15 09:06:13.290012] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.949 [2024-07-15 09:06:13.290038] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.949 [2024-07-15 09:06:13.290053] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.949 [2024-07-15 09:06:13.290066] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.949 [2024-07-15 09:06:13.290097] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.949 qpair failed and we were unable to recover it. 00:27:24.949 [2024-07-15 09:06:13.299947] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.949 [2024-07-15 09:06:13.300110] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.949 [2024-07-15 09:06:13.300135] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.949 [2024-07-15 09:06:13.300150] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.949 [2024-07-15 09:06:13.300163] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.949 [2024-07-15 09:06:13.300193] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.949 qpair failed and we were unable to recover it. 00:27:24.949 [2024-07-15 09:06:13.310008] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.949 [2024-07-15 09:06:13.310166] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.949 [2024-07-15 09:06:13.310192] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.949 [2024-07-15 09:06:13.310207] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.949 [2024-07-15 09:06:13.310220] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.949 [2024-07-15 09:06:13.310263] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.949 qpair failed and we were unable to recover it. 00:27:24.949 [2024-07-15 09:06:13.319983] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.949 [2024-07-15 09:06:13.320101] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.949 [2024-07-15 09:06:13.320126] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.949 [2024-07-15 09:06:13.320142] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.949 [2024-07-15 09:06:13.320155] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.949 [2024-07-15 09:06:13.320185] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.949 qpair failed and we were unable to recover it. 00:27:24.949 [2024-07-15 09:06:13.329999] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.949 [2024-07-15 09:06:13.330113] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.949 [2024-07-15 09:06:13.330143] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.949 [2024-07-15 09:06:13.330159] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.949 [2024-07-15 09:06:13.330173] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.949 [2024-07-15 09:06:13.330203] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.949 qpair failed and we were unable to recover it. 00:27:24.949 [2024-07-15 09:06:13.340075] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.949 [2024-07-15 09:06:13.340240] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.949 [2024-07-15 09:06:13.340266] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.949 [2024-07-15 09:06:13.340281] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.949 [2024-07-15 09:06:13.340293] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.949 [2024-07-15 09:06:13.340322] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.949 qpair failed and we were unable to recover it. 00:27:24.949 [2024-07-15 09:06:13.350113] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.949 [2024-07-15 09:06:13.350274] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.949 [2024-07-15 09:06:13.350300] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.949 [2024-07-15 09:06:13.350316] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.949 [2024-07-15 09:06:13.350329] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.949 [2024-07-15 09:06:13.350374] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.949 qpair failed and we were unable to recover it. 00:27:24.949 [2024-07-15 09:06:13.360098] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.949 [2024-07-15 09:06:13.360223] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.950 [2024-07-15 09:06:13.360249] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.950 [2024-07-15 09:06:13.360265] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.950 [2024-07-15 09:06:13.360279] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.950 [2024-07-15 09:06:13.360308] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.950 qpair failed and we were unable to recover it. 00:27:24.950 [2024-07-15 09:06:13.370136] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.950 [2024-07-15 09:06:13.370258] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.950 [2024-07-15 09:06:13.370283] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.950 [2024-07-15 09:06:13.370299] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.950 [2024-07-15 09:06:13.370318] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.950 [2024-07-15 09:06:13.370361] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.950 qpair failed and we were unable to recover it. 00:27:24.950 [2024-07-15 09:06:13.380240] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.950 [2024-07-15 09:06:13.380398] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.950 [2024-07-15 09:06:13.380425] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.950 [2024-07-15 09:06:13.380440] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.950 [2024-07-15 09:06:13.380453] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.950 [2024-07-15 09:06:13.380499] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.950 qpair failed and we were unable to recover it. 00:27:24.950 [2024-07-15 09:06:13.390214] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.950 [2024-07-15 09:06:13.390347] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.950 [2024-07-15 09:06:13.390373] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.950 [2024-07-15 09:06:13.390388] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.950 [2024-07-15 09:06:13.390402] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.950 [2024-07-15 09:06:13.390433] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.950 qpair failed and we were unable to recover it. 00:27:24.950 [2024-07-15 09:06:13.400247] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.950 [2024-07-15 09:06:13.400368] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.950 [2024-07-15 09:06:13.400395] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.950 [2024-07-15 09:06:13.400413] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.950 [2024-07-15 09:06:13.400428] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.950 [2024-07-15 09:06:13.400459] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.950 qpair failed and we were unable to recover it. 00:27:24.950 [2024-07-15 09:06:13.410339] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.950 [2024-07-15 09:06:13.410479] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.950 [2024-07-15 09:06:13.410505] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.950 [2024-07-15 09:06:13.410520] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.950 [2024-07-15 09:06:13.410534] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.950 [2024-07-15 09:06:13.410591] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.950 qpair failed and we were unable to recover it. 00:27:24.950 [2024-07-15 09:06:13.420382] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.950 [2024-07-15 09:06:13.420543] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.950 [2024-07-15 09:06:13.420572] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.950 [2024-07-15 09:06:13.420590] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.950 [2024-07-15 09:06:13.420619] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.950 [2024-07-15 09:06:13.420649] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.950 qpair failed and we were unable to recover it. 00:27:24.950 [2024-07-15 09:06:13.430365] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.950 [2024-07-15 09:06:13.430490] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.950 [2024-07-15 09:06:13.430517] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.950 [2024-07-15 09:06:13.430535] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.950 [2024-07-15 09:06:13.430549] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.950 [2024-07-15 09:06:13.430595] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.950 qpair failed and we were unable to recover it. 00:27:24.950 [2024-07-15 09:06:13.440363] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.950 [2024-07-15 09:06:13.440478] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.950 [2024-07-15 09:06:13.440503] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.950 [2024-07-15 09:06:13.440518] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.950 [2024-07-15 09:06:13.440531] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.950 [2024-07-15 09:06:13.440562] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.950 qpair failed and we were unable to recover it. 00:27:24.950 [2024-07-15 09:06:13.450385] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.950 [2024-07-15 09:06:13.450501] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.950 [2024-07-15 09:06:13.450525] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.950 [2024-07-15 09:06:13.450540] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.950 [2024-07-15 09:06:13.450553] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.950 [2024-07-15 09:06:13.450584] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.950 qpair failed and we were unable to recover it. 00:27:24.950 [2024-07-15 09:06:13.460443] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.950 [2024-07-15 09:06:13.460565] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.950 [2024-07-15 09:06:13.460591] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.950 [2024-07-15 09:06:13.460606] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.950 [2024-07-15 09:06:13.460625] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.950 [2024-07-15 09:06:13.460656] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.950 qpair failed and we were unable to recover it. 00:27:24.950 [2024-07-15 09:06:13.470490] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.950 [2024-07-15 09:06:13.470654] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.950 [2024-07-15 09:06:13.470680] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.950 [2024-07-15 09:06:13.470696] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.951 [2024-07-15 09:06:13.470724] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.951 [2024-07-15 09:06:13.470754] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.951 qpair failed and we were unable to recover it. 00:27:24.951 [2024-07-15 09:06:13.480525] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.951 [2024-07-15 09:06:13.480651] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.951 [2024-07-15 09:06:13.480678] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.951 [2024-07-15 09:06:13.480698] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.951 [2024-07-15 09:06:13.480712] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.951 [2024-07-15 09:06:13.480757] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.951 qpair failed and we were unable to recover it. 00:27:24.951 [2024-07-15 09:06:13.490599] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:24.951 [2024-07-15 09:06:13.490727] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:24.951 [2024-07-15 09:06:13.490753] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:24.951 [2024-07-15 09:06:13.490769] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:24.951 [2024-07-15 09:06:13.490783] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:24.951 [2024-07-15 09:06:13.490814] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:24.951 qpair failed and we were unable to recover it. 00:27:25.212 [2024-07-15 09:06:13.500615] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.212 [2024-07-15 09:06:13.500748] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.212 [2024-07-15 09:06:13.500775] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.212 [2024-07-15 09:06:13.500791] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.212 [2024-07-15 09:06:13.500804] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.212 [2024-07-15 09:06:13.500835] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.212 qpair failed and we were unable to recover it. 00:27:25.212 [2024-07-15 09:06:13.510597] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.212 [2024-07-15 09:06:13.510762] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.212 [2024-07-15 09:06:13.510789] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.212 [2024-07-15 09:06:13.510804] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.212 [2024-07-15 09:06:13.510818] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.212 [2024-07-15 09:06:13.510863] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.212 qpair failed and we were unable to recover it. 00:27:25.212 [2024-07-15 09:06:13.520636] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.212 [2024-07-15 09:06:13.520809] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.212 [2024-07-15 09:06:13.520836] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.212 [2024-07-15 09:06:13.520851] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.212 [2024-07-15 09:06:13.520885] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.212 [2024-07-15 09:06:13.520916] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.212 qpair failed and we were unable to recover it. 00:27:25.212 [2024-07-15 09:06:13.530660] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.212 [2024-07-15 09:06:13.530788] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.212 [2024-07-15 09:06:13.530814] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.212 [2024-07-15 09:06:13.530829] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.212 [2024-07-15 09:06:13.530842] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.212 [2024-07-15 09:06:13.530872] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.212 qpair failed and we were unable to recover it. 00:27:25.212 [2024-07-15 09:06:13.540673] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.212 [2024-07-15 09:06:13.540790] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.212 [2024-07-15 09:06:13.540814] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.212 [2024-07-15 09:06:13.540829] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.212 [2024-07-15 09:06:13.540843] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.212 [2024-07-15 09:06:13.540873] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.212 qpair failed and we were unable to recover it. 00:27:25.212 [2024-07-15 09:06:13.550723] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.212 [2024-07-15 09:06:13.550843] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.212 [2024-07-15 09:06:13.550870] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.213 [2024-07-15 09:06:13.550898] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.213 [2024-07-15 09:06:13.550913] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.213 [2024-07-15 09:06:13.550955] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.213 qpair failed and we were unable to recover it. 00:27:25.213 [2024-07-15 09:06:13.560721] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.213 [2024-07-15 09:06:13.560840] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.213 [2024-07-15 09:06:13.560865] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.213 [2024-07-15 09:06:13.560886] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.213 [2024-07-15 09:06:13.560901] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.213 [2024-07-15 09:06:13.560932] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.213 qpair failed and we were unable to recover it. 00:27:25.213 [2024-07-15 09:06:13.570743] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.213 [2024-07-15 09:06:13.570859] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.213 [2024-07-15 09:06:13.570890] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.213 [2024-07-15 09:06:13.570906] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.213 [2024-07-15 09:06:13.570919] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.213 [2024-07-15 09:06:13.570949] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.213 qpair failed and we were unable to recover it. 00:27:25.213 [2024-07-15 09:06:13.580773] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.213 [2024-07-15 09:06:13.580902] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.213 [2024-07-15 09:06:13.580926] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.213 [2024-07-15 09:06:13.580941] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.213 [2024-07-15 09:06:13.580954] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.213 [2024-07-15 09:06:13.580984] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.213 qpair failed and we were unable to recover it. 00:27:25.213 [2024-07-15 09:06:13.590799] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.213 [2024-07-15 09:06:13.590920] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.213 [2024-07-15 09:06:13.590945] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.213 [2024-07-15 09:06:13.590960] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.213 [2024-07-15 09:06:13.590974] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.213 [2024-07-15 09:06:13.591003] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.213 qpair failed and we were unable to recover it. 00:27:25.213 [2024-07-15 09:06:13.600824] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.213 [2024-07-15 09:06:13.600944] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.213 [2024-07-15 09:06:13.600968] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.213 [2024-07-15 09:06:13.600983] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.213 [2024-07-15 09:06:13.600996] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.213 [2024-07-15 09:06:13.601026] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.213 qpair failed and we were unable to recover it. 00:27:25.213 [2024-07-15 09:06:13.610891] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.213 [2024-07-15 09:06:13.611013] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.213 [2024-07-15 09:06:13.611037] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.213 [2024-07-15 09:06:13.611052] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.213 [2024-07-15 09:06:13.611065] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.213 [2024-07-15 09:06:13.611096] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.213 qpair failed and we were unable to recover it. 00:27:25.213 [2024-07-15 09:06:13.620923] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.213 [2024-07-15 09:06:13.621087] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.213 [2024-07-15 09:06:13.621113] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.213 [2024-07-15 09:06:13.621128] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.213 [2024-07-15 09:06:13.621142] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.213 [2024-07-15 09:06:13.621172] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.213 qpair failed and we were unable to recover it. 00:27:25.213 [2024-07-15 09:06:13.630908] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.213 [2024-07-15 09:06:13.631032] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.213 [2024-07-15 09:06:13.631058] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.213 [2024-07-15 09:06:13.631074] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.213 [2024-07-15 09:06:13.631087] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.213 [2024-07-15 09:06:13.631117] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.213 qpair failed and we were unable to recover it. 00:27:25.213 [2024-07-15 09:06:13.640957] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.213 [2024-07-15 09:06:13.641087] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.213 [2024-07-15 09:06:13.641112] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.213 [2024-07-15 09:06:13.641133] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.213 [2024-07-15 09:06:13.641147] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.213 [2024-07-15 09:06:13.641177] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.213 qpair failed and we were unable to recover it. 00:27:25.213 [2024-07-15 09:06:13.650991] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.213 [2024-07-15 09:06:13.651159] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.213 [2024-07-15 09:06:13.651186] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.213 [2024-07-15 09:06:13.651216] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.213 [2024-07-15 09:06:13.651229] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.213 [2024-07-15 09:06:13.651259] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.213 qpair failed and we were unable to recover it. 00:27:25.213 [2024-07-15 09:06:13.661025] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.213 [2024-07-15 09:06:13.661156] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.213 [2024-07-15 09:06:13.661182] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.213 [2024-07-15 09:06:13.661198] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.213 [2024-07-15 09:06:13.661211] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.213 [2024-07-15 09:06:13.661255] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.213 qpair failed and we were unable to recover it. 00:27:25.213 [2024-07-15 09:06:13.671040] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.213 [2024-07-15 09:06:13.671210] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.213 [2024-07-15 09:06:13.671238] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.213 [2024-07-15 09:06:13.671268] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.213 [2024-07-15 09:06:13.671284] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.213 [2024-07-15 09:06:13.671315] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.213 qpair failed and we were unable to recover it. 00:27:25.213 [2024-07-15 09:06:13.681055] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.213 [2024-07-15 09:06:13.681192] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.213 [2024-07-15 09:06:13.681218] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.213 [2024-07-15 09:06:13.681234] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.213 [2024-07-15 09:06:13.681247] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.213 [2024-07-15 09:06:13.681277] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.213 qpair failed and we were unable to recover it. 00:27:25.213 [2024-07-15 09:06:13.691113] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.213 [2024-07-15 09:06:13.691279] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.213 [2024-07-15 09:06:13.691306] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.213 [2024-07-15 09:06:13.691321] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.214 [2024-07-15 09:06:13.691334] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.214 [2024-07-15 09:06:13.691366] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.214 qpair failed and we were unable to recover it. 00:27:25.214 [2024-07-15 09:06:13.701119] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.214 [2024-07-15 09:06:13.701240] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.214 [2024-07-15 09:06:13.701266] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.214 [2024-07-15 09:06:13.701281] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.214 [2024-07-15 09:06:13.701294] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.214 [2024-07-15 09:06:13.701324] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.214 qpair failed and we were unable to recover it. 00:27:25.214 [2024-07-15 09:06:13.711193] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.214 [2024-07-15 09:06:13.711318] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.214 [2024-07-15 09:06:13.711345] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.214 [2024-07-15 09:06:13.711360] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.214 [2024-07-15 09:06:13.711374] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.214 [2024-07-15 09:06:13.711403] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.214 qpair failed and we were unable to recover it. 00:27:25.214 [2024-07-15 09:06:13.721220] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.214 [2024-07-15 09:06:13.721343] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.214 [2024-07-15 09:06:13.721367] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.214 [2024-07-15 09:06:13.721382] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.214 [2024-07-15 09:06:13.721396] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.214 [2024-07-15 09:06:13.721427] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.214 qpair failed and we were unable to recover it. 00:27:25.214 [2024-07-15 09:06:13.731238] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.214 [2024-07-15 09:06:13.731369] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.214 [2024-07-15 09:06:13.731400] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.214 [2024-07-15 09:06:13.731416] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.214 [2024-07-15 09:06:13.731430] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.214 [2024-07-15 09:06:13.731460] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.214 qpair failed and we were unable to recover it. 00:27:25.214 [2024-07-15 09:06:13.741249] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.214 [2024-07-15 09:06:13.741379] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.214 [2024-07-15 09:06:13.741405] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.214 [2024-07-15 09:06:13.741421] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.214 [2024-07-15 09:06:13.741434] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.214 [2024-07-15 09:06:13.741464] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.214 qpair failed and we were unable to recover it. 00:27:25.214 [2024-07-15 09:06:13.751279] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.214 [2024-07-15 09:06:13.751405] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.214 [2024-07-15 09:06:13.751431] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.214 [2024-07-15 09:06:13.751447] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.214 [2024-07-15 09:06:13.751460] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.214 [2024-07-15 09:06:13.751490] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.214 qpair failed and we were unable to recover it. 00:27:25.474 [2024-07-15 09:06:13.761301] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.474 [2024-07-15 09:06:13.761430] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.474 [2024-07-15 09:06:13.761456] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.474 [2024-07-15 09:06:13.761471] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.474 [2024-07-15 09:06:13.761484] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.474 [2024-07-15 09:06:13.761514] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.474 qpair failed and we were unable to recover it. 00:27:25.474 [2024-07-15 09:06:13.771343] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.474 [2024-07-15 09:06:13.771466] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.474 [2024-07-15 09:06:13.771493] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.474 [2024-07-15 09:06:13.771509] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.474 [2024-07-15 09:06:13.771522] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.474 [2024-07-15 09:06:13.771577] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.474 qpair failed and we were unable to recover it. 00:27:25.474 [2024-07-15 09:06:13.781422] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.474 [2024-07-15 09:06:13.781574] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.474 [2024-07-15 09:06:13.781601] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.474 [2024-07-15 09:06:13.781616] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.474 [2024-07-15 09:06:13.781644] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.474 [2024-07-15 09:06:13.781674] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.474 qpair failed and we were unable to recover it. 00:27:25.474 [2024-07-15 09:06:13.791415] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.474 [2024-07-15 09:06:13.791534] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.474 [2024-07-15 09:06:13.791559] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.474 [2024-07-15 09:06:13.791574] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.474 [2024-07-15 09:06:13.791587] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.474 [2024-07-15 09:06:13.791618] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.474 qpair failed and we were unable to recover it. 00:27:25.474 [2024-07-15 09:06:13.801397] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.474 [2024-07-15 09:06:13.801515] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.474 [2024-07-15 09:06:13.801550] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.474 [2024-07-15 09:06:13.801566] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.474 [2024-07-15 09:06:13.801579] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.474 [2024-07-15 09:06:13.801610] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.474 qpair failed and we were unable to recover it. 00:27:25.474 [2024-07-15 09:06:13.811467] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.474 [2024-07-15 09:06:13.811589] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.474 [2024-07-15 09:06:13.811614] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.474 [2024-07-15 09:06:13.811629] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.474 [2024-07-15 09:06:13.811642] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.474 [2024-07-15 09:06:13.811673] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.474 qpair failed and we were unable to recover it. 00:27:25.474 [2024-07-15 09:06:13.821491] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.474 [2024-07-15 09:06:13.821651] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.474 [2024-07-15 09:06:13.821682] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.474 [2024-07-15 09:06:13.821698] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.474 [2024-07-15 09:06:13.821727] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.474 [2024-07-15 09:06:13.821757] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.474 qpair failed and we were unable to recover it. 00:27:25.474 [2024-07-15 09:06:13.831524] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.474 [2024-07-15 09:06:13.831668] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.474 [2024-07-15 09:06:13.831694] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.474 [2024-07-15 09:06:13.831710] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.474 [2024-07-15 09:06:13.831723] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.474 [2024-07-15 09:06:13.831753] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.474 qpair failed and we were unable to recover it. 00:27:25.474 [2024-07-15 09:06:13.841541] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.474 [2024-07-15 09:06:13.841667] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.474 [2024-07-15 09:06:13.841695] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.474 [2024-07-15 09:06:13.841711] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.474 [2024-07-15 09:06:13.841724] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.474 [2024-07-15 09:06:13.841770] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.474 qpair failed and we were unable to recover it. 00:27:25.474 [2024-07-15 09:06:13.851558] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.474 [2024-07-15 09:06:13.851682] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.474 [2024-07-15 09:06:13.851710] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.474 [2024-07-15 09:06:13.851725] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.474 [2024-07-15 09:06:13.851739] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.474 [2024-07-15 09:06:13.851769] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.474 qpair failed and we were unable to recover it. 00:27:25.474 [2024-07-15 09:06:13.861620] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.474 [2024-07-15 09:06:13.861745] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.474 [2024-07-15 09:06:13.861778] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.475 [2024-07-15 09:06:13.861793] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.475 [2024-07-15 09:06:13.861807] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.475 [2024-07-15 09:06:13.861843] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.475 qpair failed and we were unable to recover it. 00:27:25.475 [2024-07-15 09:06:13.871643] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.475 [2024-07-15 09:06:13.871807] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.475 [2024-07-15 09:06:13.871834] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.475 [2024-07-15 09:06:13.871849] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.475 [2024-07-15 09:06:13.871863] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.475 [2024-07-15 09:06:13.871915] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.475 qpair failed and we were unable to recover it. 00:27:25.475 [2024-07-15 09:06:13.881656] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.475 [2024-07-15 09:06:13.881775] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.475 [2024-07-15 09:06:13.881802] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.475 [2024-07-15 09:06:13.881817] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.475 [2024-07-15 09:06:13.881830] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.475 [2024-07-15 09:06:13.881860] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.475 qpair failed and we were unable to recover it. 00:27:25.475 [2024-07-15 09:06:13.891684] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.475 [2024-07-15 09:06:13.891805] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.475 [2024-07-15 09:06:13.891832] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.475 [2024-07-15 09:06:13.891847] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.475 [2024-07-15 09:06:13.891864] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.475 [2024-07-15 09:06:13.891902] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.475 qpair failed and we were unable to recover it. 00:27:25.475 [2024-07-15 09:06:13.901736] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.475 [2024-07-15 09:06:13.901872] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.475 [2024-07-15 09:06:13.901907] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.475 [2024-07-15 09:06:13.901927] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.475 [2024-07-15 09:06:13.901941] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.475 [2024-07-15 09:06:13.901971] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.475 qpair failed and we were unable to recover it. 00:27:25.475 [2024-07-15 09:06:13.911756] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.475 [2024-07-15 09:06:13.911895] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.475 [2024-07-15 09:06:13.911924] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.475 [2024-07-15 09:06:13.911943] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.475 [2024-07-15 09:06:13.911957] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.475 [2024-07-15 09:06:13.911988] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.475 qpair failed and we were unable to recover it. 00:27:25.475 [2024-07-15 09:06:13.921775] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.475 [2024-07-15 09:06:13.921911] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.475 [2024-07-15 09:06:13.921939] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.475 [2024-07-15 09:06:13.921954] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.475 [2024-07-15 09:06:13.921970] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.475 [2024-07-15 09:06:13.922001] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.475 qpair failed and we were unable to recover it. 00:27:25.475 [2024-07-15 09:06:13.931794] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.475 [2024-07-15 09:06:13.931936] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.475 [2024-07-15 09:06:13.931962] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.475 [2024-07-15 09:06:13.931977] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.475 [2024-07-15 09:06:13.931990] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.475 [2024-07-15 09:06:13.932020] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.475 qpair failed and we were unable to recover it. 00:27:25.475 [2024-07-15 09:06:13.941830] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.475 [2024-07-15 09:06:13.941961] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.475 [2024-07-15 09:06:13.941987] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.475 [2024-07-15 09:06:13.942001] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.475 [2024-07-15 09:06:13.942014] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.475 [2024-07-15 09:06:13.942044] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.475 qpair failed and we were unable to recover it. 00:27:25.475 [2024-07-15 09:06:13.951899] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.475 [2024-07-15 09:06:13.952024] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.475 [2024-07-15 09:06:13.952050] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.475 [2024-07-15 09:06:13.952065] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.475 [2024-07-15 09:06:13.952084] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.475 [2024-07-15 09:06:13.952115] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.475 qpair failed and we were unable to recover it. 00:27:25.475 [2024-07-15 09:06:13.961921] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.475 [2024-07-15 09:06:13.962081] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.475 [2024-07-15 09:06:13.962106] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.475 [2024-07-15 09:06:13.962122] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.475 [2024-07-15 09:06:13.962136] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.475 [2024-07-15 09:06:13.962166] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.475 qpair failed and we were unable to recover it. 00:27:25.475 [2024-07-15 09:06:13.971921] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.475 [2024-07-15 09:06:13.972054] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.475 [2024-07-15 09:06:13.972080] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.476 [2024-07-15 09:06:13.972095] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.476 [2024-07-15 09:06:13.972108] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.476 [2024-07-15 09:06:13.972139] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.476 qpair failed and we were unable to recover it. 00:27:25.476 [2024-07-15 09:06:13.981981] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.476 [2024-07-15 09:06:13.982105] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.476 [2024-07-15 09:06:13.982130] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.476 [2024-07-15 09:06:13.982145] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.476 [2024-07-15 09:06:13.982158] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.476 [2024-07-15 09:06:13.982188] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.476 qpair failed and we were unable to recover it. 00:27:25.476 [2024-07-15 09:06:13.991992] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.476 [2024-07-15 09:06:13.992126] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.476 [2024-07-15 09:06:13.992151] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.476 [2024-07-15 09:06:13.992166] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.476 [2024-07-15 09:06:13.992179] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.476 [2024-07-15 09:06:13.992224] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.476 qpair failed and we were unable to recover it. 00:27:25.476 [2024-07-15 09:06:14.002023] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.476 [2024-07-15 09:06:14.002155] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.476 [2024-07-15 09:06:14.002182] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.476 [2024-07-15 09:06:14.002200] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.476 [2024-07-15 09:06:14.002213] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.476 [2024-07-15 09:06:14.002259] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.476 qpair failed and we were unable to recover it. 00:27:25.476 [2024-07-15 09:06:14.012056] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.476 [2024-07-15 09:06:14.012175] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.476 [2024-07-15 09:06:14.012200] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.476 [2024-07-15 09:06:14.012215] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.476 [2024-07-15 09:06:14.012227] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.476 [2024-07-15 09:06:14.012256] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.476 qpair failed and we were unable to recover it. 00:27:25.736 [2024-07-15 09:06:14.022097] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.736 [2024-07-15 09:06:14.022222] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.736 [2024-07-15 09:06:14.022247] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.736 [2024-07-15 09:06:14.022262] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.736 [2024-07-15 09:06:14.022276] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.736 [2024-07-15 09:06:14.022307] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.736 qpair failed and we were unable to recover it. 00:27:25.736 [2024-07-15 09:06:14.032138] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.736 [2024-07-15 09:06:14.032260] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.736 [2024-07-15 09:06:14.032285] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.736 [2024-07-15 09:06:14.032300] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.736 [2024-07-15 09:06:14.032313] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.736 [2024-07-15 09:06:14.032344] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.736 qpair failed and we were unable to recover it. 00:27:25.736 [2024-07-15 09:06:14.042129] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.736 [2024-07-15 09:06:14.042247] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.736 [2024-07-15 09:06:14.042272] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.736 [2024-07-15 09:06:14.042292] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.736 [2024-07-15 09:06:14.042308] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.736 [2024-07-15 09:06:14.042337] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.736 qpair failed and we were unable to recover it. 00:27:25.737 [2024-07-15 09:06:14.052137] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.737 [2024-07-15 09:06:14.052259] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.737 [2024-07-15 09:06:14.052284] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.737 [2024-07-15 09:06:14.052298] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.737 [2024-07-15 09:06:14.052311] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.737 [2024-07-15 09:06:14.052342] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.737 qpair failed and we were unable to recover it. 00:27:25.737 [2024-07-15 09:06:14.062227] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.737 [2024-07-15 09:06:14.062385] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.737 [2024-07-15 09:06:14.062409] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.737 [2024-07-15 09:06:14.062424] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.737 [2024-07-15 09:06:14.062437] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.737 [2024-07-15 09:06:14.062467] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.737 qpair failed and we were unable to recover it. 00:27:25.737 [2024-07-15 09:06:14.072192] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.737 [2024-07-15 09:06:14.072331] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.737 [2024-07-15 09:06:14.072356] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.737 [2024-07-15 09:06:14.072371] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.737 [2024-07-15 09:06:14.072383] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.737 [2024-07-15 09:06:14.072413] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.737 qpair failed and we were unable to recover it. 00:27:25.737 [2024-07-15 09:06:14.082314] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.737 [2024-07-15 09:06:14.082455] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.737 [2024-07-15 09:06:14.082479] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.737 [2024-07-15 09:06:14.082492] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.737 [2024-07-15 09:06:14.082504] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.737 [2024-07-15 09:06:14.082533] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.737 qpair failed and we were unable to recover it. 00:27:25.737 [2024-07-15 09:06:14.092294] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.737 [2024-07-15 09:06:14.092409] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.737 [2024-07-15 09:06:14.092434] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.737 [2024-07-15 09:06:14.092448] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.737 [2024-07-15 09:06:14.092461] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.737 [2024-07-15 09:06:14.092491] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.737 qpair failed and we were unable to recover it. 00:27:25.737 [2024-07-15 09:06:14.102281] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.737 [2024-07-15 09:06:14.102406] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.737 [2024-07-15 09:06:14.102433] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.737 [2024-07-15 09:06:14.102447] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.737 [2024-07-15 09:06:14.102460] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.737 [2024-07-15 09:06:14.102489] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.737 qpair failed and we were unable to recover it. 00:27:25.737 [2024-07-15 09:06:14.112415] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.737 [2024-07-15 09:06:14.112532] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.737 [2024-07-15 09:06:14.112557] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.737 [2024-07-15 09:06:14.112571] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.737 [2024-07-15 09:06:14.112584] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.737 [2024-07-15 09:06:14.112613] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.737 qpair failed and we were unable to recover it. 00:27:25.737 [2024-07-15 09:06:14.122367] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.737 [2024-07-15 09:06:14.122491] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.737 [2024-07-15 09:06:14.122517] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.737 [2024-07-15 09:06:14.122531] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.737 [2024-07-15 09:06:14.122543] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.737 [2024-07-15 09:06:14.122574] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.737 qpair failed and we were unable to recover it. 00:27:25.737 [2024-07-15 09:06:14.132408] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.737 [2024-07-15 09:06:14.132538] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.737 [2024-07-15 09:06:14.132564] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.737 [2024-07-15 09:06:14.132584] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.737 [2024-07-15 09:06:14.132598] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.737 [2024-07-15 09:06:14.132628] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.737 qpair failed and we were unable to recover it. 00:27:25.737 [2024-07-15 09:06:14.142402] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.737 [2024-07-15 09:06:14.142575] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.737 [2024-07-15 09:06:14.142601] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.737 [2024-07-15 09:06:14.142615] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.737 [2024-07-15 09:06:14.142627] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.737 [2024-07-15 09:06:14.142657] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.737 qpair failed and we were unable to recover it. 00:27:25.737 [2024-07-15 09:06:14.152421] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.737 [2024-07-15 09:06:14.152556] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.737 [2024-07-15 09:06:14.152582] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.737 [2024-07-15 09:06:14.152596] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.737 [2024-07-15 09:06:14.152609] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.737 [2024-07-15 09:06:14.152638] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.737 qpair failed and we were unable to recover it. 00:27:25.737 [2024-07-15 09:06:14.162460] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.737 [2024-07-15 09:06:14.162609] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.737 [2024-07-15 09:06:14.162634] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.737 [2024-07-15 09:06:14.162649] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.737 [2024-07-15 09:06:14.162662] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.737 [2024-07-15 09:06:14.162706] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.737 qpair failed and we were unable to recover it. 00:27:25.737 [2024-07-15 09:06:14.172466] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.737 [2024-07-15 09:06:14.172587] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.737 [2024-07-15 09:06:14.172612] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.737 [2024-07-15 09:06:14.172627] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.737 [2024-07-15 09:06:14.172639] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.737 [2024-07-15 09:06:14.172669] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.737 qpair failed and we were unable to recover it. 00:27:25.737 [2024-07-15 09:06:14.182547] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.737 [2024-07-15 09:06:14.182690] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.737 [2024-07-15 09:06:14.182715] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.737 [2024-07-15 09:06:14.182730] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.737 [2024-07-15 09:06:14.182743] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.737 [2024-07-15 09:06:14.182788] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.737 qpair failed and we were unable to recover it. 00:27:25.737 [2024-07-15 09:06:14.192537] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.738 [2024-07-15 09:06:14.192659] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.738 [2024-07-15 09:06:14.192684] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.738 [2024-07-15 09:06:14.192699] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.738 [2024-07-15 09:06:14.192711] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.738 [2024-07-15 09:06:14.192742] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.738 qpair failed and we were unable to recover it. 00:27:25.738 [2024-07-15 09:06:14.202557] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.738 [2024-07-15 09:06:14.202675] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.738 [2024-07-15 09:06:14.202700] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.738 [2024-07-15 09:06:14.202715] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.738 [2024-07-15 09:06:14.202728] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.738 [2024-07-15 09:06:14.202758] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.738 qpair failed and we were unable to recover it. 00:27:25.738 [2024-07-15 09:06:14.212639] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.738 [2024-07-15 09:06:14.212754] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.738 [2024-07-15 09:06:14.212779] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.738 [2024-07-15 09:06:14.212795] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.738 [2024-07-15 09:06:14.212808] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.738 [2024-07-15 09:06:14.212838] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.738 qpair failed and we were unable to recover it. 00:27:25.738 [2024-07-15 09:06:14.222733] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.738 [2024-07-15 09:06:14.222870] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.738 [2024-07-15 09:06:14.222910] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.738 [2024-07-15 09:06:14.222927] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.738 [2024-07-15 09:06:14.222940] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.738 [2024-07-15 09:06:14.222972] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.738 qpair failed and we were unable to recover it. 00:27:25.738 [2024-07-15 09:06:14.232670] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.738 [2024-07-15 09:06:14.232806] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.738 [2024-07-15 09:06:14.232832] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.738 [2024-07-15 09:06:14.232847] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.738 [2024-07-15 09:06:14.232860] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.738 [2024-07-15 09:06:14.232897] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.738 qpair failed and we were unable to recover it. 00:27:25.738 [2024-07-15 09:06:14.242666] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.738 [2024-07-15 09:06:14.242785] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.738 [2024-07-15 09:06:14.242811] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.738 [2024-07-15 09:06:14.242825] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.738 [2024-07-15 09:06:14.242838] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.738 [2024-07-15 09:06:14.242869] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.738 qpair failed and we were unable to recover it. 00:27:25.738 [2024-07-15 09:06:14.252742] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.738 [2024-07-15 09:06:14.252868] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.738 [2024-07-15 09:06:14.252901] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.738 [2024-07-15 09:06:14.252917] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.738 [2024-07-15 09:06:14.252930] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.738 [2024-07-15 09:06:14.252973] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.738 qpair failed and we were unable to recover it. 00:27:25.738 [2024-07-15 09:06:14.262751] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.738 [2024-07-15 09:06:14.262873] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.738 [2024-07-15 09:06:14.262906] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.738 [2024-07-15 09:06:14.262921] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.738 [2024-07-15 09:06:14.262934] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.738 [2024-07-15 09:06:14.262970] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.738 qpair failed and we were unable to recover it. 00:27:25.738 [2024-07-15 09:06:14.272902] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.738 [2024-07-15 09:06:14.273042] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.738 [2024-07-15 09:06:14.273068] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.738 [2024-07-15 09:06:14.273083] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.738 [2024-07-15 09:06:14.273096] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.738 [2024-07-15 09:06:14.273139] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.738 qpair failed and we were unable to recover it. 00:27:25.998 [2024-07-15 09:06:14.282850] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.998 [2024-07-15 09:06:14.283006] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.998 [2024-07-15 09:06:14.283036] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.998 [2024-07-15 09:06:14.283053] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.998 [2024-07-15 09:06:14.283067] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.998 [2024-07-15 09:06:14.283099] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.998 qpair failed and we were unable to recover it. 00:27:25.998 [2024-07-15 09:06:14.292872] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.998 [2024-07-15 09:06:14.293002] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.998 [2024-07-15 09:06:14.293028] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.998 [2024-07-15 09:06:14.293043] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.998 [2024-07-15 09:06:14.293056] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.998 [2024-07-15 09:06:14.293087] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.998 qpair failed and we were unable to recover it. 00:27:25.998 [2024-07-15 09:06:14.302922] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.998 [2024-07-15 09:06:14.303046] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.998 [2024-07-15 09:06:14.303071] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.998 [2024-07-15 09:06:14.303086] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.998 [2024-07-15 09:06:14.303099] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.998 [2024-07-15 09:06:14.303129] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.998 qpair failed and we were unable to recover it. 00:27:25.998 [2024-07-15 09:06:14.312938] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.998 [2024-07-15 09:06:14.313090] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.998 [2024-07-15 09:06:14.313122] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.998 [2024-07-15 09:06:14.313138] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.998 [2024-07-15 09:06:14.313151] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.998 [2024-07-15 09:06:14.313195] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.998 qpair failed and we were unable to recover it. 00:27:25.998 [2024-07-15 09:06:14.322899] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.998 [2024-07-15 09:06:14.323019] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.998 [2024-07-15 09:06:14.323045] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.998 [2024-07-15 09:06:14.323060] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.998 [2024-07-15 09:06:14.323073] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.998 [2024-07-15 09:06:14.323103] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.998 qpair failed and we were unable to recover it. 00:27:25.998 [2024-07-15 09:06:14.332944] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.998 [2024-07-15 09:06:14.333064] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.998 [2024-07-15 09:06:14.333090] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.998 [2024-07-15 09:06:14.333105] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.998 [2024-07-15 09:06:14.333119] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.998 [2024-07-15 09:06:14.333150] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.998 qpair failed and we were unable to recover it. 00:27:25.998 [2024-07-15 09:06:14.342999] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.998 [2024-07-15 09:06:14.343137] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.998 [2024-07-15 09:06:14.343162] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.998 [2024-07-15 09:06:14.343177] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.998 [2024-07-15 09:06:14.343190] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.998 [2024-07-15 09:06:14.343236] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.998 qpair failed and we were unable to recover it. 00:27:25.998 [2024-07-15 09:06:14.352989] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.998 [2024-07-15 09:06:14.353110] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.998 [2024-07-15 09:06:14.353135] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.998 [2024-07-15 09:06:14.353149] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.998 [2024-07-15 09:06:14.353162] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.998 [2024-07-15 09:06:14.353198] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.998 qpair failed and we were unable to recover it. 00:27:25.998 [2024-07-15 09:06:14.363046] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.998 [2024-07-15 09:06:14.363170] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.999 [2024-07-15 09:06:14.363195] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.999 [2024-07-15 09:06:14.363210] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.999 [2024-07-15 09:06:14.363223] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.999 [2024-07-15 09:06:14.363255] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.999 qpair failed and we were unable to recover it. 00:27:25.999 [2024-07-15 09:06:14.373056] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.999 [2024-07-15 09:06:14.373177] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.999 [2024-07-15 09:06:14.373204] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.999 [2024-07-15 09:06:14.373218] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.999 [2024-07-15 09:06:14.373231] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.999 [2024-07-15 09:06:14.373262] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.999 qpair failed and we were unable to recover it. 00:27:25.999 [2024-07-15 09:06:14.383092] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.999 [2024-07-15 09:06:14.383208] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.999 [2024-07-15 09:06:14.383233] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.999 [2024-07-15 09:06:14.383248] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.999 [2024-07-15 09:06:14.383261] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.999 [2024-07-15 09:06:14.383293] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.999 qpair failed and we were unable to recover it. 00:27:25.999 [2024-07-15 09:06:14.393253] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.999 [2024-07-15 09:06:14.393381] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.999 [2024-07-15 09:06:14.393407] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.999 [2024-07-15 09:06:14.393421] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.999 [2024-07-15 09:06:14.393434] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.999 [2024-07-15 09:06:14.393465] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.999 qpair failed and we were unable to recover it. 00:27:25.999 [2024-07-15 09:06:14.403143] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.999 [2024-07-15 09:06:14.403261] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.999 [2024-07-15 09:06:14.403291] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.999 [2024-07-15 09:06:14.403307] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.999 [2024-07-15 09:06:14.403320] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.999 [2024-07-15 09:06:14.403350] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.999 qpair failed and we were unable to recover it. 00:27:25.999 [2024-07-15 09:06:14.413180] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.999 [2024-07-15 09:06:14.413303] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.999 [2024-07-15 09:06:14.413329] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.999 [2024-07-15 09:06:14.413344] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.999 [2024-07-15 09:06:14.413357] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.999 [2024-07-15 09:06:14.413387] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.999 qpair failed and we were unable to recover it. 00:27:25.999 [2024-07-15 09:06:14.423200] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.999 [2024-07-15 09:06:14.423322] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.999 [2024-07-15 09:06:14.423347] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.999 [2024-07-15 09:06:14.423362] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.999 [2024-07-15 09:06:14.423375] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.999 [2024-07-15 09:06:14.423405] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.999 qpair failed and we were unable to recover it. 00:27:25.999 [2024-07-15 09:06:14.433268] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.999 [2024-07-15 09:06:14.433385] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.999 [2024-07-15 09:06:14.433409] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.999 [2024-07-15 09:06:14.433424] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.999 [2024-07-15 09:06:14.433437] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.999 [2024-07-15 09:06:14.433467] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.999 qpair failed and we were unable to recover it. 00:27:25.999 [2024-07-15 09:06:14.443256] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.999 [2024-07-15 09:06:14.443378] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.999 [2024-07-15 09:06:14.443404] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.999 [2024-07-15 09:06:14.443419] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.999 [2024-07-15 09:06:14.443442] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.999 [2024-07-15 09:06:14.443472] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.999 qpair failed and we were unable to recover it. 00:27:25.999 [2024-07-15 09:06:14.453332] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.999 [2024-07-15 09:06:14.453451] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.999 [2024-07-15 09:06:14.453477] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.999 [2024-07-15 09:06:14.453491] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.999 [2024-07-15 09:06:14.453504] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.999 [2024-07-15 09:06:14.453536] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.999 qpair failed and we were unable to recover it. 00:27:25.999 [2024-07-15 09:06:14.463430] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.999 [2024-07-15 09:06:14.463556] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:25.999 [2024-07-15 09:06:14.463582] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:25.999 [2024-07-15 09:06:14.463597] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:25.999 [2024-07-15 09:06:14.463610] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:25.999 [2024-07-15 09:06:14.463640] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:25.999 qpair failed and we were unable to recover it. 00:27:25.999 [2024-07-15 09:06:14.473335] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:25.999 [2024-07-15 09:06:14.473456] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.000 [2024-07-15 09:06:14.473482] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.000 [2024-07-15 09:06:14.473497] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.000 [2024-07-15 09:06:14.473511] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.000 [2024-07-15 09:06:14.473541] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.000 qpair failed and we were unable to recover it. 00:27:26.000 [2024-07-15 09:06:14.483436] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.000 [2024-07-15 09:06:14.483559] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.000 [2024-07-15 09:06:14.483584] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.000 [2024-07-15 09:06:14.483599] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.000 [2024-07-15 09:06:14.483614] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.000 [2024-07-15 09:06:14.483645] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.000 qpair failed and we were unable to recover it. 00:27:26.000 [2024-07-15 09:06:14.493459] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.000 [2024-07-15 09:06:14.493587] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.000 [2024-07-15 09:06:14.493612] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.000 [2024-07-15 09:06:14.493627] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.000 [2024-07-15 09:06:14.493641] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.000 [2024-07-15 09:06:14.493671] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.000 qpair failed and we were unable to recover it. 00:27:26.000 [2024-07-15 09:06:14.503541] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.000 [2024-07-15 09:06:14.503725] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.000 [2024-07-15 09:06:14.503750] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.000 [2024-07-15 09:06:14.503781] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.000 [2024-07-15 09:06:14.503795] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.000 [2024-07-15 09:06:14.503840] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.000 qpair failed and we were unable to recover it. 00:27:26.000 [2024-07-15 09:06:14.513474] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.000 [2024-07-15 09:06:14.513606] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.000 [2024-07-15 09:06:14.513632] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.000 [2024-07-15 09:06:14.513647] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.000 [2024-07-15 09:06:14.513661] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.000 [2024-07-15 09:06:14.513692] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.000 qpair failed and we were unable to recover it. 00:27:26.000 [2024-07-15 09:06:14.523508] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.000 [2024-07-15 09:06:14.523644] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.000 [2024-07-15 09:06:14.523671] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.000 [2024-07-15 09:06:14.523691] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.000 [2024-07-15 09:06:14.523706] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.000 [2024-07-15 09:06:14.523751] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.000 qpair failed and we were unable to recover it. 00:27:26.000 [2024-07-15 09:06:14.533519] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.000 [2024-07-15 09:06:14.533642] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.000 [2024-07-15 09:06:14.533668] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.000 [2024-07-15 09:06:14.533683] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.000 [2024-07-15 09:06:14.533702] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.000 [2024-07-15 09:06:14.533733] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.000 qpair failed and we were unable to recover it. 00:27:26.261 [2024-07-15 09:06:14.543603] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.261 [2024-07-15 09:06:14.543733] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.261 [2024-07-15 09:06:14.543758] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.261 [2024-07-15 09:06:14.543774] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.261 [2024-07-15 09:06:14.543787] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.261 [2024-07-15 09:06:14.543831] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.261 qpair failed and we were unable to recover it. 00:27:26.261 [2024-07-15 09:06:14.553610] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.261 [2024-07-15 09:06:14.553741] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.261 [2024-07-15 09:06:14.553767] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.261 [2024-07-15 09:06:14.553782] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.261 [2024-07-15 09:06:14.553796] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.261 [2024-07-15 09:06:14.553826] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.261 qpair failed and we were unable to recover it. 00:27:26.261 [2024-07-15 09:06:14.563609] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.261 [2024-07-15 09:06:14.563731] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.261 [2024-07-15 09:06:14.563756] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.261 [2024-07-15 09:06:14.563771] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.261 [2024-07-15 09:06:14.563784] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.261 [2024-07-15 09:06:14.563827] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.261 qpair failed and we were unable to recover it. 00:27:26.261 [2024-07-15 09:06:14.573632] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.261 [2024-07-15 09:06:14.573764] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.261 [2024-07-15 09:06:14.573789] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.261 [2024-07-15 09:06:14.573804] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.261 [2024-07-15 09:06:14.573817] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.261 [2024-07-15 09:06:14.573849] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.261 qpair failed and we were unable to recover it. 00:27:26.261 [2024-07-15 09:06:14.583688] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.261 [2024-07-15 09:06:14.583821] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.261 [2024-07-15 09:06:14.583846] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.261 [2024-07-15 09:06:14.583871] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.261 [2024-07-15 09:06:14.583893] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.261 [2024-07-15 09:06:14.583923] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.261 qpair failed and we were unable to recover it. 00:27:26.261 [2024-07-15 09:06:14.593676] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.261 [2024-07-15 09:06:14.593802] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.261 [2024-07-15 09:06:14.593826] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.261 [2024-07-15 09:06:14.593841] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.261 [2024-07-15 09:06:14.593854] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.261 [2024-07-15 09:06:14.593891] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.261 qpair failed and we were unable to recover it. 00:27:26.261 [2024-07-15 09:06:14.603732] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.261 [2024-07-15 09:06:14.603907] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.261 [2024-07-15 09:06:14.603933] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.261 [2024-07-15 09:06:14.603947] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.261 [2024-07-15 09:06:14.603961] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.261 [2024-07-15 09:06:14.603992] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.261 qpair failed and we were unable to recover it. 00:27:26.261 [2024-07-15 09:06:14.613723] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.261 [2024-07-15 09:06:14.613846] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.261 [2024-07-15 09:06:14.613871] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.261 [2024-07-15 09:06:14.613893] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.261 [2024-07-15 09:06:14.613908] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.261 [2024-07-15 09:06:14.613939] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.261 qpair failed and we were unable to recover it. 00:27:26.261 [2024-07-15 09:06:14.623776] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.261 [2024-07-15 09:06:14.623916] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.261 [2024-07-15 09:06:14.623941] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.261 [2024-07-15 09:06:14.623962] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.261 [2024-07-15 09:06:14.623977] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.261 [2024-07-15 09:06:14.624018] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.261 qpair failed and we were unable to recover it. 00:27:26.261 [2024-07-15 09:06:14.633798] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.261 [2024-07-15 09:06:14.633930] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.261 [2024-07-15 09:06:14.633956] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.261 [2024-07-15 09:06:14.633972] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.261 [2024-07-15 09:06:14.633985] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.261 [2024-07-15 09:06:14.634027] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.261 qpair failed and we were unable to recover it. 00:27:26.261 [2024-07-15 09:06:14.643828] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.261 [2024-07-15 09:06:14.643967] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.261 [2024-07-15 09:06:14.643993] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.261 [2024-07-15 09:06:14.644007] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.261 [2024-07-15 09:06:14.644020] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.261 [2024-07-15 09:06:14.644050] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.261 qpair failed and we were unable to recover it. 00:27:26.261 [2024-07-15 09:06:14.653841] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.261 [2024-07-15 09:06:14.653972] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.261 [2024-07-15 09:06:14.653998] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.261 [2024-07-15 09:06:14.654013] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.261 [2024-07-15 09:06:14.654026] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.261 [2024-07-15 09:06:14.654055] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.261 qpair failed and we were unable to recover it. 00:27:26.261 [2024-07-15 09:06:14.663919] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.261 [2024-07-15 09:06:14.664056] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.261 [2024-07-15 09:06:14.664082] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.261 [2024-07-15 09:06:14.664108] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.261 [2024-07-15 09:06:14.664120] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.261 [2024-07-15 09:06:14.664151] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.261 qpair failed and we were unable to recover it. 00:27:26.261 [2024-07-15 09:06:14.673906] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.261 [2024-07-15 09:06:14.674039] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.261 [2024-07-15 09:06:14.674065] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.261 [2024-07-15 09:06:14.674080] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.261 [2024-07-15 09:06:14.674093] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.261 [2024-07-15 09:06:14.674123] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.261 qpair failed and we were unable to recover it. 00:27:26.261 [2024-07-15 09:06:14.683926] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.261 [2024-07-15 09:06:14.684053] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.261 [2024-07-15 09:06:14.684078] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.261 [2024-07-15 09:06:14.684093] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.261 [2024-07-15 09:06:14.684106] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.261 [2024-07-15 09:06:14.684136] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.261 qpair failed and we were unable to recover it. 00:27:26.261 [2024-07-15 09:06:14.693976] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.261 [2024-07-15 09:06:14.694102] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.261 [2024-07-15 09:06:14.694127] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.261 [2024-07-15 09:06:14.694142] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.261 [2024-07-15 09:06:14.694156] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.261 [2024-07-15 09:06:14.694186] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.261 qpair failed and we were unable to recover it. 00:27:26.261 [2024-07-15 09:06:14.704024] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.261 [2024-07-15 09:06:14.704154] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.261 [2024-07-15 09:06:14.704178] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.261 [2024-07-15 09:06:14.704193] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.261 [2024-07-15 09:06:14.704206] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.261 [2024-07-15 09:06:14.704236] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.261 qpair failed and we were unable to recover it. 00:27:26.261 [2024-07-15 09:06:14.714019] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.261 [2024-07-15 09:06:14.714187] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.261 [2024-07-15 09:06:14.714217] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.261 [2024-07-15 09:06:14.714233] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.261 [2024-07-15 09:06:14.714246] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.261 [2024-07-15 09:06:14.714276] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.261 qpair failed and we were unable to recover it. 00:27:26.261 [2024-07-15 09:06:14.724042] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.261 [2024-07-15 09:06:14.724166] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.261 [2024-07-15 09:06:14.724190] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.261 [2024-07-15 09:06:14.724205] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.261 [2024-07-15 09:06:14.724218] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.261 [2024-07-15 09:06:14.724248] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.261 qpair failed and we were unable to recover it. 00:27:26.261 [2024-07-15 09:06:14.734084] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.261 [2024-07-15 09:06:14.734212] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.261 [2024-07-15 09:06:14.734238] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.261 [2024-07-15 09:06:14.734253] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.261 [2024-07-15 09:06:14.734266] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.261 [2024-07-15 09:06:14.734296] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.261 qpair failed and we were unable to recover it. 00:27:26.261 [2024-07-15 09:06:14.744107] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.261 [2024-07-15 09:06:14.744237] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.261 [2024-07-15 09:06:14.744261] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.261 [2024-07-15 09:06:14.744276] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.261 [2024-07-15 09:06:14.744289] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.261 [2024-07-15 09:06:14.744319] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.261 qpair failed and we were unable to recover it. 00:27:26.261 [2024-07-15 09:06:14.754129] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.261 [2024-07-15 09:06:14.754250] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.261 [2024-07-15 09:06:14.754275] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.261 [2024-07-15 09:06:14.754290] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.261 [2024-07-15 09:06:14.754304] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.261 [2024-07-15 09:06:14.754333] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.261 qpair failed and we were unable to recover it. 00:27:26.261 [2024-07-15 09:06:14.764167] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.261 [2024-07-15 09:06:14.764292] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.261 [2024-07-15 09:06:14.764317] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.261 [2024-07-15 09:06:14.764332] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.261 [2024-07-15 09:06:14.764345] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.261 [2024-07-15 09:06:14.764375] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.261 qpair failed and we were unable to recover it. 00:27:26.261 [2024-07-15 09:06:14.774205] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.261 [2024-07-15 09:06:14.774362] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.262 [2024-07-15 09:06:14.774387] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.262 [2024-07-15 09:06:14.774402] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.262 [2024-07-15 09:06:14.774415] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.262 [2024-07-15 09:06:14.774459] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.262 qpair failed and we were unable to recover it. 00:27:26.262 [2024-07-15 09:06:14.784247] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.262 [2024-07-15 09:06:14.784375] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.262 [2024-07-15 09:06:14.784400] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.262 [2024-07-15 09:06:14.784414] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.262 [2024-07-15 09:06:14.784428] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.262 [2024-07-15 09:06:14.784457] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.262 qpair failed and we were unable to recover it. 00:27:26.262 [2024-07-15 09:06:14.794278] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.262 [2024-07-15 09:06:14.794415] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.262 [2024-07-15 09:06:14.794441] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.262 [2024-07-15 09:06:14.794456] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.262 [2024-07-15 09:06:14.794470] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.262 [2024-07-15 09:06:14.794499] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.262 qpair failed and we were unable to recover it. 00:27:26.524 [2024-07-15 09:06:14.804354] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.524 [2024-07-15 09:06:14.804477] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.524 [2024-07-15 09:06:14.804508] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.524 [2024-07-15 09:06:14.804523] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.524 [2024-07-15 09:06:14.804537] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.524 [2024-07-15 09:06:14.804567] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.524 qpair failed and we were unable to recover it. 00:27:26.524 [2024-07-15 09:06:14.814358] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.524 [2024-07-15 09:06:14.814486] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.524 [2024-07-15 09:06:14.814516] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.524 [2024-07-15 09:06:14.814531] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.524 [2024-07-15 09:06:14.814544] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.524 [2024-07-15 09:06:14.814589] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.524 qpair failed and we were unable to recover it. 00:27:26.524 [2024-07-15 09:06:14.824390] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.524 [2024-07-15 09:06:14.824521] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.524 [2024-07-15 09:06:14.824548] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.524 [2024-07-15 09:06:14.824568] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.524 [2024-07-15 09:06:14.824582] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.524 [2024-07-15 09:06:14.824628] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.524 qpair failed and we were unable to recover it. 00:27:26.524 [2024-07-15 09:06:14.834397] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.524 [2024-07-15 09:06:14.834565] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.524 [2024-07-15 09:06:14.834592] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.524 [2024-07-15 09:06:14.834607] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.524 [2024-07-15 09:06:14.834636] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.524 [2024-07-15 09:06:14.834666] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.524 qpair failed and we were unable to recover it. 00:27:26.524 [2024-07-15 09:06:14.844434] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.524 [2024-07-15 09:06:14.844572] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.524 [2024-07-15 09:06:14.844599] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.524 [2024-07-15 09:06:14.844629] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.524 [2024-07-15 09:06:14.844658] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.524 [2024-07-15 09:06:14.844696] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.524 qpair failed and we were unable to recover it. 00:27:26.524 [2024-07-15 09:06:14.854449] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.524 [2024-07-15 09:06:14.854568] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.524 [2024-07-15 09:06:14.854595] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.524 [2024-07-15 09:06:14.854610] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.524 [2024-07-15 09:06:14.854623] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.524 [2024-07-15 09:06:14.854654] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.524 qpair failed and we were unable to recover it. 00:27:26.524 [2024-07-15 09:06:14.864497] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.524 [2024-07-15 09:06:14.864630] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.524 [2024-07-15 09:06:14.864656] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.524 [2024-07-15 09:06:14.864671] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.524 [2024-07-15 09:06:14.864684] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.524 [2024-07-15 09:06:14.864714] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.524 qpair failed and we were unable to recover it. 00:27:26.524 [2024-07-15 09:06:14.874504] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.524 [2024-07-15 09:06:14.874626] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.524 [2024-07-15 09:06:14.874650] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.524 [2024-07-15 09:06:14.874665] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.524 [2024-07-15 09:06:14.874678] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.524 [2024-07-15 09:06:14.874709] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.524 qpair failed and we were unable to recover it. 00:27:26.524 [2024-07-15 09:06:14.884548] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.524 [2024-07-15 09:06:14.884667] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.524 [2024-07-15 09:06:14.884693] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.524 [2024-07-15 09:06:14.884708] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.524 [2024-07-15 09:06:14.884721] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.524 [2024-07-15 09:06:14.884751] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.524 qpair failed and we were unable to recover it. 00:27:26.524 [2024-07-15 09:06:14.894550] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.524 [2024-07-15 09:06:14.894674] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.524 [2024-07-15 09:06:14.894705] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.524 [2024-07-15 09:06:14.894721] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.525 [2024-07-15 09:06:14.894734] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.525 [2024-07-15 09:06:14.894764] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.525 qpair failed and we were unable to recover it. 00:27:26.525 [2024-07-15 09:06:14.904605] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.525 [2024-07-15 09:06:14.904729] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.525 [2024-07-15 09:06:14.904755] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.525 [2024-07-15 09:06:14.904770] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.525 [2024-07-15 09:06:14.904783] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.525 [2024-07-15 09:06:14.904826] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.525 qpair failed and we were unable to recover it. 00:27:26.525 [2024-07-15 09:06:14.914631] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.525 [2024-07-15 09:06:14.914764] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.525 [2024-07-15 09:06:14.914791] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.525 [2024-07-15 09:06:14.914810] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.525 [2024-07-15 09:06:14.914825] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.525 [2024-07-15 09:06:14.914870] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.525 qpair failed and we were unable to recover it. 00:27:26.525 [2024-07-15 09:06:14.924649] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.525 [2024-07-15 09:06:14.924773] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.525 [2024-07-15 09:06:14.924800] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.525 [2024-07-15 09:06:14.924816] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.525 [2024-07-15 09:06:14.924829] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.525 [2024-07-15 09:06:14.924859] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.525 qpair failed and we were unable to recover it. 00:27:26.525 [2024-07-15 09:06:14.934758] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.525 [2024-07-15 09:06:14.934870] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.525 [2024-07-15 09:06:14.934903] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.525 [2024-07-15 09:06:14.934917] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.525 [2024-07-15 09:06:14.934936] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.525 [2024-07-15 09:06:14.934967] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.525 qpair failed and we were unable to recover it. 00:27:26.525 [2024-07-15 09:06:14.944709] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.525 [2024-07-15 09:06:14.944841] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.525 [2024-07-15 09:06:14.944867] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.525 [2024-07-15 09:06:14.944888] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.525 [2024-07-15 09:06:14.944903] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.525 [2024-07-15 09:06:14.944933] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.525 qpair failed and we were unable to recover it. 00:27:26.525 [2024-07-15 09:06:14.954737] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.525 [2024-07-15 09:06:14.954858] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.525 [2024-07-15 09:06:14.954891] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.525 [2024-07-15 09:06:14.954907] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.525 [2024-07-15 09:06:14.954920] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.525 [2024-07-15 09:06:14.954950] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.525 qpair failed and we were unable to recover it. 00:27:26.525 [2024-07-15 09:06:14.964790] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.525 [2024-07-15 09:06:14.964917] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.525 [2024-07-15 09:06:14.964941] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.525 [2024-07-15 09:06:14.964955] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.525 [2024-07-15 09:06:14.964969] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.525 [2024-07-15 09:06:14.964999] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.525 qpair failed and we were unable to recover it. 00:27:26.525 [2024-07-15 09:06:14.974816] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.525 [2024-07-15 09:06:14.974939] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.525 [2024-07-15 09:06:14.974964] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.525 [2024-07-15 09:06:14.974978] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.525 [2024-07-15 09:06:14.974992] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.525 [2024-07-15 09:06:14.975022] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.525 qpair failed and we were unable to recover it. 00:27:26.525 [2024-07-15 09:06:14.984833] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.525 [2024-07-15 09:06:14.984970] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.525 [2024-07-15 09:06:14.984997] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.525 [2024-07-15 09:06:14.985012] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.525 [2024-07-15 09:06:14.985026] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.525 [2024-07-15 09:06:14.985056] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.525 qpair failed and we were unable to recover it. 00:27:26.525 [2024-07-15 09:06:14.994848] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.525 [2024-07-15 09:06:14.994984] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.525 [2024-07-15 09:06:14.995011] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.525 [2024-07-15 09:06:14.995026] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.525 [2024-07-15 09:06:14.995039] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.525 [2024-07-15 09:06:14.995069] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.525 qpair failed and we were unable to recover it. 00:27:26.525 [2024-07-15 09:06:15.004917] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.525 [2024-07-15 09:06:15.005036] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.525 [2024-07-15 09:06:15.005063] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.525 [2024-07-15 09:06:15.005079] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.525 [2024-07-15 09:06:15.005093] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.525 [2024-07-15 09:06:15.005123] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.525 qpair failed and we were unable to recover it. 00:27:26.525 [2024-07-15 09:06:15.014914] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.525 [2024-07-15 09:06:15.015033] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.525 [2024-07-15 09:06:15.015059] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.525 [2024-07-15 09:06:15.015074] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.525 [2024-07-15 09:06:15.015088] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.525 [2024-07-15 09:06:15.015117] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.525 qpair failed and we were unable to recover it. 00:27:26.525 [2024-07-15 09:06:15.024958] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.525 [2024-07-15 09:06:15.025079] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.525 [2024-07-15 09:06:15.025105] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.525 [2024-07-15 09:06:15.025120] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.525 [2024-07-15 09:06:15.025139] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.525 [2024-07-15 09:06:15.025171] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.525 qpair failed and we were unable to recover it. 00:27:26.525 [2024-07-15 09:06:15.034989] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.525 [2024-07-15 09:06:15.035114] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.525 [2024-07-15 09:06:15.035138] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.525 [2024-07-15 09:06:15.035153] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.525 [2024-07-15 09:06:15.035166] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.526 [2024-07-15 09:06:15.035196] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.526 qpair failed and we were unable to recover it. 00:27:26.526 [2024-07-15 09:06:15.045004] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.526 [2024-07-15 09:06:15.045121] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.526 [2024-07-15 09:06:15.045145] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.526 [2024-07-15 09:06:15.045160] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.526 [2024-07-15 09:06:15.045172] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.526 [2024-07-15 09:06:15.045203] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.526 qpair failed and we were unable to recover it. 00:27:26.526 [2024-07-15 09:06:15.055030] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.526 [2024-07-15 09:06:15.055144] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.526 [2024-07-15 09:06:15.055167] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.526 [2024-07-15 09:06:15.055182] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.526 [2024-07-15 09:06:15.055195] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.526 [2024-07-15 09:06:15.055226] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.526 qpair failed and we were unable to recover it. 00:27:26.526 [2024-07-15 09:06:15.065097] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.526 [2024-07-15 09:06:15.065233] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.526 [2024-07-15 09:06:15.065263] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.526 [2024-07-15 09:06:15.065278] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.526 [2024-07-15 09:06:15.065291] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.526 [2024-07-15 09:06:15.065336] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.526 qpair failed and we were unable to recover it. 00:27:26.787 [2024-07-15 09:06:15.075119] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.787 [2024-07-15 09:06:15.075245] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.787 [2024-07-15 09:06:15.075270] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.787 [2024-07-15 09:06:15.075285] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.787 [2024-07-15 09:06:15.075298] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.787 [2024-07-15 09:06:15.075327] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.787 qpair failed and we were unable to recover it. 00:27:26.787 [2024-07-15 09:06:15.085164] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.787 [2024-07-15 09:06:15.085291] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.787 [2024-07-15 09:06:15.085316] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.787 [2024-07-15 09:06:15.085330] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.787 [2024-07-15 09:06:15.085343] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.787 [2024-07-15 09:06:15.085372] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.787 qpair failed and we were unable to recover it. 00:27:26.787 [2024-07-15 09:06:15.095203] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.787 [2024-07-15 09:06:15.095334] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.787 [2024-07-15 09:06:15.095360] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.787 [2024-07-15 09:06:15.095375] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.787 [2024-07-15 09:06:15.095388] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.787 [2024-07-15 09:06:15.095418] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.787 qpair failed and we were unable to recover it. 00:27:26.787 [2024-07-15 09:06:15.105211] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.787 [2024-07-15 09:06:15.105344] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.787 [2024-07-15 09:06:15.105370] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.787 [2024-07-15 09:06:15.105385] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.787 [2024-07-15 09:06:15.105397] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.787 [2024-07-15 09:06:15.105426] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.787 qpair failed and we were unable to recover it. 00:27:26.787 [2024-07-15 09:06:15.115204] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.787 [2024-07-15 09:06:15.115328] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.787 [2024-07-15 09:06:15.115354] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.787 [2024-07-15 09:06:15.115375] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.787 [2024-07-15 09:06:15.115389] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.787 [2024-07-15 09:06:15.115419] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.787 qpair failed and we were unable to recover it. 00:27:26.787 [2024-07-15 09:06:15.125281] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.787 [2024-07-15 09:06:15.125397] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.787 [2024-07-15 09:06:15.125422] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.787 [2024-07-15 09:06:15.125437] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.787 [2024-07-15 09:06:15.125451] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.787 [2024-07-15 09:06:15.125482] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.787 qpair failed and we were unable to recover it. 00:27:26.787 [2024-07-15 09:06:15.135267] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.787 [2024-07-15 09:06:15.135387] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.787 [2024-07-15 09:06:15.135412] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.787 [2024-07-15 09:06:15.135427] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.787 [2024-07-15 09:06:15.135439] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.787 [2024-07-15 09:06:15.135470] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.787 qpair failed and we were unable to recover it. 00:27:26.787 [2024-07-15 09:06:15.145352] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.787 [2024-07-15 09:06:15.145525] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.787 [2024-07-15 09:06:15.145550] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.787 [2024-07-15 09:06:15.145564] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.787 [2024-07-15 09:06:15.145577] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.787 [2024-07-15 09:06:15.145608] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.787 qpair failed and we were unable to recover it. 00:27:26.787 [2024-07-15 09:06:15.155331] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.787 [2024-07-15 09:06:15.155452] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.787 [2024-07-15 09:06:15.155478] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.787 [2024-07-15 09:06:15.155492] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.787 [2024-07-15 09:06:15.155505] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.787 [2024-07-15 09:06:15.155535] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.787 qpair failed and we were unable to recover it. 00:27:26.787 [2024-07-15 09:06:15.165405] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.787 [2024-07-15 09:06:15.165534] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.787 [2024-07-15 09:06:15.165561] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.787 [2024-07-15 09:06:15.165585] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.787 [2024-07-15 09:06:15.165598] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.787 [2024-07-15 09:06:15.165627] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.787 qpair failed and we were unable to recover it. 00:27:26.787 [2024-07-15 09:06:15.175448] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.787 [2024-07-15 09:06:15.175600] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.787 [2024-07-15 09:06:15.175627] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.787 [2024-07-15 09:06:15.175642] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.787 [2024-07-15 09:06:15.175659] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.787 [2024-07-15 09:06:15.175703] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.787 qpair failed and we were unable to recover it. 00:27:26.787 [2024-07-15 09:06:15.185419] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.788 [2024-07-15 09:06:15.185543] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.788 [2024-07-15 09:06:15.185569] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.788 [2024-07-15 09:06:15.185584] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.788 [2024-07-15 09:06:15.185597] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.788 [2024-07-15 09:06:15.185627] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.788 qpair failed and we were unable to recover it. 00:27:26.788 [2024-07-15 09:06:15.195437] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.788 [2024-07-15 09:06:15.195555] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.788 [2024-07-15 09:06:15.195582] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.788 [2024-07-15 09:06:15.195597] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.788 [2024-07-15 09:06:15.195610] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.788 [2024-07-15 09:06:15.195640] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.788 qpair failed and we were unable to recover it. 00:27:26.788 [2024-07-15 09:06:15.205490] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.788 [2024-07-15 09:06:15.205609] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.788 [2024-07-15 09:06:15.205635] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.788 [2024-07-15 09:06:15.205658] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.788 [2024-07-15 09:06:15.205673] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.788 [2024-07-15 09:06:15.205703] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.788 qpair failed and we were unable to recover it. 00:27:26.788 [2024-07-15 09:06:15.215505] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.788 [2024-07-15 09:06:15.215623] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.788 [2024-07-15 09:06:15.215649] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.788 [2024-07-15 09:06:15.215663] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.788 [2024-07-15 09:06:15.215677] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.788 [2024-07-15 09:06:15.215706] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.788 qpair failed and we were unable to recover it. 00:27:26.788 [2024-07-15 09:06:15.225560] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.788 [2024-07-15 09:06:15.225716] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.788 [2024-07-15 09:06:15.225742] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.788 [2024-07-15 09:06:15.225760] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.788 [2024-07-15 09:06:15.225773] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.788 [2024-07-15 09:06:15.225818] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.788 qpair failed and we were unable to recover it. 00:27:26.788 [2024-07-15 09:06:15.235563] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.788 [2024-07-15 09:06:15.235685] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.788 [2024-07-15 09:06:15.235711] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.788 [2024-07-15 09:06:15.235727] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.788 [2024-07-15 09:06:15.235739] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.788 [2024-07-15 09:06:15.235769] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.788 qpair failed and we were unable to recover it. 00:27:26.788 [2024-07-15 09:06:15.245679] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.788 [2024-07-15 09:06:15.245796] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.788 [2024-07-15 09:06:15.245822] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.788 [2024-07-15 09:06:15.245837] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.788 [2024-07-15 09:06:15.245850] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.788 [2024-07-15 09:06:15.245887] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.788 qpair failed and we were unable to recover it. 00:27:26.788 [2024-07-15 09:06:15.255661] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.788 [2024-07-15 09:06:15.255800] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.788 [2024-07-15 09:06:15.255825] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.788 [2024-07-15 09:06:15.255841] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.788 [2024-07-15 09:06:15.255853] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.788 [2024-07-15 09:06:15.255890] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.788 qpair failed and we were unable to recover it. 00:27:26.788 [2024-07-15 09:06:15.265672] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.788 [2024-07-15 09:06:15.265844] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.788 [2024-07-15 09:06:15.265868] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.788 [2024-07-15 09:06:15.265893] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.788 [2024-07-15 09:06:15.265907] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.788 [2024-07-15 09:06:15.265942] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.788 qpair failed and we were unable to recover it. 00:27:26.788 [2024-07-15 09:06:15.275730] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.788 [2024-07-15 09:06:15.275899] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.788 [2024-07-15 09:06:15.275929] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.788 [2024-07-15 09:06:15.275945] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.788 [2024-07-15 09:06:15.275959] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.788 [2024-07-15 09:06:15.275990] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.788 qpair failed and we were unable to recover it. 00:27:26.788 [2024-07-15 09:06:15.285734] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.788 [2024-07-15 09:06:15.285858] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.788 [2024-07-15 09:06:15.285892] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.788 [2024-07-15 09:06:15.285909] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.788 [2024-07-15 09:06:15.285926] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.788 [2024-07-15 09:06:15.285956] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.788 qpair failed and we were unable to recover it. 00:27:26.788 [2024-07-15 09:06:15.295770] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.788 [2024-07-15 09:06:15.295903] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.788 [2024-07-15 09:06:15.295947] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.788 [2024-07-15 09:06:15.295964] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.788 [2024-07-15 09:06:15.295977] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.788 [2024-07-15 09:06:15.296020] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.788 qpair failed and we were unable to recover it. 00:27:26.788 [2024-07-15 09:06:15.305791] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.788 [2024-07-15 09:06:15.305939] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.788 [2024-07-15 09:06:15.305965] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.788 [2024-07-15 09:06:15.305980] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.788 [2024-07-15 09:06:15.305993] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.788 [2024-07-15 09:06:15.306023] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.788 qpair failed and we were unable to recover it. 00:27:26.788 [2024-07-15 09:06:15.315859] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.788 [2024-07-15 09:06:15.315992] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.788 [2024-07-15 09:06:15.316021] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.788 [2024-07-15 09:06:15.316036] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.788 [2024-07-15 09:06:15.316053] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.788 [2024-07-15 09:06:15.316086] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.788 qpair failed and we were unable to recover it. 00:27:26.788 [2024-07-15 09:06:15.325843] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:26.788 [2024-07-15 09:06:15.326012] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:26.788 [2024-07-15 09:06:15.326038] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:26.788 [2024-07-15 09:06:15.326053] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:26.788 [2024-07-15 09:06:15.326069] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:26.788 [2024-07-15 09:06:15.326111] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.788 qpair failed and we were unable to recover it. 00:27:27.048 [2024-07-15 09:06:15.335864] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.048 [2024-07-15 09:06:15.336012] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.048 [2024-07-15 09:06:15.336038] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.048 [2024-07-15 09:06:15.336053] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.048 [2024-07-15 09:06:15.336074] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.048 [2024-07-15 09:06:15.336109] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.048 qpair failed and we were unable to recover it. 00:27:27.048 [2024-07-15 09:06:15.345914] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.048 [2024-07-15 09:06:15.346042] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.048 [2024-07-15 09:06:15.346068] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.048 [2024-07-15 09:06:15.346082] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.048 [2024-07-15 09:06:15.346095] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.048 [2024-07-15 09:06:15.346125] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.048 qpair failed and we were unable to recover it. 00:27:27.048 [2024-07-15 09:06:15.355925] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.049 [2024-07-15 09:06:15.356095] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.049 [2024-07-15 09:06:15.356121] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.049 [2024-07-15 09:06:15.356137] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.049 [2024-07-15 09:06:15.356150] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.049 [2024-07-15 09:06:15.356179] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.049 qpair failed and we were unable to recover it. 00:27:27.049 [2024-07-15 09:06:15.365964] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.049 [2024-07-15 09:06:15.366110] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.049 [2024-07-15 09:06:15.366137] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.049 [2024-07-15 09:06:15.366152] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.049 [2024-07-15 09:06:15.366169] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.049 [2024-07-15 09:06:15.366214] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.049 qpair failed and we were unable to recover it. 00:27:27.049 [2024-07-15 09:06:15.376002] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.049 [2024-07-15 09:06:15.376169] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.049 [2024-07-15 09:06:15.376196] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.049 [2024-07-15 09:06:15.376211] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.049 [2024-07-15 09:06:15.376240] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.049 [2024-07-15 09:06:15.376270] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.049 qpair failed and we were unable to recover it. 00:27:27.049 [2024-07-15 09:06:15.386039] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.049 [2024-07-15 09:06:15.386170] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.049 [2024-07-15 09:06:15.386202] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.049 [2024-07-15 09:06:15.386218] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.049 [2024-07-15 09:06:15.386231] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.049 [2024-07-15 09:06:15.386276] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.049 qpair failed and we were unable to recover it. 00:27:27.049 [2024-07-15 09:06:15.396058] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.049 [2024-07-15 09:06:15.396196] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.049 [2024-07-15 09:06:15.396223] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.049 [2024-07-15 09:06:15.396239] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.049 [2024-07-15 09:06:15.396252] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.049 [2024-07-15 09:06:15.396310] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.049 qpair failed and we were unable to recover it. 00:27:27.049 [2024-07-15 09:06:15.406061] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.049 [2024-07-15 09:06:15.406184] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.049 [2024-07-15 09:06:15.406210] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.049 [2024-07-15 09:06:15.406226] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.049 [2024-07-15 09:06:15.406239] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.049 [2024-07-15 09:06:15.406270] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.049 qpair failed and we were unable to recover it. 00:27:27.049 [2024-07-15 09:06:15.416235] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.049 [2024-07-15 09:06:15.416374] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.049 [2024-07-15 09:06:15.416400] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.049 [2024-07-15 09:06:15.416415] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.049 [2024-07-15 09:06:15.416428] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.049 [2024-07-15 09:06:15.416458] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.049 qpair failed and we were unable to recover it. 00:27:27.049 [2024-07-15 09:06:15.426129] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.049 [2024-07-15 09:06:15.426253] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.049 [2024-07-15 09:06:15.426280] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.049 [2024-07-15 09:06:15.426296] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.049 [2024-07-15 09:06:15.426309] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.049 [2024-07-15 09:06:15.426344] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.049 qpair failed and we were unable to recover it. 00:27:27.049 [2024-07-15 09:06:15.436201] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.049 [2024-07-15 09:06:15.436318] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.049 [2024-07-15 09:06:15.436342] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.049 [2024-07-15 09:06:15.436358] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.049 [2024-07-15 09:06:15.436371] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.049 [2024-07-15 09:06:15.436401] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.049 qpair failed and we were unable to recover it. 00:27:27.049 [2024-07-15 09:06:15.446185] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.049 [2024-07-15 09:06:15.446310] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.049 [2024-07-15 09:06:15.446337] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.049 [2024-07-15 09:06:15.446356] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.049 [2024-07-15 09:06:15.446369] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.049 [2024-07-15 09:06:15.446399] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.049 qpair failed and we were unable to recover it. 00:27:27.049 [2024-07-15 09:06:15.456227] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.049 [2024-07-15 09:06:15.456380] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.049 [2024-07-15 09:06:15.456408] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.049 [2024-07-15 09:06:15.456427] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.049 [2024-07-15 09:06:15.456456] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.049 [2024-07-15 09:06:15.456488] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.049 qpair failed and we were unable to recover it. 00:27:27.049 [2024-07-15 09:06:15.466359] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.049 [2024-07-15 09:06:15.466487] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.049 [2024-07-15 09:06:15.466513] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.049 [2024-07-15 09:06:15.466529] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.049 [2024-07-15 09:06:15.466542] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.049 [2024-07-15 09:06:15.466588] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.049 qpair failed and we were unable to recover it. 00:27:27.049 [2024-07-15 09:06:15.476292] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.049 [2024-07-15 09:06:15.476422] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.049 [2024-07-15 09:06:15.476447] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.049 [2024-07-15 09:06:15.476462] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.049 [2024-07-15 09:06:15.476475] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.049 [2024-07-15 09:06:15.476505] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.049 qpair failed and we were unable to recover it. 00:27:27.049 [2024-07-15 09:06:15.486310] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.049 [2024-07-15 09:06:15.486422] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.049 [2024-07-15 09:06:15.486447] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.049 [2024-07-15 09:06:15.486462] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.049 [2024-07-15 09:06:15.486475] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.049 [2024-07-15 09:06:15.486506] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.049 qpair failed and we were unable to recover it. 00:27:27.049 [2024-07-15 09:06:15.496388] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.049 [2024-07-15 09:06:15.496573] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.049 [2024-07-15 09:06:15.496604] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.049 [2024-07-15 09:06:15.496636] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.050 [2024-07-15 09:06:15.496649] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.050 [2024-07-15 09:06:15.496680] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.050 qpair failed and we were unable to recover it. 00:27:27.050 [2024-07-15 09:06:15.506378] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.050 [2024-07-15 09:06:15.506499] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.050 [2024-07-15 09:06:15.506524] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.050 [2024-07-15 09:06:15.506539] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.050 [2024-07-15 09:06:15.506552] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.050 [2024-07-15 09:06:15.506583] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.050 qpair failed and we were unable to recover it. 00:27:27.050 [2024-07-15 09:06:15.516417] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.050 [2024-07-15 09:06:15.516541] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.050 [2024-07-15 09:06:15.516576] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.050 [2024-07-15 09:06:15.516591] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.050 [2024-07-15 09:06:15.516610] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.050 [2024-07-15 09:06:15.516641] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.050 qpair failed and we were unable to recover it. 00:27:27.050 [2024-07-15 09:06:15.526446] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.050 [2024-07-15 09:06:15.526562] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.050 [2024-07-15 09:06:15.526587] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.050 [2024-07-15 09:06:15.526602] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.050 [2024-07-15 09:06:15.526615] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.050 [2024-07-15 09:06:15.526645] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.050 qpair failed and we were unable to recover it. 00:27:27.050 [2024-07-15 09:06:15.536499] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.050 [2024-07-15 09:06:15.536634] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.050 [2024-07-15 09:06:15.536662] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.050 [2024-07-15 09:06:15.536678] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.050 [2024-07-15 09:06:15.536706] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.050 [2024-07-15 09:06:15.536752] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.050 qpair failed and we were unable to recover it. 00:27:27.050 [2024-07-15 09:06:15.546589] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.050 [2024-07-15 09:06:15.546726] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.050 [2024-07-15 09:06:15.546755] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.050 [2024-07-15 09:06:15.546770] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.050 [2024-07-15 09:06:15.546783] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.050 [2024-07-15 09:06:15.546814] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.050 qpair failed and we were unable to recover it. 00:27:27.050 [2024-07-15 09:06:15.556541] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.050 [2024-07-15 09:06:15.556661] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.050 [2024-07-15 09:06:15.556689] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.050 [2024-07-15 09:06:15.556704] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.050 [2024-07-15 09:06:15.556717] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.050 [2024-07-15 09:06:15.556747] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.050 qpair failed and we were unable to recover it. 00:27:27.050 [2024-07-15 09:06:15.566562] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.050 [2024-07-15 09:06:15.566682] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.050 [2024-07-15 09:06:15.566707] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.050 [2024-07-15 09:06:15.566722] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.050 [2024-07-15 09:06:15.566735] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.050 [2024-07-15 09:06:15.566766] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.050 qpair failed and we were unable to recover it. 00:27:27.050 [2024-07-15 09:06:15.576601] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.050 [2024-07-15 09:06:15.576752] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.050 [2024-07-15 09:06:15.576779] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.050 [2024-07-15 09:06:15.576794] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.050 [2024-07-15 09:06:15.576807] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.050 [2024-07-15 09:06:15.576837] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.050 qpair failed and we were unable to recover it. 00:27:27.050 [2024-07-15 09:06:15.586637] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.050 [2024-07-15 09:06:15.586766] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.050 [2024-07-15 09:06:15.586792] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.050 [2024-07-15 09:06:15.586807] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.050 [2024-07-15 09:06:15.586820] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.050 [2024-07-15 09:06:15.586852] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.050 qpair failed and we were unable to recover it. 00:27:27.310 [2024-07-15 09:06:15.596681] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.310 [2024-07-15 09:06:15.596802] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.310 [2024-07-15 09:06:15.596828] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.310 [2024-07-15 09:06:15.596843] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.310 [2024-07-15 09:06:15.596856] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.310 [2024-07-15 09:06:15.596907] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.310 qpair failed and we were unable to recover it. 00:27:27.310 [2024-07-15 09:06:15.606668] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.310 [2024-07-15 09:06:15.606788] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.310 [2024-07-15 09:06:15.606814] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.310 [2024-07-15 09:06:15.606837] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.310 [2024-07-15 09:06:15.606853] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.310 [2024-07-15 09:06:15.606889] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.310 qpair failed and we were unable to recover it. 00:27:27.310 [2024-07-15 09:06:15.616696] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.310 [2024-07-15 09:06:15.616812] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.310 [2024-07-15 09:06:15.616838] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.310 [2024-07-15 09:06:15.616852] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.310 [2024-07-15 09:06:15.616865] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.310 [2024-07-15 09:06:15.616905] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.310 qpair failed and we were unable to recover it. 00:27:27.310 [2024-07-15 09:06:15.626791] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.310 [2024-07-15 09:06:15.626947] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.310 [2024-07-15 09:06:15.626974] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.310 [2024-07-15 09:06:15.626989] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.310 [2024-07-15 09:06:15.627002] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.310 [2024-07-15 09:06:15.627033] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.310 qpair failed and we were unable to recover it. 00:27:27.310 [2024-07-15 09:06:15.636783] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.310 [2024-07-15 09:06:15.636918] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.310 [2024-07-15 09:06:15.636945] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.310 [2024-07-15 09:06:15.636965] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.310 [2024-07-15 09:06:15.636979] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.310 [2024-07-15 09:06:15.637010] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.310 qpair failed and we were unable to recover it. 00:27:27.310 [2024-07-15 09:06:15.646805] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.310 [2024-07-15 09:06:15.646933] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.310 [2024-07-15 09:06:15.646960] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.310 [2024-07-15 09:06:15.646975] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.310 [2024-07-15 09:06:15.646999] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.310 [2024-07-15 09:06:15.647030] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.310 qpair failed and we were unable to recover it. 00:27:27.310 [2024-07-15 09:06:15.656830] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.310 [2024-07-15 09:06:15.656955] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.310 [2024-07-15 09:06:15.656982] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.310 [2024-07-15 09:06:15.656997] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.310 [2024-07-15 09:06:15.657010] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.310 [2024-07-15 09:06:15.657041] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.310 qpair failed and we were unable to recover it. 00:27:27.310 [2024-07-15 09:06:15.666872] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.310 [2024-07-15 09:06:15.667007] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.310 [2024-07-15 09:06:15.667033] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.310 [2024-07-15 09:06:15.667048] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.310 [2024-07-15 09:06:15.667061] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.310 [2024-07-15 09:06:15.667092] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.310 qpair failed and we were unable to recover it. 00:27:27.310 [2024-07-15 09:06:15.676911] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.310 [2024-07-15 09:06:15.677032] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.310 [2024-07-15 09:06:15.677058] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.310 [2024-07-15 09:06:15.677074] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.310 [2024-07-15 09:06:15.677087] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.310 [2024-07-15 09:06:15.677118] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.310 qpair failed and we were unable to recover it. 00:27:27.310 [2024-07-15 09:06:15.686922] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.310 [2024-07-15 09:06:15.687042] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.310 [2024-07-15 09:06:15.687069] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.310 [2024-07-15 09:06:15.687087] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.310 [2024-07-15 09:06:15.687102] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.310 [2024-07-15 09:06:15.687133] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.310 qpair failed and we were unable to recover it. 00:27:27.310 [2024-07-15 09:06:15.696956] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.310 [2024-07-15 09:06:15.697074] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.310 [2024-07-15 09:06:15.697100] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.310 [2024-07-15 09:06:15.697121] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.311 [2024-07-15 09:06:15.697136] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.311 [2024-07-15 09:06:15.697166] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.311 qpair failed and we were unable to recover it. 00:27:27.311 [2024-07-15 09:06:15.706977] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.311 [2024-07-15 09:06:15.707108] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.311 [2024-07-15 09:06:15.707134] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.311 [2024-07-15 09:06:15.707150] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.311 [2024-07-15 09:06:15.707162] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.311 [2024-07-15 09:06:15.707192] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.311 qpair failed and we were unable to recover it. 00:27:27.311 [2024-07-15 09:06:15.717026] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.311 [2024-07-15 09:06:15.717146] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.311 [2024-07-15 09:06:15.717173] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.311 [2024-07-15 09:06:15.717188] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.311 [2024-07-15 09:06:15.717202] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.311 [2024-07-15 09:06:15.717232] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.311 qpair failed and we were unable to recover it. 00:27:27.311 [2024-07-15 09:06:15.727053] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.311 [2024-07-15 09:06:15.727169] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.311 [2024-07-15 09:06:15.727194] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.311 [2024-07-15 09:06:15.727209] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.311 [2024-07-15 09:06:15.727222] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.311 [2024-07-15 09:06:15.727253] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.311 qpair failed and we were unable to recover it. 00:27:27.311 [2024-07-15 09:06:15.737102] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.311 [2024-07-15 09:06:15.737217] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.311 [2024-07-15 09:06:15.737243] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.311 [2024-07-15 09:06:15.737258] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.311 [2024-07-15 09:06:15.737271] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.311 [2024-07-15 09:06:15.737301] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.311 qpair failed and we were unable to recover it. 00:27:27.311 [2024-07-15 09:06:15.747138] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.311 [2024-07-15 09:06:15.747271] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.311 [2024-07-15 09:06:15.747298] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.311 [2024-07-15 09:06:15.747318] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.311 [2024-07-15 09:06:15.747332] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.311 [2024-07-15 09:06:15.747377] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.311 qpair failed and we were unable to recover it. 00:27:27.311 [2024-07-15 09:06:15.757170] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.311 [2024-07-15 09:06:15.757300] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.311 [2024-07-15 09:06:15.757327] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.311 [2024-07-15 09:06:15.757342] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.311 [2024-07-15 09:06:15.757355] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.311 [2024-07-15 09:06:15.757385] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.311 qpair failed and we were unable to recover it. 00:27:27.311 [2024-07-15 09:06:15.767168] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.311 [2024-07-15 09:06:15.767286] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.311 [2024-07-15 09:06:15.767310] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.311 [2024-07-15 09:06:15.767325] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.311 [2024-07-15 09:06:15.767339] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.311 [2024-07-15 09:06:15.767370] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.311 qpair failed and we were unable to recover it. 00:27:27.311 [2024-07-15 09:06:15.777196] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.311 [2024-07-15 09:06:15.777327] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.311 [2024-07-15 09:06:15.777354] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.311 [2024-07-15 09:06:15.777369] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.311 [2024-07-15 09:06:15.777382] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.311 [2024-07-15 09:06:15.777411] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.311 qpair failed and we were unable to recover it. 00:27:27.311 [2024-07-15 09:06:15.787218] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.311 [2024-07-15 09:06:15.787354] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.311 [2024-07-15 09:06:15.787386] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.311 [2024-07-15 09:06:15.787402] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.311 [2024-07-15 09:06:15.787415] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.311 [2024-07-15 09:06:15.787444] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.311 qpair failed and we were unable to recover it. 00:27:27.311 [2024-07-15 09:06:15.797274] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.311 [2024-07-15 09:06:15.797405] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.311 [2024-07-15 09:06:15.797431] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.311 [2024-07-15 09:06:15.797446] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.311 [2024-07-15 09:06:15.797459] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.311 [2024-07-15 09:06:15.797489] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.311 qpair failed and we were unable to recover it. 00:27:27.311 [2024-07-15 09:06:15.807311] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.311 [2024-07-15 09:06:15.807437] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.311 [2024-07-15 09:06:15.807463] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.311 [2024-07-15 09:06:15.807478] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.311 [2024-07-15 09:06:15.807491] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.311 [2024-07-15 09:06:15.807521] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.311 qpair failed and we were unable to recover it. 00:27:27.311 [2024-07-15 09:06:15.817297] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.311 [2024-07-15 09:06:15.817413] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.311 [2024-07-15 09:06:15.817439] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.311 [2024-07-15 09:06:15.817454] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.311 [2024-07-15 09:06:15.817466] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.311 [2024-07-15 09:06:15.817497] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.311 qpair failed and we were unable to recover it. 00:27:27.311 [2024-07-15 09:06:15.827337] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.311 [2024-07-15 09:06:15.827468] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.311 [2024-07-15 09:06:15.827495] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.311 [2024-07-15 09:06:15.827510] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.311 [2024-07-15 09:06:15.827522] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.311 [2024-07-15 09:06:15.827558] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.311 qpair failed and we were unable to recover it. 00:27:27.311 [2024-07-15 09:06:15.837355] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.311 [2024-07-15 09:06:15.837471] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.311 [2024-07-15 09:06:15.837520] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.311 [2024-07-15 09:06:15.837536] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.311 [2024-07-15 09:06:15.837550] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.311 [2024-07-15 09:06:15.837581] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.312 qpair failed and we were unable to recover it. 00:27:27.312 [2024-07-15 09:06:15.847449] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.312 [2024-07-15 09:06:15.847575] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.312 [2024-07-15 09:06:15.847601] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.312 [2024-07-15 09:06:15.847615] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.312 [2024-07-15 09:06:15.847628] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.312 [2024-07-15 09:06:15.847659] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.312 qpair failed and we were unable to recover it. 00:27:27.571 [2024-07-15 09:06:15.857517] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.571 [2024-07-15 09:06:15.857635] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.571 [2024-07-15 09:06:15.857661] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.572 [2024-07-15 09:06:15.857675] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.572 [2024-07-15 09:06:15.857689] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.572 [2024-07-15 09:06:15.857720] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.572 qpair failed and we were unable to recover it. 00:27:27.572 [2024-07-15 09:06:15.867451] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.572 [2024-07-15 09:06:15.867577] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.572 [2024-07-15 09:06:15.867602] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.572 [2024-07-15 09:06:15.867617] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.572 [2024-07-15 09:06:15.867630] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.572 [2024-07-15 09:06:15.867660] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.572 qpair failed and we were unable to recover it. 00:27:27.572 [2024-07-15 09:06:15.877506] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.572 [2024-07-15 09:06:15.877634] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.572 [2024-07-15 09:06:15.877665] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.572 [2024-07-15 09:06:15.877681] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.572 [2024-07-15 09:06:15.877694] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.572 [2024-07-15 09:06:15.877725] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.572 qpair failed and we were unable to recover it. 00:27:27.572 [2024-07-15 09:06:15.887524] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.572 [2024-07-15 09:06:15.887651] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.572 [2024-07-15 09:06:15.887677] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.572 [2024-07-15 09:06:15.887691] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.572 [2024-07-15 09:06:15.887704] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.572 [2024-07-15 09:06:15.887735] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.572 qpair failed and we were unable to recover it. 00:27:27.572 [2024-07-15 09:06:15.897624] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.572 [2024-07-15 09:06:15.897777] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.572 [2024-07-15 09:06:15.897803] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.572 [2024-07-15 09:06:15.897818] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.572 [2024-07-15 09:06:15.897830] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.572 [2024-07-15 09:06:15.897861] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.572 qpair failed and we were unable to recover it. 00:27:27.572 [2024-07-15 09:06:15.907589] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.572 [2024-07-15 09:06:15.907732] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.572 [2024-07-15 09:06:15.907759] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.572 [2024-07-15 09:06:15.907774] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.572 [2024-07-15 09:06:15.907786] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.572 [2024-07-15 09:06:15.907818] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.572 qpair failed and we were unable to recover it. 00:27:27.572 [2024-07-15 09:06:15.917597] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.572 [2024-07-15 09:06:15.917723] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.572 [2024-07-15 09:06:15.917750] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.572 [2024-07-15 09:06:15.917765] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.572 [2024-07-15 09:06:15.917778] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.572 [2024-07-15 09:06:15.917814] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.572 qpair failed and we were unable to recover it. 00:27:27.572 [2024-07-15 09:06:15.927649] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.572 [2024-07-15 09:06:15.927789] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.572 [2024-07-15 09:06:15.927816] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.572 [2024-07-15 09:06:15.927831] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.572 [2024-07-15 09:06:15.927843] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.572 [2024-07-15 09:06:15.927874] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.572 qpair failed and we were unable to recover it. 00:27:27.572 [2024-07-15 09:06:15.937667] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.572 [2024-07-15 09:06:15.937796] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.572 [2024-07-15 09:06:15.937822] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.572 [2024-07-15 09:06:15.937836] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.572 [2024-07-15 09:06:15.937849] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.572 [2024-07-15 09:06:15.937887] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.572 qpair failed and we were unable to recover it. 00:27:27.572 [2024-07-15 09:06:15.947701] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.572 [2024-07-15 09:06:15.947825] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.572 [2024-07-15 09:06:15.947850] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.572 [2024-07-15 09:06:15.947865] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.572 [2024-07-15 09:06:15.947884] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.572 [2024-07-15 09:06:15.947918] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.572 qpair failed and we were unable to recover it. 00:27:27.572 [2024-07-15 09:06:15.957707] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.572 [2024-07-15 09:06:15.957828] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.572 [2024-07-15 09:06:15.957853] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.572 [2024-07-15 09:06:15.957868] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.572 [2024-07-15 09:06:15.957889] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.572 [2024-07-15 09:06:15.957922] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.572 qpair failed and we were unable to recover it. 00:27:27.572 [2024-07-15 09:06:15.967739] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.572 [2024-07-15 09:06:15.967856] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.573 [2024-07-15 09:06:15.967893] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.573 [2024-07-15 09:06:15.967909] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.573 [2024-07-15 09:06:15.967922] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.573 [2024-07-15 09:06:15.967953] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.573 qpair failed and we were unable to recover it. 00:27:27.573 [2024-07-15 09:06:15.977762] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.573 [2024-07-15 09:06:15.977906] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.573 [2024-07-15 09:06:15.977932] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.573 [2024-07-15 09:06:15.977947] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.573 [2024-07-15 09:06:15.977960] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.573 [2024-07-15 09:06:15.977991] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.573 qpair failed and we were unable to recover it. 00:27:27.573 [2024-07-15 09:06:15.987802] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.573 [2024-07-15 09:06:15.987942] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.573 [2024-07-15 09:06:15.987969] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.573 [2024-07-15 09:06:15.987985] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.573 [2024-07-15 09:06:15.987998] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.573 [2024-07-15 09:06:15.988029] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.573 qpair failed and we were unable to recover it. 00:27:27.573 [2024-07-15 09:06:15.997829] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.573 [2024-07-15 09:06:15.997986] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.573 [2024-07-15 09:06:15.998013] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.573 [2024-07-15 09:06:15.998028] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.573 [2024-07-15 09:06:15.998040] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.573 [2024-07-15 09:06:15.998071] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.573 qpair failed and we were unable to recover it. 00:27:27.573 [2024-07-15 09:06:16.007899] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.573 [2024-07-15 09:06:16.008069] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.573 [2024-07-15 09:06:16.008095] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.573 [2024-07-15 09:06:16.008110] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.573 [2024-07-15 09:06:16.008129] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.573 [2024-07-15 09:06:16.008159] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.573 qpair failed and we were unable to recover it. 00:27:27.573 [2024-07-15 09:06:16.017884] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.573 [2024-07-15 09:06:16.018000] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.573 [2024-07-15 09:06:16.018025] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.573 [2024-07-15 09:06:16.018040] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.573 [2024-07-15 09:06:16.018052] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.573 [2024-07-15 09:06:16.018082] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.573 qpair failed and we were unable to recover it. 00:27:27.573 [2024-07-15 09:06:16.027968] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.573 [2024-07-15 09:06:16.028128] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.573 [2024-07-15 09:06:16.028154] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.573 [2024-07-15 09:06:16.028168] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.573 [2024-07-15 09:06:16.028181] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.573 [2024-07-15 09:06:16.028211] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.573 qpair failed and we were unable to recover it. 00:27:27.573 [2024-07-15 09:06:16.037932] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.573 [2024-07-15 09:06:16.038051] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.573 [2024-07-15 09:06:16.038076] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.573 [2024-07-15 09:06:16.038091] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.573 [2024-07-15 09:06:16.038104] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.573 [2024-07-15 09:06:16.038135] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.573 qpair failed and we were unable to recover it. 00:27:27.573 [2024-07-15 09:06:16.047976] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.573 [2024-07-15 09:06:16.048092] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.573 [2024-07-15 09:06:16.048117] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.573 [2024-07-15 09:06:16.048131] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.573 [2024-07-15 09:06:16.048144] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.573 [2024-07-15 09:06:16.048175] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.573 qpair failed and we were unable to recover it. 00:27:27.573 [2024-07-15 09:06:16.058052] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.573 [2024-07-15 09:06:16.058222] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.573 [2024-07-15 09:06:16.058248] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.573 [2024-07-15 09:06:16.058263] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.573 [2024-07-15 09:06:16.058276] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.573 [2024-07-15 09:06:16.058307] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.573 qpair failed and we were unable to recover it. 00:27:27.573 [2024-07-15 09:06:16.068073] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.573 [2024-07-15 09:06:16.068254] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.573 [2024-07-15 09:06:16.068294] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.573 [2024-07-15 09:06:16.068308] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.573 [2024-07-15 09:06:16.068321] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.573 [2024-07-15 09:06:16.068351] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.573 qpair failed and we were unable to recover it. 00:27:27.573 [2024-07-15 09:06:16.078044] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.573 [2024-07-15 09:06:16.078185] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.573 [2024-07-15 09:06:16.078211] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.573 [2024-07-15 09:06:16.078226] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.574 [2024-07-15 09:06:16.078239] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.574 [2024-07-15 09:06:16.078269] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.574 qpair failed and we were unable to recover it. 00:27:27.574 [2024-07-15 09:06:16.088083] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.574 [2024-07-15 09:06:16.088205] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.574 [2024-07-15 09:06:16.088230] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.574 [2024-07-15 09:06:16.088244] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.574 [2024-07-15 09:06:16.088256] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.574 [2024-07-15 09:06:16.088285] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.574 qpair failed and we were unable to recover it. 00:27:27.574 [2024-07-15 09:06:16.098132] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.574 [2024-07-15 09:06:16.098251] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.574 [2024-07-15 09:06:16.098277] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.574 [2024-07-15 09:06:16.098292] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.574 [2024-07-15 09:06:16.098311] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.574 [2024-07-15 09:06:16.098342] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.574 qpair failed and we were unable to recover it. 00:27:27.574 [2024-07-15 09:06:16.108158] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.574 [2024-07-15 09:06:16.108333] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.574 [2024-07-15 09:06:16.108358] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.574 [2024-07-15 09:06:16.108373] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.574 [2024-07-15 09:06:16.108386] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.574 [2024-07-15 09:06:16.108416] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.574 qpair failed and we were unable to recover it. 00:27:27.840 [2024-07-15 09:06:16.118175] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.840 [2024-07-15 09:06:16.118310] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.840 [2024-07-15 09:06:16.118336] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.840 [2024-07-15 09:06:16.118351] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.840 [2024-07-15 09:06:16.118363] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.840 [2024-07-15 09:06:16.118409] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.840 qpair failed and we were unable to recover it. 00:27:27.840 [2024-07-15 09:06:16.128185] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.840 [2024-07-15 09:06:16.128313] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.840 [2024-07-15 09:06:16.128338] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.840 [2024-07-15 09:06:16.128353] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.840 [2024-07-15 09:06:16.128365] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.840 [2024-07-15 09:06:16.128396] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.840 qpair failed and we were unable to recover it. 00:27:27.840 [2024-07-15 09:06:16.138237] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.840 [2024-07-15 09:06:16.138358] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.840 [2024-07-15 09:06:16.138384] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.840 [2024-07-15 09:06:16.138399] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.840 [2024-07-15 09:06:16.138412] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.840 [2024-07-15 09:06:16.138442] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.840 qpair failed and we were unable to recover it. 00:27:27.840 [2024-07-15 09:06:16.148270] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.840 [2024-07-15 09:06:16.148400] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.840 [2024-07-15 09:06:16.148426] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.840 [2024-07-15 09:06:16.148441] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.840 [2024-07-15 09:06:16.148454] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.840 [2024-07-15 09:06:16.148499] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.840 qpair failed and we were unable to recover it. 00:27:27.841 [2024-07-15 09:06:16.158322] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.841 [2024-07-15 09:06:16.158446] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.841 [2024-07-15 09:06:16.158471] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.841 [2024-07-15 09:06:16.158486] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.841 [2024-07-15 09:06:16.158499] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.841 [2024-07-15 09:06:16.158529] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.841 qpair failed and we were unable to recover it. 00:27:27.841 [2024-07-15 09:06:16.168293] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.841 [2024-07-15 09:06:16.168461] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.841 [2024-07-15 09:06:16.168487] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.841 [2024-07-15 09:06:16.168502] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.841 [2024-07-15 09:06:16.168515] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.841 [2024-07-15 09:06:16.168545] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.841 qpair failed and we were unable to recover it. 00:27:27.841 [2024-07-15 09:06:16.178353] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.841 [2024-07-15 09:06:16.178477] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.841 [2024-07-15 09:06:16.178503] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.841 [2024-07-15 09:06:16.178517] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.841 [2024-07-15 09:06:16.178530] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.841 [2024-07-15 09:06:16.178560] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.841 qpair failed and we were unable to recover it. 00:27:27.841 [2024-07-15 09:06:16.188364] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.841 [2024-07-15 09:06:16.188501] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.841 [2024-07-15 09:06:16.188526] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.841 [2024-07-15 09:06:16.188547] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.841 [2024-07-15 09:06:16.188561] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.841 [2024-07-15 09:06:16.188591] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.841 qpair failed and we were unable to recover it. 00:27:27.841 [2024-07-15 09:06:16.198425] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.841 [2024-07-15 09:06:16.198540] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.841 [2024-07-15 09:06:16.198566] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.841 [2024-07-15 09:06:16.198580] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.841 [2024-07-15 09:06:16.198593] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.841 [2024-07-15 09:06:16.198623] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.841 qpair failed and we were unable to recover it. 00:27:27.841 [2024-07-15 09:06:16.208459] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.841 [2024-07-15 09:06:16.208594] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.841 [2024-07-15 09:06:16.208619] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.841 [2024-07-15 09:06:16.208633] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.841 [2024-07-15 09:06:16.208647] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.841 [2024-07-15 09:06:16.208677] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.841 qpair failed and we were unable to recover it. 00:27:27.841 [2024-07-15 09:06:16.218456] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.841 [2024-07-15 09:06:16.218584] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.841 [2024-07-15 09:06:16.218609] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.841 [2024-07-15 09:06:16.218624] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.841 [2024-07-15 09:06:16.218637] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.841 [2024-07-15 09:06:16.218667] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.841 qpair failed and we were unable to recover it. 00:27:27.841 [2024-07-15 09:06:16.228489] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.841 [2024-07-15 09:06:16.228666] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.841 [2024-07-15 09:06:16.228693] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.841 [2024-07-15 09:06:16.228722] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.841 [2024-07-15 09:06:16.228735] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.842 [2024-07-15 09:06:16.228779] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.842 qpair failed and we were unable to recover it. 00:27:27.842 [2024-07-15 09:06:16.238521] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.842 [2024-07-15 09:06:16.238641] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.842 [2024-07-15 09:06:16.238666] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.842 [2024-07-15 09:06:16.238681] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.842 [2024-07-15 09:06:16.238693] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.842 [2024-07-15 09:06:16.238724] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.842 qpair failed and we were unable to recover it. 00:27:27.842 [2024-07-15 09:06:16.248544] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.842 [2024-07-15 09:06:16.248687] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.842 [2024-07-15 09:06:16.248713] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.842 [2024-07-15 09:06:16.248727] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.842 [2024-07-15 09:06:16.248744] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.842 [2024-07-15 09:06:16.248790] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.842 qpair failed and we were unable to recover it. 00:27:27.842 [2024-07-15 09:06:16.258585] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.842 [2024-07-15 09:06:16.258698] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.842 [2024-07-15 09:06:16.258723] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.842 [2024-07-15 09:06:16.258738] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.842 [2024-07-15 09:06:16.258751] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.842 [2024-07-15 09:06:16.258781] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.842 qpair failed and we were unable to recover it. 00:27:27.842 [2024-07-15 09:06:16.268616] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.842 [2024-07-15 09:06:16.268743] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.842 [2024-07-15 09:06:16.268768] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.842 [2024-07-15 09:06:16.268783] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.842 [2024-07-15 09:06:16.268795] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.842 [2024-07-15 09:06:16.268841] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.842 qpair failed and we were unable to recover it. 00:27:27.842 [2024-07-15 09:06:16.278630] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.842 [2024-07-15 09:06:16.278753] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.842 [2024-07-15 09:06:16.278784] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.842 [2024-07-15 09:06:16.278800] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.842 [2024-07-15 09:06:16.278814] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.842 [2024-07-15 09:06:16.278844] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.842 qpair failed and we were unable to recover it. 00:27:27.842 [2024-07-15 09:06:16.288682] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.842 [2024-07-15 09:06:16.288806] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.842 [2024-07-15 09:06:16.288832] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.842 [2024-07-15 09:06:16.288847] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.842 [2024-07-15 09:06:16.288862] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.842 [2024-07-15 09:06:16.288900] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.842 qpair failed and we were unable to recover it. 00:27:27.842 [2024-07-15 09:06:16.298697] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.842 [2024-07-15 09:06:16.298836] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.842 [2024-07-15 09:06:16.298861] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.842 [2024-07-15 09:06:16.298884] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.842 [2024-07-15 09:06:16.298899] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.842 [2024-07-15 09:06:16.298929] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.842 qpair failed and we were unable to recover it. 00:27:27.842 [2024-07-15 09:06:16.308751] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.842 [2024-07-15 09:06:16.308875] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.842 [2024-07-15 09:06:16.308907] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.842 [2024-07-15 09:06:16.308923] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.842 [2024-07-15 09:06:16.308935] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.843 [2024-07-15 09:06:16.308967] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.843 qpair failed and we were unable to recover it. 00:27:27.843 [2024-07-15 09:06:16.318763] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.843 [2024-07-15 09:06:16.318937] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.843 [2024-07-15 09:06:16.318963] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.843 [2024-07-15 09:06:16.318978] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.843 [2024-07-15 09:06:16.318990] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.843 [2024-07-15 09:06:16.319027] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.843 qpair failed and we were unable to recover it. 00:27:27.843 [2024-07-15 09:06:16.328768] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.843 [2024-07-15 09:06:16.328892] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.843 [2024-07-15 09:06:16.328918] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.843 [2024-07-15 09:06:16.328932] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.843 [2024-07-15 09:06:16.328945] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.843 [2024-07-15 09:06:16.328974] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.843 qpair failed and we were unable to recover it. 00:27:27.843 [2024-07-15 09:06:16.338793] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.843 [2024-07-15 09:06:16.338931] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.843 [2024-07-15 09:06:16.338956] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.843 [2024-07-15 09:06:16.338971] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.843 [2024-07-15 09:06:16.338983] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.843 [2024-07-15 09:06:16.339012] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.843 qpair failed and we were unable to recover it. 00:27:27.843 [2024-07-15 09:06:16.348828] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.843 [2024-07-15 09:06:16.348966] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.843 [2024-07-15 09:06:16.348992] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.843 [2024-07-15 09:06:16.349011] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.843 [2024-07-15 09:06:16.349025] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.843 [2024-07-15 09:06:16.349056] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.843 qpair failed and we were unable to recover it. 00:27:27.843 [2024-07-15 09:06:16.358883] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.843 [2024-07-15 09:06:16.359038] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.843 [2024-07-15 09:06:16.359065] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.843 [2024-07-15 09:06:16.359080] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.843 [2024-07-15 09:06:16.359092] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.843 [2024-07-15 09:06:16.359123] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.843 qpair failed and we were unable to recover it. 00:27:27.843 [2024-07-15 09:06:16.368874] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.843 [2024-07-15 09:06:16.369061] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.843 [2024-07-15 09:06:16.369092] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.843 [2024-07-15 09:06:16.369107] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.843 [2024-07-15 09:06:16.369121] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.843 [2024-07-15 09:06:16.369152] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.843 qpair failed and we were unable to recover it. 00:27:27.843 [2024-07-15 09:06:16.378913] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:27.843 [2024-07-15 09:06:16.379044] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:27.843 [2024-07-15 09:06:16.379069] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:27.843 [2024-07-15 09:06:16.379084] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:27.843 [2024-07-15 09:06:16.379099] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:27.843 [2024-07-15 09:06:16.379129] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:27.843 qpair failed and we were unable to recover it. 00:27:28.104 [2024-07-15 09:06:16.388970] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.104 [2024-07-15 09:06:16.389100] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.104 [2024-07-15 09:06:16.389125] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.104 [2024-07-15 09:06:16.389140] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.104 [2024-07-15 09:06:16.389153] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:28.104 [2024-07-15 09:06:16.389183] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:28.104 qpair failed and we were unable to recover it. 00:27:28.104 [2024-07-15 09:06:16.399002] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.105 [2024-07-15 09:06:16.399179] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.105 [2024-07-15 09:06:16.399205] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.105 [2024-07-15 09:06:16.399223] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.105 [2024-07-15 09:06:16.399237] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:28.105 [2024-07-15 09:06:16.399267] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:28.105 qpair failed and we were unable to recover it. 00:27:28.105 [2024-07-15 09:06:16.409015] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.105 [2024-07-15 09:06:16.409135] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.105 [2024-07-15 09:06:16.409161] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.105 [2024-07-15 09:06:16.409176] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.105 [2024-07-15 09:06:16.409189] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:28.105 [2024-07-15 09:06:16.409237] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:28.105 qpair failed and we were unable to recover it. 00:27:28.105 [2024-07-15 09:06:16.419057] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.105 [2024-07-15 09:06:16.419174] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.105 [2024-07-15 09:06:16.419200] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.105 [2024-07-15 09:06:16.419215] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.105 [2024-07-15 09:06:16.419228] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:28.105 [2024-07-15 09:06:16.419258] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:28.105 qpair failed and we were unable to recover it. 00:27:28.105 [2024-07-15 09:06:16.429082] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.105 [2024-07-15 09:06:16.429249] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.105 [2024-07-15 09:06:16.429275] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.105 [2024-07-15 09:06:16.429290] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.105 [2024-07-15 09:06:16.429303] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:28.105 [2024-07-15 09:06:16.429334] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:28.105 qpair failed and we were unable to recover it. 00:27:28.105 [2024-07-15 09:06:16.439078] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.105 [2024-07-15 09:06:16.439200] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.105 [2024-07-15 09:06:16.439226] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.105 [2024-07-15 09:06:16.439240] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.105 [2024-07-15 09:06:16.439253] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:28.105 [2024-07-15 09:06:16.439283] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:28.105 qpair failed and we were unable to recover it. 00:27:28.105 [2024-07-15 09:06:16.449123] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.105 [2024-07-15 09:06:16.449242] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.105 [2024-07-15 09:06:16.449268] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.105 [2024-07-15 09:06:16.449283] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.105 [2024-07-15 09:06:16.449297] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:28.105 [2024-07-15 09:06:16.449328] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:28.105 qpair failed and we were unable to recover it. 00:27:28.105 [2024-07-15 09:06:16.459132] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.105 [2024-07-15 09:06:16.459279] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.105 [2024-07-15 09:06:16.459310] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.105 [2024-07-15 09:06:16.459325] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.105 [2024-07-15 09:06:16.459338] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:28.105 [2024-07-15 09:06:16.459368] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:28.105 qpair failed and we were unable to recover it. 00:27:28.105 [2024-07-15 09:06:16.469178] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.105 [2024-07-15 09:06:16.469302] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.105 [2024-07-15 09:06:16.469328] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.105 [2024-07-15 09:06:16.469342] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.105 [2024-07-15 09:06:16.469355] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:28.105 [2024-07-15 09:06:16.469386] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:28.105 qpair failed and we were unable to recover it. 00:27:28.105 [2024-07-15 09:06:16.479235] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.105 [2024-07-15 09:06:16.479365] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.105 [2024-07-15 09:06:16.479391] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.105 [2024-07-15 09:06:16.479406] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.105 [2024-07-15 09:06:16.479419] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:28.105 [2024-07-15 09:06:16.479449] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:28.105 qpair failed and we were unable to recover it. 00:27:28.105 [2024-07-15 09:06:16.489326] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.105 [2024-07-15 09:06:16.489450] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.105 [2024-07-15 09:06:16.489476] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.105 [2024-07-15 09:06:16.489491] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.105 [2024-07-15 09:06:16.489505] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:28.105 [2024-07-15 09:06:16.489535] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:28.105 qpair failed and we were unable to recover it. 00:27:28.105 [2024-07-15 09:06:16.499339] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.105 [2024-07-15 09:06:16.499460] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.105 [2024-07-15 09:06:16.499486] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.105 [2024-07-15 09:06:16.499502] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.105 [2024-07-15 09:06:16.499524] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:28.105 [2024-07-15 09:06:16.499555] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:28.105 qpair failed and we were unable to recover it. 00:27:28.105 [2024-07-15 09:06:16.509344] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.105 [2024-07-15 09:06:16.509469] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.105 [2024-07-15 09:06:16.509494] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.105 [2024-07-15 09:06:16.509509] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.105 [2024-07-15 09:06:16.509521] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:28.105 [2024-07-15 09:06:16.509552] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:28.105 qpair failed and we were unable to recover it. 00:27:28.105 [2024-07-15 09:06:16.519317] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.105 [2024-07-15 09:06:16.519440] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.105 [2024-07-15 09:06:16.519466] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.105 [2024-07-15 09:06:16.519481] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.105 [2024-07-15 09:06:16.519494] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:28.105 [2024-07-15 09:06:16.519524] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:28.105 qpair failed and we were unable to recover it. 00:27:28.105 [2024-07-15 09:06:16.529380] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.105 [2024-07-15 09:06:16.529500] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.105 [2024-07-15 09:06:16.529525] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.105 [2024-07-15 09:06:16.529540] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.105 [2024-07-15 09:06:16.529553] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:28.105 [2024-07-15 09:06:16.529583] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:28.105 qpair failed and we were unable to recover it. 00:27:28.105 [2024-07-15 09:06:16.539364] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.105 [2024-07-15 09:06:16.539482] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.106 [2024-07-15 09:06:16.539507] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.106 [2024-07-15 09:06:16.539522] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.106 [2024-07-15 09:06:16.539535] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:28.106 [2024-07-15 09:06:16.539566] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:28.106 qpair failed and we were unable to recover it. 00:27:28.106 [2024-07-15 09:06:16.549500] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.106 [2024-07-15 09:06:16.549637] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.106 [2024-07-15 09:06:16.549663] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.106 [2024-07-15 09:06:16.549677] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.106 [2024-07-15 09:06:16.549690] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:28.106 [2024-07-15 09:06:16.549720] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:28.106 qpair failed and we were unable to recover it. 00:27:28.106 [2024-07-15 09:06:16.559426] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.106 [2024-07-15 09:06:16.559552] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.106 [2024-07-15 09:06:16.559578] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.106 [2024-07-15 09:06:16.559593] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.106 [2024-07-15 09:06:16.559605] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:28.106 [2024-07-15 09:06:16.559635] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:28.106 qpair failed and we were unable to recover it. 00:27:28.106 [2024-07-15 09:06:16.569456] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.106 [2024-07-15 09:06:16.569599] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.106 [2024-07-15 09:06:16.569623] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.106 [2024-07-15 09:06:16.569638] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.106 [2024-07-15 09:06:16.569650] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:28.106 [2024-07-15 09:06:16.569681] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:28.106 qpair failed and we were unable to recover it. 00:27:28.106 [2024-07-15 09:06:16.579509] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.106 [2024-07-15 09:06:16.579632] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.106 [2024-07-15 09:06:16.579658] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.106 [2024-07-15 09:06:16.579672] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.106 [2024-07-15 09:06:16.579685] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:28.106 [2024-07-15 09:06:16.579715] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:28.106 qpair failed and we were unable to recover it. 00:27:28.106 [2024-07-15 09:06:16.589550] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.106 [2024-07-15 09:06:16.589671] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.106 [2024-07-15 09:06:16.589696] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.106 [2024-07-15 09:06:16.589711] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.106 [2024-07-15 09:06:16.589732] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:28.106 [2024-07-15 09:06:16.589763] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:28.106 qpair failed and we were unable to recover it. 00:27:28.106 [2024-07-15 09:06:16.599601] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.106 [2024-07-15 09:06:16.599724] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.106 [2024-07-15 09:06:16.599750] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.106 [2024-07-15 09:06:16.599765] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.106 [2024-07-15 09:06:16.599778] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:28.106 [2024-07-15 09:06:16.599809] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:28.106 qpair failed and we were unable to recover it. 00:27:28.106 [2024-07-15 09:06:16.609663] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.106 [2024-07-15 09:06:16.609777] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.106 [2024-07-15 09:06:16.609802] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.106 [2024-07-15 09:06:16.609817] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.106 [2024-07-15 09:06:16.609830] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:28.106 [2024-07-15 09:06:16.609862] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:28.106 qpair failed and we were unable to recover it. 00:27:28.106 [2024-07-15 09:06:16.619613] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.106 [2024-07-15 09:06:16.619742] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.106 [2024-07-15 09:06:16.619768] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.106 [2024-07-15 09:06:16.619782] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.106 [2024-07-15 09:06:16.619795] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:28.106 [2024-07-15 09:06:16.619826] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:28.106 qpair failed and we were unable to recover it. 00:27:28.106 [2024-07-15 09:06:16.629658] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:28.106 [2024-07-15 09:06:16.629827] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:28.106 [2024-07-15 09:06:16.629852] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:28.106 [2024-07-15 09:06:16.629867] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:28.106 [2024-07-15 09:06:16.629886] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f56f0000b90 00:27:28.106 [2024-07-15 09:06:16.629917] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:28.106 qpair failed and we were unable to recover it. 00:27:28.106 [2024-07-15 09:06:16.629954] nvme_ctrlr.c:4339:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:27:28.106 A controller has encountered a failure and is being reset. 00:27:28.106 Controller properly reset. 00:27:28.672 Initializing NVMe Controllers 00:27:28.672 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:28.672 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:28.672 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:27:28.672 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:27:28.672 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:27:28.672 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:27:28.672 Initialization complete. Launching workers. 00:27:28.672 Starting thread on core 1 00:27:28.672 Starting thread on core 2 00:27:28.672 Starting thread on core 3 00:27:28.672 Starting thread on core 0 00:27:28.672 09:06:17 -- host/target_disconnect.sh@59 -- # sync 00:27:28.672 00:27:28.672 real 0m11.270s 00:27:28.672 user 0m22.180s 00:27:28.672 sys 0m5.538s 00:27:28.672 09:06:17 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:27:28.672 09:06:17 -- common/autotest_common.sh@10 -- # set +x 00:27:28.672 ************************************ 00:27:28.672 END TEST nvmf_target_disconnect_tc2 00:27:28.672 ************************************ 00:27:28.930 09:06:17 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:27:28.930 09:06:17 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:27:28.930 09:06:17 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:27:28.930 09:06:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:28.930 09:06:17 -- nvmf/common.sh@116 -- # sync 00:27:28.930 09:06:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:28.930 09:06:17 -- nvmf/common.sh@119 -- # set +e 00:27:28.930 09:06:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:28.930 09:06:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:28.930 rmmod nvme_tcp 00:27:28.930 rmmod nvme_fabrics 00:27:28.930 rmmod nvme_keyring 00:27:28.930 09:06:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:28.930 09:06:17 -- nvmf/common.sh@123 -- # set -e 00:27:28.930 09:06:17 -- nvmf/common.sh@124 -- # return 0 00:27:28.930 09:06:17 -- nvmf/common.sh@477 -- # '[' -n 1621814 ']' 00:27:28.930 09:06:17 -- nvmf/common.sh@478 -- # killprocess 1621814 00:27:28.930 09:06:17 -- common/autotest_common.sh@926 -- # '[' -z 1621814 ']' 00:27:28.930 09:06:17 -- common/autotest_common.sh@930 -- # kill -0 1621814 00:27:28.930 09:06:17 -- common/autotest_common.sh@931 -- # uname 00:27:28.930 09:06:17 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:27:28.930 09:06:17 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1621814 00:27:28.930 09:06:17 -- common/autotest_common.sh@932 -- # process_name=reactor_4 00:27:28.930 09:06:17 -- common/autotest_common.sh@936 -- # '[' reactor_4 = sudo ']' 00:27:28.930 09:06:17 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1621814' 00:27:28.930 killing process with pid 1621814 00:27:28.930 09:06:17 -- common/autotest_common.sh@945 -- # kill 1621814 00:27:28.930 09:06:17 -- common/autotest_common.sh@950 -- # wait 1621814 00:27:29.188 09:06:17 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:29.188 09:06:17 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:29.188 09:06:17 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:29.188 09:06:17 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:29.188 09:06:17 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:29.188 09:06:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:29.188 09:06:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:29.188 09:06:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:31.126 09:06:19 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:31.126 00:27:31.126 real 0m15.943s 00:27:31.126 user 0m47.628s 00:27:31.126 sys 0m7.492s 00:27:31.126 09:06:19 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:27:31.126 09:06:19 -- common/autotest_common.sh@10 -- # set +x 00:27:31.126 ************************************ 00:27:31.126 END TEST nvmf_target_disconnect 00:27:31.126 ************************************ 00:27:31.126 09:06:19 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:27:31.126 09:06:19 -- common/autotest_common.sh@718 -- # xtrace_disable 00:27:31.126 09:06:19 -- common/autotest_common.sh@10 -- # set +x 00:27:31.383 09:06:19 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:27:31.384 00:27:31.384 real 21m3.561s 00:27:31.384 user 60m56.448s 00:27:31.384 sys 5m0.281s 00:27:31.384 09:06:19 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:27:31.384 09:06:19 -- common/autotest_common.sh@10 -- # set +x 00:27:31.384 ************************************ 00:27:31.384 END TEST nvmf_tcp 00:27:31.384 ************************************ 00:27:31.384 09:06:19 -- spdk/autotest.sh@296 -- # [[ 0 -eq 0 ]] 00:27:31.384 09:06:19 -- spdk/autotest.sh@297 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:27:31.384 09:06:19 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:27:31.384 09:06:19 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:27:31.384 09:06:19 -- common/autotest_common.sh@10 -- # set +x 00:27:31.384 ************************************ 00:27:31.384 START TEST spdkcli_nvmf_tcp 00:27:31.384 ************************************ 00:27:31.384 09:06:19 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:27:31.384 * Looking for test storage... 00:27:31.384 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:27:31.384 09:06:19 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:27:31.384 09:06:19 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:27:31.384 09:06:19 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:27:31.384 09:06:19 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:31.384 09:06:19 -- nvmf/common.sh@7 -- # uname -s 00:27:31.384 09:06:19 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:31.384 09:06:19 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:31.384 09:06:19 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:31.384 09:06:19 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:31.384 09:06:19 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:31.384 09:06:19 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:31.384 09:06:19 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:31.384 09:06:19 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:31.384 09:06:19 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:31.384 09:06:19 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:31.384 09:06:19 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:31.384 09:06:19 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:31.384 09:06:19 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:31.384 09:06:19 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:31.384 09:06:19 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:31.384 09:06:19 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:31.384 09:06:19 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:31.384 09:06:19 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:31.384 09:06:19 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:31.384 09:06:19 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:31.384 09:06:19 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:31.384 09:06:19 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:31.384 09:06:19 -- paths/export.sh@5 -- # export PATH 00:27:31.384 09:06:19 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:31.384 09:06:19 -- nvmf/common.sh@46 -- # : 0 00:27:31.384 09:06:19 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:31.384 09:06:19 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:31.384 09:06:19 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:31.384 09:06:19 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:31.384 09:06:19 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:31.384 09:06:19 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:31.384 09:06:19 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:31.384 09:06:19 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:31.384 09:06:19 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:27:31.384 09:06:19 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:27:31.384 09:06:19 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:27:31.384 09:06:19 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:27:31.384 09:06:19 -- common/autotest_common.sh@712 -- # xtrace_disable 00:27:31.384 09:06:19 -- common/autotest_common.sh@10 -- # set +x 00:27:31.384 09:06:19 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:27:31.384 09:06:19 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=1622964 00:27:31.384 09:06:19 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:27:31.384 09:06:19 -- spdkcli/common.sh@34 -- # waitforlisten 1622964 00:27:31.384 09:06:19 -- common/autotest_common.sh@819 -- # '[' -z 1622964 ']' 00:27:31.384 09:06:19 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:31.384 09:06:19 -- common/autotest_common.sh@824 -- # local max_retries=100 00:27:31.384 09:06:19 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:31.384 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:31.384 09:06:19 -- common/autotest_common.sh@828 -- # xtrace_disable 00:27:31.384 09:06:19 -- common/autotest_common.sh@10 -- # set +x 00:27:31.384 [2024-07-15 09:06:19.810796] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:27:31.384 [2024-07-15 09:06:19.810910] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1622964 ] 00:27:31.384 EAL: No free 2048 kB hugepages reported on node 1 00:27:31.384 [2024-07-15 09:06:19.871917] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:27:31.642 [2024-07-15 09:06:19.978240] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:31.642 [2024-07-15 09:06:19.978444] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:31.642 [2024-07-15 09:06:19.978448] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:32.574 09:06:20 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:27:32.574 09:06:20 -- common/autotest_common.sh@852 -- # return 0 00:27:32.574 09:06:20 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:27:32.574 09:06:20 -- common/autotest_common.sh@718 -- # xtrace_disable 00:27:32.574 09:06:20 -- common/autotest_common.sh@10 -- # set +x 00:27:32.574 09:06:20 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:27:32.574 09:06:20 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:27:32.574 09:06:20 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:27:32.574 09:06:20 -- common/autotest_common.sh@712 -- # xtrace_disable 00:27:32.574 09:06:20 -- common/autotest_common.sh@10 -- # set +x 00:27:32.574 09:06:20 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:27:32.574 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:27:32.574 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:27:32.574 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:27:32.574 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:27:32.574 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:27:32.574 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:27:32.574 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:27:32.574 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:27:32.574 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:27:32.574 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:27:32.574 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:32.574 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:27:32.574 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:27:32.574 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:32.574 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:27:32.574 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:27:32.574 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:27:32.574 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:27:32.574 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:32.574 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:27:32.574 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:27:32.574 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:27:32.574 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:27:32.574 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:32.574 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:27:32.574 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:27:32.574 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:27:32.574 ' 00:27:32.833 [2024-07-15 09:06:21.168673] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:27:35.362 [2024-07-15 09:06:23.322665] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:36.303 [2024-07-15 09:06:24.563302] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:27:38.831 [2024-07-15 09:06:26.834575] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:27:40.732 [2024-07-15 09:06:28.773046] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:27:42.106 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:27:42.106 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:27:42.106 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:27:42.106 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:27:42.106 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:27:42.106 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:27:42.106 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:27:42.106 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:27:42.106 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:27:42.106 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:27:42.106 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:27:42.106 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:27:42.106 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:27:42.106 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:27:42.106 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:27:42.106 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:27:42.106 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:27:42.106 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:27:42.106 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:27:42.106 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:27:42.106 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:27:42.106 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:27:42.106 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:27:42.106 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:27:42.106 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:27:42.106 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:27:42.106 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:27:42.106 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:27:42.106 09:06:30 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:27:42.106 09:06:30 -- common/autotest_common.sh@718 -- # xtrace_disable 00:27:42.106 09:06:30 -- common/autotest_common.sh@10 -- # set +x 00:27:42.107 09:06:30 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:27:42.107 09:06:30 -- common/autotest_common.sh@712 -- # xtrace_disable 00:27:42.107 09:06:30 -- common/autotest_common.sh@10 -- # set +x 00:27:42.107 09:06:30 -- spdkcli/nvmf.sh@69 -- # check_match 00:27:42.107 09:06:30 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:27:42.365 09:06:30 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:27:42.365 09:06:30 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:27:42.365 09:06:30 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:27:42.365 09:06:30 -- common/autotest_common.sh@718 -- # xtrace_disable 00:27:42.365 09:06:30 -- common/autotest_common.sh@10 -- # set +x 00:27:42.365 09:06:30 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:27:42.365 09:06:30 -- common/autotest_common.sh@712 -- # xtrace_disable 00:27:42.365 09:06:30 -- common/autotest_common.sh@10 -- # set +x 00:27:42.365 09:06:30 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:27:42.365 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:27:42.365 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:27:42.365 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:27:42.365 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:27:42.365 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:27:42.365 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:27:42.365 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:27:42.365 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:27:42.365 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:27:42.365 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:27:42.365 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:27:42.365 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:27:42.365 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:27:42.365 ' 00:27:47.625 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:27:47.625 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:27:47.625 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:27:47.625 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:27:47.625 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:27:47.625 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:27:47.625 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:27:47.625 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:27:47.625 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:27:47.625 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:27:47.625 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:27:47.625 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:27:47.625 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:27:47.625 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:27:47.625 09:06:36 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:27:47.625 09:06:36 -- common/autotest_common.sh@718 -- # xtrace_disable 00:27:47.625 09:06:36 -- common/autotest_common.sh@10 -- # set +x 00:27:47.625 09:06:36 -- spdkcli/nvmf.sh@90 -- # killprocess 1622964 00:27:47.625 09:06:36 -- common/autotest_common.sh@926 -- # '[' -z 1622964 ']' 00:27:47.625 09:06:36 -- common/autotest_common.sh@930 -- # kill -0 1622964 00:27:47.625 09:06:36 -- common/autotest_common.sh@931 -- # uname 00:27:47.625 09:06:36 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:27:47.625 09:06:36 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1622964 00:27:47.882 09:06:36 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:27:47.882 09:06:36 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:27:47.882 09:06:36 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1622964' 00:27:47.882 killing process with pid 1622964 00:27:47.882 09:06:36 -- common/autotest_common.sh@945 -- # kill 1622964 00:27:47.882 [2024-07-15 09:06:36.183374] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:27:47.882 09:06:36 -- common/autotest_common.sh@950 -- # wait 1622964 00:27:48.140 09:06:36 -- spdkcli/nvmf.sh@1 -- # cleanup 00:27:48.140 09:06:36 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:27:48.140 09:06:36 -- spdkcli/common.sh@13 -- # '[' -n 1622964 ']' 00:27:48.140 09:06:36 -- spdkcli/common.sh@14 -- # killprocess 1622964 00:27:48.140 09:06:36 -- common/autotest_common.sh@926 -- # '[' -z 1622964 ']' 00:27:48.140 09:06:36 -- common/autotest_common.sh@930 -- # kill -0 1622964 00:27:48.140 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (1622964) - No such process 00:27:48.140 09:06:36 -- common/autotest_common.sh@953 -- # echo 'Process with pid 1622964 is not found' 00:27:48.140 Process with pid 1622964 is not found 00:27:48.140 09:06:36 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:27:48.140 09:06:36 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:27:48.140 09:06:36 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:27:48.140 00:27:48.140 real 0m16.749s 00:27:48.140 user 0m35.405s 00:27:48.140 sys 0m0.890s 00:27:48.140 09:06:36 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:27:48.140 09:06:36 -- common/autotest_common.sh@10 -- # set +x 00:27:48.140 ************************************ 00:27:48.140 END TEST spdkcli_nvmf_tcp 00:27:48.140 ************************************ 00:27:48.140 09:06:36 -- spdk/autotest.sh@298 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:27:48.140 09:06:36 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:27:48.140 09:06:36 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:27:48.140 09:06:36 -- common/autotest_common.sh@10 -- # set +x 00:27:48.140 ************************************ 00:27:48.140 START TEST nvmf_identify_passthru 00:27:48.140 ************************************ 00:27:48.140 09:06:36 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:27:48.140 * Looking for test storage... 00:27:48.140 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:27:48.140 09:06:36 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:48.140 09:06:36 -- nvmf/common.sh@7 -- # uname -s 00:27:48.140 09:06:36 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:48.140 09:06:36 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:48.140 09:06:36 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:48.140 09:06:36 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:48.140 09:06:36 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:48.140 09:06:36 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:48.140 09:06:36 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:48.140 09:06:36 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:48.140 09:06:36 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:48.140 09:06:36 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:48.140 09:06:36 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:48.140 09:06:36 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:48.140 09:06:36 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:48.140 09:06:36 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:48.140 09:06:36 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:48.140 09:06:36 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:48.140 09:06:36 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:48.140 09:06:36 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:48.140 09:06:36 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:48.140 09:06:36 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:48.140 09:06:36 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:48.140 09:06:36 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:48.140 09:06:36 -- paths/export.sh@5 -- # export PATH 00:27:48.140 09:06:36 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:48.140 09:06:36 -- nvmf/common.sh@46 -- # : 0 00:27:48.140 09:06:36 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:48.140 09:06:36 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:48.140 09:06:36 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:48.140 09:06:36 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:48.140 09:06:36 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:48.140 09:06:36 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:48.140 09:06:36 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:48.140 09:06:36 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:48.140 09:06:36 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:48.141 09:06:36 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:48.141 09:06:36 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:48.141 09:06:36 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:48.141 09:06:36 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:48.141 09:06:36 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:48.141 09:06:36 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:48.141 09:06:36 -- paths/export.sh@5 -- # export PATH 00:27:48.141 09:06:36 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:48.141 09:06:36 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:27:48.141 09:06:36 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:48.141 09:06:36 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:48.141 09:06:36 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:48.141 09:06:36 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:48.141 09:06:36 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:48.141 09:06:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:48.141 09:06:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:27:48.141 09:06:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:48.141 09:06:36 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:48.141 09:06:36 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:48.141 09:06:36 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:48.141 09:06:36 -- common/autotest_common.sh@10 -- # set +x 00:27:50.041 09:06:38 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:50.041 09:06:38 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:50.041 09:06:38 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:50.041 09:06:38 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:50.041 09:06:38 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:50.041 09:06:38 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:50.041 09:06:38 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:50.041 09:06:38 -- nvmf/common.sh@294 -- # net_devs=() 00:27:50.041 09:06:38 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:50.041 09:06:38 -- nvmf/common.sh@295 -- # e810=() 00:27:50.041 09:06:38 -- nvmf/common.sh@295 -- # local -ga e810 00:27:50.042 09:06:38 -- nvmf/common.sh@296 -- # x722=() 00:27:50.042 09:06:38 -- nvmf/common.sh@296 -- # local -ga x722 00:27:50.042 09:06:38 -- nvmf/common.sh@297 -- # mlx=() 00:27:50.042 09:06:38 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:50.042 09:06:38 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:50.042 09:06:38 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:50.042 09:06:38 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:50.042 09:06:38 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:50.042 09:06:38 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:50.042 09:06:38 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:50.042 09:06:38 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:50.042 09:06:38 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:50.042 09:06:38 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:50.042 09:06:38 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:50.042 09:06:38 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:50.042 09:06:38 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:50.042 09:06:38 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:50.042 09:06:38 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:50.042 09:06:38 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:50.042 09:06:38 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:50.042 09:06:38 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:50.042 09:06:38 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:50.042 09:06:38 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:50.042 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:50.042 09:06:38 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:50.042 09:06:38 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:50.042 09:06:38 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:50.042 09:06:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:50.042 09:06:38 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:50.042 09:06:38 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:50.042 09:06:38 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:50.042 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:50.042 09:06:38 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:50.042 09:06:38 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:50.042 09:06:38 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:50.042 09:06:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:50.042 09:06:38 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:50.042 09:06:38 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:50.042 09:06:38 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:50.042 09:06:38 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:50.042 09:06:38 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:50.042 09:06:38 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:50.042 09:06:38 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:50.042 09:06:38 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:50.042 09:06:38 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:50.042 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:50.042 09:06:38 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:50.042 09:06:38 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:50.042 09:06:38 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:50.042 09:06:38 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:50.042 09:06:38 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:50.042 09:06:38 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:50.042 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:50.042 09:06:38 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:50.042 09:06:38 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:50.042 09:06:38 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:50.042 09:06:38 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:50.042 09:06:38 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:50.042 09:06:38 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:50.042 09:06:38 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:50.042 09:06:38 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:50.042 09:06:38 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:50.042 09:06:38 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:50.042 09:06:38 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:50.042 09:06:38 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:50.042 09:06:38 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:50.042 09:06:38 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:50.042 09:06:38 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:50.042 09:06:38 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:50.042 09:06:38 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:50.042 09:06:38 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:50.042 09:06:38 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:50.042 09:06:38 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:50.042 09:06:38 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:50.301 09:06:38 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:50.301 09:06:38 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:50.301 09:06:38 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:50.301 09:06:38 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:50.301 09:06:38 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:50.301 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:50.301 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.200 ms 00:27:50.301 00:27:50.301 --- 10.0.0.2 ping statistics --- 00:27:50.301 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:50.301 rtt min/avg/max/mdev = 0.200/0.200/0.200/0.000 ms 00:27:50.301 09:06:38 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:50.301 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:50.301 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.085 ms 00:27:50.301 00:27:50.301 --- 10.0.0.1 ping statistics --- 00:27:50.301 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:50.301 rtt min/avg/max/mdev = 0.085/0.085/0.085/0.000 ms 00:27:50.301 09:06:38 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:50.301 09:06:38 -- nvmf/common.sh@410 -- # return 0 00:27:50.301 09:06:38 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:50.301 09:06:38 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:50.301 09:06:38 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:50.301 09:06:38 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:50.301 09:06:38 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:50.301 09:06:38 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:50.301 09:06:38 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:50.301 09:06:38 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:27:50.301 09:06:38 -- common/autotest_common.sh@712 -- # xtrace_disable 00:27:50.301 09:06:38 -- common/autotest_common.sh@10 -- # set +x 00:27:50.301 09:06:38 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:27:50.301 09:06:38 -- common/autotest_common.sh@1509 -- # bdfs=() 00:27:50.301 09:06:38 -- common/autotest_common.sh@1509 -- # local bdfs 00:27:50.301 09:06:38 -- common/autotest_common.sh@1510 -- # bdfs=($(get_nvme_bdfs)) 00:27:50.301 09:06:38 -- common/autotest_common.sh@1510 -- # get_nvme_bdfs 00:27:50.301 09:06:38 -- common/autotest_common.sh@1498 -- # bdfs=() 00:27:50.301 09:06:38 -- common/autotest_common.sh@1498 -- # local bdfs 00:27:50.301 09:06:38 -- common/autotest_common.sh@1499 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:27:50.301 09:06:38 -- common/autotest_common.sh@1499 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:27:50.301 09:06:38 -- common/autotest_common.sh@1499 -- # jq -r '.config[].params.traddr' 00:27:50.301 09:06:38 -- common/autotest_common.sh@1500 -- # (( 1 == 0 )) 00:27:50.301 09:06:38 -- common/autotest_common.sh@1504 -- # printf '%s\n' 0000:88:00.0 00:27:50.301 09:06:38 -- common/autotest_common.sh@1512 -- # echo 0000:88:00.0 00:27:50.301 09:06:38 -- target/identify_passthru.sh@16 -- # bdf=0000:88:00.0 00:27:50.301 09:06:38 -- target/identify_passthru.sh@17 -- # '[' -z 0000:88:00.0 ']' 00:27:50.301 09:06:38 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:27:50.301 09:06:38 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:27:50.301 09:06:38 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:27:50.301 EAL: No free 2048 kB hugepages reported on node 1 00:27:54.489 09:06:42 -- target/identify_passthru.sh@23 -- # nvme_serial_number=PHLJ916004901P0FGN 00:27:54.489 09:06:42 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:27:54.489 09:06:42 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:27:54.489 09:06:42 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:27:54.489 EAL: No free 2048 kB hugepages reported on node 1 00:27:58.693 09:06:47 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:27:58.693 09:06:47 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:27:58.693 09:06:47 -- common/autotest_common.sh@718 -- # xtrace_disable 00:27:58.693 09:06:47 -- common/autotest_common.sh@10 -- # set +x 00:27:58.693 09:06:47 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:27:58.693 09:06:47 -- common/autotest_common.sh@712 -- # xtrace_disable 00:27:58.693 09:06:47 -- common/autotest_common.sh@10 -- # set +x 00:27:58.693 09:06:47 -- target/identify_passthru.sh@31 -- # nvmfpid=1627734 00:27:58.693 09:06:47 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:27:58.693 09:06:47 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:27:58.693 09:06:47 -- target/identify_passthru.sh@35 -- # waitforlisten 1627734 00:27:58.693 09:06:47 -- common/autotest_common.sh@819 -- # '[' -z 1627734 ']' 00:27:58.693 09:06:47 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:58.693 09:06:47 -- common/autotest_common.sh@824 -- # local max_retries=100 00:27:58.693 09:06:47 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:58.693 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:58.693 09:06:47 -- common/autotest_common.sh@828 -- # xtrace_disable 00:27:58.693 09:06:47 -- common/autotest_common.sh@10 -- # set +x 00:27:58.693 [2024-07-15 09:06:47.223702] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:27:58.693 [2024-07-15 09:06:47.223792] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:58.950 EAL: No free 2048 kB hugepages reported on node 1 00:27:58.950 [2024-07-15 09:06:47.288149] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:58.950 [2024-07-15 09:06:47.392469] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:58.950 [2024-07-15 09:06:47.392623] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:58.950 [2024-07-15 09:06:47.392640] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:58.950 [2024-07-15 09:06:47.392651] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:58.950 [2024-07-15 09:06:47.392791] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:58.950 [2024-07-15 09:06:47.392849] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:58.950 [2024-07-15 09:06:47.392916] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:58.950 [2024-07-15 09:06:47.392920] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:58.950 09:06:47 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:27:58.950 09:06:47 -- common/autotest_common.sh@852 -- # return 0 00:27:58.950 09:06:47 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:27:58.950 09:06:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:58.950 09:06:47 -- common/autotest_common.sh@10 -- # set +x 00:27:58.950 INFO: Log level set to 20 00:27:58.950 INFO: Requests: 00:27:58.950 { 00:27:58.950 "jsonrpc": "2.0", 00:27:58.950 "method": "nvmf_set_config", 00:27:58.950 "id": 1, 00:27:58.950 "params": { 00:27:58.950 "admin_cmd_passthru": { 00:27:58.950 "identify_ctrlr": true 00:27:58.950 } 00:27:58.950 } 00:27:58.950 } 00:27:58.950 00:27:58.950 INFO: response: 00:27:58.950 { 00:27:58.950 "jsonrpc": "2.0", 00:27:58.950 "id": 1, 00:27:58.950 "result": true 00:27:58.950 } 00:27:58.950 00:27:58.950 09:06:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:58.950 09:06:47 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:27:58.950 09:06:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:58.950 09:06:47 -- common/autotest_common.sh@10 -- # set +x 00:27:58.950 INFO: Setting log level to 20 00:27:58.950 INFO: Setting log level to 20 00:27:58.950 INFO: Log level set to 20 00:27:58.950 INFO: Log level set to 20 00:27:58.950 INFO: Requests: 00:27:58.950 { 00:27:58.950 "jsonrpc": "2.0", 00:27:58.950 "method": "framework_start_init", 00:27:58.950 "id": 1 00:27:58.950 } 00:27:58.950 00:27:58.950 INFO: Requests: 00:27:58.950 { 00:27:58.950 "jsonrpc": "2.0", 00:27:58.951 "method": "framework_start_init", 00:27:58.951 "id": 1 00:27:58.951 } 00:27:58.951 00:27:59.208 [2024-07-15 09:06:47.529233] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:27:59.208 INFO: response: 00:27:59.208 { 00:27:59.208 "jsonrpc": "2.0", 00:27:59.208 "id": 1, 00:27:59.208 "result": true 00:27:59.208 } 00:27:59.208 00:27:59.208 INFO: response: 00:27:59.208 { 00:27:59.208 "jsonrpc": "2.0", 00:27:59.208 "id": 1, 00:27:59.208 "result": true 00:27:59.208 } 00:27:59.208 00:27:59.208 09:06:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:59.208 09:06:47 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:59.208 09:06:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:59.208 09:06:47 -- common/autotest_common.sh@10 -- # set +x 00:27:59.208 INFO: Setting log level to 40 00:27:59.208 INFO: Setting log level to 40 00:27:59.208 INFO: Setting log level to 40 00:27:59.208 [2024-07-15 09:06:47.539380] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:59.208 09:06:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:59.208 09:06:47 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:27:59.208 09:06:47 -- common/autotest_common.sh@718 -- # xtrace_disable 00:27:59.208 09:06:47 -- common/autotest_common.sh@10 -- # set +x 00:27:59.208 09:06:47 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 00:27:59.208 09:06:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:59.208 09:06:47 -- common/autotest_common.sh@10 -- # set +x 00:28:02.486 Nvme0n1 00:28:02.486 09:06:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:02.486 09:06:50 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:28:02.486 09:06:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:02.486 09:06:50 -- common/autotest_common.sh@10 -- # set +x 00:28:02.486 09:06:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:02.486 09:06:50 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:28:02.486 09:06:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:02.486 09:06:50 -- common/autotest_common.sh@10 -- # set +x 00:28:02.486 09:06:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:02.486 09:06:50 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:02.486 09:06:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:02.486 09:06:50 -- common/autotest_common.sh@10 -- # set +x 00:28:02.486 [2024-07-15 09:06:50.436840] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:02.486 09:06:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:02.486 09:06:50 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:28:02.486 09:06:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:02.486 09:06:50 -- common/autotest_common.sh@10 -- # set +x 00:28:02.486 [2024-07-15 09:06:50.444584] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:28:02.486 [ 00:28:02.486 { 00:28:02.486 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:28:02.486 "subtype": "Discovery", 00:28:02.486 "listen_addresses": [], 00:28:02.486 "allow_any_host": true, 00:28:02.486 "hosts": [] 00:28:02.486 }, 00:28:02.486 { 00:28:02.486 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:28:02.486 "subtype": "NVMe", 00:28:02.486 "listen_addresses": [ 00:28:02.486 { 00:28:02.486 "transport": "TCP", 00:28:02.486 "trtype": "TCP", 00:28:02.486 "adrfam": "IPv4", 00:28:02.486 "traddr": "10.0.0.2", 00:28:02.486 "trsvcid": "4420" 00:28:02.486 } 00:28:02.486 ], 00:28:02.486 "allow_any_host": true, 00:28:02.486 "hosts": [], 00:28:02.486 "serial_number": "SPDK00000000000001", 00:28:02.486 "model_number": "SPDK bdev Controller", 00:28:02.486 "max_namespaces": 1, 00:28:02.486 "min_cntlid": 1, 00:28:02.486 "max_cntlid": 65519, 00:28:02.486 "namespaces": [ 00:28:02.486 { 00:28:02.487 "nsid": 1, 00:28:02.487 "bdev_name": "Nvme0n1", 00:28:02.487 "name": "Nvme0n1", 00:28:02.487 "nguid": "E76294E41163451B9C4063CBDE697E56", 00:28:02.487 "uuid": "e76294e4-1163-451b-9c40-63cbde697e56" 00:28:02.487 } 00:28:02.487 ] 00:28:02.487 } 00:28:02.487 ] 00:28:02.487 09:06:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:02.487 09:06:50 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:28:02.487 09:06:50 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:28:02.487 09:06:50 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:28:02.487 EAL: No free 2048 kB hugepages reported on node 1 00:28:02.487 09:06:50 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=PHLJ916004901P0FGN 00:28:02.487 09:06:50 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:28:02.487 09:06:50 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:28:02.487 09:06:50 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:28:02.487 EAL: No free 2048 kB hugepages reported on node 1 00:28:02.487 09:06:50 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:28:02.487 09:06:50 -- target/identify_passthru.sh@63 -- # '[' PHLJ916004901P0FGN '!=' PHLJ916004901P0FGN ']' 00:28:02.487 09:06:50 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:28:02.487 09:06:50 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:02.487 09:06:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:02.487 09:06:50 -- common/autotest_common.sh@10 -- # set +x 00:28:02.487 09:06:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:02.487 09:06:50 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:28:02.487 09:06:50 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:28:02.487 09:06:50 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:02.487 09:06:50 -- nvmf/common.sh@116 -- # sync 00:28:02.487 09:06:50 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:02.487 09:06:50 -- nvmf/common.sh@119 -- # set +e 00:28:02.487 09:06:50 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:02.487 09:06:50 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:02.487 rmmod nvme_tcp 00:28:02.487 rmmod nvme_fabrics 00:28:02.487 rmmod nvme_keyring 00:28:02.487 09:06:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:02.487 09:06:50 -- nvmf/common.sh@123 -- # set -e 00:28:02.487 09:06:50 -- nvmf/common.sh@124 -- # return 0 00:28:02.487 09:06:50 -- nvmf/common.sh@477 -- # '[' -n 1627734 ']' 00:28:02.487 09:06:50 -- nvmf/common.sh@478 -- # killprocess 1627734 00:28:02.487 09:06:50 -- common/autotest_common.sh@926 -- # '[' -z 1627734 ']' 00:28:02.487 09:06:50 -- common/autotest_common.sh@930 -- # kill -0 1627734 00:28:02.487 09:06:50 -- common/autotest_common.sh@931 -- # uname 00:28:02.487 09:06:50 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:28:02.487 09:06:50 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1627734 00:28:02.487 09:06:50 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:28:02.487 09:06:50 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:28:02.487 09:06:50 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1627734' 00:28:02.487 killing process with pid 1627734 00:28:02.487 09:06:50 -- common/autotest_common.sh@945 -- # kill 1627734 00:28:02.487 [2024-07-15 09:06:50.961538] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:28:02.487 09:06:50 -- common/autotest_common.sh@950 -- # wait 1627734 00:28:04.386 09:06:52 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:04.386 09:06:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:04.386 09:06:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:04.386 09:06:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:04.386 09:06:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:04.386 09:06:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:04.386 09:06:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:04.386 09:06:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:06.289 09:06:54 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:06.289 00:28:06.289 real 0m18.096s 00:28:06.289 user 0m26.916s 00:28:06.289 sys 0m2.293s 00:28:06.289 09:06:54 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:28:06.289 09:06:54 -- common/autotest_common.sh@10 -- # set +x 00:28:06.289 ************************************ 00:28:06.289 END TEST nvmf_identify_passthru 00:28:06.289 ************************************ 00:28:06.289 09:06:54 -- spdk/autotest.sh@300 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:28:06.289 09:06:54 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:28:06.289 09:06:54 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:28:06.289 09:06:54 -- common/autotest_common.sh@10 -- # set +x 00:28:06.289 ************************************ 00:28:06.289 START TEST nvmf_dif 00:28:06.289 ************************************ 00:28:06.289 09:06:54 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:28:06.289 * Looking for test storage... 00:28:06.289 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:28:06.289 09:06:54 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:06.289 09:06:54 -- nvmf/common.sh@7 -- # uname -s 00:28:06.289 09:06:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:06.289 09:06:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:06.289 09:06:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:06.289 09:06:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:06.289 09:06:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:06.289 09:06:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:06.289 09:06:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:06.289 09:06:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:06.289 09:06:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:06.289 09:06:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:06.289 09:06:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:06.289 09:06:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:06.289 09:06:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:06.289 09:06:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:06.289 09:06:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:06.289 09:06:54 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:06.289 09:06:54 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:06.289 09:06:54 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:06.289 09:06:54 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:06.289 09:06:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:06.289 09:06:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:06.290 09:06:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:06.290 09:06:54 -- paths/export.sh@5 -- # export PATH 00:28:06.290 09:06:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:06.290 09:06:54 -- nvmf/common.sh@46 -- # : 0 00:28:06.290 09:06:54 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:06.290 09:06:54 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:06.290 09:06:54 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:06.290 09:06:54 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:06.290 09:06:54 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:06.290 09:06:54 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:06.290 09:06:54 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:06.290 09:06:54 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:06.290 09:06:54 -- target/dif.sh@15 -- # NULL_META=16 00:28:06.290 09:06:54 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:28:06.290 09:06:54 -- target/dif.sh@15 -- # NULL_SIZE=64 00:28:06.290 09:06:54 -- target/dif.sh@15 -- # NULL_DIF=1 00:28:06.290 09:06:54 -- target/dif.sh@135 -- # nvmftestinit 00:28:06.290 09:06:54 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:06.290 09:06:54 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:06.290 09:06:54 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:06.290 09:06:54 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:06.290 09:06:54 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:06.290 09:06:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:06.290 09:06:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:06.290 09:06:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:06.290 09:06:54 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:06.290 09:06:54 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:06.290 09:06:54 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:06.290 09:06:54 -- common/autotest_common.sh@10 -- # set +x 00:28:08.189 09:06:56 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:08.189 09:06:56 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:08.189 09:06:56 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:08.189 09:06:56 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:08.189 09:06:56 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:08.189 09:06:56 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:08.189 09:06:56 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:08.189 09:06:56 -- nvmf/common.sh@294 -- # net_devs=() 00:28:08.189 09:06:56 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:08.189 09:06:56 -- nvmf/common.sh@295 -- # e810=() 00:28:08.189 09:06:56 -- nvmf/common.sh@295 -- # local -ga e810 00:28:08.189 09:06:56 -- nvmf/common.sh@296 -- # x722=() 00:28:08.189 09:06:56 -- nvmf/common.sh@296 -- # local -ga x722 00:28:08.189 09:06:56 -- nvmf/common.sh@297 -- # mlx=() 00:28:08.189 09:06:56 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:08.189 09:06:56 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:08.189 09:06:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:08.189 09:06:56 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:08.189 09:06:56 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:08.189 09:06:56 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:08.189 09:06:56 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:08.189 09:06:56 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:08.189 09:06:56 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:08.189 09:06:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:08.189 09:06:56 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:08.189 09:06:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:08.189 09:06:56 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:08.189 09:06:56 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:08.189 09:06:56 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:08.189 09:06:56 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:08.189 09:06:56 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:08.189 09:06:56 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:08.189 09:06:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:08.189 09:06:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:08.189 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:08.189 09:06:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:08.189 09:06:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:08.189 09:06:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:08.189 09:06:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:08.189 09:06:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:08.189 09:06:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:08.189 09:06:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:08.189 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:08.189 09:06:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:08.189 09:06:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:08.189 09:06:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:08.189 09:06:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:08.189 09:06:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:08.189 09:06:56 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:08.189 09:06:56 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:08.189 09:06:56 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:08.189 09:06:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:08.189 09:06:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:08.189 09:06:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:08.189 09:06:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:08.189 09:06:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:08.189 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:08.189 09:06:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:08.189 09:06:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:08.189 09:06:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:08.189 09:06:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:08.189 09:06:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:08.189 09:06:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:08.189 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:08.189 09:06:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:08.189 09:06:56 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:08.189 09:06:56 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:08.189 09:06:56 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:08.189 09:06:56 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:08.189 09:06:56 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:08.189 09:06:56 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:08.189 09:06:56 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:08.189 09:06:56 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:08.190 09:06:56 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:08.190 09:06:56 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:08.190 09:06:56 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:08.190 09:06:56 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:08.190 09:06:56 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:08.190 09:06:56 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:08.190 09:06:56 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:08.190 09:06:56 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:08.190 09:06:56 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:08.190 09:06:56 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:08.190 09:06:56 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:08.190 09:06:56 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:08.190 09:06:56 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:08.190 09:06:56 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:08.190 09:06:56 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:08.190 09:06:56 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:08.190 09:06:56 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:08.190 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:08.190 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.129 ms 00:28:08.190 00:28:08.190 --- 10.0.0.2 ping statistics --- 00:28:08.190 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:08.190 rtt min/avg/max/mdev = 0.129/0.129/0.129/0.000 ms 00:28:08.190 09:06:56 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:08.190 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:08.190 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.117 ms 00:28:08.190 00:28:08.190 --- 10.0.0.1 ping statistics --- 00:28:08.190 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:08.190 rtt min/avg/max/mdev = 0.117/0.117/0.117/0.000 ms 00:28:08.190 09:06:56 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:08.190 09:06:56 -- nvmf/common.sh@410 -- # return 0 00:28:08.190 09:06:56 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:28:08.190 09:06:56 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:28:09.566 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:28:09.566 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:28:09.566 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:28:09.566 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:28:09.566 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:28:09.566 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:28:09.566 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:28:09.566 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:28:09.566 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:28:09.566 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:28:09.566 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:28:09.566 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:28:09.566 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:28:09.566 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:28:09.566 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:28:09.566 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:28:09.566 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:28:09.566 09:06:58 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:09.566 09:06:58 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:09.566 09:06:58 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:09.566 09:06:58 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:09.566 09:06:58 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:09.566 09:06:58 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:09.566 09:06:58 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:28:09.566 09:06:58 -- target/dif.sh@137 -- # nvmfappstart 00:28:09.566 09:06:58 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:09.566 09:06:58 -- common/autotest_common.sh@712 -- # xtrace_disable 00:28:09.566 09:06:58 -- common/autotest_common.sh@10 -- # set +x 00:28:09.566 09:06:58 -- nvmf/common.sh@469 -- # nvmfpid=1630966 00:28:09.566 09:06:58 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:28:09.566 09:06:58 -- nvmf/common.sh@470 -- # waitforlisten 1630966 00:28:09.566 09:06:58 -- common/autotest_common.sh@819 -- # '[' -z 1630966 ']' 00:28:09.566 09:06:58 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:09.566 09:06:58 -- common/autotest_common.sh@824 -- # local max_retries=100 00:28:09.566 09:06:58 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:09.566 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:09.566 09:06:58 -- common/autotest_common.sh@828 -- # xtrace_disable 00:28:09.566 09:06:58 -- common/autotest_common.sh@10 -- # set +x 00:28:09.566 [2024-07-15 09:06:58.089376] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:28:09.566 [2024-07-15 09:06:58.089459] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:09.823 EAL: No free 2048 kB hugepages reported on node 1 00:28:09.823 [2024-07-15 09:06:58.153756] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:09.823 [2024-07-15 09:06:58.258706] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:09.823 [2024-07-15 09:06:58.258884] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:09.823 [2024-07-15 09:06:58.258903] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:09.823 [2024-07-15 09:06:58.258916] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:09.823 [2024-07-15 09:06:58.258958] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:10.754 09:06:59 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:28:10.754 09:06:59 -- common/autotest_common.sh@852 -- # return 0 00:28:10.754 09:06:59 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:10.754 09:06:59 -- common/autotest_common.sh@718 -- # xtrace_disable 00:28:10.754 09:06:59 -- common/autotest_common.sh@10 -- # set +x 00:28:10.754 09:06:59 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:10.754 09:06:59 -- target/dif.sh@139 -- # create_transport 00:28:10.754 09:06:59 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:28:10.754 09:06:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:10.754 09:06:59 -- common/autotest_common.sh@10 -- # set +x 00:28:10.754 [2024-07-15 09:06:59.094120] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:10.754 09:06:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:10.754 09:06:59 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:28:10.754 09:06:59 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:28:10.754 09:06:59 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:28:10.754 09:06:59 -- common/autotest_common.sh@10 -- # set +x 00:28:10.754 ************************************ 00:28:10.754 START TEST fio_dif_1_default 00:28:10.754 ************************************ 00:28:10.754 09:06:59 -- common/autotest_common.sh@1104 -- # fio_dif_1 00:28:10.754 09:06:59 -- target/dif.sh@86 -- # create_subsystems 0 00:28:10.754 09:06:59 -- target/dif.sh@28 -- # local sub 00:28:10.754 09:06:59 -- target/dif.sh@30 -- # for sub in "$@" 00:28:10.754 09:06:59 -- target/dif.sh@31 -- # create_subsystem 0 00:28:10.754 09:06:59 -- target/dif.sh@18 -- # local sub_id=0 00:28:10.754 09:06:59 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:10.754 09:06:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:10.754 09:06:59 -- common/autotest_common.sh@10 -- # set +x 00:28:10.754 bdev_null0 00:28:10.754 09:06:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:10.754 09:06:59 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:10.754 09:06:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:10.754 09:06:59 -- common/autotest_common.sh@10 -- # set +x 00:28:10.754 09:06:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:10.754 09:06:59 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:10.754 09:06:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:10.754 09:06:59 -- common/autotest_common.sh@10 -- # set +x 00:28:10.754 09:06:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:10.754 09:06:59 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:10.754 09:06:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:10.754 09:06:59 -- common/autotest_common.sh@10 -- # set +x 00:28:10.754 [2024-07-15 09:06:59.134404] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:10.754 09:06:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:10.754 09:06:59 -- target/dif.sh@87 -- # fio /dev/fd/62 00:28:10.754 09:06:59 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:28:10.754 09:06:59 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:28:10.754 09:06:59 -- nvmf/common.sh@520 -- # config=() 00:28:10.754 09:06:59 -- nvmf/common.sh@520 -- # local subsystem config 00:28:10.754 09:06:59 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:10.754 09:06:59 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:10.754 { 00:28:10.754 "params": { 00:28:10.754 "name": "Nvme$subsystem", 00:28:10.754 "trtype": "$TEST_TRANSPORT", 00:28:10.754 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:10.754 "adrfam": "ipv4", 00:28:10.754 "trsvcid": "$NVMF_PORT", 00:28:10.754 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:10.754 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:10.754 "hdgst": ${hdgst:-false}, 00:28:10.754 "ddgst": ${ddgst:-false} 00:28:10.754 }, 00:28:10.754 "method": "bdev_nvme_attach_controller" 00:28:10.754 } 00:28:10.754 EOF 00:28:10.754 )") 00:28:10.754 09:06:59 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:10.754 09:06:59 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:10.754 09:06:59 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:28:10.754 09:06:59 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:10.754 09:06:59 -- common/autotest_common.sh@1318 -- # local sanitizers 00:28:10.754 09:06:59 -- target/dif.sh@82 -- # gen_fio_conf 00:28:10.754 09:06:59 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:10.754 09:06:59 -- common/autotest_common.sh@1320 -- # shift 00:28:10.754 09:06:59 -- target/dif.sh@54 -- # local file 00:28:10.754 09:06:59 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:28:10.754 09:06:59 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:10.754 09:06:59 -- target/dif.sh@56 -- # cat 00:28:10.754 09:06:59 -- nvmf/common.sh@542 -- # cat 00:28:10.754 09:06:59 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:10.754 09:06:59 -- common/autotest_common.sh@1324 -- # grep libasan 00:28:10.754 09:06:59 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:10.754 09:06:59 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:10.754 09:06:59 -- target/dif.sh@72 -- # (( file <= files )) 00:28:10.754 09:06:59 -- nvmf/common.sh@544 -- # jq . 00:28:10.754 09:06:59 -- nvmf/common.sh@545 -- # IFS=, 00:28:10.754 09:06:59 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:10.754 "params": { 00:28:10.754 "name": "Nvme0", 00:28:10.754 "trtype": "tcp", 00:28:10.754 "traddr": "10.0.0.2", 00:28:10.754 "adrfam": "ipv4", 00:28:10.754 "trsvcid": "4420", 00:28:10.754 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:10.754 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:10.754 "hdgst": false, 00:28:10.754 "ddgst": false 00:28:10.754 }, 00:28:10.754 "method": "bdev_nvme_attach_controller" 00:28:10.754 }' 00:28:10.754 09:06:59 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:10.754 09:06:59 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:10.754 09:06:59 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:10.754 09:06:59 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:10.754 09:06:59 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:28:10.754 09:06:59 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:10.754 09:06:59 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:10.754 09:06:59 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:10.754 09:06:59 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:10.754 09:06:59 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:11.012 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:11.012 fio-3.35 00:28:11.012 Starting 1 thread 00:28:11.012 EAL: No free 2048 kB hugepages reported on node 1 00:28:11.577 [2024-07-15 09:06:59.819492] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:11.578 [2024-07-15 09:06:59.819574] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:21.600 00:28:21.600 filename0: (groupid=0, jobs=1): err= 0: pid=1631330: Mon Jul 15 09:07:09 2024 00:28:21.600 read: IOPS=189, BW=760KiB/s (778kB/s)(7600KiB/10003msec) 00:28:21.600 slat (nsec): min=4180, max=40879, avg=9504.40, stdev=3877.50 00:28:21.600 clat (usec): min=690, max=48564, avg=21027.99, stdev=20241.51 00:28:21.600 lat (usec): min=697, max=48578, avg=21037.50, stdev=20241.65 00:28:21.600 clat percentiles (usec): 00:28:21.600 | 1.00th=[ 709], 5.00th=[ 725], 10.00th=[ 734], 20.00th=[ 742], 00:28:21.600 | 30.00th=[ 758], 40.00th=[ 766], 50.00th=[41157], 60.00th=[41157], 00:28:21.600 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:28:21.600 | 99.00th=[41157], 99.50th=[41157], 99.90th=[48497], 99.95th=[48497], 00:28:21.600 | 99.99th=[48497] 00:28:21.600 bw ( KiB/s): min= 704, max= 768, per=100.00%, avg=761.26, stdev=20.18, samples=19 00:28:21.600 iops : min= 176, max= 192, avg=190.32, stdev= 5.04, samples=19 00:28:21.600 lat (usec) : 750=25.32%, 1000=24.58% 00:28:21.600 lat (msec) : 50=50.11% 00:28:21.600 cpu : usr=90.81%, sys=8.91%, ctx=13, majf=0, minf=240 00:28:21.600 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:21.600 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:21.600 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:21.600 issued rwts: total=1900,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:21.600 latency : target=0, window=0, percentile=100.00%, depth=4 00:28:21.600 00:28:21.600 Run status group 0 (all jobs): 00:28:21.600 READ: bw=760KiB/s (778kB/s), 760KiB/s-760KiB/s (778kB/s-778kB/s), io=7600KiB (7782kB), run=10003-10003msec 00:28:21.600 09:07:10 -- target/dif.sh@88 -- # destroy_subsystems 0 00:28:21.600 09:07:10 -- target/dif.sh@43 -- # local sub 00:28:21.600 09:07:10 -- target/dif.sh@45 -- # for sub in "$@" 00:28:21.600 09:07:10 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:21.600 09:07:10 -- target/dif.sh@36 -- # local sub_id=0 00:28:21.600 09:07:10 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:21.600 09:07:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:21.600 09:07:10 -- common/autotest_common.sh@10 -- # set +x 00:28:21.860 09:07:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:21.860 09:07:10 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:21.860 09:07:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:21.860 09:07:10 -- common/autotest_common.sh@10 -- # set +x 00:28:21.860 09:07:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:21.860 00:28:21.860 real 0m11.052s 00:28:21.860 user 0m10.182s 00:28:21.860 sys 0m1.151s 00:28:21.860 09:07:10 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:28:21.860 09:07:10 -- common/autotest_common.sh@10 -- # set +x 00:28:21.860 ************************************ 00:28:21.860 END TEST fio_dif_1_default 00:28:21.860 ************************************ 00:28:21.860 09:07:10 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:28:21.860 09:07:10 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:28:21.860 09:07:10 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:28:21.860 09:07:10 -- common/autotest_common.sh@10 -- # set +x 00:28:21.860 ************************************ 00:28:21.860 START TEST fio_dif_1_multi_subsystems 00:28:21.860 ************************************ 00:28:21.860 09:07:10 -- common/autotest_common.sh@1104 -- # fio_dif_1_multi_subsystems 00:28:21.860 09:07:10 -- target/dif.sh@92 -- # local files=1 00:28:21.860 09:07:10 -- target/dif.sh@94 -- # create_subsystems 0 1 00:28:21.860 09:07:10 -- target/dif.sh@28 -- # local sub 00:28:21.860 09:07:10 -- target/dif.sh@30 -- # for sub in "$@" 00:28:21.860 09:07:10 -- target/dif.sh@31 -- # create_subsystem 0 00:28:21.860 09:07:10 -- target/dif.sh@18 -- # local sub_id=0 00:28:21.860 09:07:10 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:21.860 09:07:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:21.860 09:07:10 -- common/autotest_common.sh@10 -- # set +x 00:28:21.860 bdev_null0 00:28:21.860 09:07:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:21.860 09:07:10 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:21.860 09:07:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:21.860 09:07:10 -- common/autotest_common.sh@10 -- # set +x 00:28:21.860 09:07:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:21.860 09:07:10 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:21.860 09:07:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:21.860 09:07:10 -- common/autotest_common.sh@10 -- # set +x 00:28:21.860 09:07:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:21.860 09:07:10 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:21.860 09:07:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:21.860 09:07:10 -- common/autotest_common.sh@10 -- # set +x 00:28:21.860 [2024-07-15 09:07:10.206914] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:21.860 09:07:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:21.860 09:07:10 -- target/dif.sh@30 -- # for sub in "$@" 00:28:21.860 09:07:10 -- target/dif.sh@31 -- # create_subsystem 1 00:28:21.860 09:07:10 -- target/dif.sh@18 -- # local sub_id=1 00:28:21.860 09:07:10 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:28:21.860 09:07:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:21.860 09:07:10 -- common/autotest_common.sh@10 -- # set +x 00:28:21.860 bdev_null1 00:28:21.860 09:07:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:21.860 09:07:10 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:28:21.860 09:07:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:21.860 09:07:10 -- common/autotest_common.sh@10 -- # set +x 00:28:21.861 09:07:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:21.861 09:07:10 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:28:21.861 09:07:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:21.861 09:07:10 -- common/autotest_common.sh@10 -- # set +x 00:28:21.861 09:07:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:21.861 09:07:10 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:21.861 09:07:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:21.861 09:07:10 -- common/autotest_common.sh@10 -- # set +x 00:28:21.861 09:07:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:21.861 09:07:10 -- target/dif.sh@95 -- # fio /dev/fd/62 00:28:21.861 09:07:10 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:28:21.861 09:07:10 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:28:21.861 09:07:10 -- nvmf/common.sh@520 -- # config=() 00:28:21.861 09:07:10 -- nvmf/common.sh@520 -- # local subsystem config 00:28:21.861 09:07:10 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:21.861 09:07:10 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:21.861 09:07:10 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:21.861 { 00:28:21.861 "params": { 00:28:21.861 "name": "Nvme$subsystem", 00:28:21.861 "trtype": "$TEST_TRANSPORT", 00:28:21.861 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:21.861 "adrfam": "ipv4", 00:28:21.861 "trsvcid": "$NVMF_PORT", 00:28:21.861 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:21.861 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:21.861 "hdgst": ${hdgst:-false}, 00:28:21.861 "ddgst": ${ddgst:-false} 00:28:21.861 }, 00:28:21.861 "method": "bdev_nvme_attach_controller" 00:28:21.861 } 00:28:21.861 EOF 00:28:21.861 )") 00:28:21.861 09:07:10 -- target/dif.sh@82 -- # gen_fio_conf 00:28:21.861 09:07:10 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:21.861 09:07:10 -- target/dif.sh@54 -- # local file 00:28:21.861 09:07:10 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:28:21.861 09:07:10 -- target/dif.sh@56 -- # cat 00:28:21.861 09:07:10 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:21.861 09:07:10 -- common/autotest_common.sh@1318 -- # local sanitizers 00:28:21.861 09:07:10 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:21.861 09:07:10 -- common/autotest_common.sh@1320 -- # shift 00:28:21.861 09:07:10 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:28:21.861 09:07:10 -- nvmf/common.sh@542 -- # cat 00:28:21.861 09:07:10 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:21.861 09:07:10 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:21.861 09:07:10 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:21.861 09:07:10 -- target/dif.sh@72 -- # (( file <= files )) 00:28:21.861 09:07:10 -- target/dif.sh@73 -- # cat 00:28:21.861 09:07:10 -- common/autotest_common.sh@1324 -- # grep libasan 00:28:21.861 09:07:10 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:21.861 09:07:10 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:21.861 09:07:10 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:21.861 { 00:28:21.861 "params": { 00:28:21.861 "name": "Nvme$subsystem", 00:28:21.861 "trtype": "$TEST_TRANSPORT", 00:28:21.861 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:21.861 "adrfam": "ipv4", 00:28:21.861 "trsvcid": "$NVMF_PORT", 00:28:21.861 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:21.861 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:21.861 "hdgst": ${hdgst:-false}, 00:28:21.861 "ddgst": ${ddgst:-false} 00:28:21.861 }, 00:28:21.861 "method": "bdev_nvme_attach_controller" 00:28:21.861 } 00:28:21.861 EOF 00:28:21.861 )") 00:28:21.861 09:07:10 -- nvmf/common.sh@542 -- # cat 00:28:21.861 09:07:10 -- target/dif.sh@72 -- # (( file++ )) 00:28:21.861 09:07:10 -- target/dif.sh@72 -- # (( file <= files )) 00:28:21.861 09:07:10 -- nvmf/common.sh@544 -- # jq . 00:28:21.861 09:07:10 -- nvmf/common.sh@545 -- # IFS=, 00:28:21.861 09:07:10 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:21.861 "params": { 00:28:21.861 "name": "Nvme0", 00:28:21.861 "trtype": "tcp", 00:28:21.861 "traddr": "10.0.0.2", 00:28:21.861 "adrfam": "ipv4", 00:28:21.861 "trsvcid": "4420", 00:28:21.861 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:21.861 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:21.861 "hdgst": false, 00:28:21.861 "ddgst": false 00:28:21.861 }, 00:28:21.861 "method": "bdev_nvme_attach_controller" 00:28:21.861 },{ 00:28:21.861 "params": { 00:28:21.861 "name": "Nvme1", 00:28:21.861 "trtype": "tcp", 00:28:21.861 "traddr": "10.0.0.2", 00:28:21.861 "adrfam": "ipv4", 00:28:21.861 "trsvcid": "4420", 00:28:21.861 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:28:21.861 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:28:21.861 "hdgst": false, 00:28:21.861 "ddgst": false 00:28:21.861 }, 00:28:21.861 "method": "bdev_nvme_attach_controller" 00:28:21.861 }' 00:28:21.861 09:07:10 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:21.861 09:07:10 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:21.861 09:07:10 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:21.861 09:07:10 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:21.861 09:07:10 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:28:21.861 09:07:10 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:21.861 09:07:10 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:21.861 09:07:10 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:21.861 09:07:10 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:21.861 09:07:10 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:22.120 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:22.120 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:22.120 fio-3.35 00:28:22.120 Starting 2 threads 00:28:22.120 EAL: No free 2048 kB hugepages reported on node 1 00:28:22.686 [2024-07-15 09:07:11.082675] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:22.686 [2024-07-15 09:07:11.082726] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:34.902 00:28:34.902 filename0: (groupid=0, jobs=1): err= 0: pid=1632771: Mon Jul 15 09:07:21 2024 00:28:34.902 read: IOPS=190, BW=760KiB/s (778kB/s)(7632KiB/10040msec) 00:28:34.902 slat (nsec): min=7023, max=64392, avg=9652.74, stdev=2860.95 00:28:34.902 clat (usec): min=670, max=43074, avg=21016.59, stdev=20218.34 00:28:34.902 lat (usec): min=679, max=43086, avg=21026.24, stdev=20218.58 00:28:34.902 clat percentiles (usec): 00:28:34.902 | 1.00th=[ 709], 5.00th=[ 717], 10.00th=[ 725], 20.00th=[ 742], 00:28:34.902 | 30.00th=[ 766], 40.00th=[ 807], 50.00th=[41157], 60.00th=[41157], 00:28:34.902 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:28:34.902 | 99.00th=[41157], 99.50th=[41157], 99.90th=[43254], 99.95th=[43254], 00:28:34.902 | 99.99th=[43254] 00:28:34.902 bw ( KiB/s): min= 704, max= 768, per=50.07%, avg=761.60, stdev=19.70, samples=20 00:28:34.902 iops : min= 176, max= 192, avg=190.40, stdev= 4.92, samples=20 00:28:34.902 lat (usec) : 750=26.68%, 1000=23.22% 00:28:34.902 lat (msec) : 50=50.10% 00:28:34.902 cpu : usr=94.65%, sys=5.04%, ctx=16, majf=0, minf=222 00:28:34.902 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:34.902 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:34.902 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:34.902 issued rwts: total=1908,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:34.902 latency : target=0, window=0, percentile=100.00%, depth=4 00:28:34.902 filename1: (groupid=0, jobs=1): err= 0: pid=1632772: Mon Jul 15 09:07:21 2024 00:28:34.902 read: IOPS=190, BW=760KiB/s (778kB/s)(7632KiB/10042msec) 00:28:34.902 slat (nsec): min=7318, max=27614, avg=9459.53, stdev=2535.03 00:28:34.902 clat (usec): min=697, max=43102, avg=21021.06, stdev=20160.45 00:28:34.902 lat (usec): min=705, max=43129, avg=21030.52, stdev=20160.54 00:28:34.902 clat percentiles (usec): 00:28:34.902 | 1.00th=[ 709], 5.00th=[ 717], 10.00th=[ 734], 20.00th=[ 783], 00:28:34.902 | 30.00th=[ 873], 40.00th=[ 898], 50.00th=[41157], 60.00th=[41157], 00:28:34.902 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:28:34.902 | 99.00th=[41157], 99.50th=[41681], 99.90th=[43254], 99.95th=[43254], 00:28:34.902 | 99.99th=[43254] 00:28:34.902 bw ( KiB/s): min= 704, max= 768, per=50.07%, avg=761.60, stdev=19.70, samples=20 00:28:34.902 iops : min= 176, max= 192, avg=190.40, stdev= 4.92, samples=20 00:28:34.902 lat (usec) : 750=12.47%, 1000=37.21% 00:28:34.902 lat (msec) : 2=0.21%, 50=50.10% 00:28:34.902 cpu : usr=94.71%, sys=4.98%, ctx=15, majf=0, minf=92 00:28:34.902 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:34.902 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:34.902 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:34.902 issued rwts: total=1908,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:34.902 latency : target=0, window=0, percentile=100.00%, depth=4 00:28:34.902 00:28:34.902 Run status group 0 (all jobs): 00:28:34.902 READ: bw=1520KiB/s (1556kB/s), 760KiB/s-760KiB/s (778kB/s-778kB/s), io=14.9MiB (15.6MB), run=10040-10042msec 00:28:34.902 09:07:21 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:28:34.902 09:07:21 -- target/dif.sh@43 -- # local sub 00:28:34.902 09:07:21 -- target/dif.sh@45 -- # for sub in "$@" 00:28:34.902 09:07:21 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:34.902 09:07:21 -- target/dif.sh@36 -- # local sub_id=0 00:28:34.902 09:07:21 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:34.902 09:07:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:34.902 09:07:21 -- common/autotest_common.sh@10 -- # set +x 00:28:34.902 09:07:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:34.902 09:07:21 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:34.902 09:07:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:34.902 09:07:21 -- common/autotest_common.sh@10 -- # set +x 00:28:34.902 09:07:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:34.902 09:07:21 -- target/dif.sh@45 -- # for sub in "$@" 00:28:34.902 09:07:21 -- target/dif.sh@46 -- # destroy_subsystem 1 00:28:34.902 09:07:21 -- target/dif.sh@36 -- # local sub_id=1 00:28:34.902 09:07:21 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:34.902 09:07:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:34.902 09:07:21 -- common/autotest_common.sh@10 -- # set +x 00:28:34.902 09:07:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:34.902 09:07:21 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:28:34.902 09:07:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:34.902 09:07:21 -- common/autotest_common.sh@10 -- # set +x 00:28:34.902 09:07:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:34.902 00:28:34.902 real 0m11.299s 00:28:34.902 user 0m20.326s 00:28:34.902 sys 0m1.342s 00:28:34.902 09:07:21 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:28:34.902 09:07:21 -- common/autotest_common.sh@10 -- # set +x 00:28:34.902 ************************************ 00:28:34.902 END TEST fio_dif_1_multi_subsystems 00:28:34.902 ************************************ 00:28:34.902 09:07:21 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:28:34.902 09:07:21 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:28:34.902 09:07:21 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:28:34.902 09:07:21 -- common/autotest_common.sh@10 -- # set +x 00:28:34.902 ************************************ 00:28:34.902 START TEST fio_dif_rand_params 00:28:34.902 ************************************ 00:28:34.902 09:07:21 -- common/autotest_common.sh@1104 -- # fio_dif_rand_params 00:28:34.902 09:07:21 -- target/dif.sh@100 -- # local NULL_DIF 00:28:34.902 09:07:21 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:28:34.902 09:07:21 -- target/dif.sh@103 -- # NULL_DIF=3 00:28:34.902 09:07:21 -- target/dif.sh@103 -- # bs=128k 00:28:34.902 09:07:21 -- target/dif.sh@103 -- # numjobs=3 00:28:34.902 09:07:21 -- target/dif.sh@103 -- # iodepth=3 00:28:34.902 09:07:21 -- target/dif.sh@103 -- # runtime=5 00:28:34.902 09:07:21 -- target/dif.sh@105 -- # create_subsystems 0 00:28:34.902 09:07:21 -- target/dif.sh@28 -- # local sub 00:28:34.902 09:07:21 -- target/dif.sh@30 -- # for sub in "$@" 00:28:34.902 09:07:21 -- target/dif.sh@31 -- # create_subsystem 0 00:28:34.902 09:07:21 -- target/dif.sh@18 -- # local sub_id=0 00:28:34.902 09:07:21 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:28:34.902 09:07:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:34.902 09:07:21 -- common/autotest_common.sh@10 -- # set +x 00:28:34.902 bdev_null0 00:28:34.902 09:07:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:34.902 09:07:21 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:34.902 09:07:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:34.902 09:07:21 -- common/autotest_common.sh@10 -- # set +x 00:28:34.902 09:07:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:34.902 09:07:21 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:34.902 09:07:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:34.902 09:07:21 -- common/autotest_common.sh@10 -- # set +x 00:28:34.902 09:07:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:34.902 09:07:21 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:34.902 09:07:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:34.902 09:07:21 -- common/autotest_common.sh@10 -- # set +x 00:28:34.902 [2024-07-15 09:07:21.530154] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:34.902 09:07:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:34.902 09:07:21 -- target/dif.sh@106 -- # fio /dev/fd/62 00:28:34.902 09:07:21 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:28:34.902 09:07:21 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:28:34.902 09:07:21 -- nvmf/common.sh@520 -- # config=() 00:28:34.902 09:07:21 -- nvmf/common.sh@520 -- # local subsystem config 00:28:34.902 09:07:21 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:34.902 09:07:21 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:34.902 09:07:21 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:34.902 { 00:28:34.902 "params": { 00:28:34.902 "name": "Nvme$subsystem", 00:28:34.902 "trtype": "$TEST_TRANSPORT", 00:28:34.902 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:34.902 "adrfam": "ipv4", 00:28:34.902 "trsvcid": "$NVMF_PORT", 00:28:34.902 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:34.902 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:34.902 "hdgst": ${hdgst:-false}, 00:28:34.902 "ddgst": ${ddgst:-false} 00:28:34.902 }, 00:28:34.902 "method": "bdev_nvme_attach_controller" 00:28:34.902 } 00:28:34.902 EOF 00:28:34.902 )") 00:28:34.902 09:07:21 -- target/dif.sh@82 -- # gen_fio_conf 00:28:34.902 09:07:21 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:34.902 09:07:21 -- target/dif.sh@54 -- # local file 00:28:34.902 09:07:21 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:28:34.902 09:07:21 -- target/dif.sh@56 -- # cat 00:28:34.902 09:07:21 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:34.902 09:07:21 -- common/autotest_common.sh@1318 -- # local sanitizers 00:28:34.902 09:07:21 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:34.902 09:07:21 -- common/autotest_common.sh@1320 -- # shift 00:28:34.902 09:07:21 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:28:34.902 09:07:21 -- nvmf/common.sh@542 -- # cat 00:28:34.902 09:07:21 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:34.902 09:07:21 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:34.902 09:07:21 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:34.902 09:07:21 -- target/dif.sh@72 -- # (( file <= files )) 00:28:34.902 09:07:21 -- common/autotest_common.sh@1324 -- # grep libasan 00:28:34.902 09:07:21 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:34.902 09:07:21 -- nvmf/common.sh@544 -- # jq . 00:28:34.902 09:07:21 -- nvmf/common.sh@545 -- # IFS=, 00:28:34.902 09:07:21 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:34.902 "params": { 00:28:34.902 "name": "Nvme0", 00:28:34.902 "trtype": "tcp", 00:28:34.902 "traddr": "10.0.0.2", 00:28:34.902 "adrfam": "ipv4", 00:28:34.902 "trsvcid": "4420", 00:28:34.902 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:34.902 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:34.902 "hdgst": false, 00:28:34.902 "ddgst": false 00:28:34.902 }, 00:28:34.902 "method": "bdev_nvme_attach_controller" 00:28:34.902 }' 00:28:34.902 09:07:21 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:34.902 09:07:21 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:34.902 09:07:21 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:34.902 09:07:21 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:34.902 09:07:21 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:28:34.902 09:07:21 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:34.902 09:07:21 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:34.902 09:07:21 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:34.902 09:07:21 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:34.902 09:07:21 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:34.902 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:28:34.902 ... 00:28:34.902 fio-3.35 00:28:34.902 Starting 3 threads 00:28:34.902 EAL: No free 2048 kB hugepages reported on node 1 00:28:34.902 [2024-07-15 09:07:22.222613] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:34.902 [2024-07-15 09:07:22.222702] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:39.090 00:28:39.091 filename0: (groupid=0, jobs=1): err= 0: pid=1634084: Mon Jul 15 09:07:27 2024 00:28:39.091 read: IOPS=224, BW=28.1MiB/s (29.4MB/s)(142MiB/5042msec) 00:28:39.091 slat (nsec): min=5081, max=81964, avg=16637.98, stdev=4996.69 00:28:39.091 clat (usec): min=4933, max=88099, avg=13304.76, stdev=11843.61 00:28:39.091 lat (usec): min=4946, max=88118, avg=13321.40, stdev=11843.91 00:28:39.091 clat percentiles (usec): 00:28:39.091 | 1.00th=[ 5211], 5.00th=[ 6194], 10.00th=[ 7177], 20.00th=[ 7767], 00:28:39.091 | 30.00th=[ 8291], 40.00th=[ 8848], 50.00th=[ 9765], 60.00th=[10814], 00:28:39.091 | 70.00th=[11731], 80.00th=[12649], 90.00th=[15401], 95.00th=[49546], 00:28:39.091 | 99.00th=[53740], 99.50th=[54789], 99.90th=[54789], 99.95th=[88605], 00:28:39.091 | 99.99th=[88605] 00:28:39.091 bw ( KiB/s): min=21248, max=38656, per=34.80%, avg=28908.70, stdev=5496.17, samples=10 00:28:39.091 iops : min= 166, max= 302, avg=225.80, stdev=42.91, samples=10 00:28:39.091 lat (msec) : 10=51.77%, 20=39.66%, 50=3.98%, 100=4.59% 00:28:39.091 cpu : usr=93.71%, sys=5.73%, ctx=14, majf=0, minf=119 00:28:39.091 IO depths : 1=1.0%, 2=99.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:39.091 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.091 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.091 issued rwts: total=1132,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:39.091 latency : target=0, window=0, percentile=100.00%, depth=3 00:28:39.091 filename0: (groupid=0, jobs=1): err= 0: pid=1634085: Mon Jul 15 09:07:27 2024 00:28:39.091 read: IOPS=198, BW=24.8MiB/s (26.0MB/s)(125MiB/5026msec) 00:28:39.091 slat (nsec): min=4314, max=50213, avg=15269.43, stdev=5038.92 00:28:39.091 clat (usec): min=4992, max=88718, avg=15082.21, stdev=13880.64 00:28:39.091 lat (usec): min=5004, max=88729, avg=15097.48, stdev=13880.41 00:28:39.091 clat percentiles (usec): 00:28:39.091 | 1.00th=[ 5473], 5.00th=[ 6456], 10.00th=[ 7570], 20.00th=[ 8356], 00:28:39.091 | 30.00th=[ 8848], 40.00th=[ 9634], 50.00th=[10552], 60.00th=[11207], 00:28:39.091 | 70.00th=[11863], 80.00th=[12911], 90.00th=[49546], 95.00th=[51643], 00:28:39.091 | 99.00th=[53740], 99.50th=[54264], 99.90th=[88605], 99.95th=[88605], 00:28:39.091 | 99.99th=[88605] 00:28:39.091 bw ( KiB/s): min=20736, max=34816, per=30.66%, avg=25472.00, stdev=4294.31, samples=10 00:28:39.091 iops : min= 162, max= 272, avg=199.00, stdev=33.55, samples=10 00:28:39.091 lat (msec) : 10=43.19%, 20=44.39%, 50=3.71%, 100=8.72% 00:28:39.091 cpu : usr=93.79%, sys=5.77%, ctx=12, majf=0, minf=76 00:28:39.091 IO depths : 1=2.8%, 2=97.2%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:39.091 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.091 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.091 issued rwts: total=998,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:39.091 latency : target=0, window=0, percentile=100.00%, depth=3 00:28:39.091 filename0: (groupid=0, jobs=1): err= 0: pid=1634086: Mon Jul 15 09:07:27 2024 00:28:39.091 read: IOPS=228, BW=28.5MiB/s (29.9MB/s)(143MiB/5004msec) 00:28:39.091 slat (nsec): min=5076, max=81532, avg=14509.18, stdev=4651.73 00:28:39.091 clat (usec): min=5716, max=59814, avg=13125.96, stdev=9406.30 00:28:39.091 lat (usec): min=5728, max=59824, avg=13140.47, stdev=9406.19 00:28:39.091 clat percentiles (usec): 00:28:39.091 | 1.00th=[ 6587], 5.00th=[ 7242], 10.00th=[ 8029], 20.00th=[ 8848], 00:28:39.091 | 30.00th=[ 9372], 40.00th=[10159], 50.00th=[10814], 60.00th=[11731], 00:28:39.091 | 70.00th=[12649], 80.00th=[13698], 90.00th=[15401], 95.00th=[47973], 00:28:39.091 | 99.00th=[53216], 99.50th=[54264], 99.90th=[60031], 99.95th=[60031], 00:28:39.091 | 99.99th=[60031] 00:28:39.091 bw ( KiB/s): min=23296, max=35072, per=35.10%, avg=29158.40, stdev=3964.92, samples=10 00:28:39.091 iops : min= 182, max= 274, avg=227.80, stdev=30.98, samples=10 00:28:39.091 lat (msec) : 10=38.27%, 20=56.48%, 50=1.58%, 100=3.68% 00:28:39.091 cpu : usr=93.96%, sys=5.58%, ctx=20, majf=0, minf=167 00:28:39.091 IO depths : 1=0.4%, 2=99.6%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:39.091 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.091 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:39.091 issued rwts: total=1142,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:39.091 latency : target=0, window=0, percentile=100.00%, depth=3 00:28:39.091 00:28:39.091 Run status group 0 (all jobs): 00:28:39.091 READ: bw=81.1MiB/s (85.1MB/s), 24.8MiB/s-28.5MiB/s (26.0MB/s-29.9MB/s), io=409MiB (429MB), run=5004-5042msec 00:28:39.349 09:07:27 -- target/dif.sh@107 -- # destroy_subsystems 0 00:28:39.349 09:07:27 -- target/dif.sh@43 -- # local sub 00:28:39.349 09:07:27 -- target/dif.sh@45 -- # for sub in "$@" 00:28:39.349 09:07:27 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:39.349 09:07:27 -- target/dif.sh@36 -- # local sub_id=0 00:28:39.349 09:07:27 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:39.349 09:07:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:39.349 09:07:27 -- common/autotest_common.sh@10 -- # set +x 00:28:39.349 09:07:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:39.349 09:07:27 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:39.349 09:07:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:39.349 09:07:27 -- common/autotest_common.sh@10 -- # set +x 00:28:39.349 09:07:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:39.349 09:07:27 -- target/dif.sh@109 -- # NULL_DIF=2 00:28:39.349 09:07:27 -- target/dif.sh@109 -- # bs=4k 00:28:39.349 09:07:27 -- target/dif.sh@109 -- # numjobs=8 00:28:39.349 09:07:27 -- target/dif.sh@109 -- # iodepth=16 00:28:39.349 09:07:27 -- target/dif.sh@109 -- # runtime= 00:28:39.349 09:07:27 -- target/dif.sh@109 -- # files=2 00:28:39.349 09:07:27 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:28:39.349 09:07:27 -- target/dif.sh@28 -- # local sub 00:28:39.349 09:07:27 -- target/dif.sh@30 -- # for sub in "$@" 00:28:39.349 09:07:27 -- target/dif.sh@31 -- # create_subsystem 0 00:28:39.350 09:07:27 -- target/dif.sh@18 -- # local sub_id=0 00:28:39.350 09:07:27 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:28:39.350 09:07:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:39.350 09:07:27 -- common/autotest_common.sh@10 -- # set +x 00:28:39.350 bdev_null0 00:28:39.350 09:07:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:39.350 09:07:27 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:39.350 09:07:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:39.350 09:07:27 -- common/autotest_common.sh@10 -- # set +x 00:28:39.350 09:07:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:39.350 09:07:27 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:39.350 09:07:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:39.350 09:07:27 -- common/autotest_common.sh@10 -- # set +x 00:28:39.350 09:07:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:39.350 09:07:27 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:39.350 09:07:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:39.350 09:07:27 -- common/autotest_common.sh@10 -- # set +x 00:28:39.350 [2024-07-15 09:07:27.706760] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:39.350 09:07:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:39.350 09:07:27 -- target/dif.sh@30 -- # for sub in "$@" 00:28:39.350 09:07:27 -- target/dif.sh@31 -- # create_subsystem 1 00:28:39.350 09:07:27 -- target/dif.sh@18 -- # local sub_id=1 00:28:39.350 09:07:27 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:28:39.350 09:07:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:39.350 09:07:27 -- common/autotest_common.sh@10 -- # set +x 00:28:39.350 bdev_null1 00:28:39.350 09:07:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:39.350 09:07:27 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:28:39.350 09:07:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:39.350 09:07:27 -- common/autotest_common.sh@10 -- # set +x 00:28:39.350 09:07:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:39.350 09:07:27 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:28:39.350 09:07:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:39.350 09:07:27 -- common/autotest_common.sh@10 -- # set +x 00:28:39.350 09:07:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:39.350 09:07:27 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:39.350 09:07:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:39.350 09:07:27 -- common/autotest_common.sh@10 -- # set +x 00:28:39.350 09:07:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:39.350 09:07:27 -- target/dif.sh@30 -- # for sub in "$@" 00:28:39.350 09:07:27 -- target/dif.sh@31 -- # create_subsystem 2 00:28:39.350 09:07:27 -- target/dif.sh@18 -- # local sub_id=2 00:28:39.350 09:07:27 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:28:39.350 09:07:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:39.350 09:07:27 -- common/autotest_common.sh@10 -- # set +x 00:28:39.350 bdev_null2 00:28:39.350 09:07:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:39.350 09:07:27 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:28:39.350 09:07:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:39.350 09:07:27 -- common/autotest_common.sh@10 -- # set +x 00:28:39.350 09:07:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:39.350 09:07:27 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:28:39.350 09:07:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:39.350 09:07:27 -- common/autotest_common.sh@10 -- # set +x 00:28:39.350 09:07:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:39.350 09:07:27 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:28:39.350 09:07:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:39.350 09:07:27 -- common/autotest_common.sh@10 -- # set +x 00:28:39.350 09:07:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:39.350 09:07:27 -- target/dif.sh@112 -- # fio /dev/fd/62 00:28:39.350 09:07:27 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:28:39.350 09:07:27 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:28:39.350 09:07:27 -- nvmf/common.sh@520 -- # config=() 00:28:39.350 09:07:27 -- nvmf/common.sh@520 -- # local subsystem config 00:28:39.350 09:07:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:39.350 09:07:27 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:39.350 09:07:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:39.350 { 00:28:39.350 "params": { 00:28:39.350 "name": "Nvme$subsystem", 00:28:39.350 "trtype": "$TEST_TRANSPORT", 00:28:39.350 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:39.350 "adrfam": "ipv4", 00:28:39.350 "trsvcid": "$NVMF_PORT", 00:28:39.350 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:39.350 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:39.350 "hdgst": ${hdgst:-false}, 00:28:39.350 "ddgst": ${ddgst:-false} 00:28:39.350 }, 00:28:39.350 "method": "bdev_nvme_attach_controller" 00:28:39.350 } 00:28:39.350 EOF 00:28:39.350 )") 00:28:39.350 09:07:27 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:39.350 09:07:27 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:28:39.350 09:07:27 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:39.350 09:07:27 -- target/dif.sh@82 -- # gen_fio_conf 00:28:39.350 09:07:27 -- common/autotest_common.sh@1318 -- # local sanitizers 00:28:39.350 09:07:27 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:39.350 09:07:27 -- target/dif.sh@54 -- # local file 00:28:39.350 09:07:27 -- common/autotest_common.sh@1320 -- # shift 00:28:39.350 09:07:27 -- target/dif.sh@56 -- # cat 00:28:39.350 09:07:27 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:28:39.350 09:07:27 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:39.350 09:07:27 -- nvmf/common.sh@542 -- # cat 00:28:39.350 09:07:27 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:39.350 09:07:27 -- common/autotest_common.sh@1324 -- # grep libasan 00:28:39.350 09:07:27 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:39.350 09:07:27 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:39.350 09:07:27 -- target/dif.sh@72 -- # (( file <= files )) 00:28:39.350 09:07:27 -- target/dif.sh@73 -- # cat 00:28:39.350 09:07:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:39.350 09:07:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:39.350 { 00:28:39.350 "params": { 00:28:39.350 "name": "Nvme$subsystem", 00:28:39.350 "trtype": "$TEST_TRANSPORT", 00:28:39.350 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:39.350 "adrfam": "ipv4", 00:28:39.350 "trsvcid": "$NVMF_PORT", 00:28:39.350 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:39.350 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:39.350 "hdgst": ${hdgst:-false}, 00:28:39.350 "ddgst": ${ddgst:-false} 00:28:39.350 }, 00:28:39.350 "method": "bdev_nvme_attach_controller" 00:28:39.350 } 00:28:39.350 EOF 00:28:39.350 )") 00:28:39.350 09:07:27 -- nvmf/common.sh@542 -- # cat 00:28:39.350 09:07:27 -- target/dif.sh@72 -- # (( file++ )) 00:28:39.350 09:07:27 -- target/dif.sh@72 -- # (( file <= files )) 00:28:39.350 09:07:27 -- target/dif.sh@73 -- # cat 00:28:39.350 09:07:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:39.350 09:07:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:39.350 { 00:28:39.350 "params": { 00:28:39.350 "name": "Nvme$subsystem", 00:28:39.350 "trtype": "$TEST_TRANSPORT", 00:28:39.350 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:39.350 "adrfam": "ipv4", 00:28:39.350 "trsvcid": "$NVMF_PORT", 00:28:39.350 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:39.350 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:39.350 "hdgst": ${hdgst:-false}, 00:28:39.350 "ddgst": ${ddgst:-false} 00:28:39.350 }, 00:28:39.350 "method": "bdev_nvme_attach_controller" 00:28:39.350 } 00:28:39.350 EOF 00:28:39.350 )") 00:28:39.350 09:07:27 -- target/dif.sh@72 -- # (( file++ )) 00:28:39.350 09:07:27 -- target/dif.sh@72 -- # (( file <= files )) 00:28:39.350 09:07:27 -- nvmf/common.sh@542 -- # cat 00:28:39.350 09:07:27 -- nvmf/common.sh@544 -- # jq . 00:28:39.350 09:07:27 -- nvmf/common.sh@545 -- # IFS=, 00:28:39.350 09:07:27 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:39.350 "params": { 00:28:39.350 "name": "Nvme0", 00:28:39.350 "trtype": "tcp", 00:28:39.350 "traddr": "10.0.0.2", 00:28:39.350 "adrfam": "ipv4", 00:28:39.350 "trsvcid": "4420", 00:28:39.350 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:39.350 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:39.350 "hdgst": false, 00:28:39.350 "ddgst": false 00:28:39.350 }, 00:28:39.350 "method": "bdev_nvme_attach_controller" 00:28:39.350 },{ 00:28:39.350 "params": { 00:28:39.350 "name": "Nvme1", 00:28:39.350 "trtype": "tcp", 00:28:39.350 "traddr": "10.0.0.2", 00:28:39.350 "adrfam": "ipv4", 00:28:39.350 "trsvcid": "4420", 00:28:39.350 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:28:39.350 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:28:39.350 "hdgst": false, 00:28:39.350 "ddgst": false 00:28:39.350 }, 00:28:39.350 "method": "bdev_nvme_attach_controller" 00:28:39.350 },{ 00:28:39.350 "params": { 00:28:39.350 "name": "Nvme2", 00:28:39.350 "trtype": "tcp", 00:28:39.350 "traddr": "10.0.0.2", 00:28:39.350 "adrfam": "ipv4", 00:28:39.350 "trsvcid": "4420", 00:28:39.350 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:28:39.350 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:28:39.350 "hdgst": false, 00:28:39.350 "ddgst": false 00:28:39.350 }, 00:28:39.350 "method": "bdev_nvme_attach_controller" 00:28:39.350 }' 00:28:39.350 09:07:27 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:39.350 09:07:27 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:39.350 09:07:27 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:39.350 09:07:27 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:39.350 09:07:27 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:28:39.350 09:07:27 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:39.350 09:07:27 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:39.350 09:07:27 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:39.350 09:07:27 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:39.351 09:07:27 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:39.608 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:28:39.608 ... 00:28:39.608 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:28:39.608 ... 00:28:39.608 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:28:39.608 ... 00:28:39.608 fio-3.35 00:28:39.608 Starting 24 threads 00:28:39.608 EAL: No free 2048 kB hugepages reported on node 1 00:28:40.544 [2024-07-15 09:07:28.886808] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:40.544 [2024-07-15 09:07:28.886912] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:52.806 00:28:52.806 filename0: (groupid=0, jobs=1): err= 0: pid=1634971: Mon Jul 15 09:07:39 2024 00:28:52.806 read: IOPS=507, BW=2029KiB/s (2078kB/s)(19.8MiB/10010msec) 00:28:52.806 slat (usec): min=7, max=334, avg=41.97, stdev=22.73 00:28:52.806 clat (usec): min=9064, max=53704, avg=31169.90, stdev=1550.01 00:28:52.806 lat (usec): min=9078, max=53736, avg=31211.87, stdev=1553.25 00:28:52.806 clat percentiles (usec): 00:28:52.806 | 1.00th=[29754], 5.00th=[30540], 10.00th=[30540], 20.00th=[30802], 00:28:52.806 | 30.00th=[30802], 40.00th=[30802], 50.00th=[31065], 60.00th=[31065], 00:28:52.806 | 70.00th=[31327], 80.00th=[31589], 90.00th=[32113], 95.00th=[32375], 00:28:52.806 | 99.00th=[34341], 99.50th=[38536], 99.90th=[46924], 99.95th=[46924], 00:28:52.806 | 99.99th=[53740] 00:28:52.806 bw ( KiB/s): min= 1920, max= 2096, per=4.15%, avg=2023.58, stdev=56.28, samples=19 00:28:52.806 iops : min= 480, max= 524, avg=505.89, stdev=14.07, samples=19 00:28:52.806 lat (msec) : 10=0.08%, 20=0.20%, 50=99.68%, 100=0.04% 00:28:52.806 cpu : usr=91.93%, sys=3.92%, ctx=104, majf=0, minf=9 00:28:52.806 IO depths : 1=4.9%, 2=11.0%, 4=24.3%, 8=52.1%, 16=7.7%, 32=0.0%, >=64=0.0% 00:28:52.806 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.806 complete : 0=0.0%, 4=94.0%, 8=0.3%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.806 issued rwts: total=5078,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:52.806 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:52.806 filename0: (groupid=0, jobs=1): err= 0: pid=1634972: Mon Jul 15 09:07:39 2024 00:28:52.806 read: IOPS=526, BW=2106KiB/s (2156kB/s)(20.6MiB/10011msec) 00:28:52.806 slat (usec): min=10, max=202, avg=43.51, stdev=22.10 00:28:52.806 clat (usec): min=11362, max=50002, avg=30007.97, stdev=3561.37 00:28:52.806 lat (usec): min=11396, max=50045, avg=30051.48, stdev=3557.54 00:28:52.806 clat percentiles (usec): 00:28:52.806 | 1.00th=[19006], 5.00th=[20317], 10.00th=[25297], 20.00th=[30540], 00:28:52.806 | 30.00th=[30540], 40.00th=[30802], 50.00th=[30802], 60.00th=[30802], 00:28:52.806 | 70.00th=[31065], 80.00th=[31327], 90.00th=[31851], 95.00th=[32375], 00:28:52.806 | 99.00th=[36439], 99.50th=[39060], 99.90th=[50070], 99.95th=[50070], 00:28:52.806 | 99.99th=[50070] 00:28:52.806 bw ( KiB/s): min= 1920, max= 2480, per=4.30%, avg=2097.68, stdev=155.39, samples=19 00:28:52.806 iops : min= 480, max= 620, avg=524.42, stdev=38.85, samples=19 00:28:52.806 lat (msec) : 20=3.76%, 50=96.22%, 100=0.02% 00:28:52.806 cpu : usr=98.54%, sys=0.97%, ctx=17, majf=0, minf=9 00:28:52.806 IO depths : 1=5.1%, 2=10.2%, 4=21.3%, 8=55.5%, 16=7.8%, 32=0.0%, >=64=0.0% 00:28:52.806 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.806 complete : 0=0.0%, 4=93.2%, 8=1.4%, 16=5.4%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.806 issued rwts: total=5270,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:52.806 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:52.806 filename0: (groupid=0, jobs=1): err= 0: pid=1634973: Mon Jul 15 09:07:39 2024 00:28:52.806 read: IOPS=506, BW=2025KiB/s (2074kB/s)(19.8MiB/10019msec) 00:28:52.806 slat (usec): min=6, max=170, avg=45.48, stdev=23.28 00:28:52.806 clat (usec): min=23031, max=56026, avg=31162.04, stdev=1590.81 00:28:52.806 lat (usec): min=23085, max=56069, avg=31207.52, stdev=1591.08 00:28:52.806 clat percentiles (usec): 00:28:52.806 | 1.00th=[30016], 5.00th=[30278], 10.00th=[30540], 20.00th=[30540], 00:28:52.806 | 30.00th=[30802], 40.00th=[30802], 50.00th=[30802], 60.00th=[31065], 00:28:52.806 | 70.00th=[31327], 80.00th=[31589], 90.00th=[32113], 95.00th=[32375], 00:28:52.806 | 99.00th=[33162], 99.50th=[33817], 99.90th=[55837], 99.95th=[55837], 00:28:52.806 | 99.99th=[55837] 00:28:52.806 bw ( KiB/s): min= 1792, max= 2048, per=4.15%, avg=2022.40, stdev=66.96, samples=20 00:28:52.806 iops : min= 448, max= 512, avg=505.60, stdev=16.74, samples=20 00:28:52.806 lat (msec) : 50=99.68%, 100=0.32% 00:28:52.806 cpu : usr=90.56%, sys=4.33%, ctx=272, majf=0, minf=9 00:28:52.806 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:28:52.806 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.806 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.806 issued rwts: total=5072,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:52.806 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:52.806 filename0: (groupid=0, jobs=1): err= 0: pid=1634974: Mon Jul 15 09:07:39 2024 00:28:52.806 read: IOPS=506, BW=2027KiB/s (2075kB/s)(19.8MiB/10010msec) 00:28:52.806 slat (usec): min=8, max=158, avg=66.07, stdev=26.09 00:28:52.806 clat (usec): min=6571, max=55066, avg=30973.04, stdev=1427.61 00:28:52.806 lat (usec): min=6670, max=55097, avg=31039.11, stdev=1425.43 00:28:52.806 clat percentiles (usec): 00:28:52.806 | 1.00th=[29492], 5.00th=[29754], 10.00th=[30016], 20.00th=[30278], 00:28:52.806 | 30.00th=[30540], 40.00th=[30802], 50.00th=[30802], 60.00th=[31065], 00:28:52.806 | 70.00th=[31327], 80.00th=[31589], 90.00th=[31851], 95.00th=[32375], 00:28:52.806 | 99.00th=[33817], 99.50th=[34341], 99.90th=[46924], 99.95th=[46924], 00:28:52.806 | 99.99th=[55313] 00:28:52.806 bw ( KiB/s): min= 1920, max= 2048, per=4.14%, avg=2021.05, stdev=53.61, samples=19 00:28:52.806 iops : min= 480, max= 512, avg=505.26, stdev=13.40, samples=19 00:28:52.806 lat (msec) : 10=0.04%, 50=99.92%, 100=0.04% 00:28:52.806 cpu : usr=98.24%, sys=1.26%, ctx=15, majf=0, minf=9 00:28:52.806 IO depths : 1=5.8%, 2=12.0%, 4=24.9%, 8=50.6%, 16=6.7%, 32=0.0%, >=64=0.0% 00:28:52.806 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.806 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.806 issued rwts: total=5072,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:52.806 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:52.806 filename0: (groupid=0, jobs=1): err= 0: pid=1634975: Mon Jul 15 09:07:39 2024 00:28:52.806 read: IOPS=506, BW=2025KiB/s (2074kB/s)(19.8MiB/10001msec) 00:28:52.806 slat (usec): min=7, max=118, avg=36.11, stdev=26.27 00:28:52.806 clat (usec): min=8074, max=57001, avg=31383.95, stdev=3345.98 00:28:52.806 lat (usec): min=8103, max=57023, avg=31420.06, stdev=3346.79 00:28:52.806 clat percentiles (usec): 00:28:52.806 | 1.00th=[19530], 5.00th=[30016], 10.00th=[30540], 20.00th=[30802], 00:28:52.806 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31065], 60.00th=[31327], 00:28:52.806 | 70.00th=[31589], 80.00th=[31851], 90.00th=[32375], 95.00th=[32900], 00:28:52.806 | 99.00th=[48497], 99.50th=[54789], 99.90th=[56886], 99.95th=[56886], 00:28:52.807 | 99.99th=[56886] 00:28:52.807 bw ( KiB/s): min= 1840, max= 2080, per=4.14%, avg=2017.68, stdev=54.36, samples=19 00:28:52.807 iops : min= 460, max= 520, avg=504.42, stdev=13.59, samples=19 00:28:52.807 lat (msec) : 10=0.24%, 20=0.85%, 50=98.08%, 100=0.83% 00:28:52.807 cpu : usr=94.31%, sys=3.05%, ctx=337, majf=0, minf=9 00:28:52.807 IO depths : 1=2.4%, 2=6.5%, 4=16.6%, 8=62.6%, 16=11.9%, 32=0.0%, >=64=0.0% 00:28:52.807 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.807 complete : 0=0.0%, 4=92.4%, 8=3.6%, 16=3.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.807 issued rwts: total=5064,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:52.807 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:52.807 filename0: (groupid=0, jobs=1): err= 0: pid=1634976: Mon Jul 15 09:07:39 2024 00:28:52.807 read: IOPS=506, BW=2026KiB/s (2074kB/s)(19.8MiB/10016msec) 00:28:52.807 slat (usec): min=7, max=118, avg=35.38, stdev=13.08 00:28:52.807 clat (usec): min=23321, max=70768, avg=31291.98, stdev=1662.11 00:28:52.807 lat (usec): min=23375, max=70782, avg=31327.36, stdev=1659.21 00:28:52.807 clat percentiles (usec): 00:28:52.807 | 1.00th=[30016], 5.00th=[30278], 10.00th=[30540], 20.00th=[30802], 00:28:52.807 | 30.00th=[30802], 40.00th=[31065], 50.00th=[31065], 60.00th=[31065], 00:28:52.807 | 70.00th=[31327], 80.00th=[31851], 90.00th=[32113], 95.00th=[32637], 00:28:52.807 | 99.00th=[33424], 99.50th=[33424], 99.90th=[53740], 99.95th=[70779], 00:28:52.807 | 99.99th=[70779] 00:28:52.807 bw ( KiB/s): min= 1792, max= 2048, per=4.14%, avg=2021.05, stdev=68.52, samples=19 00:28:52.807 iops : min= 448, max= 512, avg=505.26, stdev=17.13, samples=19 00:28:52.807 lat (msec) : 50=99.68%, 100=0.32% 00:28:52.807 cpu : usr=95.68%, sys=2.33%, ctx=109, majf=0, minf=9 00:28:52.807 IO depths : 1=6.2%, 2=12.3%, 4=24.8%, 8=50.4%, 16=6.3%, 32=0.0%, >=64=0.0% 00:28:52.807 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.807 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.807 issued rwts: total=5072,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:52.807 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:52.807 filename0: (groupid=0, jobs=1): err= 0: pid=1634977: Mon Jul 15 09:07:39 2024 00:28:52.807 read: IOPS=508, BW=2033KiB/s (2082kB/s)(19.9MiB/10004msec) 00:28:52.807 slat (usec): min=8, max=123, avg=48.43, stdev=18.85 00:28:52.807 clat (usec): min=11402, max=51303, avg=31048.62, stdev=2097.56 00:28:52.807 lat (usec): min=11436, max=51345, avg=31097.05, stdev=2099.39 00:28:52.807 clat percentiles (usec): 00:28:52.807 | 1.00th=[23725], 5.00th=[30278], 10.00th=[30540], 20.00th=[30540], 00:28:52.807 | 30.00th=[30802], 40.00th=[30802], 50.00th=[31065], 60.00th=[31065], 00:28:52.807 | 70.00th=[31327], 80.00th=[31589], 90.00th=[31851], 95.00th=[32375], 00:28:52.807 | 99.00th=[34866], 99.50th=[45876], 99.90th=[51119], 99.95th=[51119], 00:28:52.807 | 99.99th=[51119] 00:28:52.807 bw ( KiB/s): min= 1920, max= 2176, per=4.15%, avg=2025.26, stdev=67.11, samples=19 00:28:52.807 iops : min= 480, max= 544, avg=506.32, stdev=16.78, samples=19 00:28:52.807 lat (msec) : 20=0.39%, 50=99.37%, 100=0.24% 00:28:52.807 cpu : usr=97.42%, sys=1.54%, ctx=227, majf=0, minf=9 00:28:52.807 IO depths : 1=5.6%, 2=11.8%, 4=24.7%, 8=51.0%, 16=6.9%, 32=0.0%, >=64=0.0% 00:28:52.807 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.807 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.807 issued rwts: total=5084,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:52.807 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:52.807 filename0: (groupid=0, jobs=1): err= 0: pid=1634978: Mon Jul 15 09:07:39 2024 00:28:52.807 read: IOPS=510, BW=2041KiB/s (2090kB/s)(19.9MiB/10003msec) 00:28:52.807 slat (usec): min=10, max=171, avg=49.60, stdev=24.42 00:28:52.807 clat (usec): min=11310, max=51227, avg=30905.46, stdev=2282.27 00:28:52.807 lat (usec): min=11332, max=51302, avg=30955.06, stdev=2284.79 00:28:52.807 clat percentiles (usec): 00:28:52.807 | 1.00th=[22414], 5.00th=[30016], 10.00th=[30278], 20.00th=[30540], 00:28:52.807 | 30.00th=[30540], 40.00th=[30802], 50.00th=[30802], 60.00th=[31065], 00:28:52.807 | 70.00th=[31065], 80.00th=[31589], 90.00th=[31851], 95.00th=[32375], 00:28:52.807 | 99.00th=[39060], 99.50th=[44827], 99.90th=[50594], 99.95th=[51119], 00:28:52.807 | 99.99th=[51119] 00:28:52.807 bw ( KiB/s): min= 1920, max= 2176, per=4.17%, avg=2034.53, stdev=57.26, samples=19 00:28:52.807 iops : min= 480, max= 544, avg=508.63, stdev=14.31, samples=19 00:28:52.807 lat (msec) : 20=0.35%, 50=99.49%, 100=0.16% 00:28:52.807 cpu : usr=97.69%, sys=1.43%, ctx=105, majf=0, minf=9 00:28:52.807 IO depths : 1=5.2%, 2=10.8%, 4=22.9%, 8=53.5%, 16=7.6%, 32=0.0%, >=64=0.0% 00:28:52.807 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.807 complete : 0=0.0%, 4=93.6%, 8=0.9%, 16=5.5%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.807 issued rwts: total=5104,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:52.807 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:52.807 filename1: (groupid=0, jobs=1): err= 0: pid=1634979: Mon Jul 15 09:07:39 2024 00:28:52.807 read: IOPS=508, BW=2034KiB/s (2083kB/s)(19.9MiB/10003msec) 00:28:52.807 slat (usec): min=7, max=197, avg=69.51, stdev=27.59 00:28:52.807 clat (usec): min=10121, max=55879, avg=30946.54, stdev=1949.21 00:28:52.807 lat (usec): min=10198, max=55900, avg=31016.06, stdev=1948.38 00:28:52.807 clat percentiles (usec): 00:28:52.807 | 1.00th=[23462], 5.00th=[30016], 10.00th=[30016], 20.00th=[30540], 00:28:52.807 | 30.00th=[30540], 40.00th=[30802], 50.00th=[30802], 60.00th=[31065], 00:28:52.807 | 70.00th=[31327], 80.00th=[31589], 90.00th=[32113], 95.00th=[32375], 00:28:52.807 | 99.00th=[33817], 99.50th=[39584], 99.90th=[46400], 99.95th=[49021], 00:28:52.807 | 99.99th=[55837] 00:28:52.807 bw ( KiB/s): min= 1904, max= 2144, per=4.15%, avg=2026.11, stdev=57.49, samples=19 00:28:52.807 iops : min= 476, max= 536, avg=506.53, stdev=14.37, samples=19 00:28:52.807 lat (msec) : 20=0.43%, 50=99.53%, 100=0.04% 00:28:52.807 cpu : usr=93.21%, sys=3.34%, ctx=262, majf=0, minf=9 00:28:52.807 IO depths : 1=0.5%, 2=6.7%, 4=25.0%, 8=55.8%, 16=12.0%, 32=0.0%, >=64=0.0% 00:28:52.807 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.807 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.807 issued rwts: total=5086,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:52.807 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:52.807 filename1: (groupid=0, jobs=1): err= 0: pid=1634980: Mon Jul 15 09:07:39 2024 00:28:52.807 read: IOPS=507, BW=2031KiB/s (2080kB/s)(19.9MiB/10019msec) 00:28:52.807 slat (usec): min=6, max=131, avg=45.18, stdev=23.28 00:28:52.807 clat (usec): min=4959, max=56383, avg=31129.20, stdev=2365.41 00:28:52.807 lat (usec): min=4967, max=56427, avg=31174.38, stdev=2366.95 00:28:52.807 clat percentiles (usec): 00:28:52.807 | 1.00th=[27395], 5.00th=[30278], 10.00th=[30540], 20.00th=[30802], 00:28:52.807 | 30.00th=[30802], 40.00th=[30802], 50.00th=[31065], 60.00th=[31065], 00:28:52.807 | 70.00th=[31327], 80.00th=[31589], 90.00th=[32113], 95.00th=[32637], 00:28:52.807 | 99.00th=[34341], 99.50th=[46400], 99.90th=[56361], 99.95th=[56361], 00:28:52.807 | 99.99th=[56361] 00:28:52.807 bw ( KiB/s): min= 1792, max= 2160, per=4.16%, avg=2028.80, stdev=73.89, samples=20 00:28:52.807 iops : min= 448, max= 540, avg=507.20, stdev=18.47, samples=20 00:28:52.807 lat (msec) : 10=0.14%, 20=0.37%, 50=99.17%, 100=0.31% 00:28:52.807 cpu : usr=93.38%, sys=3.11%, ctx=277, majf=0, minf=9 00:28:52.807 IO depths : 1=3.9%, 2=10.0%, 4=24.6%, 8=52.8%, 16=8.7%, 32=0.0%, >=64=0.0% 00:28:52.807 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.807 complete : 0=0.0%, 4=94.2%, 8=0.1%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.807 issued rwts: total=5088,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:52.807 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:52.807 filename1: (groupid=0, jobs=1): err= 0: pid=1634981: Mon Jul 15 09:07:39 2024 00:28:52.807 read: IOPS=506, BW=2027KiB/s (2075kB/s)(19.8MiB/10010msec) 00:28:52.807 slat (usec): min=8, max=119, avg=48.39, stdev=17.95 00:28:52.807 clat (usec): min=23607, max=54602, avg=31150.87, stdev=1478.70 00:28:52.807 lat (usec): min=23640, max=54620, avg=31199.27, stdev=1480.98 00:28:52.807 clat percentiles (usec): 00:28:52.807 | 1.00th=[30016], 5.00th=[30540], 10.00th=[30540], 20.00th=[30802], 00:28:52.807 | 30.00th=[30802], 40.00th=[30802], 50.00th=[31065], 60.00th=[31065], 00:28:52.807 | 70.00th=[31327], 80.00th=[31589], 90.00th=[31851], 95.00th=[32375], 00:28:52.807 | 99.00th=[33162], 99.50th=[33424], 99.90th=[54264], 99.95th=[54789], 00:28:52.807 | 99.99th=[54789] 00:28:52.807 bw ( KiB/s): min= 1792, max= 2048, per=4.14%, avg=2021.05, stdev=68.52, samples=19 00:28:52.807 iops : min= 448, max= 512, avg=505.26, stdev=17.13, samples=19 00:28:52.807 lat (msec) : 50=99.68%, 100=0.32% 00:28:52.807 cpu : usr=97.31%, sys=1.65%, ctx=267, majf=0, minf=9 00:28:52.807 IO depths : 1=6.1%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.4%, 32=0.0%, >=64=0.0% 00:28:52.807 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.807 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.807 issued rwts: total=5072,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:52.807 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:52.807 filename1: (groupid=0, jobs=1): err= 0: pid=1634982: Mon Jul 15 09:07:39 2024 00:28:52.807 read: IOPS=506, BW=2026KiB/s (2075kB/s)(19.8MiB/10009msec) 00:28:52.807 slat (usec): min=7, max=238, avg=29.85, stdev=14.05 00:28:52.807 clat (usec): min=16559, max=60221, avg=31359.30, stdev=2000.51 00:28:52.807 lat (usec): min=16575, max=60235, avg=31389.14, stdev=2000.45 00:28:52.807 clat percentiles (usec): 00:28:52.807 | 1.00th=[26084], 5.00th=[30278], 10.00th=[30540], 20.00th=[30802], 00:28:52.807 | 30.00th=[30802], 40.00th=[31065], 50.00th=[31065], 60.00th=[31327], 00:28:52.807 | 70.00th=[31589], 80.00th=[31851], 90.00th=[32375], 95.00th=[33162], 00:28:52.807 | 99.00th=[37487], 99.50th=[45876], 99.90th=[46924], 99.95th=[49021], 00:28:52.807 | 99.99th=[60031] 00:28:52.807 bw ( KiB/s): min= 1888, max= 2048, per=4.14%, avg=2020.21, stdev=55.90, samples=19 00:28:52.807 iops : min= 472, max= 512, avg=505.05, stdev=13.97, samples=19 00:28:52.807 lat (msec) : 20=0.28%, 50=99.68%, 100=0.04% 00:28:52.807 cpu : usr=97.48%, sys=1.67%, ctx=24, majf=0, minf=9 00:28:52.807 IO depths : 1=2.1%, 2=8.1%, 4=24.1%, 8=55.2%, 16=10.5%, 32=0.0%, >=64=0.0% 00:28:52.807 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.807 complete : 0=0.0%, 4=94.1%, 8=0.3%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.807 issued rwts: total=5070,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:52.807 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:52.807 filename1: (groupid=0, jobs=1): err= 0: pid=1634983: Mon Jul 15 09:07:39 2024 00:28:52.807 read: IOPS=508, BW=2032KiB/s (2081kB/s)(19.9MiB/10007msec) 00:28:52.807 slat (usec): min=7, max=242, avg=49.55, stdev=22.08 00:28:52.807 clat (usec): min=9808, max=52924, avg=31100.94, stdev=2184.62 00:28:52.807 lat (usec): min=9836, max=52932, avg=31150.49, stdev=2186.94 00:28:52.807 clat percentiles (usec): 00:28:52.807 | 1.00th=[23725], 5.00th=[30278], 10.00th=[30540], 20.00th=[30802], 00:28:52.807 | 30.00th=[30802], 40.00th=[30802], 50.00th=[31065], 60.00th=[31065], 00:28:52.807 | 70.00th=[31327], 80.00th=[31589], 90.00th=[32113], 95.00th=[32375], 00:28:52.807 | 99.00th=[35390], 99.50th=[44827], 99.90th=[50070], 99.95th=[51643], 00:28:52.807 | 99.99th=[52691] 00:28:52.807 bw ( KiB/s): min= 1795, max= 2160, per=4.15%, avg=2026.26, stdev=74.95, samples=19 00:28:52.807 iops : min= 448, max= 540, avg=506.53, stdev=18.87, samples=19 00:28:52.807 lat (msec) : 10=0.14%, 20=0.43%, 50=99.21%, 100=0.22% 00:28:52.807 cpu : usr=91.56%, sys=4.18%, ctx=166, majf=0, minf=9 00:28:52.807 IO depths : 1=1.8%, 2=8.0%, 4=24.9%, 8=54.5%, 16=10.7%, 32=0.0%, >=64=0.0% 00:28:52.807 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.807 complete : 0=0.0%, 4=94.3%, 8=0.1%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.807 issued rwts: total=5084,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:52.807 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:52.807 filename1: (groupid=0, jobs=1): err= 0: pid=1634984: Mon Jul 15 09:07:39 2024 00:28:52.807 read: IOPS=506, BW=2028KiB/s (2076kB/s)(19.8MiB/10005msec) 00:28:52.807 slat (usec): min=7, max=120, avg=51.60, stdev=20.27 00:28:52.807 clat (usec): min=23689, max=49217, avg=31101.69, stdev=1247.46 00:28:52.807 lat (usec): min=23716, max=49231, avg=31153.28, stdev=1247.64 00:28:52.807 clat percentiles (usec): 00:28:52.807 | 1.00th=[29754], 5.00th=[30278], 10.00th=[30540], 20.00th=[30540], 00:28:52.807 | 30.00th=[30802], 40.00th=[30802], 50.00th=[31065], 60.00th=[31065], 00:28:52.807 | 70.00th=[31327], 80.00th=[31589], 90.00th=[31851], 95.00th=[32375], 00:28:52.807 | 99.00th=[32900], 99.50th=[33424], 99.90th=[49021], 99.95th=[49021], 00:28:52.807 | 99.99th=[49021] 00:28:52.807 bw ( KiB/s): min= 1920, max= 2048, per=4.14%, avg=2021.05, stdev=53.61, samples=19 00:28:52.807 iops : min= 480, max= 512, avg=505.26, stdev=13.40, samples=19 00:28:52.807 lat (msec) : 50=100.00% 00:28:52.807 cpu : usr=98.34%, sys=1.19%, ctx=48, majf=0, minf=9 00:28:52.807 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:28:52.807 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.807 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.808 issued rwts: total=5072,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:52.808 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:52.808 filename1: (groupid=0, jobs=1): err= 0: pid=1634985: Mon Jul 15 09:07:39 2024 00:28:52.808 read: IOPS=506, BW=2026KiB/s (2074kB/s)(19.8MiB/10016msec) 00:28:52.808 slat (usec): min=7, max=129, avg=37.40, stdev=13.73 00:28:52.808 clat (usec): min=29306, max=54214, avg=31272.13, stdev=1456.08 00:28:52.808 lat (usec): min=29319, max=54228, avg=31309.53, stdev=1452.82 00:28:52.808 clat percentiles (usec): 00:28:52.808 | 1.00th=[30278], 5.00th=[30278], 10.00th=[30540], 20.00th=[30540], 00:28:52.808 | 30.00th=[30802], 40.00th=[30802], 50.00th=[31065], 60.00th=[31065], 00:28:52.808 | 70.00th=[31327], 80.00th=[31589], 90.00th=[32113], 95.00th=[32637], 00:28:52.808 | 99.00th=[33424], 99.50th=[33817], 99.90th=[54264], 99.95th=[54264], 00:28:52.808 | 99.99th=[54264] 00:28:52.808 bw ( KiB/s): min= 1792, max= 2048, per=4.14%, avg=2021.05, stdev=68.52, samples=19 00:28:52.808 iops : min= 448, max= 512, avg=505.26, stdev=17.13, samples=19 00:28:52.808 lat (msec) : 50=99.68%, 100=0.32% 00:28:52.808 cpu : usr=94.04%, sys=3.13%, ctx=301, majf=0, minf=9 00:28:52.808 IO depths : 1=6.1%, 2=12.3%, 4=24.8%, 8=50.4%, 16=6.4%, 32=0.0%, >=64=0.0% 00:28:52.808 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.808 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.808 issued rwts: total=5072,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:52.808 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:52.808 filename1: (groupid=0, jobs=1): err= 0: pid=1634986: Mon Jul 15 09:07:39 2024 00:28:52.808 read: IOPS=506, BW=2027KiB/s (2076kB/s)(19.8MiB/10009msec) 00:28:52.808 slat (nsec): min=7534, max=73121, avg=24518.22, stdev=11913.37 00:28:52.808 clat (usec): min=22945, max=46638, avg=31384.17, stdev=1437.57 00:28:52.808 lat (usec): min=22982, max=46655, avg=31408.69, stdev=1436.08 00:28:52.808 clat percentiles (usec): 00:28:52.808 | 1.00th=[27132], 5.00th=[30540], 10.00th=[30802], 20.00th=[30802], 00:28:52.808 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31065], 60.00th=[31327], 00:28:52.808 | 70.00th=[31589], 80.00th=[31851], 90.00th=[32375], 95.00th=[32637], 00:28:52.808 | 99.00th=[36963], 99.50th=[38536], 99.90th=[46400], 99.95th=[46400], 00:28:52.808 | 99.99th=[46400] 00:28:52.808 bw ( KiB/s): min= 1920, max= 2048, per=4.14%, avg=2021.05, stdev=53.61, samples=19 00:28:52.808 iops : min= 480, max= 512, avg=505.26, stdev=13.40, samples=19 00:28:52.808 lat (msec) : 50=100.00% 00:28:52.808 cpu : usr=98.26%, sys=1.35%, ctx=15, majf=0, minf=9 00:28:52.808 IO depths : 1=3.6%, 2=9.8%, 4=24.9%, 8=52.7%, 16=8.9%, 32=0.0%, >=64=0.0% 00:28:52.808 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.808 complete : 0=0.0%, 4=94.2%, 8=0.1%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.808 issued rwts: total=5072,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:52.808 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:52.808 filename2: (groupid=0, jobs=1): err= 0: pid=1634987: Mon Jul 15 09:07:39 2024 00:28:52.808 read: IOPS=506, BW=2027KiB/s (2076kB/s)(19.8MiB/10009msec) 00:28:52.808 slat (usec): min=7, max=309, avg=46.29, stdev=18.97 00:28:52.808 clat (usec): min=22877, max=46946, avg=31175.39, stdev=1179.05 00:28:52.808 lat (usec): min=22951, max=46964, avg=31221.68, stdev=1181.48 00:28:52.808 clat percentiles (usec): 00:28:52.808 | 1.00th=[30016], 5.00th=[30540], 10.00th=[30540], 20.00th=[30802], 00:28:52.808 | 30.00th=[30802], 40.00th=[30802], 50.00th=[31065], 60.00th=[31065], 00:28:52.808 | 70.00th=[31327], 80.00th=[31589], 90.00th=[31851], 95.00th=[32375], 00:28:52.808 | 99.00th=[33817], 99.50th=[34866], 99.90th=[46924], 99.95th=[46924], 00:28:52.808 | 99.99th=[46924] 00:28:52.808 bw ( KiB/s): min= 1920, max= 2048, per=4.14%, avg=2021.05, stdev=53.61, samples=19 00:28:52.808 iops : min= 480, max= 512, avg=505.26, stdev=13.40, samples=19 00:28:52.808 lat (msec) : 50=100.00% 00:28:52.808 cpu : usr=94.55%, sys=2.89%, ctx=145, majf=0, minf=9 00:28:52.808 IO depths : 1=6.0%, 2=12.2%, 4=24.9%, 8=50.4%, 16=6.5%, 32=0.0%, >=64=0.0% 00:28:52.808 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.808 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.808 issued rwts: total=5072,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:52.808 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:52.808 filename2: (groupid=0, jobs=1): err= 0: pid=1634988: Mon Jul 15 09:07:39 2024 00:28:52.808 read: IOPS=506, BW=2025KiB/s (2074kB/s)(19.8MiB/10019msec) 00:28:52.808 slat (usec): min=4, max=163, avg=52.56, stdev=23.78 00:28:52.808 clat (usec): min=22845, max=63914, avg=31101.05, stdev=1798.12 00:28:52.808 lat (usec): min=22903, max=63958, avg=31153.62, stdev=1800.05 00:28:52.808 clat percentiles (usec): 00:28:52.808 | 1.00th=[30016], 5.00th=[30278], 10.00th=[30540], 20.00th=[30540], 00:28:52.808 | 30.00th=[30540], 40.00th=[30802], 50.00th=[30802], 60.00th=[31065], 00:28:52.808 | 70.00th=[31065], 80.00th=[31589], 90.00th=[31851], 95.00th=[32375], 00:28:52.808 | 99.00th=[33162], 99.50th=[33424], 99.90th=[63701], 99.95th=[63701], 00:28:52.808 | 99.99th=[63701] 00:28:52.808 bw ( KiB/s): min= 1792, max= 2048, per=4.15%, avg=2022.40, stdev=66.96, samples=20 00:28:52.808 iops : min= 448, max= 512, avg=505.60, stdev=16.74, samples=20 00:28:52.808 lat (msec) : 50=99.68%, 100=0.32% 00:28:52.808 cpu : usr=93.78%, sys=2.99%, ctx=163, majf=0, minf=9 00:28:52.808 IO depths : 1=6.2%, 2=12.4%, 4=24.9%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:28:52.808 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.808 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.808 issued rwts: total=5072,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:52.808 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:52.808 filename2: (groupid=0, jobs=1): err= 0: pid=1634989: Mon Jul 15 09:07:39 2024 00:28:52.808 read: IOPS=507, BW=2029KiB/s (2078kB/s)(19.8MiB/10010msec) 00:28:52.808 slat (nsec): min=7495, max=68301, avg=29120.18, stdev=10847.14 00:28:52.808 clat (usec): min=7450, max=53687, avg=31286.86, stdev=1605.30 00:28:52.808 lat (usec): min=7460, max=53720, avg=31315.98, stdev=1604.29 00:28:52.808 clat percentiles (usec): 00:28:52.808 | 1.00th=[27657], 5.00th=[30540], 10.00th=[30540], 20.00th=[30802], 00:28:52.808 | 30.00th=[30802], 40.00th=[31065], 50.00th=[31065], 60.00th=[31327], 00:28:52.808 | 70.00th=[31589], 80.00th=[31851], 90.00th=[32375], 95.00th=[32637], 00:28:52.808 | 99.00th=[34866], 99.50th=[38536], 99.90th=[46400], 99.95th=[53216], 00:28:52.808 | 99.99th=[53740] 00:28:52.808 bw ( KiB/s): min= 1920, max= 2096, per=4.15%, avg=2023.58, stdev=56.03, samples=19 00:28:52.808 iops : min= 480, max= 524, avg=505.89, stdev=14.01, samples=19 00:28:52.808 lat (msec) : 10=0.12%, 50=99.80%, 100=0.08% 00:28:52.808 cpu : usr=98.16%, sys=1.47%, ctx=20, majf=0, minf=9 00:28:52.808 IO depths : 1=5.6%, 2=11.7%, 4=24.7%, 8=51.1%, 16=6.9%, 32=0.0%, >=64=0.0% 00:28:52.808 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.808 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.808 issued rwts: total=5078,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:52.808 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:52.808 filename2: (groupid=0, jobs=1): err= 0: pid=1634990: Mon Jul 15 09:07:39 2024 00:28:52.808 read: IOPS=506, BW=2026KiB/s (2074kB/s)(19.8MiB/10015msec) 00:28:52.808 slat (usec): min=3, max=118, avg=47.73, stdev=20.91 00:28:52.808 clat (usec): min=28647, max=53323, avg=31194.78, stdev=1399.68 00:28:52.808 lat (usec): min=28656, max=53335, avg=31242.51, stdev=1399.00 00:28:52.808 clat percentiles (usec): 00:28:52.808 | 1.00th=[29754], 5.00th=[30278], 10.00th=[30540], 20.00th=[30802], 00:28:52.808 | 30.00th=[30802], 40.00th=[30802], 50.00th=[31065], 60.00th=[31065], 00:28:52.808 | 70.00th=[31327], 80.00th=[31589], 90.00th=[32113], 95.00th=[32375], 00:28:52.808 | 99.00th=[33424], 99.50th=[33817], 99.90th=[53216], 99.95th=[53216], 00:28:52.808 | 99.99th=[53216] 00:28:52.808 bw ( KiB/s): min= 1795, max= 2048, per=4.14%, avg=2021.21, stdev=67.96, samples=19 00:28:52.808 iops : min= 448, max= 512, avg=505.26, stdev=17.13, samples=19 00:28:52.808 lat (msec) : 50=99.68%, 100=0.32% 00:28:52.808 cpu : usr=96.40%, sys=2.07%, ctx=106, majf=0, minf=9 00:28:52.808 IO depths : 1=6.1%, 2=12.2%, 4=24.6%, 8=50.7%, 16=6.4%, 32=0.0%, >=64=0.0% 00:28:52.808 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.808 complete : 0=0.0%, 4=94.0%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.808 issued rwts: total=5072,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:52.808 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:52.808 filename2: (groupid=0, jobs=1): err= 0: pid=1634991: Mon Jul 15 09:07:39 2024 00:28:52.808 read: IOPS=508, BW=2034KiB/s (2083kB/s)(19.9MiB/10006msec) 00:28:52.808 slat (usec): min=6, max=125, avg=38.40, stdev=26.02 00:28:52.808 clat (usec): min=6247, max=63692, avg=31144.90, stdev=2304.89 00:28:52.808 lat (usec): min=6270, max=63735, avg=31183.30, stdev=2307.14 00:28:52.808 clat percentiles (usec): 00:28:52.808 | 1.00th=[28443], 5.00th=[30540], 10.00th=[30540], 20.00th=[30802], 00:28:52.808 | 30.00th=[30802], 40.00th=[31065], 50.00th=[31065], 60.00th=[31065], 00:28:52.808 | 70.00th=[31327], 80.00th=[31589], 90.00th=[31851], 95.00th=[32375], 00:28:52.808 | 99.00th=[33162], 99.50th=[41157], 99.90th=[56361], 99.95th=[63701], 00:28:52.808 | 99.99th=[63701] 00:28:52.808 bw ( KiB/s): min= 1792, max= 2120, per=4.16%, avg=2027.79, stdev=74.11, samples=19 00:28:52.808 iops : min= 448, max= 530, avg=506.95, stdev=18.53, samples=19 00:28:52.808 lat (msec) : 10=0.31%, 50=99.37%, 100=0.31% 00:28:52.808 cpu : usr=96.05%, sys=2.20%, ctx=93, majf=0, minf=9 00:28:52.808 IO depths : 1=5.9%, 2=11.9%, 4=24.4%, 8=51.1%, 16=6.6%, 32=0.0%, >=64=0.0% 00:28:52.808 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.808 complete : 0=0.0%, 4=94.0%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.808 issued rwts: total=5088,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:52.808 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:52.808 filename2: (groupid=0, jobs=1): err= 0: pid=1634992: Mon Jul 15 09:07:39 2024 00:28:52.808 read: IOPS=509, BW=2038KiB/s (2086kB/s)(19.9MiB/10004msec) 00:28:52.808 slat (usec): min=6, max=299, avg=43.86, stdev=19.16 00:28:52.808 clat (usec): min=11305, max=68641, avg=31086.66, stdev=3498.44 00:28:52.808 lat (usec): min=11328, max=68654, avg=31130.52, stdev=3500.45 00:28:52.808 clat percentiles (usec): 00:28:52.808 | 1.00th=[18744], 5.00th=[27657], 10.00th=[30540], 20.00th=[30540], 00:28:52.808 | 30.00th=[30802], 40.00th=[30802], 50.00th=[31065], 60.00th=[31065], 00:28:52.808 | 70.00th=[31327], 80.00th=[31589], 90.00th=[32113], 95.00th=[33162], 00:28:52.808 | 99.00th=[45876], 99.50th=[49546], 99.90th=[61604], 99.95th=[68682], 00:28:52.808 | 99.99th=[68682] 00:28:52.808 bw ( KiB/s): min= 1792, max= 2160, per=4.17%, avg=2031.16, stdev=74.38, samples=19 00:28:52.808 iops : min= 448, max= 540, avg=507.79, stdev=18.59, samples=19 00:28:52.808 lat (msec) : 20=1.39%, 50=98.14%, 100=0.47% 00:28:52.808 cpu : usr=94.79%, sys=2.63%, ctx=57, majf=0, minf=9 00:28:52.808 IO depths : 1=2.5%, 2=7.7%, 4=21.3%, 8=57.9%, 16=10.6%, 32=0.0%, >=64=0.0% 00:28:52.808 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.808 complete : 0=0.0%, 4=93.4%, 8=1.5%, 16=5.1%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.808 issued rwts: total=5096,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:52.808 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:52.808 filename2: (groupid=0, jobs=1): err= 0: pid=1634993: Mon Jul 15 09:07:39 2024 00:28:52.808 read: IOPS=514, BW=2060KiB/s (2109kB/s)(20.1MiB/10008msec) 00:28:52.808 slat (usec): min=7, max=599, avg=24.59, stdev=16.54 00:28:52.808 clat (usec): min=10232, max=50499, avg=30895.28, stdev=3166.30 00:28:52.808 lat (usec): min=10240, max=50541, avg=30919.87, stdev=3167.92 00:28:52.808 clat percentiles (usec): 00:28:52.808 | 1.00th=[18744], 5.00th=[24773], 10.00th=[30540], 20.00th=[30802], 00:28:52.808 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31065], 60.00th=[31065], 00:28:52.808 | 70.00th=[31327], 80.00th=[31589], 90.00th=[32113], 95.00th=[32375], 00:28:52.808 | 99.00th=[42206], 99.50th=[47449], 99.90th=[50594], 99.95th=[50594], 00:28:52.808 | 99.99th=[50594] 00:28:52.808 bw ( KiB/s): min= 1792, max= 2304, per=4.21%, avg=2055.58, stdev=110.64, samples=19 00:28:52.808 iops : min= 448, max= 576, avg=513.89, stdev=27.66, samples=19 00:28:52.808 lat (msec) : 20=2.10%, 50=97.59%, 100=0.31% 00:28:52.808 cpu : usr=95.61%, sys=2.20%, ctx=124, majf=0, minf=9 00:28:52.808 IO depths : 1=1.8%, 2=5.2%, 4=14.1%, 8=65.8%, 16=13.2%, 32=0.0%, >=64=0.0% 00:28:52.808 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.808 complete : 0=0.0%, 4=92.0%, 8=4.6%, 16=3.4%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.808 issued rwts: total=5154,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:52.808 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:52.808 filename2: (groupid=0, jobs=1): err= 0: pid=1634994: Mon Jul 15 09:07:39 2024 00:28:52.808 read: IOPS=506, BW=2028KiB/s (2076kB/s)(19.8MiB/10006msec) 00:28:52.808 slat (usec): min=5, max=120, avg=47.75, stdev=21.24 00:28:52.808 clat (usec): min=21809, max=51682, avg=31176.94, stdev=1497.57 00:28:52.808 lat (usec): min=21842, max=51697, avg=31224.69, stdev=1499.06 00:28:52.808 clat percentiles (usec): 00:28:52.808 | 1.00th=[30016], 5.00th=[30540], 10.00th=[30540], 20.00th=[30802], 00:28:52.808 | 30.00th=[30802], 40.00th=[30802], 50.00th=[31065], 60.00th=[31065], 00:28:52.808 | 70.00th=[31327], 80.00th=[31589], 90.00th=[31851], 95.00th=[32375], 00:28:52.808 | 99.00th=[33424], 99.50th=[39584], 99.90th=[51643], 99.95th=[51643], 00:28:52.808 | 99.99th=[51643] 00:28:52.808 bw ( KiB/s): min= 1792, max= 2048, per=4.14%, avg=2021.05, stdev=68.52, samples=19 00:28:52.808 iops : min= 448, max= 512, avg=505.26, stdev=17.13, samples=19 00:28:52.808 lat (msec) : 50=99.68%, 100=0.32% 00:28:52.808 cpu : usr=91.79%, sys=4.16%, ctx=749, majf=0, minf=9 00:28:52.808 IO depths : 1=3.0%, 2=9.2%, 4=25.0%, 8=53.3%, 16=9.5%, 32=0.0%, >=64=0.0% 00:28:52.808 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.808 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:52.808 issued rwts: total=5072,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:52.808 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:52.808 00:28:52.808 Run status group 0 (all jobs): 00:28:52.809 READ: bw=47.6MiB/s (49.9MB/s), 2025KiB/s-2106KiB/s (2074kB/s-2156kB/s), io=477MiB (500MB), run=10001-10019msec 00:28:52.809 09:07:39 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:28:52.809 09:07:39 -- target/dif.sh@43 -- # local sub 00:28:52.809 09:07:39 -- target/dif.sh@45 -- # for sub in "$@" 00:28:52.809 09:07:39 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:52.809 09:07:39 -- target/dif.sh@36 -- # local sub_id=0 00:28:52.809 09:07:39 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:52.809 09:07:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:52.809 09:07:39 -- common/autotest_common.sh@10 -- # set +x 00:28:52.809 09:07:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:52.809 09:07:39 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:52.809 09:07:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:52.809 09:07:39 -- common/autotest_common.sh@10 -- # set +x 00:28:52.809 09:07:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:52.809 09:07:39 -- target/dif.sh@45 -- # for sub in "$@" 00:28:52.809 09:07:39 -- target/dif.sh@46 -- # destroy_subsystem 1 00:28:52.809 09:07:39 -- target/dif.sh@36 -- # local sub_id=1 00:28:52.809 09:07:39 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:52.809 09:07:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:52.809 09:07:39 -- common/autotest_common.sh@10 -- # set +x 00:28:52.809 09:07:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:52.809 09:07:39 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:28:52.809 09:07:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:52.809 09:07:39 -- common/autotest_common.sh@10 -- # set +x 00:28:52.809 09:07:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:52.809 09:07:39 -- target/dif.sh@45 -- # for sub in "$@" 00:28:52.809 09:07:39 -- target/dif.sh@46 -- # destroy_subsystem 2 00:28:52.809 09:07:39 -- target/dif.sh@36 -- # local sub_id=2 00:28:52.809 09:07:39 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:28:52.809 09:07:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:52.809 09:07:39 -- common/autotest_common.sh@10 -- # set +x 00:28:52.809 09:07:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:52.809 09:07:39 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:28:52.809 09:07:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:52.809 09:07:39 -- common/autotest_common.sh@10 -- # set +x 00:28:52.809 09:07:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:52.809 09:07:39 -- target/dif.sh@115 -- # NULL_DIF=1 00:28:52.809 09:07:39 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:28:52.809 09:07:39 -- target/dif.sh@115 -- # numjobs=2 00:28:52.809 09:07:39 -- target/dif.sh@115 -- # iodepth=8 00:28:52.809 09:07:39 -- target/dif.sh@115 -- # runtime=5 00:28:52.809 09:07:39 -- target/dif.sh@115 -- # files=1 00:28:52.809 09:07:39 -- target/dif.sh@117 -- # create_subsystems 0 1 00:28:52.809 09:07:39 -- target/dif.sh@28 -- # local sub 00:28:52.809 09:07:39 -- target/dif.sh@30 -- # for sub in "$@" 00:28:52.809 09:07:39 -- target/dif.sh@31 -- # create_subsystem 0 00:28:52.809 09:07:39 -- target/dif.sh@18 -- # local sub_id=0 00:28:52.809 09:07:39 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:52.809 09:07:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:52.809 09:07:39 -- common/autotest_common.sh@10 -- # set +x 00:28:52.809 bdev_null0 00:28:52.809 09:07:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:52.809 09:07:39 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:52.809 09:07:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:52.809 09:07:39 -- common/autotest_common.sh@10 -- # set +x 00:28:52.809 09:07:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:52.809 09:07:39 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:52.809 09:07:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:52.809 09:07:39 -- common/autotest_common.sh@10 -- # set +x 00:28:52.809 09:07:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:52.809 09:07:39 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:52.809 09:07:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:52.809 09:07:39 -- common/autotest_common.sh@10 -- # set +x 00:28:52.809 [2024-07-15 09:07:39.440409] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:52.809 09:07:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:52.809 09:07:39 -- target/dif.sh@30 -- # for sub in "$@" 00:28:52.809 09:07:39 -- target/dif.sh@31 -- # create_subsystem 1 00:28:52.809 09:07:39 -- target/dif.sh@18 -- # local sub_id=1 00:28:52.809 09:07:39 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:28:52.809 09:07:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:52.809 09:07:39 -- common/autotest_common.sh@10 -- # set +x 00:28:52.809 bdev_null1 00:28:52.809 09:07:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:52.809 09:07:39 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:28:52.809 09:07:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:52.809 09:07:39 -- common/autotest_common.sh@10 -- # set +x 00:28:52.809 09:07:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:52.809 09:07:39 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:28:52.809 09:07:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:52.809 09:07:39 -- common/autotest_common.sh@10 -- # set +x 00:28:52.809 09:07:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:52.809 09:07:39 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:52.809 09:07:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:52.809 09:07:39 -- common/autotest_common.sh@10 -- # set +x 00:28:52.809 09:07:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:52.809 09:07:39 -- target/dif.sh@118 -- # fio /dev/fd/62 00:28:52.809 09:07:39 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:28:52.809 09:07:39 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:28:52.809 09:07:39 -- nvmf/common.sh@520 -- # config=() 00:28:52.809 09:07:39 -- nvmf/common.sh@520 -- # local subsystem config 00:28:52.809 09:07:39 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:52.809 09:07:39 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:52.809 09:07:39 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:52.809 { 00:28:52.809 "params": { 00:28:52.809 "name": "Nvme$subsystem", 00:28:52.809 "trtype": "$TEST_TRANSPORT", 00:28:52.809 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:52.809 "adrfam": "ipv4", 00:28:52.809 "trsvcid": "$NVMF_PORT", 00:28:52.809 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:52.809 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:52.809 "hdgst": ${hdgst:-false}, 00:28:52.809 "ddgst": ${ddgst:-false} 00:28:52.809 }, 00:28:52.809 "method": "bdev_nvme_attach_controller" 00:28:52.809 } 00:28:52.809 EOF 00:28:52.809 )") 00:28:52.809 09:07:39 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:52.809 09:07:39 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:28:52.809 09:07:39 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:52.809 09:07:39 -- common/autotest_common.sh@1318 -- # local sanitizers 00:28:52.809 09:07:39 -- target/dif.sh@82 -- # gen_fio_conf 00:28:52.809 09:07:39 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:52.809 09:07:39 -- common/autotest_common.sh@1320 -- # shift 00:28:52.809 09:07:39 -- target/dif.sh@54 -- # local file 00:28:52.809 09:07:39 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:28:52.809 09:07:39 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:52.809 09:07:39 -- target/dif.sh@56 -- # cat 00:28:52.809 09:07:39 -- nvmf/common.sh@542 -- # cat 00:28:52.809 09:07:39 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:52.809 09:07:39 -- common/autotest_common.sh@1324 -- # grep libasan 00:28:52.809 09:07:39 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:52.809 09:07:39 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:52.809 09:07:39 -- target/dif.sh@72 -- # (( file <= files )) 00:28:52.809 09:07:39 -- target/dif.sh@73 -- # cat 00:28:52.809 09:07:39 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:52.809 09:07:39 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:52.809 { 00:28:52.809 "params": { 00:28:52.809 "name": "Nvme$subsystem", 00:28:52.809 "trtype": "$TEST_TRANSPORT", 00:28:52.809 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:52.809 "adrfam": "ipv4", 00:28:52.809 "trsvcid": "$NVMF_PORT", 00:28:52.809 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:52.809 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:52.809 "hdgst": ${hdgst:-false}, 00:28:52.809 "ddgst": ${ddgst:-false} 00:28:52.809 }, 00:28:52.809 "method": "bdev_nvme_attach_controller" 00:28:52.809 } 00:28:52.809 EOF 00:28:52.809 )") 00:28:52.809 09:07:39 -- nvmf/common.sh@542 -- # cat 00:28:52.809 09:07:39 -- target/dif.sh@72 -- # (( file++ )) 00:28:52.809 09:07:39 -- target/dif.sh@72 -- # (( file <= files )) 00:28:52.809 09:07:39 -- nvmf/common.sh@544 -- # jq . 00:28:52.809 09:07:39 -- nvmf/common.sh@545 -- # IFS=, 00:28:52.809 09:07:39 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:52.809 "params": { 00:28:52.809 "name": "Nvme0", 00:28:52.809 "trtype": "tcp", 00:28:52.809 "traddr": "10.0.0.2", 00:28:52.809 "adrfam": "ipv4", 00:28:52.809 "trsvcid": "4420", 00:28:52.809 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:52.809 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:52.809 "hdgst": false, 00:28:52.809 "ddgst": false 00:28:52.809 }, 00:28:52.809 "method": "bdev_nvme_attach_controller" 00:28:52.809 },{ 00:28:52.809 "params": { 00:28:52.809 "name": "Nvme1", 00:28:52.809 "trtype": "tcp", 00:28:52.809 "traddr": "10.0.0.2", 00:28:52.809 "adrfam": "ipv4", 00:28:52.809 "trsvcid": "4420", 00:28:52.809 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:28:52.809 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:28:52.809 "hdgst": false, 00:28:52.809 "ddgst": false 00:28:52.809 }, 00:28:52.809 "method": "bdev_nvme_attach_controller" 00:28:52.809 }' 00:28:52.809 09:07:39 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:52.809 09:07:39 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:52.809 09:07:39 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:52.809 09:07:39 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:52.809 09:07:39 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:28:52.809 09:07:39 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:52.809 09:07:39 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:52.809 09:07:39 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:52.809 09:07:39 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:52.809 09:07:39 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:52.809 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:28:52.809 ... 00:28:52.809 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:28:52.809 ... 00:28:52.809 fio-3.35 00:28:52.809 Starting 4 threads 00:28:52.809 EAL: No free 2048 kB hugepages reported on node 1 00:28:52.809 [2024-07-15 09:07:40.286297] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:52.809 [2024-07-15 09:07:40.286350] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:56.992 00:28:56.992 filename0: (groupid=0, jobs=1): err= 0: pid=1636543: Mon Jul 15 09:07:45 2024 00:28:56.992 read: IOPS=1992, BW=15.6MiB/s (16.3MB/s)(77.9MiB/5002msec) 00:28:56.992 slat (nsec): min=3498, max=59469, avg=18602.01, stdev=6622.24 00:28:56.992 clat (usec): min=664, max=8415, avg=3954.01, stdev=275.45 00:28:56.992 lat (usec): min=681, max=8445, avg=3972.61, stdev=275.66 00:28:56.992 clat percentiles (usec): 00:28:56.992 | 1.00th=[ 3425], 5.00th=[ 3654], 10.00th=[ 3720], 20.00th=[ 3818], 00:28:56.992 | 30.00th=[ 3884], 40.00th=[ 3916], 50.00th=[ 3949], 60.00th=[ 3982], 00:28:56.992 | 70.00th=[ 4015], 80.00th=[ 4080], 90.00th=[ 4146], 95.00th=[ 4228], 00:28:56.992 | 99.00th=[ 4490], 99.50th=[ 5080], 99.90th=[ 6718], 99.95th=[ 8291], 00:28:56.992 | 99.99th=[ 8455] 00:28:56.992 bw ( KiB/s): min=15519, max=16640, per=25.34%, avg=15937.50, stdev=393.88, samples=10 00:28:56.992 iops : min= 1939, max= 2080, avg=1992.10, stdev=49.34, samples=10 00:28:56.992 lat (usec) : 750=0.02%, 1000=0.03% 00:28:56.992 lat (msec) : 2=0.10%, 4=62.97%, 10=36.88% 00:28:56.992 cpu : usr=94.78%, sys=4.76%, ctx=16, majf=0, minf=9 00:28:56.992 IO depths : 1=0.1%, 2=9.4%, 4=64.9%, 8=25.7%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:56.992 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:56.992 complete : 0=0.0%, 4=90.6%, 8=9.4%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:56.992 issued rwts: total=9967,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:56.992 latency : target=0, window=0, percentile=100.00%, depth=8 00:28:56.992 filename0: (groupid=0, jobs=1): err= 0: pid=1636544: Mon Jul 15 09:07:45 2024 00:28:56.992 read: IOPS=1996, BW=15.6MiB/s (16.4MB/s)(78.0MiB/5001msec) 00:28:56.992 slat (nsec): min=3733, max=59974, avg=19212.68, stdev=8254.86 00:28:56.992 clat (usec): min=855, max=8195, avg=3941.89, stdev=250.06 00:28:56.992 lat (usec): min=868, max=8210, avg=3961.11, stdev=250.32 00:28:56.992 clat percentiles (usec): 00:28:56.992 | 1.00th=[ 3294], 5.00th=[ 3621], 10.00th=[ 3720], 20.00th=[ 3818], 00:28:56.992 | 30.00th=[ 3884], 40.00th=[ 3916], 50.00th=[ 3949], 60.00th=[ 3982], 00:28:56.992 | 70.00th=[ 4015], 80.00th=[ 4080], 90.00th=[ 4113], 95.00th=[ 4178], 00:28:56.992 | 99.00th=[ 4424], 99.50th=[ 4817], 99.90th=[ 6783], 99.95th=[ 7767], 00:28:56.992 | 99.99th=[ 8225] 00:28:56.992 bw ( KiB/s): min=15504, max=16576, per=25.43%, avg=15992.89, stdev=429.41, samples=9 00:28:56.992 iops : min= 1938, max= 2072, avg=1999.11, stdev=53.68, samples=9 00:28:56.992 lat (usec) : 1000=0.01% 00:28:56.992 lat (msec) : 2=0.05%, 4=64.78%, 10=35.16% 00:28:56.992 cpu : usr=93.12%, sys=5.18%, ctx=250, majf=0, minf=9 00:28:56.992 IO depths : 1=0.1%, 2=11.2%, 4=63.3%, 8=25.4%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:56.992 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:56.992 complete : 0=0.0%, 4=90.4%, 8=9.6%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:56.992 issued rwts: total=9982,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:56.992 latency : target=0, window=0, percentile=100.00%, depth=8 00:28:56.992 filename1: (groupid=0, jobs=1): err= 0: pid=1636545: Mon Jul 15 09:07:45 2024 00:28:56.992 read: IOPS=1994, BW=15.6MiB/s (16.3MB/s)(77.9MiB/5002msec) 00:28:56.992 slat (nsec): min=4051, max=58542, avg=17918.96, stdev=8183.84 00:28:56.992 clat (usec): min=650, max=9464, avg=3952.99, stdev=277.44 00:28:56.992 lat (usec): min=664, max=9480, avg=3970.91, stdev=278.13 00:28:56.992 clat percentiles (usec): 00:28:56.992 | 1.00th=[ 3359], 5.00th=[ 3654], 10.00th=[ 3752], 20.00th=[ 3851], 00:28:56.992 | 30.00th=[ 3884], 40.00th=[ 3916], 50.00th=[ 3949], 60.00th=[ 3982], 00:28:56.992 | 70.00th=[ 4015], 80.00th=[ 4080], 90.00th=[ 4146], 95.00th=[ 4228], 00:28:56.992 | 99.00th=[ 4490], 99.50th=[ 4883], 99.90th=[ 6980], 99.95th=[ 9241], 00:28:56.992 | 99.99th=[ 9503] 00:28:56.992 bw ( KiB/s): min=15488, max=16576, per=25.36%, avg=15950.40, stdev=358.68, samples=10 00:28:56.992 iops : min= 1936, max= 2072, avg=1993.80, stdev=44.84, samples=10 00:28:56.992 lat (usec) : 750=0.01%, 1000=0.01% 00:28:56.992 lat (msec) : 2=0.07%, 4=63.28%, 10=36.63% 00:28:56.992 cpu : usr=95.10%, sys=4.34%, ctx=14, majf=0, minf=9 00:28:56.992 IO depths : 1=0.1%, 2=9.4%, 4=61.5%, 8=29.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:56.992 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:56.992 complete : 0=0.0%, 4=93.5%, 8=6.5%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:56.992 issued rwts: total=9977,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:56.992 latency : target=0, window=0, percentile=100.00%, depth=8 00:28:56.992 filename1: (groupid=0, jobs=1): err= 0: pid=1636546: Mon Jul 15 09:07:45 2024 00:28:56.992 read: IOPS=1926, BW=15.1MiB/s (15.8MB/s)(75.9MiB/5042msec) 00:28:56.992 slat (usec): min=4, max=100, avg=17.57, stdev= 8.66 00:28:56.992 clat (usec): min=687, max=45540, avg=4075.61, stdev=970.65 00:28:56.992 lat (usec): min=701, max=45554, avg=4093.19, stdev=970.06 00:28:56.992 clat percentiles (usec): 00:28:56.992 | 1.00th=[ 2835], 5.00th=[ 3687], 10.00th=[ 3752], 20.00th=[ 3818], 00:28:56.992 | 30.00th=[ 3884], 40.00th=[ 3916], 50.00th=[ 3982], 60.00th=[ 4015], 00:28:56.992 | 70.00th=[ 4080], 80.00th=[ 4113], 90.00th=[ 4228], 95.00th=[ 5669], 00:28:56.992 | 99.00th=[ 6063], 99.50th=[ 6456], 99.90th=[ 7373], 99.95th=[10683], 00:28:56.992 | 99.99th=[45351] 00:28:56.992 bw ( KiB/s): min=15056, max=15872, per=24.70%, avg=15537.60, stdev=285.76, samples=10 00:28:56.992 iops : min= 1882, max= 1984, avg=1942.20, stdev=35.72, samples=10 00:28:56.992 lat (usec) : 750=0.05%, 1000=0.15% 00:28:56.992 lat (msec) : 2=0.66%, 4=55.85%, 10=43.19%, 20=0.05%, 50=0.04% 00:28:56.992 cpu : usr=95.10%, sys=4.21%, ctx=21, majf=0, minf=9 00:28:56.992 IO depths : 1=0.1%, 2=9.6%, 4=63.0%, 8=27.3%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:56.992 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:56.992 complete : 0=0.0%, 4=92.2%, 8=7.8%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:56.992 issued rwts: total=9715,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:56.992 latency : target=0, window=0, percentile=100.00%, depth=8 00:28:56.992 00:28:56.992 Run status group 0 (all jobs): 00:28:56.992 READ: bw=61.4MiB/s (64.4MB/s), 15.1MiB/s-15.6MiB/s (15.8MB/s-16.4MB/s), io=310MiB (325MB), run=5001-5042msec 00:28:57.253 09:07:45 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:28:57.253 09:07:45 -- target/dif.sh@43 -- # local sub 00:28:57.253 09:07:45 -- target/dif.sh@45 -- # for sub in "$@" 00:28:57.253 09:07:45 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:57.253 09:07:45 -- target/dif.sh@36 -- # local sub_id=0 00:28:57.253 09:07:45 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:57.253 09:07:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:57.253 09:07:45 -- common/autotest_common.sh@10 -- # set +x 00:28:57.253 09:07:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:57.253 09:07:45 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:57.253 09:07:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:57.253 09:07:45 -- common/autotest_common.sh@10 -- # set +x 00:28:57.253 09:07:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:57.253 09:07:45 -- target/dif.sh@45 -- # for sub in "$@" 00:28:57.253 09:07:45 -- target/dif.sh@46 -- # destroy_subsystem 1 00:28:57.253 09:07:45 -- target/dif.sh@36 -- # local sub_id=1 00:28:57.253 09:07:45 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:57.253 09:07:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:57.253 09:07:45 -- common/autotest_common.sh@10 -- # set +x 00:28:57.253 09:07:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:57.253 09:07:45 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:28:57.253 09:07:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:57.253 09:07:45 -- common/autotest_common.sh@10 -- # set +x 00:28:57.253 09:07:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:57.253 00:28:57.253 real 0m24.198s 00:28:57.253 user 4m26.632s 00:28:57.253 sys 0m8.622s 00:28:57.253 09:07:45 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:28:57.253 09:07:45 -- common/autotest_common.sh@10 -- # set +x 00:28:57.253 ************************************ 00:28:57.253 END TEST fio_dif_rand_params 00:28:57.253 ************************************ 00:28:57.253 09:07:45 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:28:57.253 09:07:45 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:28:57.253 09:07:45 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:28:57.253 09:07:45 -- common/autotest_common.sh@10 -- # set +x 00:28:57.253 ************************************ 00:28:57.253 START TEST fio_dif_digest 00:28:57.253 ************************************ 00:28:57.253 09:07:45 -- common/autotest_common.sh@1104 -- # fio_dif_digest 00:28:57.253 09:07:45 -- target/dif.sh@123 -- # local NULL_DIF 00:28:57.253 09:07:45 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:28:57.253 09:07:45 -- target/dif.sh@125 -- # local hdgst ddgst 00:28:57.253 09:07:45 -- target/dif.sh@127 -- # NULL_DIF=3 00:28:57.253 09:07:45 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:28:57.253 09:07:45 -- target/dif.sh@127 -- # numjobs=3 00:28:57.253 09:07:45 -- target/dif.sh@127 -- # iodepth=3 00:28:57.253 09:07:45 -- target/dif.sh@127 -- # runtime=10 00:28:57.253 09:07:45 -- target/dif.sh@128 -- # hdgst=true 00:28:57.253 09:07:45 -- target/dif.sh@128 -- # ddgst=true 00:28:57.253 09:07:45 -- target/dif.sh@130 -- # create_subsystems 0 00:28:57.253 09:07:45 -- target/dif.sh@28 -- # local sub 00:28:57.253 09:07:45 -- target/dif.sh@30 -- # for sub in "$@" 00:28:57.253 09:07:45 -- target/dif.sh@31 -- # create_subsystem 0 00:28:57.253 09:07:45 -- target/dif.sh@18 -- # local sub_id=0 00:28:57.253 09:07:45 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:28:57.253 09:07:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:57.253 09:07:45 -- common/autotest_common.sh@10 -- # set +x 00:28:57.253 bdev_null0 00:28:57.253 09:07:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:57.253 09:07:45 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:57.253 09:07:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:57.253 09:07:45 -- common/autotest_common.sh@10 -- # set +x 00:28:57.253 09:07:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:57.253 09:07:45 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:57.253 09:07:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:57.253 09:07:45 -- common/autotest_common.sh@10 -- # set +x 00:28:57.253 09:07:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:57.253 09:07:45 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:57.253 09:07:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:57.253 09:07:45 -- common/autotest_common.sh@10 -- # set +x 00:28:57.253 [2024-07-15 09:07:45.751491] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:57.253 09:07:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:57.253 09:07:45 -- target/dif.sh@131 -- # fio /dev/fd/62 00:28:57.253 09:07:45 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:28:57.253 09:07:45 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:28:57.253 09:07:45 -- nvmf/common.sh@520 -- # config=() 00:28:57.253 09:07:45 -- nvmf/common.sh@520 -- # local subsystem config 00:28:57.253 09:07:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:57.253 09:07:45 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:57.253 09:07:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:57.253 { 00:28:57.253 "params": { 00:28:57.253 "name": "Nvme$subsystem", 00:28:57.253 "trtype": "$TEST_TRANSPORT", 00:28:57.253 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:57.253 "adrfam": "ipv4", 00:28:57.253 "trsvcid": "$NVMF_PORT", 00:28:57.253 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:57.253 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:57.253 "hdgst": ${hdgst:-false}, 00:28:57.253 "ddgst": ${ddgst:-false} 00:28:57.253 }, 00:28:57.253 "method": "bdev_nvme_attach_controller" 00:28:57.253 } 00:28:57.253 EOF 00:28:57.253 )") 00:28:57.253 09:07:45 -- target/dif.sh@82 -- # gen_fio_conf 00:28:57.253 09:07:45 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:57.253 09:07:45 -- target/dif.sh@54 -- # local file 00:28:57.253 09:07:45 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:28:57.253 09:07:45 -- target/dif.sh@56 -- # cat 00:28:57.253 09:07:45 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:57.253 09:07:45 -- common/autotest_common.sh@1318 -- # local sanitizers 00:28:57.253 09:07:45 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:57.253 09:07:45 -- common/autotest_common.sh@1320 -- # shift 00:28:57.253 09:07:45 -- nvmf/common.sh@542 -- # cat 00:28:57.253 09:07:45 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:28:57.253 09:07:45 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:57.253 09:07:45 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:57.253 09:07:45 -- target/dif.sh@72 -- # (( file <= files )) 00:28:57.253 09:07:45 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:57.253 09:07:45 -- common/autotest_common.sh@1324 -- # grep libasan 00:28:57.253 09:07:45 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:57.253 09:07:45 -- nvmf/common.sh@544 -- # jq . 00:28:57.253 09:07:45 -- nvmf/common.sh@545 -- # IFS=, 00:28:57.253 09:07:45 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:57.253 "params": { 00:28:57.253 "name": "Nvme0", 00:28:57.253 "trtype": "tcp", 00:28:57.253 "traddr": "10.0.0.2", 00:28:57.253 "adrfam": "ipv4", 00:28:57.253 "trsvcid": "4420", 00:28:57.253 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:57.253 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:57.253 "hdgst": true, 00:28:57.253 "ddgst": true 00:28:57.253 }, 00:28:57.253 "method": "bdev_nvme_attach_controller" 00:28:57.253 }' 00:28:57.253 09:07:45 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:57.253 09:07:45 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:57.253 09:07:45 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:57.253 09:07:45 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:57.253 09:07:45 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:28:57.253 09:07:45 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:57.253 09:07:45 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:57.253 09:07:45 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:57.512 09:07:45 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:57.512 09:07:45 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:57.512 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:28:57.512 ... 00:28:57.512 fio-3.35 00:28:57.512 Starting 3 threads 00:28:57.512 EAL: No free 2048 kB hugepages reported on node 1 00:28:58.078 [2024-07-15 09:07:46.500275] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:58.078 [2024-07-15 09:07:46.500345] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:10.271 00:29:10.271 filename0: (groupid=0, jobs=1): err= 0: pid=1637321: Mon Jul 15 09:07:56 2024 00:29:10.271 read: IOPS=204, BW=25.5MiB/s (26.8MB/s)(256MiB/10007msec) 00:29:10.271 slat (nsec): min=5593, max=62559, avg=13245.84, stdev=3092.46 00:29:10.271 clat (usec): min=6292, max=19020, avg=14669.53, stdev=1360.20 00:29:10.271 lat (usec): min=6304, max=19034, avg=14682.78, stdev=1360.13 00:29:10.271 clat percentiles (usec): 00:29:10.271 | 1.00th=[10290], 5.00th=[12518], 10.00th=[13173], 20.00th=[13698], 00:29:10.271 | 30.00th=[14091], 40.00th=[14484], 50.00th=[14746], 60.00th=[15008], 00:29:10.271 | 70.00th=[15401], 80.00th=[15664], 90.00th=[16188], 95.00th=[16712], 00:29:10.272 | 99.00th=[17695], 99.50th=[17957], 99.90th=[19006], 99.95th=[19006], 00:29:10.272 | 99.99th=[19006] 00:29:10.272 bw ( KiB/s): min=24320, max=27648, per=33.28%, avg=26124.80, stdev=1018.85, samples=20 00:29:10.272 iops : min= 190, max= 216, avg=204.10, stdev= 7.96, samples=20 00:29:10.272 lat (msec) : 10=0.83%, 20=99.17% 00:29:10.272 cpu : usr=90.15%, sys=9.35%, ctx=36, majf=0, minf=203 00:29:10.272 IO depths : 1=0.3%, 2=99.7%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:10.272 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:10.272 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:10.272 issued rwts: total=2044,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:10.272 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:10.272 filename0: (groupid=0, jobs=1): err= 0: pid=1637322: Mon Jul 15 09:07:56 2024 00:29:10.272 read: IOPS=205, BW=25.6MiB/s (26.9MB/s)(258MiB/10048msec) 00:29:10.272 slat (nsec): min=5715, max=35633, avg=13429.19, stdev=3118.14 00:29:10.272 clat (usec): min=8929, max=56454, avg=14593.95, stdev=3552.69 00:29:10.272 lat (usec): min=8937, max=56466, avg=14607.37, stdev=3552.65 00:29:10.272 clat percentiles (usec): 00:29:10.272 | 1.00th=[11076], 5.00th=[12387], 10.00th=[12911], 20.00th=[13304], 00:29:10.272 | 30.00th=[13698], 40.00th=[14091], 50.00th=[14353], 60.00th=[14615], 00:29:10.272 | 70.00th=[14877], 80.00th=[15270], 90.00th=[15926], 95.00th=[16319], 00:29:10.272 | 99.00th=[17695], 99.50th=[54789], 99.90th=[55837], 99.95th=[56361], 00:29:10.272 | 99.99th=[56361] 00:29:10.272 bw ( KiB/s): min=20992, max=28416, per=33.54%, avg=26329.60, stdev=1678.24, samples=20 00:29:10.272 iops : min= 164, max= 222, avg=205.70, stdev=13.11, samples=20 00:29:10.272 lat (msec) : 10=0.39%, 20=98.93%, 50=0.05%, 100=0.63% 00:29:10.272 cpu : usr=90.35%, sys=9.17%, ctx=21, majf=0, minf=143 00:29:10.272 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:10.272 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:10.272 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:10.272 issued rwts: total=2060,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:10.272 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:10.272 filename0: (groupid=0, jobs=1): err= 0: pid=1637323: Mon Jul 15 09:07:56 2024 00:29:10.272 read: IOPS=204, BW=25.6MiB/s (26.9MB/s)(257MiB/10046msec) 00:29:10.272 slat (nsec): min=4637, max=36550, avg=13291.31, stdev=3291.21 00:29:10.272 clat (usec): min=7924, max=56751, avg=14605.43, stdev=2410.48 00:29:10.272 lat (usec): min=7936, max=56764, avg=14618.72, stdev=2410.50 00:29:10.272 clat percentiles (usec): 00:29:10.272 | 1.00th=[ 9896], 5.00th=[12387], 10.00th=[12911], 20.00th=[13566], 00:29:10.272 | 30.00th=[13960], 40.00th=[14222], 50.00th=[14615], 60.00th=[14877], 00:29:10.272 | 70.00th=[15270], 80.00th=[15533], 90.00th=[16057], 95.00th=[16581], 00:29:10.272 | 99.00th=[17433], 99.50th=[17957], 99.90th=[55313], 99.95th=[56361], 00:29:10.272 | 99.99th=[56886] 00:29:10.272 bw ( KiB/s): min=25088, max=27904, per=33.53%, avg=26319.45, stdev=921.43, samples=20 00:29:10.272 iops : min= 196, max= 218, avg=205.60, stdev= 7.18, samples=20 00:29:10.272 lat (msec) : 10=1.12%, 20=98.64%, 100=0.24% 00:29:10.272 cpu : usr=90.17%, sys=9.34%, ctx=29, majf=0, minf=119 00:29:10.272 IO depths : 1=0.6%, 2=99.4%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:10.272 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:10.272 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:10.272 issued rwts: total=2058,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:10.272 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:10.272 00:29:10.272 Run status group 0 (all jobs): 00:29:10.272 READ: bw=76.7MiB/s (80.4MB/s), 25.5MiB/s-25.6MiB/s (26.8MB/s-26.9MB/s), io=770MiB (808MB), run=10007-10048msec 00:29:10.272 09:07:56 -- target/dif.sh@132 -- # destroy_subsystems 0 00:29:10.272 09:07:56 -- target/dif.sh@43 -- # local sub 00:29:10.272 09:07:56 -- target/dif.sh@45 -- # for sub in "$@" 00:29:10.272 09:07:56 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:10.272 09:07:56 -- target/dif.sh@36 -- # local sub_id=0 00:29:10.272 09:07:56 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:10.272 09:07:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:10.272 09:07:56 -- common/autotest_common.sh@10 -- # set +x 00:29:10.272 09:07:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:10.272 09:07:56 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:10.272 09:07:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:10.272 09:07:56 -- common/autotest_common.sh@10 -- # set +x 00:29:10.272 09:07:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:10.272 00:29:10.272 real 0m11.256s 00:29:10.272 user 0m28.409s 00:29:10.272 sys 0m3.040s 00:29:10.272 09:07:56 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:29:10.272 09:07:56 -- common/autotest_common.sh@10 -- # set +x 00:29:10.272 ************************************ 00:29:10.272 END TEST fio_dif_digest 00:29:10.272 ************************************ 00:29:10.272 09:07:56 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:29:10.272 09:07:56 -- target/dif.sh@147 -- # nvmftestfini 00:29:10.272 09:07:56 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:10.272 09:07:56 -- nvmf/common.sh@116 -- # sync 00:29:10.272 09:07:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:10.272 09:07:57 -- nvmf/common.sh@119 -- # set +e 00:29:10.272 09:07:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:10.272 09:07:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:10.272 rmmod nvme_tcp 00:29:10.272 rmmod nvme_fabrics 00:29:10.272 rmmod nvme_keyring 00:29:10.272 09:07:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:10.272 09:07:57 -- nvmf/common.sh@123 -- # set -e 00:29:10.272 09:07:57 -- nvmf/common.sh@124 -- # return 0 00:29:10.272 09:07:57 -- nvmf/common.sh@477 -- # '[' -n 1630966 ']' 00:29:10.272 09:07:57 -- nvmf/common.sh@478 -- # killprocess 1630966 00:29:10.272 09:07:57 -- common/autotest_common.sh@926 -- # '[' -z 1630966 ']' 00:29:10.272 09:07:57 -- common/autotest_common.sh@930 -- # kill -0 1630966 00:29:10.272 09:07:57 -- common/autotest_common.sh@931 -- # uname 00:29:10.272 09:07:57 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:10.272 09:07:57 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1630966 00:29:10.272 09:07:57 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:29:10.272 09:07:57 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:29:10.272 09:07:57 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1630966' 00:29:10.272 killing process with pid 1630966 00:29:10.272 09:07:57 -- common/autotest_common.sh@945 -- # kill 1630966 00:29:10.272 09:07:57 -- common/autotest_common.sh@950 -- # wait 1630966 00:29:10.272 09:07:57 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:29:10.272 09:07:57 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:29:10.272 Waiting for block devices as requested 00:29:10.272 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:29:10.272 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:10.272 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:10.272 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:10.531 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:10.531 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:10.531 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:10.531 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:10.790 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:10.790 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:10.790 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:10.790 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:11.050 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:11.050 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:11.050 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:11.309 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:11.309 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:11.309 09:07:59 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:11.309 09:07:59 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:11.309 09:07:59 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:11.309 09:07:59 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:11.309 09:07:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:11.309 09:07:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:11.309 09:07:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:13.838 09:08:01 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:13.838 00:29:13.838 real 1m7.216s 00:29:13.838 user 6m23.095s 00:29:13.838 sys 0m20.899s 00:29:13.838 09:08:01 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:29:13.838 09:08:01 -- common/autotest_common.sh@10 -- # set +x 00:29:13.838 ************************************ 00:29:13.838 END TEST nvmf_dif 00:29:13.838 ************************************ 00:29:13.838 09:08:01 -- spdk/autotest.sh@301 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:29:13.838 09:08:01 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:29:13.838 09:08:01 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:29:13.838 09:08:01 -- common/autotest_common.sh@10 -- # set +x 00:29:13.838 ************************************ 00:29:13.838 START TEST nvmf_abort_qd_sizes 00:29:13.838 ************************************ 00:29:13.838 09:08:01 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:29:13.838 * Looking for test storage... 00:29:13.838 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:29:13.838 09:08:01 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:13.838 09:08:01 -- nvmf/common.sh@7 -- # uname -s 00:29:13.838 09:08:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:13.838 09:08:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:13.838 09:08:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:13.838 09:08:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:13.838 09:08:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:13.838 09:08:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:13.838 09:08:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:13.838 09:08:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:13.838 09:08:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:13.838 09:08:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:13.838 09:08:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:13.838 09:08:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:13.838 09:08:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:13.838 09:08:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:13.838 09:08:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:13.838 09:08:01 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:13.838 09:08:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:13.838 09:08:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:13.838 09:08:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:13.838 09:08:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:13.838 09:08:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:13.838 09:08:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:13.838 09:08:01 -- paths/export.sh@5 -- # export PATH 00:29:13.838 09:08:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:13.838 09:08:01 -- nvmf/common.sh@46 -- # : 0 00:29:13.838 09:08:01 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:13.838 09:08:01 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:13.838 09:08:01 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:13.838 09:08:01 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:13.838 09:08:01 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:13.838 09:08:01 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:13.838 09:08:01 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:13.838 09:08:01 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:13.838 09:08:01 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:29:13.838 09:08:01 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:13.839 09:08:01 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:13.839 09:08:01 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:13.839 09:08:01 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:13.839 09:08:01 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:13.839 09:08:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:13.839 09:08:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:13.839 09:08:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:13.839 09:08:01 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:13.839 09:08:01 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:13.839 09:08:01 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:13.839 09:08:01 -- common/autotest_common.sh@10 -- # set +x 00:29:15.213 09:08:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:15.213 09:08:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:15.213 09:08:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:15.213 09:08:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:15.213 09:08:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:15.213 09:08:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:15.213 09:08:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:15.213 09:08:03 -- nvmf/common.sh@294 -- # net_devs=() 00:29:15.213 09:08:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:15.213 09:08:03 -- nvmf/common.sh@295 -- # e810=() 00:29:15.213 09:08:03 -- nvmf/common.sh@295 -- # local -ga e810 00:29:15.213 09:08:03 -- nvmf/common.sh@296 -- # x722=() 00:29:15.470 09:08:03 -- nvmf/common.sh@296 -- # local -ga x722 00:29:15.470 09:08:03 -- nvmf/common.sh@297 -- # mlx=() 00:29:15.470 09:08:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:15.470 09:08:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:15.470 09:08:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:15.470 09:08:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:15.470 09:08:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:15.470 09:08:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:15.470 09:08:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:15.470 09:08:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:15.470 09:08:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:15.470 09:08:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:15.470 09:08:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:15.470 09:08:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:15.470 09:08:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:15.470 09:08:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:15.470 09:08:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:15.470 09:08:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:15.470 09:08:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:15.470 09:08:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:15.470 09:08:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:15.470 09:08:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:15.470 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:15.470 09:08:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:15.470 09:08:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:15.470 09:08:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:15.470 09:08:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:15.470 09:08:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:15.470 09:08:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:15.470 09:08:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:15.470 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:15.470 09:08:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:15.470 09:08:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:15.470 09:08:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:15.470 09:08:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:15.470 09:08:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:15.470 09:08:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:15.470 09:08:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:15.470 09:08:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:15.470 09:08:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:15.470 09:08:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:15.470 09:08:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:15.470 09:08:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:15.470 09:08:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:15.470 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:15.470 09:08:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:15.470 09:08:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:15.470 09:08:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:15.470 09:08:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:15.470 09:08:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:15.470 09:08:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:15.470 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:15.470 09:08:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:15.470 09:08:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:15.470 09:08:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:15.470 09:08:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:15.470 09:08:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:15.470 09:08:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:15.470 09:08:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:15.470 09:08:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:15.470 09:08:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:15.470 09:08:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:15.470 09:08:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:15.470 09:08:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:15.470 09:08:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:15.470 09:08:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:15.470 09:08:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:15.470 09:08:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:15.470 09:08:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:15.470 09:08:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:15.470 09:08:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:15.470 09:08:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:15.470 09:08:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:15.470 09:08:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:15.470 09:08:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:15.470 09:08:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:15.470 09:08:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:15.470 09:08:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:15.470 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:15.470 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.127 ms 00:29:15.470 00:29:15.470 --- 10.0.0.2 ping statistics --- 00:29:15.470 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:15.470 rtt min/avg/max/mdev = 0.127/0.127/0.127/0.000 ms 00:29:15.470 09:08:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:15.470 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:15.470 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.105 ms 00:29:15.470 00:29:15.470 --- 10.0.0.1 ping statistics --- 00:29:15.470 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:15.470 rtt min/avg/max/mdev = 0.105/0.105/0.105/0.000 ms 00:29:15.470 09:08:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:15.470 09:08:03 -- nvmf/common.sh@410 -- # return 0 00:29:15.470 09:08:03 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:29:15.470 09:08:03 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:29:16.845 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:16.845 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:16.845 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:16.845 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:16.845 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:16.845 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:16.845 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:16.845 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:16.845 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:16.845 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:16.845 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:16.845 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:16.845 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:16.845 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:16.845 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:16.845 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:17.829 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:29:17.829 09:08:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:17.829 09:08:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:17.829 09:08:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:17.829 09:08:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:17.829 09:08:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:17.829 09:08:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:17.829 09:08:06 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:29:17.829 09:08:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:17.829 09:08:06 -- common/autotest_common.sh@712 -- # xtrace_disable 00:29:17.829 09:08:06 -- common/autotest_common.sh@10 -- # set +x 00:29:17.829 09:08:06 -- nvmf/common.sh@469 -- # nvmfpid=1642316 00:29:17.829 09:08:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:29:17.829 09:08:06 -- nvmf/common.sh@470 -- # waitforlisten 1642316 00:29:17.829 09:08:06 -- common/autotest_common.sh@819 -- # '[' -z 1642316 ']' 00:29:17.829 09:08:06 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:17.829 09:08:06 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:17.829 09:08:06 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:17.829 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:17.829 09:08:06 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:17.829 09:08:06 -- common/autotest_common.sh@10 -- # set +x 00:29:17.829 [2024-07-15 09:08:06.238075] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:29:17.829 [2024-07-15 09:08:06.238154] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:17.829 EAL: No free 2048 kB hugepages reported on node 1 00:29:17.829 [2024-07-15 09:08:06.302566] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:29:18.087 [2024-07-15 09:08:06.413958] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:18.087 [2024-07-15 09:08:06.414099] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:18.087 [2024-07-15 09:08:06.414116] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:18.087 [2024-07-15 09:08:06.414127] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:18.087 [2024-07-15 09:08:06.414179] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:18.087 [2024-07-15 09:08:06.414238] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:29:18.087 [2024-07-15 09:08:06.414303] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:29:18.087 [2024-07-15 09:08:06.414306] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:18.654 09:08:07 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:18.654 09:08:07 -- common/autotest_common.sh@852 -- # return 0 00:29:18.654 09:08:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:18.654 09:08:07 -- common/autotest_common.sh@718 -- # xtrace_disable 00:29:18.654 09:08:07 -- common/autotest_common.sh@10 -- # set +x 00:29:18.654 09:08:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:18.654 09:08:07 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:29:18.654 09:08:07 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:29:18.654 09:08:07 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:29:18.654 09:08:07 -- scripts/common.sh@311 -- # local bdf bdfs 00:29:18.654 09:08:07 -- scripts/common.sh@312 -- # local nvmes 00:29:18.654 09:08:07 -- scripts/common.sh@314 -- # [[ -n 0000:88:00.0 ]] 00:29:18.654 09:08:07 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:29:18.654 09:08:07 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:29:18.654 09:08:07 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:88:00.0 ]] 00:29:18.654 09:08:07 -- scripts/common.sh@322 -- # uname -s 00:29:18.654 09:08:07 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:29:18.654 09:08:07 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:29:18.654 09:08:07 -- scripts/common.sh@327 -- # (( 1 )) 00:29:18.654 09:08:07 -- scripts/common.sh@328 -- # printf '%s\n' 0000:88:00.0 00:29:18.654 09:08:07 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:29:18.654 09:08:07 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:88:00.0 00:29:18.654 09:08:07 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:29:18.654 09:08:07 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:29:18.654 09:08:07 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:29:18.654 09:08:07 -- common/autotest_common.sh@10 -- # set +x 00:29:18.910 ************************************ 00:29:18.910 START TEST spdk_target_abort 00:29:18.910 ************************************ 00:29:18.910 09:08:07 -- common/autotest_common.sh@1104 -- # spdk_target 00:29:18.910 09:08:07 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:29:18.910 09:08:07 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:29:18.910 09:08:07 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:88:00.0 -b spdk_target 00:29:18.910 09:08:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:18.910 09:08:07 -- common/autotest_common.sh@10 -- # set +x 00:29:22.196 spdk_targetn1 00:29:22.196 09:08:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:22.196 09:08:10 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:29:22.196 09:08:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:22.196 09:08:10 -- common/autotest_common.sh@10 -- # set +x 00:29:22.196 [2024-07-15 09:08:10.043268] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:22.196 09:08:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:22.196 09:08:10 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:29:22.196 09:08:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:22.196 09:08:10 -- common/autotest_common.sh@10 -- # set +x 00:29:22.196 09:08:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:22.196 09:08:10 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:29:22.196 09:08:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:22.196 09:08:10 -- common/autotest_common.sh@10 -- # set +x 00:29:22.196 09:08:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:22.196 09:08:10 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:29:22.196 09:08:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:22.196 09:08:10 -- common/autotest_common.sh@10 -- # set +x 00:29:22.196 [2024-07-15 09:08:10.075527] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:22.196 09:08:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:22.196 09:08:10 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:29:22.196 09:08:10 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:29:22.196 09:08:10 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:29:22.196 09:08:10 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:29:22.196 09:08:10 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:29:22.196 09:08:10 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:29:22.196 09:08:10 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:29:22.196 09:08:10 -- target/abort_qd_sizes.sh@24 -- # local target r 00:29:22.196 09:08:10 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:29:22.196 09:08:10 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:22.196 09:08:10 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:29:22.196 09:08:10 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:22.196 09:08:10 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:29:22.196 09:08:10 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:22.196 09:08:10 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:29:22.196 09:08:10 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:22.196 09:08:10 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:29:22.196 09:08:10 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:22.196 09:08:10 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:22.196 09:08:10 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:22.196 09:08:10 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:22.196 EAL: No free 2048 kB hugepages reported on node 1 00:29:24.719 Initializing NVMe Controllers 00:29:24.719 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:29:24.719 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:29:24.719 Initialization complete. Launching workers. 00:29:24.719 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 11959, failed: 0 00:29:24.719 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1512, failed to submit 10447 00:29:24.719 success 813, unsuccess 699, failed 0 00:29:24.719 09:08:13 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:24.719 09:08:13 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:24.719 EAL: No free 2048 kB hugepages reported on node 1 00:29:28.020 [2024-07-15 09:08:16.353914] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfe8270 is same with the state(5) to be set 00:29:28.020 [2024-07-15 09:08:16.353966] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfe8270 is same with the state(5) to be set 00:29:28.020 [2024-07-15 09:08:16.353989] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfe8270 is same with the state(5) to be set 00:29:28.020 [2024-07-15 09:08:16.354002] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfe8270 is same with the state(5) to be set 00:29:28.020 Initializing NVMe Controllers 00:29:28.020 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:29:28.020 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:29:28.020 Initialization complete. Launching workers. 00:29:28.020 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8672, failed: 0 00:29:28.020 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1251, failed to submit 7421 00:29:28.020 success 319, unsuccess 932, failed 0 00:29:28.020 09:08:16 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:28.020 09:08:16 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:28.020 EAL: No free 2048 kB hugepages reported on node 1 00:29:31.305 Initializing NVMe Controllers 00:29:31.305 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:29:31.305 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:29:31.305 Initialization complete. Launching workers. 00:29:31.305 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 32648, failed: 0 00:29:31.305 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2750, failed to submit 29898 00:29:31.305 success 528, unsuccess 2222, failed 0 00:29:31.305 09:08:19 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:29:31.305 09:08:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:31.305 09:08:19 -- common/autotest_common.sh@10 -- # set +x 00:29:31.305 09:08:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:31.305 09:08:19 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:29:31.305 09:08:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:31.305 09:08:19 -- common/autotest_common.sh@10 -- # set +x 00:29:32.680 09:08:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:32.680 09:08:21 -- target/abort_qd_sizes.sh@62 -- # killprocess 1642316 00:29:32.680 09:08:21 -- common/autotest_common.sh@926 -- # '[' -z 1642316 ']' 00:29:32.680 09:08:21 -- common/autotest_common.sh@930 -- # kill -0 1642316 00:29:32.680 09:08:21 -- common/autotest_common.sh@931 -- # uname 00:29:32.680 09:08:21 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:32.680 09:08:21 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1642316 00:29:32.680 09:08:21 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:29:32.680 09:08:21 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:29:32.680 09:08:21 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1642316' 00:29:32.680 killing process with pid 1642316 00:29:32.680 09:08:21 -- common/autotest_common.sh@945 -- # kill 1642316 00:29:32.680 09:08:21 -- common/autotest_common.sh@950 -- # wait 1642316 00:29:32.937 00:29:32.937 real 0m14.217s 00:29:32.937 user 0m55.378s 00:29:32.937 sys 0m2.855s 00:29:32.937 09:08:21 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:29:32.937 09:08:21 -- common/autotest_common.sh@10 -- # set +x 00:29:32.937 ************************************ 00:29:32.937 END TEST spdk_target_abort 00:29:32.937 ************************************ 00:29:32.937 09:08:21 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:29:32.937 09:08:21 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:29:32.937 09:08:21 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:29:32.937 09:08:21 -- common/autotest_common.sh@10 -- # set +x 00:29:32.937 ************************************ 00:29:32.937 START TEST kernel_target_abort 00:29:32.937 ************************************ 00:29:32.937 09:08:21 -- common/autotest_common.sh@1104 -- # kernel_target 00:29:32.937 09:08:21 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:29:32.937 09:08:21 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:29:32.937 09:08:21 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:29:32.937 09:08:21 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:29:32.937 09:08:21 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:29:32.937 09:08:21 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:29:32.937 09:08:21 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:29:32.937 09:08:21 -- nvmf/common.sh@627 -- # local block nvme 00:29:32.937 09:08:21 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:29:32.937 09:08:21 -- nvmf/common.sh@630 -- # modprobe nvmet 00:29:32.937 09:08:21 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:29:32.937 09:08:21 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:29:34.342 Waiting for block devices as requested 00:29:34.342 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:29:34.342 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:34.342 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:34.599 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:34.599 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:34.599 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:34.599 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:34.599 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:34.858 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:34.858 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:34.858 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:35.116 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:35.116 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:35.116 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:35.116 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:35.373 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:35.373 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:35.373 09:08:23 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:29:35.373 09:08:23 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:29:35.373 09:08:23 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:29:35.373 09:08:23 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:29:35.373 09:08:23 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:29:35.629 No valid GPT data, bailing 00:29:35.629 09:08:23 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:29:35.629 09:08:23 -- scripts/common.sh@393 -- # pt= 00:29:35.629 09:08:23 -- scripts/common.sh@394 -- # return 1 00:29:35.629 09:08:23 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:29:35.629 09:08:23 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:29:35.629 09:08:23 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:29:35.629 09:08:23 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:29:35.629 09:08:23 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:29:35.629 09:08:23 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:29:35.629 09:08:23 -- nvmf/common.sh@654 -- # echo 1 00:29:35.629 09:08:23 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:29:35.629 09:08:23 -- nvmf/common.sh@656 -- # echo 1 00:29:35.629 09:08:23 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:29:35.629 09:08:23 -- nvmf/common.sh@663 -- # echo tcp 00:29:35.629 09:08:23 -- nvmf/common.sh@664 -- # echo 4420 00:29:35.629 09:08:23 -- nvmf/common.sh@665 -- # echo ipv4 00:29:35.629 09:08:23 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:29:35.629 09:08:23 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:29:35.629 00:29:35.629 Discovery Log Number of Records 2, Generation counter 2 00:29:35.629 =====Discovery Log Entry 0====== 00:29:35.629 trtype: tcp 00:29:35.629 adrfam: ipv4 00:29:35.629 subtype: current discovery subsystem 00:29:35.629 treq: not specified, sq flow control disable supported 00:29:35.629 portid: 1 00:29:35.630 trsvcid: 4420 00:29:35.630 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:29:35.630 traddr: 10.0.0.1 00:29:35.630 eflags: none 00:29:35.630 sectype: none 00:29:35.630 =====Discovery Log Entry 1====== 00:29:35.630 trtype: tcp 00:29:35.630 adrfam: ipv4 00:29:35.630 subtype: nvme subsystem 00:29:35.630 treq: not specified, sq flow control disable supported 00:29:35.630 portid: 1 00:29:35.630 trsvcid: 4420 00:29:35.630 subnqn: kernel_target 00:29:35.630 traddr: 10.0.0.1 00:29:35.630 eflags: none 00:29:35.630 sectype: none 00:29:35.630 09:08:24 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:29:35.630 09:08:24 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:29:35.630 09:08:24 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:29:35.630 09:08:24 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:29:35.630 09:08:24 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:29:35.630 09:08:24 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:29:35.630 09:08:24 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:29:35.630 09:08:24 -- target/abort_qd_sizes.sh@24 -- # local target r 00:29:35.630 09:08:24 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:29:35.630 09:08:24 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:35.630 09:08:24 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:29:35.630 09:08:24 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:35.630 09:08:24 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:29:35.630 09:08:24 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:35.630 09:08:24 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:29:35.630 09:08:24 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:35.630 09:08:24 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:29:35.630 09:08:24 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:35.630 09:08:24 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:29:35.630 09:08:24 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:35.630 09:08:24 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:29:35.630 EAL: No free 2048 kB hugepages reported on node 1 00:29:38.947 Initializing NVMe Controllers 00:29:38.947 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:29:38.947 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:29:38.947 Initialization complete. Launching workers. 00:29:38.947 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 34871, failed: 0 00:29:38.947 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 34871, failed to submit 0 00:29:38.947 success 0, unsuccess 34871, failed 0 00:29:38.947 09:08:27 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:38.947 09:08:27 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:29:38.947 EAL: No free 2048 kB hugepages reported on node 1 00:29:42.233 Initializing NVMe Controllers 00:29:42.233 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:29:42.233 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:29:42.233 Initialization complete. Launching workers. 00:29:42.233 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 65991, failed: 0 00:29:42.233 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 16642, failed to submit 49349 00:29:42.233 success 0, unsuccess 16642, failed 0 00:29:42.233 09:08:30 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:42.233 09:08:30 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:29:42.233 EAL: No free 2048 kB hugepages reported on node 1 00:29:45.518 Initializing NVMe Controllers 00:29:45.518 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:29:45.518 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:29:45.518 Initialization complete. Launching workers. 00:29:45.518 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 63901, failed: 0 00:29:45.518 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 15962, failed to submit 47939 00:29:45.518 success 0, unsuccess 15962, failed 0 00:29:45.518 09:08:33 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:29:45.518 09:08:33 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:29:45.518 09:08:33 -- nvmf/common.sh@677 -- # echo 0 00:29:45.518 09:08:33 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:29:45.518 09:08:33 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:29:45.518 09:08:33 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:29:45.518 09:08:33 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:29:45.518 09:08:33 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:29:45.518 09:08:33 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:29:45.518 00:29:45.518 real 0m11.941s 00:29:45.518 user 0m4.792s 00:29:45.518 sys 0m2.464s 00:29:45.518 09:08:33 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:29:45.518 09:08:33 -- common/autotest_common.sh@10 -- # set +x 00:29:45.518 ************************************ 00:29:45.518 END TEST kernel_target_abort 00:29:45.518 ************************************ 00:29:45.518 09:08:33 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:29:45.518 09:08:33 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:29:45.518 09:08:33 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:45.518 09:08:33 -- nvmf/common.sh@116 -- # sync 00:29:45.518 09:08:33 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:45.518 09:08:33 -- nvmf/common.sh@119 -- # set +e 00:29:45.518 09:08:33 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:45.518 09:08:33 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:45.518 rmmod nvme_tcp 00:29:45.518 rmmod nvme_fabrics 00:29:45.518 rmmod nvme_keyring 00:29:45.518 09:08:33 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:45.518 09:08:33 -- nvmf/common.sh@123 -- # set -e 00:29:45.518 09:08:33 -- nvmf/common.sh@124 -- # return 0 00:29:45.518 09:08:33 -- nvmf/common.sh@477 -- # '[' -n 1642316 ']' 00:29:45.518 09:08:33 -- nvmf/common.sh@478 -- # killprocess 1642316 00:29:45.518 09:08:33 -- common/autotest_common.sh@926 -- # '[' -z 1642316 ']' 00:29:45.518 09:08:33 -- common/autotest_common.sh@930 -- # kill -0 1642316 00:29:45.518 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (1642316) - No such process 00:29:45.518 09:08:33 -- common/autotest_common.sh@953 -- # echo 'Process with pid 1642316 is not found' 00:29:45.518 Process with pid 1642316 is not found 00:29:45.518 09:08:33 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:29:45.518 09:08:33 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:29:46.085 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:29:46.085 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:29:46.085 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:29:46.085 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:29:46.085 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:29:46.344 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:29:46.344 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:29:46.344 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:29:46.344 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:29:46.344 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:29:46.344 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:29:46.344 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:29:46.344 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:29:46.344 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:29:46.344 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:29:46.344 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:29:46.344 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:29:46.344 09:08:34 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:46.344 09:08:34 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:46.344 09:08:34 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:46.344 09:08:34 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:46.344 09:08:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:46.344 09:08:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:46.344 09:08:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:48.876 09:08:36 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:48.876 00:29:48.876 real 0m35.063s 00:29:48.876 user 1m2.493s 00:29:48.876 sys 0m8.489s 00:29:48.876 09:08:36 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:29:48.876 09:08:36 -- common/autotest_common.sh@10 -- # set +x 00:29:48.876 ************************************ 00:29:48.876 END TEST nvmf_abort_qd_sizes 00:29:48.876 ************************************ 00:29:48.877 09:08:36 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:29:48.877 09:08:36 -- spdk/autotest.sh@315 -- # '[' 0 -eq 1 ']' 00:29:48.877 09:08:36 -- spdk/autotest.sh@319 -- # '[' 0 -eq 1 ']' 00:29:48.877 09:08:36 -- spdk/autotest.sh@324 -- # '[' 0 -eq 1 ']' 00:29:48.877 09:08:36 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:29:48.877 09:08:36 -- spdk/autotest.sh@338 -- # '[' 0 -eq 1 ']' 00:29:48.877 09:08:36 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:29:48.877 09:08:36 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:29:48.877 09:08:36 -- spdk/autotest.sh@350 -- # '[' 0 -eq 1 ']' 00:29:48.877 09:08:36 -- spdk/autotest.sh@355 -- # '[' 0 -eq 1 ']' 00:29:48.877 09:08:36 -- spdk/autotest.sh@359 -- # '[' 0 -eq 1 ']' 00:29:48.877 09:08:36 -- spdk/autotest.sh@366 -- # [[ 0 -eq 1 ]] 00:29:48.877 09:08:36 -- spdk/autotest.sh@370 -- # [[ 0 -eq 1 ]] 00:29:48.877 09:08:36 -- spdk/autotest.sh@374 -- # [[ 0 -eq 1 ]] 00:29:48.877 09:08:36 -- spdk/autotest.sh@378 -- # [[ 0 -eq 1 ]] 00:29:48.877 09:08:36 -- spdk/autotest.sh@383 -- # trap - SIGINT SIGTERM EXIT 00:29:48.877 09:08:36 -- spdk/autotest.sh@385 -- # timing_enter post_cleanup 00:29:48.877 09:08:36 -- common/autotest_common.sh@712 -- # xtrace_disable 00:29:48.877 09:08:36 -- common/autotest_common.sh@10 -- # set +x 00:29:48.877 09:08:36 -- spdk/autotest.sh@386 -- # autotest_cleanup 00:29:48.877 09:08:36 -- common/autotest_common.sh@1371 -- # local autotest_es=0 00:29:48.877 09:08:36 -- common/autotest_common.sh@1372 -- # xtrace_disable 00:29:48.877 09:08:36 -- common/autotest_common.sh@10 -- # set +x 00:29:50.247 INFO: APP EXITING 00:29:50.247 INFO: killing all VMs 00:29:50.247 INFO: killing vhost app 00:29:50.247 INFO: EXIT DONE 00:29:51.180 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:29:51.180 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:29:51.180 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:29:51.180 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:29:51.180 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:29:51.439 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:29:51.439 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:29:51.439 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:29:51.439 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:29:51.439 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:29:51.439 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:29:51.439 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:29:51.439 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:29:51.439 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:29:51.439 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:29:51.439 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:29:51.439 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:29:52.812 Cleaning 00:29:52.812 Removing: /var/run/dpdk/spdk0/config 00:29:52.812 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:29:52.812 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:29:52.812 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:29:52.812 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:29:52.812 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:29:52.812 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:29:52.812 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:29:52.812 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:29:52.812 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:29:52.812 Removing: /var/run/dpdk/spdk0/hugepage_info 00:29:52.812 Removing: /var/run/dpdk/spdk1/config 00:29:52.812 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:29:52.812 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:29:52.812 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:29:52.812 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:29:52.812 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:29:52.812 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:29:52.812 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:29:52.812 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:29:52.812 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:29:52.812 Removing: /var/run/dpdk/spdk1/hugepage_info 00:29:52.812 Removing: /var/run/dpdk/spdk1/mp_socket 00:29:52.812 Removing: /var/run/dpdk/spdk2/config 00:29:52.812 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:29:52.812 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:29:52.812 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:29:52.812 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:29:52.812 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:29:52.812 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:29:52.812 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:29:52.812 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:29:52.812 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:29:52.812 Removing: /var/run/dpdk/spdk2/hugepage_info 00:29:52.812 Removing: /var/run/dpdk/spdk3/config 00:29:52.812 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:29:52.812 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:29:52.812 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:29:52.812 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:29:52.812 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:29:52.812 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:29:52.812 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:29:52.812 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:29:52.812 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:29:52.812 Removing: /var/run/dpdk/spdk3/hugepage_info 00:29:52.812 Removing: /var/run/dpdk/spdk4/config 00:29:52.812 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:29:52.812 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:29:52.812 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:29:52.812 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:29:52.812 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:29:52.812 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:29:52.812 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:29:52.812 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:29:52.812 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:29:52.812 Removing: /var/run/dpdk/spdk4/hugepage_info 00:29:52.812 Removing: /dev/shm/bdev_svc_trace.1 00:29:52.812 Removing: /dev/shm/nvmf_trace.0 00:29:52.812 Removing: /dev/shm/spdk_tgt_trace.pid1376711 00:29:52.812 Removing: /var/run/dpdk/spdk0 00:29:52.812 Removing: /var/run/dpdk/spdk1 00:29:52.812 Removing: /var/run/dpdk/spdk2 00:29:52.812 Removing: /var/run/dpdk/spdk3 00:29:52.812 Removing: /var/run/dpdk/spdk4 00:29:52.812 Removing: /var/run/dpdk/spdk_pid1375016 00:29:52.812 Removing: /var/run/dpdk/spdk_pid1375768 00:29:52.812 Removing: /var/run/dpdk/spdk_pid1376711 00:29:52.812 Removing: /var/run/dpdk/spdk_pid1377192 00:29:52.812 Removing: /var/run/dpdk/spdk_pid1378419 00:29:52.812 Removing: /var/run/dpdk/spdk_pid1379353 00:29:52.812 Removing: /var/run/dpdk/spdk_pid1379665 00:29:52.812 Removing: /var/run/dpdk/spdk_pid1379865 00:29:52.812 Removing: /var/run/dpdk/spdk_pid1380195 00:29:52.812 Removing: /var/run/dpdk/spdk_pid1380395 00:29:52.812 Removing: /var/run/dpdk/spdk_pid1380622 00:29:52.812 Removing: /var/run/dpdk/spdk_pid1380840 00:29:52.812 Removing: /var/run/dpdk/spdk_pid1381019 00:29:52.812 Removing: /var/run/dpdk/spdk_pid1381483 00:29:52.812 Removing: /var/run/dpdk/spdk_pid1384024 00:29:52.812 Removing: /var/run/dpdk/spdk_pid1384294 00:29:52.812 Removing: /var/run/dpdk/spdk_pid1384499 00:29:52.812 Removing: /var/run/dpdk/spdk_pid1384636 00:29:52.812 Removing: /var/run/dpdk/spdk_pid1385018 00:29:52.812 Removing: /var/run/dpdk/spdk_pid1385087 00:29:52.812 Removing: /var/run/dpdk/spdk_pid1385523 00:29:52.812 Removing: /var/run/dpdk/spdk_pid1385663 00:29:52.812 Removing: /var/run/dpdk/spdk_pid1385837 00:29:52.812 Removing: /var/run/dpdk/spdk_pid1385977 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1386143 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1386285 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1386670 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1386842 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1387148 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1387328 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1387439 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1387535 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1387679 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1387962 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1388104 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1388263 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1388529 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1388694 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1388834 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1389107 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1389262 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1389415 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1389614 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1389842 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1389989 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1390154 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1390416 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1390571 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1390718 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1390992 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1391146 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1391299 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1391564 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1391726 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1391873 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1392147 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1392297 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1392456 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1392680 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1392878 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1393032 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1393214 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1393450 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1393612 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1393800 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1394150 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1394295 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1394470 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1394724 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1395200 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1395545 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1395820 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1395906 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1396228 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1398290 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1453993 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1457207 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1464211 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1467564 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1470063 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1470479 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1475551 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1475840 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1478521 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1482288 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1484524 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1491094 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1497087 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1498405 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1499087 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1509587 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1511835 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1514791 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1516009 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1517381 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1517650 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1517805 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1517960 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1518552 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1520040 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1520939 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1521386 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1525008 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1529080 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1532724 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1557170 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1560002 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1563965 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1564948 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1566201 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1568780 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1571303 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1575681 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1575683 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1578493 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1578752 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1578897 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1579177 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1579182 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1580298 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1581617 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1582833 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1584062 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1585278 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1586495 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1591006 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1591440 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1592780 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1593537 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1597319 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1599383 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1602991 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1606619 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1610284 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1610706 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1611128 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1611544 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1612137 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1612693 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1613242 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1613791 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1616461 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1616615 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1620585 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1620766 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1622964 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1628076 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1628205 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1631148 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1632586 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1634025 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1634785 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1636358 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1637235 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1642765 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1643168 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1643572 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1645052 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1645463 00:29:53.101 Removing: /var/run/dpdk/spdk_pid1645875 00:29:53.101 Clean 00:29:53.359 killing process with pid 1346968 00:30:01.496 killing process with pid 1346965 00:30:01.496 killing process with pid 1346967 00:30:01.496 killing process with pid 1346966 00:30:01.496 09:08:49 -- common/autotest_common.sh@1436 -- # return 0 00:30:01.496 09:08:49 -- spdk/autotest.sh@387 -- # timing_exit post_cleanup 00:30:01.496 09:08:49 -- common/autotest_common.sh@718 -- # xtrace_disable 00:30:01.496 09:08:49 -- common/autotest_common.sh@10 -- # set +x 00:30:01.496 09:08:49 -- spdk/autotest.sh@389 -- # timing_exit autotest 00:30:01.496 09:08:49 -- common/autotest_common.sh@718 -- # xtrace_disable 00:30:01.496 09:08:49 -- common/autotest_common.sh@10 -- # set +x 00:30:01.496 09:08:49 -- spdk/autotest.sh@390 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:30:01.496 09:08:49 -- spdk/autotest.sh@392 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:30:01.496 09:08:49 -- spdk/autotest.sh@392 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:30:01.496 09:08:49 -- spdk/autotest.sh@394 -- # hash lcov 00:30:01.496 09:08:49 -- spdk/autotest.sh@394 -- # [[ CC_TYPE=gcc == *\c\l\a\n\g* ]] 00:30:01.496 09:08:49 -- spdk/autotest.sh@396 -- # hostname 00:30:01.496 09:08:49 -- spdk/autotest.sh@396 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -c -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-11 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:30:01.496 geninfo: WARNING: invalid characters removed from testname! 00:30:28.052 09:09:14 -- spdk/autotest.sh@397 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:29.433 09:09:17 -- spdk/autotest.sh@398 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:31.969 09:09:20 -- spdk/autotest.sh@399 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:35.261 09:09:23 -- spdk/autotest.sh@400 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:37.802 09:09:25 -- spdk/autotest.sh@401 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:40.397 09:09:28 -- spdk/autotest.sh@402 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:42.936 09:09:31 -- spdk/autotest.sh@403 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:30:42.936 09:09:31 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:42.936 09:09:31 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:30:42.937 09:09:31 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:42.937 09:09:31 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:42.937 09:09:31 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:42.937 09:09:31 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:42.937 09:09:31 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:42.937 09:09:31 -- paths/export.sh@5 -- $ export PATH 00:30:42.937 09:09:31 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:42.937 09:09:31 -- common/autobuild_common.sh@434 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:30:42.937 09:09:31 -- common/autobuild_common.sh@435 -- $ date +%s 00:30:42.937 09:09:31 -- common/autobuild_common.sh@435 -- $ mktemp -dt spdk_1721027371.XXXXXX 00:30:42.937 09:09:31 -- common/autobuild_common.sh@435 -- $ SPDK_WORKSPACE=/tmp/spdk_1721027371.xdGPAJ 00:30:42.937 09:09:31 -- common/autobuild_common.sh@437 -- $ [[ -n '' ]] 00:30:42.937 09:09:31 -- common/autobuild_common.sh@441 -- $ '[' -n '' ']' 00:30:42.937 09:09:31 -- common/autobuild_common.sh@444 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:30:42.937 09:09:31 -- common/autobuild_common.sh@448 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:30:42.937 09:09:31 -- common/autobuild_common.sh@450 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:30:42.937 09:09:31 -- common/autobuild_common.sh@451 -- $ get_config_params 00:30:42.937 09:09:31 -- common/autotest_common.sh@387 -- $ xtrace_disable 00:30:42.937 09:09:31 -- common/autotest_common.sh@10 -- $ set +x 00:30:42.937 09:09:31 -- common/autobuild_common.sh@451 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:30:42.937 09:09:31 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:30:42.937 09:09:31 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:30:42.937 09:09:31 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:30:42.937 09:09:31 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:30:42.937 09:09:31 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:30:42.937 09:09:31 -- spdk/autopackage.sh@19 -- $ timing_finish 00:30:42.937 09:09:31 -- common/autotest_common.sh@724 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:30:42.937 09:09:31 -- common/autotest_common.sh@725 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:30:42.937 09:09:31 -- common/autotest_common.sh@727 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:30:42.937 09:09:31 -- spdk/autopackage.sh@20 -- $ exit 0 00:30:42.937 + [[ -n 1304690 ]] 00:30:42.937 + sudo kill 1304690 00:30:42.947 [Pipeline] } 00:30:42.970 [Pipeline] // stage 00:30:42.975 [Pipeline] } 00:30:42.993 [Pipeline] // timeout 00:30:42.998 [Pipeline] } 00:30:43.016 [Pipeline] // catchError 00:30:43.022 [Pipeline] } 00:30:43.039 [Pipeline] // wrap 00:30:43.046 [Pipeline] } 00:30:43.064 [Pipeline] // catchError 00:30:43.075 [Pipeline] stage 00:30:43.079 [Pipeline] { (Epilogue) 00:30:43.097 [Pipeline] catchError 00:30:43.099 [Pipeline] { 00:30:43.113 [Pipeline] echo 00:30:43.114 Cleanup processes 00:30:43.122 [Pipeline] sh 00:30:43.408 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:30:43.408 1658201 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:30:43.422 [Pipeline] sh 00:30:43.706 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:30:43.706 ++ grep -v 'sudo pgrep' 00:30:43.706 ++ awk '{print $1}' 00:30:43.706 + sudo kill -9 00:30:43.706 + true 00:30:43.719 [Pipeline] sh 00:30:44.003 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:30:53.981 [Pipeline] sh 00:30:54.266 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:30:54.266 Artifacts sizes are good 00:30:54.279 [Pipeline] archiveArtifacts 00:30:54.286 Archiving artifacts 00:30:54.501 [Pipeline] sh 00:30:54.782 + sudo chown -R sys_sgci /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:30:54.793 [Pipeline] cleanWs 00:30:54.800 [WS-CLEANUP] Deleting project workspace... 00:30:54.800 [WS-CLEANUP] Deferred wipeout is used... 00:30:54.805 [WS-CLEANUP] done 00:30:54.806 [Pipeline] } 00:30:54.819 [Pipeline] // catchError 00:30:54.828 [Pipeline] sh 00:30:55.108 + logger -p user.info -t JENKINS-CI 00:30:55.119 [Pipeline] } 00:30:55.136 [Pipeline] // stage 00:30:55.141 [Pipeline] } 00:30:55.158 [Pipeline] // node 00:30:55.163 [Pipeline] End of Pipeline 00:30:55.199 Finished: SUCCESS